Joseph lived in Beamsville (Clinton) with his sister Abigail and mother Maria. Their father died in 1855 and Joseph seems to have travelled to Janesville, Wisconsin with his brother (or uncle), John Herrington for a bit. He appears on the Janesville census at 12 years of age, but I could not locate him on the 1870 census.
Family lore has it that someone served in the civil war and was a bounty jumper. He is the only one who seems to be the right age. I wonder if he married in the U.S first before he returned to Canada.
Re your Herrington, that is interesting. There was a William Herrington listed in Wainfleet around 1839 and then vanishes. I have not been able to prove that he is mine, but I found it odd that Joseph settled in Wainfleet later.