Follow up searches of the US Federal censuses fail to locate a Joseph Worth in Ware or Clinch County or Florida.
One James Worth, wife Elizabeth, is found in the 1850 census that is younger than Joseph in 1870 Hamilton Fla census. This family does have a daughter, Mary, of the right age, who could possibly be the Mary Chancey in the 1870 Hamilton FL. census.
I am still searching for the data concerning this Mary Chancey that is enumeated in this Worth HH in the 1870 Hamilton Co. Fla. household.