You mention the 1861 census, the 1881 census has John Aedy at
Dwelling: High Street Census Place: Hythe St Leonard, Kent, England Source: FHL Film 1341241PRO Ref RG11Piece 1014Folio 33Page 7 Marr Age Sex Birthplace John AEDY M 30 M America Rel: Head Occ: Head Constable Of Police Elizabeth J. AEDY M 22 F Sandgate, Kent, England Rel: Wife John H.A. AEDY 7 M Ashford, Kent, England Rel: Son Occ: Scholar Willie E.A. AEDY 3 M Hythe, Kent, England Rel: Son Occ: Scholar Percy G. AEDY 2 M Hythe, Kent, England Rel: Son Catherine SKINNER 7 F Pluckley, Kent, England Rel: Relative Occ: Scholar Charles COUSINS 3 M Newington, Kent, England Rel: Relative Occ: Scholar
it is interesting to note that Elizabeth Aedy gives her age as 22 but has a child of 7 so I guess that must mean 32.