I found Hardy Smith on the 1850 Benton Co. AL census in Dist. 28, p. 306, roll M432_I.
HH562 Hardy Smith61, M, NC, Farmer
E50, F, NC,
CP33, M, NC, Mecanic (right age for Clem)
A20, F, NC
A15, M, NC
William13, M, NC
H10, M, NC
B. Butler1, M, AL
HH563 Bynum Duke25, M, NC Farmer
M24, F, NC
Myatt(Wyatt?)5, M, NC
AL3, F, AL
HH564 Meril Smith70, M, NC Farmer
Mary70, F, NC
Biddy25, F, TN
William9, M, AL
Bynum Duke, m. 14 Jan. 1843 to Mary C. Smith in Wake Co. NC (record # 01 126, bond # 000152762), Bondsman, Carns T. Smith, Witness, Jas T. Marriott.Mary is on the 1870 Ladiga, Calhoun Co. AL census, 1900 Hokes Bluff, Etowah Co. AL census, and the 1910 Ballplay, (Cherokee Co.?) AL census.
I descend from Jerome Bonaparte Smith, b. 1825 Wake Co. NC m. Elizabeth Bridges.Their son, Bailis Smith, b. 1854, m. Mary M. Duke, b. 1858.Bailis an dMary d. in 1894 in Typhoid epedemic - two of their children end up in Mary C. Smith's household (the 1900 & 1910 census).