AYERS in TENNESSEE/late 1800s

I'm trying to find info on my great-grandfather's family. His name was W.H. "Dick" Ayers and he was born in Mississippi in 1848; moved to Giles County Tenn. by 1880. He was married to a widow, Nancy McMillion (sp?) Webb, and they had three children, Mary C. (Molly)-1867, Stephen Henry-1871, and James Edward-1872. Apparently he was in the sawmill business and moved around a great deal. The family finally settled in Perry
County, Tenn. After Nancy's death, he married again, but I have no information on the second wife. The family supposedly had relatives in North Carolina and an old letter mentioning a cousin (?) by the name of Moses Ayers (in N.C., I believe) was found many years ago.
If these names ring a bell with anyone, I would so much appreciate hearing from you. This is a dead end that has lasted for several years.

Jo Ann Ayers Lynn