Eugenia, from all I can gather, mostly from those who have access to the Agee Register, the family you are referring to in Clarke, AL, are more than likely descendants of Noah Agee, b. 1756 VA. I believe this Noah Agee was younger brother to Hercules J. Agee, who is my ascendant.
Noah married Martha Mask in 1786, VA. They reportedly had at least eight children, one of whom was named for his uncle, Hercules. Noah and Martha moved from VA, first to NC, but finally to Clarke, AL. They are found in the Richmond, NC, census in 1810, and by 1830 Noah's sons can be found in Clarke, AL. The information I have found in other's research says that Noah died in 1823 in Gainstown, Clarke, AL.
Noah's son Hercules Agee was born 12 Oct. 1799, so might well have married in 1824, the date you mentioned.