I believe your James Matthew was the S/O Thomas R & Sarah ____? Thomas R & family listed in the 1860 & 1870 census of Rutherford Co., NC. Thomas R was a Physician in Rutherford Co. The family is found with the name spelled Edgerton, not Agerton. I have a large fileon Agerton's andwillshare.