You said you found Charles on the 1860 census, but didn't say which county. I saw him on the Find a Grave site with links to two of his sons. So I went looking for them on the 1870 census and found Charles and Margaret with the two sons and Margaret's sister Lutitia (Letitia on 1860 census.) Census for 1860 and 1870 were Lamar Co, TX. There are people who browse this forum with access to more sources than I have and they might be able to take some of this and run with it.
TX Dth Idx thru 19076:
name: Richard C. Smith death date: 03 Feb 1963 death place: Lamesa, Dawson, Texas gender: Male race: White death age: 95 years estimated birth date: birth date: 13 Mar 1867 birthplace: marital status: Single spouse's name: father's name: C.B. Smith father's birthplace: mother's name: mother's birthplace: occupation: Farmer - Rancher place of residence: O'Donnell, Borden, Texas cemetery: Plainview Cemetery burial place: Dawson, Texas burial date: 03 Feb 1963 additional relatives: X film number: 2117176 digital film number: 4028564 image number: 954 reference number: cn 8428
name: T.C. Smith death date: 11 Nov 1935 death place: Snyder, Scurry, Texas gender: Male race: White death age: 72 years estimated birth date: birth date: 24 May 1863 birthplace: Texas marital status: Widowed spouse's name: father's name: Chas Smith father's birthplace: South Car. mother's name: mother's birthplace: occupation: Farmer place of residence: Odonell cemetery: burial place: Soil burial date: 12 Nov 1935 additional relatives: X film number: 2116707 digital film number: 4166614 image number: 1155 reference number: cn 53479