Charles William Rayfield was the son of William and Arkansas Rayfield but he wasn't born until 1880. Arkansas Rudicell was a second wife. His father, William Rayfield, was born in June 1837, was a soldier in the CSA and is buried in Greenville, SC. You are correct that Charles William Rayfield was married twice. He married Louise Phillips in 1902 in Buncombe Co., NC.
Charles was the grandson of James T. and Lavina Horton Rayfield who divorced in Lincoln Co., NC in 1839 because Lavina was involved in adultry. James T. Rayfield remarried in Union Co., SC in 1840 to Mary C. Phillips, had another family and died either in SC or Mississippi. His widow is in Lauderdale Co., Mississippi in 1850. According to the divorce papers, Lavinia had been unfaithful for some time so there may be a question as to William's true father. I have a theory based on later records that Lavina was involved with James T. Rayfield's brother, Banion Rayfield.
James T. Rayfield and Banion were two of the older sons of John and Elizabeth Rafield who were in Lincoln and Gaston Co., NC area as early as 1830. They were from Sumter Co., SC. I have the family back to when they immigrated in 1764. I will be happy to share more.