Audrey ~ From somewhere on-line I found a James T. Matherly Sr. (b. 1832 KY) who married Martha Webb in 1857 in Mercer Co. KY and had at least two sons: David Matherly (b. 1858 KY) and James T. Matherly Jr. (b. 1860 KY).
I also found a James T. Matherly (b. before 1834)who married Elizabeth Lawson (b. 1853). Maybe the first James T's second wife?