I wish I knew more about the Goolsby's. I am researching Wilborn Whittington also.... and the McWilliams family....and the Rowans.
Wilborn's second wife was Mary Goolsby b Nov 22 1808 and I have only found one sister for Mary, (I have the parents as Isaac Goolsby and Elizabeth Mane)... Nancy Goolsby b about 1800 who married William Rowan, Jr. ....Nancy and William both died in Arkansas, but most of their kids also ended up in Van Zandt County Texas near Wilborn Whittington... Mary died in 1856. Wilborn remarried Margaret Dawsey in 1858 and they are alone in the 1880 census. I would imagine Dawsey was a married name since she was born in 1814.
I honestly have not researched James Goolsby born 1826 other than finding them in Tippah Ms in 1850 with a daughter Elizabeth...
I would appreciate our sharing of information. Milda Mason