I believe that the family of M. TITTLE of SC is possibly the son of John Archibald and Jane DEVLIN TITTLE.His name was Madison, b. 1838 in Abbeville Co, SC.The reason I feel strongly about the connection is that one of their children was named "Devlin" TITTLE.The John Archibald TITTLE family ended up in Rome, Floyd Co, GA by 1866.
Notice that your grandfather's brother was "Madison".
You will have to research this connection to be sure, but I hope that this helped you.I have the line farther back if you connect, let me know.
The TITTLEs born in GA are probably from another line.I'll have to research that a little more.There is a lot of coincidence here, but the birthplace is not right to be the same person.Does the census say where the children were born?