Yup. I checked again and he is my 1st cousin, 7 times removed. I actually do have another relative who went to and died in the Carolinas. Rev Samuel Fiske born in Lexington Ma in 1739 reportedly died in South Carolina in 1777.
Rev. Samuel and Joseph were 1st cousins, once removed... but only 13 years different in age. And both from Lexington, so they most likely knew each other, and possibly well.
It may not lead anywhere but you never know. Since Samuel died in 1777, if they went together or if Joseph went later, at least he had someone to visit or possibly stay with and he would have been 25 by the time Samuel passed, plenty old enough to stay on his own.
Back then 25 was like being 40-45 today, with regard to life experience.