This is probably a puzzle which isn't going to get solved, at least not soon. The information is confusing. I looked at the LDS site @ Familysearch.org and it gives Joseph's parents as Peter and Sarah (Brown) George. The parents of Joseph who married Anna Worthen are Samuel and Hannah (Eastman) George. Maybe part of the mix up comes from Peter George's FIRST wife's mother also being an Eastman. Sarah Brown was the daughter of George and Elizabeth (Eastman) Brown.
I have a book called "George Genealogy" by Keith H. George, 1991. He follows four George lines which are not proven to be related. The lines are James George of Amesbury, MA,John George of Haverhill, MA,Nicholas George of Dorchester, MA,and Isaac George of Albany, NH. My line is John George and so far I haven't come across errors. Some of my ancestors married into the James George line, but I have no direct descent from it and have no other family information to back up facts the way I do with my line.
What's interesting is that there is no Joseph listed as a son for Peter and Sarah (Brown) George. The "George Genealogy" also lists spouse surnames. The only Favor listed during this time period is Mary, daughter of Cutting and Mary (Wells) Favor, born July 11, 1727 in Amesbury, MA. She married Micah George, August 1746. He was the son of James and Susannah (French) George. Maybe a will, if one exists, or probate records could help solve the mystery.