The earliest records are of Captain John Foye, from the Isle of Guernsey, a Norman French speaking island. The Isle became a protectorate of England in 1066, but until 30 years ago, remained predominantly a French dialect speaking island. There is no question that in 1600 the islands were primarily French speaking, the inhabitants being Huguenots from France. The Isle, although an English dependency today, is just 16 miles from the coast of France. Its culture, architecture and customs are distinctly French.
Captain John Foye later migrated from the shoals to Kittery as explained by a previous poster on this board.
Evidently these French Huguenots also impacted on England itself, as there is a House of Foye on the Fowey (Foye) River in Cornwall, I believe.