My ancestor who left IOW was Isaac Chiverton born 29.5.1803 at Whitwell. He married Sarah Bennett on 13.11.1836 at Bermondsey, London and was living in 1861.
Isaac was the second son of James Chiverton and Jenny Downer, who were married on 20.9.1800 at Whitwell IOW. James was baptised on 25.5.1760. It was Jenny's second marriage, previously Reynolds. James was buried in Carisbrooke on 30.9.1827.
I have tracked back to 1583 on the Island with ancestors at Brading.
If you can give any more info, I will try a link. but if you say that they only went to IOW in 1800, we may not be on the same line.