I don't have the probate records for your Joseph, but I am researching the same family.My side comes down from Joseph's brother William Louis.They were both the sons of Jonathon D. Devereaux. My information down to Lewis Devereaux m. Rosanna Blodgett is from the book "A Genealogy of the Family of Devereaux of the line of Jonathan Devereaux born in Wethersfield, Connecticut, November 7, 1716".If was compiled by Cyril Allyn Herrick and Charles F. Haight.All it has to say about your Joseph is "Married -- Anner Sherman at Lanesboro, 1788.Record of St. Joseph Episcopal Church." and "Joseph Devereaux was apparently a pioneer in the Ohio country.He was a private in Townsend's Company, Van Rensselaer's Regiment, New York Troops."
I don't know whether any of this is new to you or not, but just found your query and thought I would at least give you what I know. There is a picture of his tombstone on the Licking Co. genweb site if you are interested and don't have one.