I think the person you are calling James Dutcher is actually John Dutcher.
My great grandfather Charles Willington Dutcher 1836-1895 was a Methodist Minister in New Brunswick who compiled his family genealogy in 1893. He identified his grandfather as John Dutcher, a refugee from New York who came to New Brunswick in 1783. John married Ann or Anna Horton in 1790. Her father was James Horton and she was born in Rye, New York. She had five children with John Dutcher at Sheffield, New Brunswick. They were John Dutcher 1794-?, Ianus Dutcher 1796-1796, James Duther 1796-1872, Mary Dutcher 1807-? and Sara Dutcher ?-?. James Dutcher married Sara Plummer 1806-1836 in 1825 and had Jane P. Dutcher 1831-1853 and Charles Willington Dutcher 1836-1895, who was my great grandfather. Charles married Deborah Wilson and after she died Catherine Howatt, my great grand mother.
Perhaps to clarify who James Dutcher was, do you know his birth dated and his death date and burial location? Do you know James's wife's birth and death dates plus her burial location?