I wrote a reply but somehow lost it. I looked up the 1861 census for Louise Daudelin and see that she is listed as married. The man listed above her is Etienne Royand so I looked up a marriage for them. They married in Boucherville in 1828. He was son of Jean Baptiste Roy dit Desjardin and Charlotte Senezale (looks like)Louise's parents were Pierre Daudelin and Catherine
Catherine's names looks like it may be Casonde of Lasone dit Leriche ?? But not sure
I looked for birth of this Louise to confirm parents. There is a Louise Daudelin baptized Boucherville Dec. 9, 1805 - parents Pierre Daudelin and Catherine Noriche - or that is what mother's name looks like - pretty close to the Periche so may be same person.
I found death of this Pierre and it shows wife as Catherine Leriche
So it seems that this Louise is not the same Louise that married your Joseph.
You said you did not find Louise in Vermont in 1860 but I thought she and Joseph lived in Peru, Clinton, NY??
I see they are in Peru in 1850 with the following family
Joseph 41, Louisa, 44, Gilbert 15, Jane 11, Peter 9, Caroline 7, Josephine 5, Franklin 3, Albert 5/12.
Joseph, Louisa and Gilbert born Canada, the rest all born NY
I have had no luck in finding any of them in the 1860 census. I looked in NY and in VT.