I came across your message on the Holdsworth GenForum (Genealogy.com), and wanted to see if this connection can be validated.I believe I have a bit of information (on the Holdsworth side at least) that you're looking for.
I show James Holdsworth, of Wakefield (an ironmonger) b. 1 August 1813, married one Rachel (not Jane) Roodhouse, daughter of Stephen Roodhouse of Wakefield.James d. on 21 March 1886, and left several children:
1. James Milner Holdsworth, b. 1841, d. 1844 2. Kate, m. NN Whittam 3. Jane Ann Holdsworth, m. John William Baker, a wine merchant of Wakefield.Jane d. in February 1876. 4. Muriel, m. NN Crowther 5. John Henry Holdsworth, b. 5 Sept 1847, ironmonger, of Wakefield
From the virtual match of names, it appears that Jane Ann (Holdsworth) Baker above is your ancestress.While a distant (non-Holdsworth) relation, I have a bit on the descendants of John Henry Holdsworth, and a lot on the Holdsworth ancestry.
Please write when you have a chance; looking forward to sharing what I have (and learning more on your side of the family).