I may have a few more names to add to your family which I hope may be of use. Several years ago I undertook quite alot of research into my maiden name of FitzJames, so I hope this is of use.
Starting with Michael FJ (a farmer according to his Will) died 1834 married to Catherine who died in 1841 at Bath. They had 2 known children Henry Lambert and Edward Michael. Henry married Lucy . Henry Lambert died in 1848 and Edward in 1847. Lucy and henry had 3 known children (but possibly 4) Anna Maria (abt 1840-1886 )an artist?who remained unmarried. Lucy who married a Mr Boulton , Henry Michael and possibly a Kate Harriet born about 1851.Lucy Boulton produced George, John Charles and Lucy Helen. Henry Michael with Grace produced your Violet and I think another daughter Margaret. I have copies of the Wills of Lucy FJ (1891)and Anna Maria FJ (1886). and details from 1881 census for them both. Also It is quite possible that you line originated from Somerset- the Bruton, Redlynch areas.