The more I think about it, the more I'm convinced that your Bartleys are the same as mine.
Your James Bartley was born in 1841 and I have a James Bartley Jr. that was 12 years old in 1850 (pretty close). But even more than that, there are a lot of similarities in the names of the children between your James and mine just a generation earlier, primarily the name of Samaria vs. Sumaria, and Samantha, both names are listed as children of my James. I really think my James Bartley is the father of your James Bartley.
I have a bit more information if you would like to go back a generation farther than you have. Contact me.