I've done some more research and I think that James' mother was named Lucy. His father appears to have died prior to 1850, and Lucy remarried a Squire Bennett. In the 1850 Columbia County, Oregon Territory census, it shows them living with a Mary Ann Bartlett, aged 9, who I believe is James' younger sister. It also seems that James may have had several older brothers, including a John Wesley and a Riley. I am looking for some confirmation of this, as well as Lucy's maiden name and James' fathers name.