You didn't give much in the way of details, so I looked at your message history.Is the Jesse Brown and mother thewidowed Cassie Brown your line?They are residing with Richard Butler in Fannin Co, TX on 1910 census.You did mention that year, but not where, but I found them. (^_^)
Now, you say Harvey was in Titus Co, TX in 1895, is that where Jesse was born?I would check land records for that county, also guardianship record for minor child.Yes, even if the mother was living if there was any estate, the court would appoint a guardian for Jesse.They did not physically take them and raise them, just reported to the court if any of the estate was sold, etc.By that time period, often the mother was "allowed" to petition for guardianship.Or, her father Richard Butler might have done so.
Check county tax records, even if Harvey did not own land, he might have owned a horse or mule, and showed up on a pole tax record, when he disappears, he probably died.
I thought I found your Harvey Brown buried in Fannin Co, TX, but he died in 1892, so too early for your Harvey.I was checking Fannin Co, TX GenWeb site, and the archived section of the TX GenWeb Project for Fannin Co, TX records.
Have you checked the 1900 census for Harvey?Since Jesse was born about 1896, there's a possibilty Harvey was still alive in 1900.