Can you give a bit more info. Do you know James's wife's name and about what year they married? Also what year approx. was their son William H. born? This will make it much easier to find them in the census records.
If you know James' birth place and year that may help too. Also name of their other child.