I have no information on Joshua other then what I got from Ancestory.com. I have that he was married to Lydia Marks on 1 Jan 1856 in Wabash Co., IN. I also have that she died in Mar of 1859 in Humbolt, KS. I list him as marrying Mary A Ames on 4 Sep 1859 in Warren Co., IN.
Looks like his first two children would be from his first marriage with Lydia.
I couldn't find any documents on Joshua but Lydia's father is my GGG Grandfather.