Re: samuel duvall ashe co north carolina.
We are not talking about James "Madison" Duvall, we are talking about James "Monroe" Duvall who was the son of James Duvall of Ashe County. As for James Duvall having 20 children by 2 wives, show me proof. No one has been able to so far, just assigned all of the loose Duvall's in Ashe County to him. If James was not James and Ambrose's father, why did James Sr. move to Carter County, KY with his wife Tamzy and is listed on the 1880 census as living with Ambrose Duvall, his oldest son? James adopted the children of Tamzy, changing all of their names to Duvall. James had 8 children with his first wife, Elizabeth Plummer. If the rest of the children listed for him and Tamzy are his or hers that he adopted is unknown.
Thomas Duvall, the brother of James Sr., did have a son named "Madison" Duvall, but it was not "James Madison".There was another James Monroe in Ashe Cty, but he was the son of Ambrose and was born in 1852.
As for the census, they are and have been proven wrong. Many times if people were not home, the neighbors were asked about them and they made their best guesses.
If you can show me proof let's see it, otherwise it looks like you are wasting our time.