Fagan was a prominent Arkansan, and after his Confederate War service, he returned to his Saline River Plantation, where he divided his time between farming and politics. He accepted federal office under President Grant, and served as the US Marshall for the Western District of Arkansas at Fort Smith. He was listed for a time to be one of the figures to beon Stone Mountain, Ga. in an early design. In 1890 he lost a race for governor of his state. His mother was Kittie Stevens and he was a first cousin of Pat Stevens of Oak Hill.