It shows his birth as Germany in Dec 1865. Since it may be easier to find him, you may want to try obtaining his death certificate to see if it lists his birthplace.
Happy hunting, I'll let you know if I find more as I am also looking for some Herzbergs in Missouri. There is a brother of Anna Gracia Margaret Herzberg who settled in Missouri around 1870 or so. She was born about 1850-1851 perhaps near Bremen, Germany. She married Christian Adolph Menger in Lawrence, Kansas on March 12, 1874, but I have not located her before that date.
I hope this information helps some. I would appreciate it if you can post what you find out if there is a birthplace listed or you find their parents.