In the 1880 US Federal Census, Penn Township, Cass County, Michigan, the record about this family contains the following information: Jacob Flury (48), farmer, born in Switzerland Catherine Flury (35), his wife, born in Pennsylvania (place of birth of her father and her mother is also Pennsylvania) Philipp(?) H. Flury (15), son, born in Indiana Mary S? Flury (10), daugther, born in Michigan Bobby S? Flury (2), son, born in Michigan.
I assume - Jacob Flury immigrated from Switzerland (with his parents or "alone") between 1823 (birth) and 1854 (assumed marriage) - about 1854 he married Catherine (at that time about 19 to 20 years old, a daugther of an american family from Pennsylvania) - about 1855 their first son was born somewhere in Indiana - at latest in 1860 the familiy came to Michigan (Penn Township).
The immigration lists contain a lot of persons with a name similar to Jacob Flury (Fluri, Flora, Flohri, Fleury, etc). First you shold try to trace back to localize the corresponding immigration. But even if you have collected all this data it could become quite a hard work to localize the origin of Jacob Flury in Switzerland. At that time, a lot of Jacob Fluri or Flury lived in Switzerland (most of them in catholic regions).