A brief article about the lime quarries and lime kilns near New Holstein appears in the book "Pioneer's Corner: Interesting Facts and Anecdotes of Early Local History," published by the New Holstein Historical Society. The book is a collection of history columns published over the years in the local newspaper.
The pages you want are 54-56. This article notes that the "first lime quarry south of Hayton was opened in 1865 by George Nicolson." This is the time period you are asking about. Hayton is northwest of New Holstein, near Chilton, so again the same area you are asking about. Here's a good map to see the towns: http://www.mapquest.com/maps/map.adp?city=Hayton&state=WI&country=ushttp://www.mapquest.com/maps/map.adp?city=Hayton&state=WI&country=us
The varied work involved is described in the article, as well as the living conditions of the some 35 men requied to operate the lime kilns -- and their families.