My direct line is from the elusive "John Hullier of Burrough Green" and his wife Elizabeth Coe. I say elusive because it would seem that he wasn't christened, which makes it difficult for we descendents trying to establish our family tree! I am guessing that you are probably also descended from "John Hullier of Burrough Green" as most Hullyers are: either from John Hullier 1754 or his younger brother Henry Hullier 1763.
My line follows through John Hullier 1754, William Hullier 1785, Richard Hullyer 1821, Thomas Hullyer 1842, William Richard Hullyer 1878.
William Richard Hullyer 1878 was my Granda Hullyer on my Mam's side.
My direct line follows down from Brinkley 1754 and moves to Swaffham Bulbeck in 1807. However some of the brothers and sisters along the way were christened at Weston Colville and Carlton Cum Willingham: so it would seem that families followed the jobs, just as we do today.
There don't seem to be quite as many Hullyers today. Certainly in my family the name has died out due to a profusion of girls!