The 1893 book has been superseded. A book published in 1995, _Frederick County Families_ (or something like that----I don't have the title with me at this moment----gives some documentation showing that William Jolliffe (d. 1769), was a Quaker from Bucks County, Pennsylvania, before he moved to Orange County, Virginia, and Frederick County, Virginia.His wife was apparently from New York City, which suggests that he immigrated from England himself. In any case, there is no documentary evidence that he was connected to the Norfolk County family.
James Jolliff (incorrectly called "Abner" Jolliff and "James Abner" Jolliff in an effort to reconcile the name as given in the _Pioneer History of Illinois_, 2nd ed., 1887, as "Abner," and the documntary sources which call him James) has even more obscure origins. I would not necessarily connect him with the Norfolk County Jolliffs. He was definitely in the Washington Co., PA, militia, in 1781, and in Norris Town, west side of the Ohio River, in 1785, so was unlikely to be the slaveowner in Norfolk County at that time (whose brother Richard was a Loyalist who went to Nova Scotia). The James Jolliff (d. 1821 Barren Co., KY) may have had a brother, Luke, who in 1775 was ordered by the West Augusta County Court (this covered most of what is now northern West Virginia and southwestern Pennsylvania) to be flogged for failure to take part in militia activities.But James' and Luke's origins are mysterious.