If you look on a map you will see that Turvey is only about 15 - 20 miles from Broom.
There are 24 HARLEY folk on the 1881 census in Bedfordshire, almost all are in Turvey.Perhaps an ancestor is listed there!
I think I got most of my Harley data from the local history collection in Bedford library - but it is such a long time ago (before folk did genealogy on the PC!!!) that I can't remember of the top of my head!
My connection is that my husband's grandmother was Sarah Ann HARLEY, b 1896 in Northampton, daughter of Thomas Charles Harley who was born in Turvey c 1845.TC was the son of William bc 1810 in Turvey, and so on.