our family claimed the G-G as coming from the same part of Scotland. Is that close enough? Presumably this was remembering back to pre-Glasgow times. If you try "Lord Willoughby Norrie" in a a search engine he is there and it says where he comes from, (general area only) but I can't make a link yet.
There are few Norries with the surname from our family still in NZ. Our great grandfather was the manager/editor/owner of the Tuapeka Times, NZ's 2nd newspaper, in Lawrence, close to Gabriel's Gully. One of his son's shot himself after WWI, and another never recovered from his wounds and died married, a manager of the BNZ Wellington and childless. A third was a solicitor (struck off I'm afraid) in Takapau, children unknown by me, and the last my grandfather, manager of the South British Insurance Company, two girls.