It sounds as though you're describing the Commander/Capain Simon Taylor Ogilvie who was my 3x great grandfather. He was born in 1792 in Montrose rather than in England. His wife was called jean Alexander and they married at North Leith in 1827.
His parents were called George and Catherine, and that's all I know about them.
One of his sons, William Baird Ogilvie came to Dunedin in New Zealand, and I'm descended from him. I've got a little bit more information given to my mother about the rest of their family and about his parents, which I'll be happy to pass on.