There is no Fort Victoria any more, only a camp ground where the original fort used to be. (I used to be from Victoria). That is so wonderful about you having a marriage back then because Fort Victoria was really small. It was also about the time that they found Gold in the Caribou and then Victoria grew by leaps and bounds overnight. If the kids that I sent you are his, then obviously his family stayed there for awhile. There was also another branch that headed off to Vancouver...which was a new town of 10years by the turn of the century.If your family died in Victoria, they are probably buried in Ross Bay Cemetery..one of the most beautiful cemetery's in the province with a history of its own.
Please email me at home at email@example.com because I would like to know more details. If they are at Ross Bay, then I can find their graves for you (next summer) and take pictures etc. I can help search for you on this end...but...I don't want to retrace your steps that you have already done.