The records will be there, only the need for a personal visit or someone else to access them.
If you are visiting Edinburgh and intend going to NRH, you should book beforehand, as it is extremely busy.
I think the charge is £17 per day; but the SP site gives the information.
Apart from anything else, I found it a fascinating place long when it was still purely manual, going through the Indexes, cross-checking the individual Register Offices, then being taken up the twisting cast-iron stairways to the rotunda and accessing the individual registers.
The referencing system made it extremely easy, apart from climbing the stairs!