Greetings from Bermuda. I went to google and put in 'yellow fever victims in Bermuda' and this is what I found.
Take a look at (http://bermuda-online.org/britishmilitarygravesbda.htm) and you will see that there are two locations of victims of the yellow fever in the 1860's.I do not know for sure where you would find the names of these people.
I looked in one of my books and this is what I found: Taken from church registers. St. George's Parish - burial on Aug. 19, 1864 - Thomas TEAS age 39 yrs. (St.George) Bll
You may find more infortmation if you contact the Bermuda Maritime Museum in Bermuda - (firstname.lastname@example.org) Good luck and if I can be any further help please drop me a line at (email@example.com) Sincerely, Judy