Please contact me, I am researching the surname CAYSE also. I have found it spelled several different ways: CAYES, CAYCE,AND CAYS. My family comes from Kentucky. The earliest I have is ROBERT CAYSE, who married Harriet and had son Perry L. CAYSE/CAYES/CAYZE/CAYCE.
Looking forward to hearing from you. Hope we can make a connection.