Hi Guy! Have you checked with the Texas State Archives in Austin? Eliza Ann filed a Confederate Pension Application, which was rejected. There may be some information on his service in that. It shows she was in Johnson Co. at the time of the application. It's always a good idea to post the county if you know it. There are 254 counties in Texas and it helps to narrow it down!
I checked the National Parks Service Soldier and Sailor System. As you can imagine, there are several John Kemps, and one John W. Kemp. This could be him...but it could also not be him. You would need more info on the regiment and it's formation. Here's the listing from the Soldiers and Sailors System John W. Kemp (First_Last) Regiment Name 54 Tennessee Infantry. Side Confederate CompanyA Soldier's Rank_InPrivate Soldier's Rank_OutPrivate Alternate Name Notes Film Number M231 roll 24
You might request the service records from the --I think-- the National Archives (the Park service definitely does not have them). Might post to the GenForum Civil War forum and they could give you more specific info on requesting service records.
I would first check the pension application, though. That may verify the regiment/company which would save you some money for the request.
Organized February 5, 1862; consolidated with remnants of 48th (Voorhies') and other regiments not captured at Fort Donelson to form 48th (Nixon's) Tennessee Infantry, April, 1862. The regiment was in the process of being mustered in at Nashville, on February 5, 1862, when several companies were ordered away before the muster was completed, with the result that the records are incomplete. The whereabouts of the regiment from this time until April 1862 is not known, as the regiment is not listed at all in the Official Records. Unofficial information is that the regiment moved first to Kentucky, from there to Fort Donelson, where it escaped, but was almost disbanded. It is not included in the list of forces at Fort Donelson as found in the Official Records. In April 1862, it was at Camp Hill, near Corinth, Mississippi, where it was consolidated with that portion of the 48th (Voorhies') and other regiments who were not captured at Fort Donelson. The further records of the men who comprised the 54th Regiment are filed with the records of 48th (Nixon's) Tennessee Infantry Regiment.
Lack of official records may be the reason Eliza Ann's application was rejected. Just a thought.
Anyway, hope this helps! Good luck! Andrea volunteer