We are on the same road...just hard to find the exact direction.
I'm going to start with James N. Lovvorn who was married to Nancy Morris...first, I have him as James Thomas instead of James N.James N. could be right since several people have mentioned it as James N.
The children of James N. (or as I have it James Thomas) and Nancy Morris were the following:
Benjamin Franklin Lovvorn Amos A. Lovvorn Monroe Lovvorn Jack Lovvorn and then I have a note of two sets of twins.
One of the set of twins, could be your James Monroe Lovvorn and Naomi Jane Lovvorn.