Dot-It appears that Allen never left Catahoula Parish as he appears in the 1860 Census there.However he was not living with any one named Phillips.I did not have access to the census sheet but I checked al Phillips living in the Parish in 1860 and ther were no Phillips living in his household (Family No. 495).Her is how is reads:
Allen Philips Residence: , Catahoula, Louisiana Ward: Pine Woods Dist Age: 10 years Estimated Birth Year: 1850 Birthplace: La Gender: Male Page: 69 Family Number: 495 Film Number: 803410 DGS Number: 4231221 Image Number: 00073 NARA Number: M653 If you can get to somewhere with the census roles you can use the film no. etc. above to find that Family number andsee with whom he was living.Might have been a sister or if his father died maybe Penelope remarried.
According to 1900 Census, Allen was born May 1850.
I looked for Robert, Edmund (son of Robeert b. ca 1845, his daughters Elizabeth and Ellen, and step-sons William & John Smith in the 1860 Census and could not find any of them. Hope this helps some.