I am interested in this family as well.I have the Ivory's abstracted from the Catholic Vital Records by Rev. Ledoux and a few census records from Cambria Cty.,PA.
But this is just the beginning of the search.I would be happy to share with you what I have found on this family. I do believe that we have a connection.
I am descended from Matthew Ivory and wife Rebecca [till now I had no idea what her maiden name could be] though son, Patrick Ivory and wife Ellen/Helen Connelly. to daughter, Mary Ellen "Molly" Ivory who married Charles Augustin McMullen.
I look forward to hearing from you or anyone else who has an interest in this family.