Dr. Phil had a difficult childhood where his father left the family and he had to go to New York alone to support them financially, while his sister's father took them in.