The speaker's father worked two jobs, struggled to provide for his family, and was unable to start his own business due to financial constraints. The lack of money in the household shaped the speaker's view on money.