The speaker reminisces about childhood moments of financial hardship, including not being able to afford tuition and wearing safety pins to school, highlighting the difficulties faced by families living in poverty.