The speaker recalls how he realized that every time he bought a skateboard was when he had money, reflecting on the correlation between his financial status and his passion for skateboarding.