The speaker recalls his early days of programming, including how he was paid in goods like the first iPod and an iBook due to transaction costs, and how he began working with Jason Fried who was his first business partner at Basecamp and paid him $15 an hour to program.