The speaker shares how he gradually developed an interest in cars by first getting into programming, then math, and finally, robotics. He got into cars after attending a conference on robotics in Berkeley while he was still a PhD student.