The speaker recalls spending their college vacations hacking on their home computer and teaching it how to play tic-tac-toe, which ultimately led them to studying computer science.