The speaker had an idea to teach students using Conway's theory about numbers, which became the central idea for his book. Despite being busy with other tasks, he became committed to completing the book.