The speaker emphasizes the importance of both slow and fast reading. He stresses that slow reading allows for ideas to develop and flourish, while fast reading allows for the exploration of the limits of the mind in the intellectual domain.