The speaker emphasizes the importance of exposing yourself to books that are outside of your comfort zone as it can lead to sparking interests and broadening perspectives.