The speaker talks about the importance of selecting books based on referrals and categorizing them according to the problem they solve. However, the ultimate teacher is one's own experience.