The speaker emphasizes the importance of staying consistent in working towards your goals, using the example of going to the gym and expecting results after only a few weeks.