The speaker emphasizes the need for resilience over optimization, especially in times of difficulty. He urges to prioritize adaptation even during off seasons instead of focusing solely on optimization for the future.