The speaker emphasizes the importance of choosing activities that fulfill oneself, even during times of adversity such as the COVID pandemic or hard workouts. Adversity is necessary for growth, and it exists in varying degrees for different individuals.