The speaker discusses how people often assume that chess players are not athletic, but he personally enjoys playing sports and staying fit. Despite not enjoying weightlifting, he emphasizes the importance of maintaining a balanced fitness routine alongside chess.