The speaker suggests that men have a larger leeway in terms of their physical appearance, whereas women are held to stricter beauty standards. He acknowledges that as men age, they also face beauty-related challenges but there is no established beauty standard for them unlike women.