The speaker highlights the annoyance people feel when others measure the age of their children in months, instead of years, and expresses their difficulty in performing quick math to determine a child's age.