The speaker encourages people who experience gym anxiety and nervousness to not assume others don't feel the same way, reminding them that everyone feels worried, and suggests that acknowledging this anxiety can allow individuals to continue working towards their goals despite the fear.