The speaker acknowledges the potential negative reactions to talking about money, specifically those who become envious, angry, or skeptical. He aims to inspire the group who is present to learn something new and exciting, avoiding money-related discussion for the moment.