The speaker believes that having a few tens of thousands of followers can enable you to make real money through podcasting. He also discusses his own experience of being recognized on the streets due to his podcast's popularity.