The speaker expresses their reluctance to record podcasts outdoors, citing the possibility of being interrupted by passersby, including homeless individuals.