The speaker initially treated podcasting as a side job, but eventually pivoted to prioritize it after seeing the positive impact it had on listeners. Despite needing to make money, they resolved to continue adding value to their audience.