The speaker talks about the challenges he faced while developing open source software, some of which include disagreements with developers over scaling strategies and state management strategies, and how he sometimes gave up on pushing forward changes.