The speaker discusses the approaches to coding and algorithm design, ranging from iterative tinkering to formal planning, and the considerations that go into choosing the appropriate algorithm for exploratory data analysis.