The speaker highlights the significance of simple instruction sets like store and load instructions in computing since they date back to the early days of commercial computers, and advocates for a reduced set of instructions to build microprocessors that can consistently and quickly evolve due to Moore's Law.