The speaker highlights the challenges of the different generations of CPU on the underlying machines and how abstracting this layer can benefit developers. Nonetheless, the continuous need to rewrite software as generations progress adds to the difficulties.