The speaker emphasizes the significance of understanding different programming languages to be able to work on problems with specific constraints, particularly in going from high-level flexible languages to hardware.