The creation of ML Perf, a machine learning benchmark suite, has highlighted the importance of having a strong software stack for running machine learning programs effectively. Companies that invested in their software stack were able to run ML Perf successfully, while those that didn't struggled to keep up.