The speaker recommends Paper Space for their machine learning experiments and to release code for educational purposes. Workflows, a feature offered by Paper Space Gradient, can automate machine learning pipelines on top of gradient compute infrastructure.