The guest speaks about creating the right abstraction levels to simplify the world of software so that people can work independently on different levels of it, emphasizing the importance of being sensitive to the human element in engineering. The discussion also touches on how graph-focused, deep learning-centric hardware can compete with NVIDIA's current offerings.