The speaker discusses how deep learning will start to encompass classical artificial intelligence techniques such as symbol manipulation, leading to the development of hybrids with the label of deep learning.