The fundamentals of supervised learning in the context of simple data sets, like an MNIST data set, are essential to understand before delving into other machine learning techniques like deep learning and unsupervised learning.