There are limitations to the ability of neural networks to represent the world beyond what they learn from their data – specifically, they struggle to form mental models and make analogies like humans do, due to the limitations of their learning approach.