Large neural networks surprise us with their power through getting desirable outputs when the knobs are set up properly. When trained on complicated enough problems, these large neural networks can produce very surprising emergent behaviors.