The use of larger networks and greater compute power may lead to a future where language models are able to exhibit signs of semantic understanding, without requiring the imposition of a theory of language on the learning mechanism.