The history of neural networks in language and text changed with the advent of data and compute. The recent history of using neural networks in text has focused on language models.