Researchers are trying to construct a science behind the size of a neural network needed to capture linguistic knowledge and have natural conversations. They've found that there is a phase transition, rather than a gradual increase, in neural network size that allows for emergence of linguistically capable neural networks.