The fundamental structure of behavior prediction, decision making and planning share a lot of similarities with language models, with a sequential nature, strong locality and larger context representation. Waymo along with other Alphabet researchers have been pushing research in this space, with interesting breakthroughs in language models, supervised and unsupervised machine learning.