A discussion on the evolution of generative dialogue models from testing to production and the advancements in retrieval models with the use of transformers in achieving better language performance. Despite the amount of hype surround language models, there are still a lot of experimentation and opportunities to explore for optimal dialogue models performance with people.