Language models predict the next word in a sequence of words by being trained on large volumes of text. Giving them more training data improves their accuracy, and recent breakthroughs have led to better performance with less data. These models are already being used in applications like Smart Compose and Smart Reply in Gmail.

source update: What is generative AI? A Google expert explains.