Lesson 1Where the patterns come from
If a model works by predicting the next word based on patterns, the obvious question is: patterns from what? The answer is training data — a massive collection of text the model learned from before it was ever released: books, articles, websites and other written material, gathered up to a certain point in time.