Click to see the probability a GPT model gives each candidate next word after "the cat sat on the". Predicting the next word is all it does.
A GPT model does exactly one thing: give a probability to every possible next token. Everything else is built on top of that.
