In the course of the education process, these models learn to forecast the next word inside of a sentence based on the context furnished by the previous words. The model does this by attributing a probability rating to your recurrence of words that were tokenized, damaged down into smaller sized s