Tokeniser
The step that splits text into tokens and turns each one into an ID number.
Its tokeniser has a vocabulary of 50,257 tokens, learned from its training text by a method called byte-pair encoding: start from single bytes and keep merging the pairs that turn up most often.
See it in action
Try tokeniser hands-on in the lesson Predicting the next word, part of the AI fundamentals course.