Token

A token is the basic unit of text into which a language model divides both input and output text—typically a part of a word, a whole word, a character, or a punctuation mark. Models process text in tokens, not whole words, and the cost and speed of most AI APIs are calculated based on the number of tokens processed and generated. Understanding tokenization is also important when estimating the costs of deploying AI in business processes.