Input tokens
The tokens sent to the model, including instructions, history, tool results, and the latest request.
Illustrative conversation
- My message was one sentence, so why did the request contain 20,000 input tokens?
- The harness also sent its instructions, tool schemas, prior turns, and retrieved files.
Definition
Input tokens are all tokenized content supplied for a model request. Depending on the API and harness, that can include instructions, conversation history, tool definitions, retrieved documents, tool results, images represented as tokens, and the latest user message. Cached tokens are usually reported as a subset of input tokens, not as additional tokens outside the request.
Reviewed