Stateless
Describes a system that treats each request independently unless prior information is supplied again.
Illustrative conversation
- Why did the API forget the tool result from the previous call?
- That request was stateless, and the application did not include the earlier result in the new input.
Definition
A stateless model interface does not automatically attach earlier requests to a new invocation. The caller must send the instructions, messages, tool outputs, and other context needed for that request, even if some of it came from an earlier turn. Stateless operation gives the application explicit control over retention and replay, but forgetting one required item can make a continuing task appear to lose memory.
Reviewed