Package version:

Interface TruncationObject

Controls for how a thread will be truncated prior to the run. Use this to control the initial context window of the run.

interface TruncationObject {
    lastMessages?: null | number;
    type: TruncationStrategy;
}

Properties

Properties

lastMessages?: null | number

The number of most recent messages from the thread when constructing the context for the run.

The truncation strategy to use for the thread. The default is auto. If set to last_messages, the thread will be truncated to the lastMessages count most recent messages in the thread. When set to auto, messages in the middle of the thread will be dropped to fit the context length of the model, max_prompt_tokens.