ResponseIdTracker
Track provider response IDs for incremental language model calls.
Some providers can continue from a prior response by accepting a previousResponseId plus only the messages added after that response. This module exposes a small mutable service that remembers which prompt message objects were included in each provider response and prepares a shorter prompt when a later call extends the same conversation.
Constructors
Models
PrepareResult interface
Result returned when a tracked prompt can be sent incrementally.
Details
It contains the provider response ID to pass as previousResponseId and the prompt fragment containing only the new messages after the latest assistant turn.
Signature
interface PrepareResult {
readonly previousResponseId: string;
readonly prompt: Prompt;
}Mutable service that tracks prompt message object identities by provider response ID.
Details
markParts records the prompt messages that produced a response, prepareUnsafe returns a previousResponseId plus the untracked suffix when the prompt prefix is fully recognized, and clearUnsafe drops all tracked state.
Signature
interface Service {
clearUnsafe(): void;
markParts(parts: readonly Array<object>, responseId: string): void;
prepareUnsafe(prompt: Prompt): Option<PrepareResult>;
}Services
ResponseIdTracker
Service tag for enabling provider previous-response ID reuse across language model calls.
When to use
Use when you provide a language model with previous-response ID tracking so later calls can send only new prompt messages together with the provider's prior response ID.
Signature
declare class ResponseIdTracker extends Shape<"effect/ai/ResponseIdTracker", Service, this> {
constructor(_: never);
}
Creates an in-memory
ResponseIdTrackerservice.Details
The tracker maps prompt message object identities to provider response IDs.
prepareUnsafereturns a previous response ID and the messages after the latest assistant turn only when the existing prompt prefix is fully tracked; otherwise it clears the tracked state and returnsOption.none().