GenerationOptions

Options that control generation behavior across all response methods.

Interface

interface GenerationOptions {
  temperature?: number;
  maximumResponseTokens?: number;
  sampling?: SamplingMode;
}

Property	Type	Description
temperature	number	Controls randomness. Higher = more varied.
maximumResponseTokens	number	Max tokens in the response.
sampling	SamplingMode	Sampling strategy.

Usage

await session.respond("prompt", {
  options: {
    temperature: 0.8,
    maximumResponseTokens: 500,
    sampling: SamplingMode.greedy(),
  },
});

SamplingMode

SamplingMode.greedy()

Deterministic sampling — always picks the most likely token.

static greedy(): SamplingMode

SamplingMode.random()

Stochastic sampling with optional constraints.

static random(options?: {
  top?: number;
  seed?: number;
  probabilityThreshold?: number;
}): SamplingMode

Parameter	Description
top	Top-K: only consider the K most likely tokens
seed	Random seed for reproducible output
probabilityThreshold	Top-P / nucleus: cumulative probability threshold

SamplingModeType

type SamplingModeType = "greedy" | "random"