Library · evaluation

Determinism and reproducibility

Added 2026-07-14 · Last verified 2026-07-14

Lower temperature can reduce sampling variation for extraction and routing, but it does not make a hosted model or a multi-step agent deterministic because model revisions, parallel tools, retrieval indexes, and external state can change outcomes. Record model snapshots when available, parameters, prompts, tool and data versions, seeds where supported, timestamps, and complete trajectories, then evaluate with repeated trials and outcome tolerances. For reasoning models, follow provider guidance on sampling controls and put exact calculations, policy decisions, and invariants in deterministic code rather than relying on identical natural-language reasoning traces.

Useful?

Read the source ↗


Source: The Agent Loop — agent-loop.xyz. Curated in the open knowledge base (CC BY 4.0).

Ask a question about this ↗