Core ideas
Experiments and candidates
Test better ways of running the agent. Experiments compare candidate setups (instructions, model, tools, retries) against the current one.
Experiments compare candidate agent setups against the current setup.
Candidates may change instructions, model selection, tool descriptions, context, checking, retrying, and stopping rules.
If a candidate sees the held-out tasks or lacks required evidence, it is invalid.