Skip to content

rulvar API reference


rulvar API reference / @rulvar/evals / RunSweepOptions

Interface: RunSweepOptions

Defined in: packages/evals/src/sweeps.ts:47

Properties

PropertyTypeDescriptionDefined in
committerIdstringThe dedicated committer identity.packages/evals/src/sweeps.ts:51
engineFor(member) => | Engine | Promise<Engine>A fresh engine per model cell, routed at that member: the caller owns adapters, budgets, and the VCR posture, so a sweep records and replays like any engine run.packages/evals/src/sweeps.ts:59
modelEpochFor?(member) => | { canaryFingerprint?: string; capsHash?: string; pricingVersion?: string; registryVersion?: string; } | undefinedOptional epoch stamp per pool member (capture via the core modelEpochOf; the canary fingerprint rides it when probes ran).packages/evals/src/sweeps.ts:70
observedAtstringISO date of the sweep; the TTL table applies from it (no wall clock inside).packages/evals/src/sweeps.ts:53
reportIdstringDeterministic, caller-minted; every claim's evidence and gate reference it.packages/evals/src/sweeps.ts:49
store?ModelKnowledgeStoreWhen given, emitted claims commit through the committer identity.packages/evals/src/sweeps.ts:65
suite?RunEvalSuiteOptionsPassed through to every suite run (budget, VCR hooks ride the engine).packages/evals/src/sweeps.ts:63
thresholds?Partial<SweepThresholds>Mid-band pass rates emit NO claim (uninformative); see defaults.packages/evals/src/sweeps.ts:61