Skip to content

rulvar API reference


rulvar API reference / @rulvar/evals / RunEvalSuiteOptions

Interface: RunEvalSuiteOptions

Defined in: packages/evals/src/case.ts:228

@rulvar/evals: quality measurement strictly on the public APIs (L6). EvalCase with golden, rubric, and LLM-judge graders; judge calls run through the engine (journaled, budgeted, VCR-recordable), so eval CI is deterministic; config-matrix comparison reports pass-rate, cost, and latency per cell. Matrix sweeps feeding ModelKnowledge, the eval-committer identity, and canary fingerprints are the M11 round-3 extensions.

Properties

PropertyTypeDefined in
budgetUsd?numberpackages/evals/src/case.ts:229
judgeBudgetUsd?numberpackages/evals/src/case.ts:230