Skip to content

Rulvar API reference


Rulvar API reference / @rulvar/evals / RunEvalSuiteOptions

Interface: RunEvalSuiteOptions

Defined in: packages/evals/src/case.ts:305

@rulvar/evals: quality measurement strictly on the public APIs (L6). EvalCase with golden, rubric, and LLM-judge graders; judge calls run through the engine (journaled, budgeted, VCR-recordable), so eval CI is deterministic; config-matrix comparison reports pass-rate, cost, and latency per cell. Matrix sweeps feeding ModelKnowledge, the eval-committer identity, and canary fingerprints are the M11 round-3 extensions.

Properties

PropertyTypeDescriptionDefined in
budgetUsd?number-packages/evals/src/case.ts:306
envelope?SpendEnvelopeSee RunEvalCaseOptions.envelope; shared across every case of the suite.packages/evals/src/case.ts:309
judgeBudgetUsd?number-packages/evals/src/case.ts:307