Skip to content

rulvar API reference


rulvar API reference / @rulvar/evals / RunEvalCaseOptions

Interface: RunEvalCaseOptions

Defined in: packages/evals/src/case.ts:102

@rulvar/evals: quality measurement strictly on the public APIs (L6). EvalCase with golden, rubric, and LLM-judge graders; judge calls run through the engine (journaled, budgeted, VCR-recordable), so eval CI is deterministic; config-matrix comparison reports pass-rate, cost, and latency per cell. Matrix sweeps feeding ModelKnowledge, the eval-committer identity, and canary fingerprints are the M11 round-3 extensions.

Properties

PropertyTypeDescriptionDefined in
budgetUsd?numberRun ceiling for the target run.packages/evals/src/case.ts:106
judgeBudgetUsd?numberRun ceiling for each judge run.packages/evals/src/case.ts:108
name?stringDisplay-name override; defaults to the workflow name.packages/evals/src/case.ts:104