Rulvar API reference / @rulvar/evals / RunEvalCaseOptions
Interface: RunEvalCaseOptions
Defined in: packages/evals/src/case.ts:118
@rulvar/evals: quality measurement strictly on the public APIs (L6). EvalCase with golden, rubric, and LLM-judge graders; judge calls run through the engine (journaled, budgeted, VCR-recordable), so eval CI is deterministic; config-matrix comparison reports pass-rate, cost, and latency per cell. Matrix sweeps feeding ModelKnowledge, the eval-committer identity, and canary fingerprints are the M11 round-3 extensions.
Properties
| Property | Type | Description | Defined in |
|---|---|---|---|
budgetUsd? | number | Run ceiling for the target run. | packages/evals/src/case.ts:122 |
envelope? | SpendEnvelope | Aggregate debit-only envelope (v1.16.2 review P1-2): every target and judge run authorizes its ceiling here BEFORE starting, and an envelope requires the matching per-run ceiling to be set. A refusal throws SweepBudgetError before any provider work. | packages/evals/src/case.ts:131 |
judgeBudgetUsd? | number | Run ceiling for each judge run. | packages/evals/src/case.ts:124 |
name? | string | Display-name override; defaults to the workflow name. | packages/evals/src/case.ts:120 |