Rulvar API reference / @rulvar/evals / EvalSuiteResult
Interface: EvalSuiteResult
Defined in: packages/evals/src/case.ts:284
Aggregate view of a suite run.
Properties
| Property | Type | Description | Defined in |
|---|---|---|---|
completedN | number | Result rows actually produced (equals results.length). | packages/evals/src/case.ts:294 |
meanLatencyMs | number | Arithmetic mean over result rows; 0 for an empty suite. | packages/evals/src/case.ts:290 |
passRate | number | Fraction of result rows with passed true; 0 for an empty suite. | packages/evals/src/case.ts:287 |
plannedN | number | Cases the caller asked for. | packages/evals/src/case.ts:292 |
refusal? | { atCase: string; detail: string; runLabel: string; } | Present when the aggregate envelope refused a TARGET run before it started (v1.17.0 review P1-5). The suite stops there and returns everything already measured instead of throwing: completed rows, their costs, and their names survive. Judge refusals never appear here; they normalize into the owning row's incomplete marker. | packages/evals/src/case.ts:302 |
refusal.atCase | string | - | packages/evals/src/case.ts:302 |
refusal.detail | string | - | packages/evals/src/case.ts:302 |
refusal.runLabel | string | - | packages/evals/src/case.ts:302 |
results | EvalCaseResult[] | - | packages/evals/src/case.ts:285 |
totalCostUsd | number | - | packages/evals/src/case.ts:288 |