Rulvar API reference / @rulvar/evals / BenchmarkRunRecord
Interface: BenchmarkRunRecord
Defined in: packages/evals/src/benchmark.ts:142
The full record of one benchmark run, scored or not.
Properties
| Property | Type | Description | Defined in |
|---|---|---|---|
agentDispatches | number | agent:end events on the live stream (logical dispatches). | packages/evals/src/benchmark.ts:159 |
costUsd | number | The target run's cost (judge runs are separate). | packages/evals/src/benchmark.ts:154 |
error? | WireError | - | packages/evals/src/benchmark.ts:166 |
invocations | number | agent:phase:end events on the live stream (model activations). | packages/evals/src/benchmark.ts:161 |
judgeCostUsd | number | The judge-run share this run's grading spent. | packages/evals/src/benchmark.ts:156 |
metrics | Record<string, number> | Extractor values for this run. | packages/evals/src/benchmark.ts:165 |
ordinal | number | 1-based ordinal in execution order. | packages/evals/src/benchmark.ts:144 |
rejectedReasons | string[] | Why the run was excluded; empty when scored. | packages/evals/src/benchmark.ts:150 |
runId | string | - | packages/evals/src/benchmark.ts:145 |
scored | boolean | Counted into the percentile series. | packages/evals/src/benchmark.ts:148 |
status | "ok" | "error" | "cancelled" | "exhausted" | "suspended" | - | packages/evals/src/benchmark.ts:146 |
usage | Usage | - | packages/evals/src/benchmark.ts:157 |
verdicts | GraderVerdict[] | - | packages/evals/src/benchmark.ts:162 |
verification | BenchmarkVerification | - | packages/evals/src/benchmark.ts:163 |
wallMs | number | run:start to run:end, from event timestamps. | packages/evals/src/benchmark.ts:152 |