Rulvar API reference / @rulvar/evals / BenchmarkVerification
Interface: BenchmarkVerification
Defined in: packages/evals/src/benchmark.ts:117
The replay-strict verification verdict of one run.
Properties
| Property | Type | Description | Defined in |
|---|---|---|---|
determinismWarnings | number | Workflow-provenance determinism warnings across live and replay. | packages/evals/src/benchmark.ts:136 |
outputHash? | string | The journaled output digest, when the settle recorded one. | packages/evals/src/benchmark.ts:125 |
outputReproduced | boolean | Digest equality where comparable. A run that settled ok with a value but no journaled digest (a non-JCS-serializable result) fails this clause explicitly: a benchmark demands comparable outputs. A run with no output value passes it vacuously. | packages/evals/src/benchmark.ts:134 |
pureReplay | boolean | The dry-run resume had zero misses and zero reruns. | packages/evals/src/benchmark.ts:121 |
reasons | string[] | Machine-readable failure reasons; empty when verified. | packages/evals/src/benchmark.ts:138 |
replayedOutputHash? | string | The digest of the replayed result, when hashable. | packages/evals/src/benchmark.ts:127 |
statusReproduced | boolean | The replayed settle status equals the journaled one. | packages/evals/src/benchmark.ts:123 |
verified | boolean | Every clause below held. | packages/evals/src/benchmark.ts:119 |