Rulvar API reference

---

Rulvar API reference / @rulvar/evals / runBenchmark

Function: runBenchmark()

function runBenchmark(
   engine, 
   spec, 
options?): Promise<BenchmarkReport>;

Defined in: packages/evals/src/benchmark.ts:325

Runs the spec's repeats sequentially and reports the verified series. Throws only for spec defects (invalid repeats, a throwing grader or extractor); everything a run does wrong lands in its record, and a target-run envelope refusal ends the series monotonically with the completed repeats preserved (report.refusal).

Parameters

Parameter	Type
engine	Engine
spec	BenchmarkSpec
options	RunBenchmarkOptions

Returns

Promise<BenchmarkReport>