Skip to content

Rulvar API reference


Rulvar API reference / @rulvar/evals / runEvalSuite

Function: runEvalSuite() ​

ts
function runEvalSuite(
   engine, 
   cases, 
options?): Promise<EvalSuiteResult>;

Defined in: packages/evals/src/case.ts:317

Runs cases sequentially (deterministic journal and cassette order) and aggregates. Duplicate workflow names get '#<ordinal>' suffixes so every result row and judge journal is unambiguous.

Parameters ​

ParameterType
engineEngine
casesEvalCase[]
optionsRunEvalSuiteOptions

Returns ​

Promise&lt;EvalSuiteResult&gt;