Skip to content

rulvar API reference


rulvar API reference / @rulvar/evals / Grader

Interface: Grader

Defined in: packages/evals/src/case.ts:74

@rulvar/evals: quality measurement strictly on the public APIs (L6). EvalCase with golden, rubric, and LLM-judge graders; judge calls run through the engine (journaled, budgeted, VCR-recordable), so eval CI is deterministic; config-matrix comparison reports pass-rate, cost, and latency per cell. Matrix sweeps feeding ModelKnowledge, the eval-committer identity, and canary fingerprints are the M11 round-3 extensions.

Properties

PropertyTypeDefined in
namestringpackages/evals/src/case.ts:75

Methods

grade()

ts
grade(context): 
  | GraderVerdict
| Promise<GraderVerdict>;

Defined in: packages/evals/src/case.ts:76

Parameters

ParameterType
contextGraderContext

Returns

| GraderVerdict | Promise&lt;GraderVerdict&gt;