Rulvar API reference / @rulvar/evals / GraderContext
Interface: GraderContext
Defined in: packages/evals/src/case.ts:63
What a grader sees; judge() is the only channel back into the engine.
Properties
| Property | Type | Description | Defined in |
|---|---|---|---|
outcome | RunOutcome<Json> | The full target outcome, for status- and cost-aware graders. | packages/evals/src/case.ts:67 |
value | Json | undefined | The target run's structured output (RunOutcome.value). | packages/evals/src/case.ts:65 |
Methods
judge()
ts
judge(spec): Promise<Json>;Defined in: packages/evals/src/case.ts:73
Runs one judge invocation through the engine (journaled, budgeted, VCR-recordable) and returns the judge's structured output. Throws when the judge run itself does not settle ok.
Parameters
| Parameter | Type |
|---|---|
spec | JudgeSpec |
Returns
Promise<Json>