Rulvar API reference / @rulvar/evals / CanaryReport
Interface: CanaryReport
Defined in: packages/evals/src/canary.ts:54
Properties
| Property | Type | Description | Defined in |
|---|---|---|---|
allOk | boolean | True only when every probe settled ok. A fingerprint containing a non-ok probe status is a measurement artifact (budget exhaustion, an envelope refusal, transient provider failure), NOT evidence of model drift: never feed it to flipStaleOnCanaryDrift. | packages/evals/src/canary.ts:62 |
fingerprint | string | - | packages/evals/src/canary.ts:55 |
probes | { prompt: string; status: "ok" | "error" | "cancelled" | "exhausted" | "suspended" | "refused"; }[] | One row per probe; 'refused' means the aggregate envelope refused the probe before it started (v1.17.0 review P1-5): the loop keeps walking so completed probe evidence survives, and allOk is false. | packages/evals/src/canary.ts:68 |