RELAY / Output evaluation

AI Quality Bench

Fixed sample output. Real contract checks. No live model call.

Interactive here

FICTIONAL RECORDSBrowser-only example. Nothing is sent or stored on a server.

Sample model response

Known source: fixture:inspection-01 / west approach inspection

Contract passed

5 / 5

Strict JSON object

Parsed without repairs

Summary contract

Summary must contain 10 to 240 characters

Bounded action

Only review or hold; a model cannot grant execution authority

Confidence range

Integer from 0 to 100; model confidence is not evidence

Known fixture reference

One allow-listed synthetic source; unknown references fail

What this evaluation establishes

These deterministic checks validate a structured-output contract; they do not establish factual truth, model intelligence or production reliability. The response is a fixed synthetic sample. No model is called. The scoring pattern is adapted from a real content evaluation harness Frank built.

Skip to working example

UNDERSTUDYTHE DESCENT