1.2 KiB
1.2 KiB
diagnosis-eval-demo-gatekeeper-closure Brief
Background
The Chat evidence pipeline already had Executor V2 structured output, deterministic Gatekeeper validation, Verifier claim checks, and Composer final rendering. The missing piece was an interview-ready acceptance story that made the anti-hallucination behavior easy to demonstrate and regress.
Goal
Close the next three interview-readiness gaps together:
- diagnosis eval fixture matrix
- stable demo data set
- Gatekeeper rule configuration and audit version
Scope
- Expand
mvp/evalwith matrix-oriented cases, fixtures, and baseline reports. - Add stable demo request payloads and scenario documentation.
- Add a lightweight local Gatekeeper rule catalog with
rule_set_versionand rule metadata ingatekeeper_result. - Update architecture, demo, and eval docs to describe the current implementation.
Non-goals
- No new public HTTP endpoint.
- No new database table.
- No Planner
scope_contract. - No Gatekeeper retry loop.
- No remote or dynamic rule execution engine.
OpenSpec
- Change:
openspec/changes/diagnosis-eval-demo-gatekeeper-closure - Interface impact: L2 internal contract change.