878 B
878 B
MODIFIED Requirements
Requirement: Verifier SHALL be observable
The Verifier's verdict SHALL be persisted for observability.
Scenario: prompt audit written to verifier evaluation
- WHEN the Chat verifier evaluation is persisted
- THEN the system SHALL include a
prompt_auditobject underdiagnosis_session.self_evaluation.verifier_evaluation - AND
prompt_audit.versionSHALL identify the Chat prompt audit catalog version - AND
prompt_audit.promptsSHALL include the planner, executor, verifier, and composer prompt names and versions - AND full prompt text SHALL NOT be persisted in
prompt_audit
Scenario: prompt audit available on fallback paths
- WHEN Chat verifier parsing fails, Composer parsing fails, or Chat produces a degraded answer
- THEN the persisted verifier evaluation SHALL still include
prompt_audit