17 lines
878 B
Markdown
17 lines
878 B
Markdown
## MODIFIED Requirements
|
|
|
|
### Requirement: Verifier SHALL be observable
|
|
The Verifier's verdict SHALL be persisted for observability.
|
|
|
|
#### Scenario: prompt audit written to verifier evaluation
|
|
- **WHEN** the Chat verifier evaluation is persisted
|
|
- **THEN** the system SHALL include a `prompt_audit` object under `diagnosis_session.self_evaluation.verifier_evaluation`
|
|
- **AND** `prompt_audit.version` SHALL identify the Chat prompt audit catalog version
|
|
- **AND** `prompt_audit.prompts` SHALL include the planner, executor, verifier, and composer prompt names and versions
|
|
- **AND** full prompt text SHALL NOT be persisted in `prompt_audit`
|
|
|
|
#### Scenario: prompt audit available on fallback paths
|
|
- **WHEN** Chat verifier parsing fails, Composer parsing fails, or Chat produces a degraded answer
|
|
- **THEN** the persisted verifier evaluation SHALL still include `prompt_audit`
|
|
|