Files
T

878 B

MODIFIED Requirements

Requirement: Verifier SHALL be observable

The Verifier's verdict SHALL be persisted for observability.

Scenario: prompt audit written to verifier evaluation

  • WHEN the Chat verifier evaluation is persisted
  • THEN the system SHALL include a prompt_audit object under diagnosis_session.self_evaluation.verifier_evaluation
  • AND prompt_audit.version SHALL identify the Chat prompt audit catalog version
  • AND prompt_audit.prompts SHALL include the planner, executor, verifier, and composer prompt names and versions
  • AND full prompt text SHALL NOT be persisted in prompt_audit

Scenario: prompt audit available on fallback paths

  • WHEN Chat verifier parsing fails, Composer parsing fails, or Chat produces a degraded answer
  • THEN the persisted verifier evaluation SHALL still include prompt_audit