1.2 KiB
1.2 KiB
MODIFIED Requirements
Requirement: MVP demo SHALL be reproducible for interviews
The MVP demo SHALL provide a repeatable way to show a diagnosis answer, trace, verifier evaluation, and feedback.
Scenario: interview demo check script records an evidence bundle
- WHEN the user runs the interview demo check script against a running
mvp-demoservice - THEN the script SHALL submit a fixed Chat diagnosis request
- AND it SHALL fetch the trace for the same session id
- AND it SHALL submit useful feedback for that session
- AND it SHALL write chat, trace, feedback, and summary outputs under
mvp/demo/output/
Scenario: interview demo check fails with actionable readiness output
- WHEN the target service is not reachable
- THEN the script SHALL fail before issuing diagnosis requests
- AND the failure message SHALL name the base URL and the expected startup profile
Scenario: interview documentation explains audit fields
- WHEN an interviewer asks how prompt or Gatekeeper changes are audited
- THEN the demo documentation SHALL point to
prompt_audit.versionandgatekeeper_result.rule_set_version - AND it SHALL explain that deterministic eval fixtures are the regression source of truth