66 lines
2.8 KiB
Markdown
66 lines
2.8 KiB
Markdown
# MVP Demo Trace Acceptance
|
|
|
|
## Result
|
|
|
|
Accepted for implementation scope.
|
|
|
|
## Verification
|
|
|
|
### Static Verification
|
|
|
|
- Command: `mvn -q -DskipTests compile`
|
|
- Result: passed
|
|
- Notes: New trace controller, service, DTO, profile, verifier fallback, and test sources compile with the project.
|
|
|
|
### Script Verification
|
|
|
|
- Command: `mvn -q "-Dtest=DiagnosisTraceServiceTest,ChatServiceSupervisorAgentTest" test`
|
|
- Result: passed
|
|
- Notes: Covers successful trace aggregation, missing-session 404 path via `SessionNotFoundException`, low-confidence no-retry behavior, method-tool injection, and verifier fallback when Supervisor skips `chat_verifier`.
|
|
|
|
### OpenSpec Verification
|
|
|
|
- Command: `openspec validate mvp-demo-trace-acceptance --strict`
|
|
- Result: passed
|
|
|
|
### GitNexus Verification
|
|
|
|
- Result: skipped by user decision
|
|
- Notes: User requested subsequent project flow to bypass GitNexus.
|
|
|
|
### Manual / Runtime Verification
|
|
|
|
- Steps: Follow `mvp/demo/README.md` with `--spring.profiles.active=mvp-demo`.
|
|
- Result: passed
|
|
- Notes:
|
|
- Session `mvp-demo-payment-timeout-20260703-rerun2` completed as `SUCCESS`.
|
|
- Chat request returned `code=200`, `success=true`, and the same `sessionId`.
|
|
- Chat duration was `96316 ms`; persisted session duration was `95028 ms`.
|
|
- Trace API returned `code=200`, `returnedSteps=13`, `returnedTools=12`, `hasVerifier=true`, and `verifierVerdict=LOW_CONFID`.
|
|
- Trace agents included `planner,executor,verifier`.
|
|
- Trace tools included `lookup_knowledge,query_logs,query_metrics`.
|
|
- Feedback submission returned success, and a follow-up trace query showed `feedback=useful`.
|
|
- MySQL verification confirmed `agent_step` count `13` with agents `executor,planner,verifier`.
|
|
- MySQL verification confirmed `tool_invocation` count `12` with tools `lookup_knowledge,query_logs,query_metrics`.
|
|
|
|
## Completed Scope
|
|
|
|
- Added `GET /api/diagnosis/{sessionId}/trace`.
|
|
- Added read-only trace aggregation from persisted diagnosis tables.
|
|
- Added `mvp-demo` profile overlay.
|
|
- Added payment-timeout demo acceptance documentation.
|
|
- Added MVP note for interview storytelling.
|
|
- Added verifier fallback so runtime trace remains complete when Supervisor returns without `verifier_output`.
|
|
|
|
## Known Limits
|
|
|
|
- `mvp-demo` is not a fully offline mock runtime.
|
|
- Runtime still depends on available MySQL, Redis, Milvus/Zilliz, model, and embedding configuration.
|
|
- Sensitive configuration cleanup remains intentionally deferred.
|
|
- Supervisor can still make inefficient routing choices inside a single round; `ChatService` now invokes `chat_verifier` as a fallback when Supervisor returns without `verifier_output`, so trace completeness is preserved for the MVP demo.
|
|
|
|
## Handoff
|
|
|
|
- Runtime demo passed with current infrastructure.
|
|
- OpenSpec archive confirmation: requested by user after successful rerun.
|