1.4 KiB
1.4 KiB
Payment Timeout Acceptance Case
Goal
Validate that the MVP can diagnose a payment timeout incident and expose the complete trace for replay.
Input
- Session id:
mvp-demo-payment-timeout-001 - Question:
支付接口最近出现超时,请结合知识库、日志和指标判断可能原因,并给出修复建议。 - Profile:
mvp-demo
Acceptance Criteria
- Chat returns a successful answer with the same session id.
- Trace API returns session metadata, final answer, ordered agent steps, and ordered tool invocations.
- Trace contains enough evidence to explain which tools were used and whether verifier/self-evaluation was persisted.
- Feedback can be submitted for the same session id.
- A follow-up trace query shows the persisted feedback value.
Trace Fields To Inspect
data.session.querydata.session.answerdata.session.selfEvaluationdata.session.feedbackdata.steps[*].agentNamedata.steps[*].thoughtdata.toolInvocations[*].toolNamedata.toolInvocations[*].inputParamsdata.toolInvocations[*].outputPreviewdata.toolInvocations[*].retrievalDetailsdata.summary
Known Limits
- This case is not a full offline test. It still requires valid infrastructure for chat, persistence, vector search, and model calls.
- Mock logs and metrics are enabled by the
mvp-demoprofile to make those evidence tools repeatable. - Sensitive configuration cleanup is deferred by current MVP priority.