zhuyongxin
7ae9707a3b
Persist provider reasoning and assistant text separately on agent_reasoning_audit (DeepSeekAssistantMessage path), extract diagnosis_run.conclusion, enrich RAG tool audit (step_id/query/qualityScore), gate empty mysql tools, drop devtools, and align MVP docs after live E2E verification.
2.0 KiB
2.0 KiB
RAG Retrieval Baseline
Generated at: 2026-07-28T06:55:09.379164+00:00
Aggregate
| Metric | Value |
|---|---|
| Cases | 7 |
| Top K | 5 |
| Passed | 7 |
| Failed | 0 |
| Pass rate | 1.0 |
| LookupResult fixtures | 7 |
| Recall@K | 1.0 |
| Strong hit rate | 1.0 |
| Strong hits | 7 |
| Medium hits | 0 |
| Weak hits | 0 |
| Misses | 0 |
| Average first hit rank | 1.0 |
Cases
| Case | Scenario | Pass | Hit | Attempt | Fallback | Evidence | First Expected Rank | Top Candidates | Failed Checks |
|---|---|---|---|---|---|---|---|---|---|
| chat-mysql-connection-pool | chat | true | strong | FILTERED_VECTOR | supported | 1 | 1:mysql-connection-pool 2:mysql-connection-pool |
||
| chat-diagnosis-flow | chat | true | strong | FILTERED_VECTOR | supported | 1 | 1:incident-diagnosis-flow 2:incident-diagnosis-flow |
||
| aiops-payment-latency-alert | aiops | true | strong | FILTERED_VECTOR | supported | 1 | 1:payment-service-latency 2:aiops-alert-scope-control 3:payment-service-latency 4:aiops-alert-scope-control |
||
| aiops-prometheus-alert-scope | aiops | true | strong | FILTERED_VECTOR | supported | 1 | 1:aiops-alert-scope-control 2:payment-service-latency 3:payment-service-latency 4:aiops-alert-scope-control |
||
| chat-rag-chunk-context | chat | true | strong | FILTERED_VECTOR | supported | 1 | 1:rag-chunk-context-reconstruction 2:rag-l0-domain-entity-hint 3:rag-chunk-context-reconstruction 4:rag-l0-domain-entity-hint |
||
| chat-l0-domain-hint | chat | true | strong | FILTERED_VECTOR | supported | 1 | 1:rag-l0-domain-entity-hint 2:rag-chunk-context-reconstruction 3:rag-l0-domain-entity-hint 4:rag-chunk-context-reconstruction |
||
| chat-l0-filter-fallback | chat | true | strong | UNFILTERED_VECTOR_RETRY | filtered_vector_low_quality | supported | 1 | 1:rag-l0-filter-fallback 2:rag-l0-filter-decoy 3:rag-l0-domain-entity-hint 4:rag-l0-domain-entity-hint 5:rag-chunk-context-reconstruction |