34 lines
1.6 KiB
Markdown
34 lines
1.6 KiB
Markdown
# RAG Retrieval Baseline
|
|
|
|
Generated at: `2026-07-06T13:37:59.726351+00:00`
|
|
|
|
## Aggregate
|
|
|
|
| Metric | Value |
|
|
|---|---:|
|
|
| Cases | 7 |
|
|
| Top K | 5 |
|
|
| Passed | 7 |
|
|
| Failed | 0 |
|
|
| Pass rate | 1.0 |
|
|
| LookupResult fixtures | 7 |
|
|
| Recall@K | 1.0 |
|
|
| Strong hit rate | 1.0 |
|
|
| Strong hits | 7 |
|
|
| Medium hits | 0 |
|
|
| Weak hits | 0 |
|
|
| Misses | 0 |
|
|
| Average first hit rank | 1.0 |
|
|
|
|
## Cases
|
|
|
|
| Case | Scenario | Pass | Hit | Attempt | Fallback | Evidence | First Expected Rank | Top Candidates | Failed Checks |
|
|
|---|---|---|---|---|---|---|---:|---|---|
|
|
| chat-mysql-connection-pool | chat | true | strong | FILTERED_VECTOR | | supported | 1 | 1:mysql-connection-pool<br>2:incident-diagnosis-flow | |
|
|
| chat-diagnosis-flow | chat | true | strong | FILTERED_VECTOR | | supported | 1 | 1:incident-diagnosis-flow<br>2:rag-chunk-context-reconstruction | |
|
|
| aiops-payment-latency-alert | aiops | true | strong | FILTERED_VECTOR | | supported | 1 | 1:payment-service-latency<br>2:mysql-connection-pool | |
|
|
| aiops-prometheus-alert-scope | aiops | true | strong | FILTERED_VECTOR | | supported | 1 | 1:aiops-alert-scope-control | |
|
|
| chat-rag-chunk-context | chat | true | strong | FILTERED_VECTOR | | supported | 1 | 1:rag-chunk-context-reconstruction<br>2:rag-breadcrumb-embedding-gap | |
|
|
| chat-l0-domain-hint | chat | true | strong | FILTERED_VECTOR | | supported | 1 | 1:rag-l0-domain-entity-hint<br>2:rag-l0-l1-fusion-ranking | |
|
|
| chat-l0-filter-fallback | chat | true | strong | UNFILTERED_VECTOR_RETRY | filtered_vector_low_quality | supported | 1 | 1:rag-l0-filter-fallback<br>2:rag-l0-domain-entity-hint | |
|