SuperBizAgent-java/eval/rag-retrieval/reports/baseline.md

RAG Retrieval Baseline

Generated at: 2026-07-06T13:37:59.726351+00:00

Aggregate

Metric	Value
Cases	7
Top K	5
Passed	7
Failed	0
Pass rate	1.0
LookupResult fixtures	7
Recall@K	1.0
Strong hit rate	1.0
Strong hits	7
Medium hits	0
Weak hits	0
Misses	0
Average first hit rank	1.0

Cases

Case	Scenario	Pass	Hit	Attempt	Fallback	Evidence	First Expected Rank	Top Candidates	Failed Checks
chat-mysql-connection-pool	chat	true	strong	FILTERED_VECTOR		supported	1	1:mysql-connection-pool 2:incident-diagnosis-flow
chat-diagnosis-flow	chat	true	strong	FILTERED_VECTOR		supported	1	1:incident-diagnosis-flow 2:rag-chunk-context-reconstruction
aiops-payment-latency-alert	aiops	true	strong	FILTERED_VECTOR		supported	1	1:payment-service-latency 2:mysql-connection-pool
aiops-prometheus-alert-scope	aiops	true	strong	FILTERED_VECTOR		supported	1	1:aiops-alert-scope-control
chat-rag-chunk-context	chat	true	strong	FILTERED_VECTOR		supported	1	1:rag-chunk-context-reconstruction 2:rag-breadcrumb-embedding-gap
chat-l0-domain-hint	chat	true	strong	FILTERED_VECTOR		supported	1	1:rag-l0-domain-entity-hint 2:rag-l0-l1-fusion-ranking
chat-l0-filter-fallback	chat	true	strong	UNFILTERED_VECTOR_RETRY	filtered_vector_low_quality	supported	1	1:rag-l0-filter-fallback 2:rag-l0-domain-entity-hint