27 lines
1.0 KiB
Markdown
27 lines
1.0 KiB
Markdown
# Diagnosis Eval Report
|
|
|
|
- Total cases: 8
|
|
- Passed cases: 8
|
|
- Pass rate: 100.00%
|
|
- Average tool calls: 1.63
|
|
- Average duration ms: 44875.00
|
|
|
|
## Verdict Distribution
|
|
|
|
- PASS: 2
|
|
- LOW_CONFID: 5
|
|
- REJECT: 1
|
|
|
|
## Cases
|
|
|
|
| Case | Result | Verdict | Gatekeeper | Composer | Claim Checks | Keywords | Tool Calls | Duration ms | Failed Checks |
|
|
| --- | --- | --- | --- | --- | ---: | --- | ---: | ---: | --- |
|
|
| payment-timeout | PASS | PASS | - | - | - | 3/3 | 3 | 42000 | - |
|
|
| mysql-pool-exhausted | PASS | LOW_CONFID | - | - | - | 3/3 | 2 | 51000 | - |
|
|
| redis-timeout | PASS | LOW_CONFID | - | - | - | 2/2 | 1 | 36000 | - |
|
|
| slow-response | PASS | PASS | - | - | - | 2/2 | 2 | 47000 | - |
|
|
| jvm-memory-risk | PASS | LOW_CONFID | - | - | - | 3/3 | 2 | 53000 | - |
|
|
| gatekeeper-fabricated-invocation | PASS | REJECT | fail | valid | 1 | 3/3 | 1 | 39000 | - |
|
|
| unsupported-claim-filtering | PASS | LOW_CONFID | pass | valid | 2 | 2/2 | 1 | 44000 | - |
|
|
| composer-fallback-no-raw-json | PASS | LOW_CONFID | pass | composer_malformed | 2 | 2/2 | 1 | 47000 | - |
|