38 lines
1.1 KiB
Markdown
38 lines
1.1 KiB
Markdown
# Acceptance: diagnosis-eval-baseline-diff
|
|
|
|
## Classification
|
|
|
|
standard-light
|
|
|
|
## Task Status
|
|
|
|
| Task | Status | Notes |
|
|
| --- | --- | --- |
|
|
| Issue and OpenSpec setup | Done | Created slug-based issue and initial OpenSpec artifacts. |
|
|
| Implementation | Done | Added diff model, comparator, writer, docs, sample outputs, and focused tests. |
|
|
| Verification | Done | Diff/evaluator tests, compile verification, and OpenSpec validation passed. |
|
|
|
|
## Current State
|
|
|
|
- Baseline diff is implemented for aggregate metrics, verdict distribution, case-level state, keyword coverage, evidence coverage, missing cases, and new cases.
|
|
- JSON and Markdown diff output are available.
|
|
- No production runtime behavior has been changed.
|
|
|
|
## Verification
|
|
|
|
### Script Verification
|
|
|
|
- Command: `mvn -q "-Dtest=DiagnosisEvalBaselineDiffTest" test`
|
|
- Result: passed
|
|
- Notes: Also verified with `DiagnosisTraceEvaluatorTest`.
|
|
|
|
### Static Verification
|
|
|
|
- Command: `mvn -q -DskipTests compile`
|
|
- Result: passed
|
|
|
|
### OpenSpec Verification
|
|
|
|
- Command: `openspec validate diagnosis-eval-baseline-diff --strict`
|
|
- Result: passed
|