Files
2026-07-04 23:51:43 +08:00

810 B

Diagnosis Eval Harness Evidence

Evidence

Source Evidence Conclusion Reported
openspec/specs/evidence-trace-hardening/spec.md Defines stable evidence states and summary behavior Evaluation can rely on trace semantics rather than ad hoc log parsing Yes
mvp/demo/README.md Documents an end-to-end demo flow with chat, trace, and feedback Existing demo flow provides the runtime story, but not a reusable evaluation baseline Yes
DiagnosisTraceService Aggregates session, steps, tools, and self-evaluation Trace response shape can be reused as evaluation input Yes
ToolTraceSummaryService Builds verifier-facing evidence summaries from persisted tool rows Evaluator can check evidence coverage through persisted trace artifacts Yes