27 lines
1.0 KiB
Markdown
27 lines
1.0 KiB
Markdown
## Why
|
|
|
|
AIOps now has traceable payload scope control and improved RAG retrieval, but it still lacks a quality gate comparable to Chat's verifier. A lightweight rule-based verifier can check the most important AIOps risks without introducing another LLM agent.
|
|
|
|
## What Changes
|
|
|
|
- Add a rule-based AIOps evaluation service that checks final report quality after the AIOps flow completes.
|
|
- Persist the evaluation under `diagnosis_session.self_evaluation.aiops_rule_evaluation`.
|
|
- Evaluate payload focus, evidence-tool coverage, and basic report completeness.
|
|
- Expose the evaluation through the existing trace API self-evaluation payload.
|
|
|
|
## Capabilities
|
|
|
|
### New Capabilities
|
|
|
|
None.
|
|
|
|
### Modified Capabilities
|
|
|
|
- `aiops-traceable-diagnosis-entry`: AIOps sessions include a lightweight rule evaluation for trace replay.
|
|
|
|
## Impact
|
|
|
|
- Affects AIOps session finalization and trace self-evaluation.
|
|
- Does not change AIOps API input, Agent flow topology, tool signatures, or database schema.
|
|
- Does not add an LLM verifier agent.
|