From 265874211981326797a697ae08c9059089f15328 Mon Sep 17 00:00:00 2001 From: aruo <40362743+zyongxin@users.noreply.github.com> Date: Sun, 5 Jul 2026 13:12:47 +0800 Subject: [PATCH] docs: archive rag and aiops query changes --- .../.openspec.yaml | 0 .../design.md | 0 .../proposal.md | 0 .../aiops-traceable-diagnosis-entry/spec.md | 0 .../tasks.md | 0 .../.openspec.yaml | 0 .../design.md | 0 .../proposal.md | 0 .../specs/rag-retrieval-evaluation/spec.md | 0 .../tasks.md | 0 .../aiops-traceable-diagnosis-entry/spec.md | 17 ++++++++++++++++ .../specs/rag-retrieval-evaluation/spec.md | 20 +++++++++++++++++++ 12 files changed, 37 insertions(+) rename openspec/changes/{aiops-payload-query-augmentation => archive/2026-07-05-aiops-payload-query-augmentation}/.openspec.yaml (100%) rename openspec/changes/{aiops-payload-query-augmentation => archive/2026-07-05-aiops-payload-query-augmentation}/design.md (100%) rename openspec/changes/{aiops-payload-query-augmentation => archive/2026-07-05-aiops-payload-query-augmentation}/proposal.md (100%) rename openspec/changes/{aiops-payload-query-augmentation => archive/2026-07-05-aiops-payload-query-augmentation}/specs/aiops-traceable-diagnosis-entry/spec.md (100%) rename openspec/changes/{aiops-payload-query-augmentation => archive/2026-07-05-aiops-payload-query-augmentation}/tasks.md (100%) rename openspec/changes/{rag-breadcrumb-embedding-acceptance => archive/2026-07-05-rag-breadcrumb-embedding-acceptance}/.openspec.yaml (100%) rename openspec/changes/{rag-breadcrumb-embedding-acceptance => archive/2026-07-05-rag-breadcrumb-embedding-acceptance}/design.md (100%) rename openspec/changes/{rag-breadcrumb-embedding-acceptance => archive/2026-07-05-rag-breadcrumb-embedding-acceptance}/proposal.md (100%) rename openspec/changes/{rag-breadcrumb-embedding-acceptance => archive/2026-07-05-rag-breadcrumb-embedding-acceptance}/specs/rag-retrieval-evaluation/spec.md (100%) rename openspec/changes/{rag-breadcrumb-embedding-acceptance => archive/2026-07-05-rag-breadcrumb-embedding-acceptance}/tasks.md (100%) diff --git a/openspec/changes/aiops-payload-query-augmentation/.openspec.yaml b/openspec/changes/archive/2026-07-05-aiops-payload-query-augmentation/.openspec.yaml similarity index 100% rename from openspec/changes/aiops-payload-query-augmentation/.openspec.yaml rename to openspec/changes/archive/2026-07-05-aiops-payload-query-augmentation/.openspec.yaml diff --git a/openspec/changes/aiops-payload-query-augmentation/design.md b/openspec/changes/archive/2026-07-05-aiops-payload-query-augmentation/design.md similarity index 100% rename from openspec/changes/aiops-payload-query-augmentation/design.md rename to openspec/changes/archive/2026-07-05-aiops-payload-query-augmentation/design.md diff --git a/openspec/changes/aiops-payload-query-augmentation/proposal.md b/openspec/changes/archive/2026-07-05-aiops-payload-query-augmentation/proposal.md similarity index 100% rename from openspec/changes/aiops-payload-query-augmentation/proposal.md rename to openspec/changes/archive/2026-07-05-aiops-payload-query-augmentation/proposal.md diff --git a/openspec/changes/aiops-payload-query-augmentation/specs/aiops-traceable-diagnosis-entry/spec.md b/openspec/changes/archive/2026-07-05-aiops-payload-query-augmentation/specs/aiops-traceable-diagnosis-entry/spec.md similarity index 100% rename from openspec/changes/aiops-payload-query-augmentation/specs/aiops-traceable-diagnosis-entry/spec.md rename to openspec/changes/archive/2026-07-05-aiops-payload-query-augmentation/specs/aiops-traceable-diagnosis-entry/spec.md diff --git a/openspec/changes/aiops-payload-query-augmentation/tasks.md b/openspec/changes/archive/2026-07-05-aiops-payload-query-augmentation/tasks.md similarity index 100% rename from openspec/changes/aiops-payload-query-augmentation/tasks.md rename to openspec/changes/archive/2026-07-05-aiops-payload-query-augmentation/tasks.md diff --git a/openspec/changes/rag-breadcrumb-embedding-acceptance/.openspec.yaml b/openspec/changes/archive/2026-07-05-rag-breadcrumb-embedding-acceptance/.openspec.yaml similarity index 100% rename from openspec/changes/rag-breadcrumb-embedding-acceptance/.openspec.yaml rename to openspec/changes/archive/2026-07-05-rag-breadcrumb-embedding-acceptance/.openspec.yaml diff --git a/openspec/changes/rag-breadcrumb-embedding-acceptance/design.md b/openspec/changes/archive/2026-07-05-rag-breadcrumb-embedding-acceptance/design.md similarity index 100% rename from openspec/changes/rag-breadcrumb-embedding-acceptance/design.md rename to openspec/changes/archive/2026-07-05-rag-breadcrumb-embedding-acceptance/design.md diff --git a/openspec/changes/rag-breadcrumb-embedding-acceptance/proposal.md b/openspec/changes/archive/2026-07-05-rag-breadcrumb-embedding-acceptance/proposal.md similarity index 100% rename from openspec/changes/rag-breadcrumb-embedding-acceptance/proposal.md rename to openspec/changes/archive/2026-07-05-rag-breadcrumb-embedding-acceptance/proposal.md diff --git a/openspec/changes/rag-breadcrumb-embedding-acceptance/specs/rag-retrieval-evaluation/spec.md b/openspec/changes/archive/2026-07-05-rag-breadcrumb-embedding-acceptance/specs/rag-retrieval-evaluation/spec.md similarity index 100% rename from openspec/changes/rag-breadcrumb-embedding-acceptance/specs/rag-retrieval-evaluation/spec.md rename to openspec/changes/archive/2026-07-05-rag-breadcrumb-embedding-acceptance/specs/rag-retrieval-evaluation/spec.md diff --git a/openspec/changes/rag-breadcrumb-embedding-acceptance/tasks.md b/openspec/changes/archive/2026-07-05-rag-breadcrumb-embedding-acceptance/tasks.md similarity index 100% rename from openspec/changes/rag-breadcrumb-embedding-acceptance/tasks.md rename to openspec/changes/archive/2026-07-05-rag-breadcrumb-embedding-acceptance/tasks.md diff --git a/openspec/specs/aiops-traceable-diagnosis-entry/spec.md b/openspec/specs/aiops-traceable-diagnosis-entry/spec.md index 505b956..d5b8a88 100644 --- a/openspec/specs/aiops-traceable-diagnosis-entry/spec.md +++ b/openspec/specs/aiops-traceable-diagnosis-entry/spec.md @@ -42,3 +42,20 @@ The system SHALL continue using existing `agent_step` and `tool_invocation` pers #### Scenario: AIOps uses evidence tools - **WHEN** the AIOps flow calls available evidence tools - **THEN** existing hooks and recorders persist agent steps and tool invocations under the resolved AIOps session id + +### Requirement: AIOps payload prompts SHALL include a recommended knowledge query +When an AIOps request includes alert payload fields, the system SHALL include a deterministic recommended knowledge retrieval query in the prompt sent to the Agent flow. + +#### Scenario: Payload-targeted prompt includes knowledge query +- **WHEN** an AIOps request contains alert name, service, severity, or description +- **THEN** the generated task prompt SHALL include a recommended `lookup_knowledge` query derived from the supplied payload fields + +#### Scenario: Query skips blank fields +- **WHEN** some AIOps payload fields are blank +- **THEN** the recommended knowledge query SHALL omit those blank fields +- **AND** it SHALL preserve the non-blank alert-specific terms + +#### Scenario: Auto-discovery prompt does not invent payload query +- **WHEN** an AIOps request does not include alert payload fields +- **THEN** the generated task prompt SHALL remain in auto-discovery mode +- **AND** it SHALL not include a payload-derived recommended knowledge query diff --git a/openspec/specs/rag-retrieval-evaluation/spec.md b/openspec/specs/rag-retrieval-evaluation/spec.md index 9689f18..80e098f 100644 --- a/openspec/specs/rag-retrieval-evaluation/spec.md +++ b/openspec/specs/rag-retrieval-evaluation/spec.md @@ -93,3 +93,23 @@ The offline RAG retrieval baseline SHALL remain runnable after the main retrieva #### Scenario: Baseline is checked during migration - **WHEN** the VectorStore integration change is implemented - **THEN** the existing offline baseline evaluator SHALL be run and its generated report noise SHALL not be committed unless the baseline intentionally changes + +### Requirement: Retrieval evaluation SHALL provide live post-reindex acceptance +The retrieval evaluation system SHALL provide an opt-in live acceptance flow for validating retrieval behavior after embedding input changes require a knowledge-base reindex. + +#### Scenario: Live acceptance requires a running service +- **WHEN** live retrieval acceptance is run +- **THEN** it SHALL call the configured Spring Boot retrieval endpoint +- **AND** it SHALL not be required by the offline fixture baseline + +#### Scenario: Live acceptance records retrieval evidence +- **WHEN** a live retrieval case is executed +- **THEN** the report SHALL include the query, requested topK, result count, top candidate titles or sources, score labels, and raw response fields needed for review + +#### Scenario: Reindex prerequisite is documented +- **WHEN** a developer prepares to validate breadcrumb-aware embedding behavior +- **THEN** the repository SHALL explain that existing vectors must be reindexed before live validation can reflect the new embedding text + +#### Scenario: Live report is reviewable +- **WHEN** the live acceptance script completes +- **THEN** it SHALL write JSON and Markdown outputs that can be inspected or attached to interview evidence