Skip to content

docs(memory): archive semantic evaluation v3 - #1322

Merged
XingYu-Zhong merged 1 commit into
KunAgent:developfrom
SunwardL:codex/closeout-semantic-memory-evaluation-v3
Sep 15, 2026
Merged

XingYu-Zhong merged 1 commit into
KunAgent:developfrom
SunwardL:codex/closeout-semantic-memory-evaluation-v3

Conversation

@SunwardL

Copy link
Copy Markdown
Contributor

Summary

Close out the already-merged P2-A v3 semantic Memory evaluation from PR #1317 by syncing its delta into the canonical specification and archiving the completed OpenSpec change.

PR #1317 intentionally ended at a development no-go: no candidate was locked, holdout was not run, P2-B remains blocked, and production Memory retrieval was unchanged. The change directory remained active after merge, while the main spec still described the older v2 evaluation contract.

Changes

  • Sync the v3 evaluation contract into semantic-memory-retrieval-evaluation:
    • frozen zero-lexical-overlap positive stratum and cross-split near-duplicate rejection;
    • post-fix(memory): gate weak lexical relevance #1308 lexical baseline;
    • deterministic paired-bootstrap lower-bound gates;
    • fixed similarity/margin/fusion grids;
    • evaluator-only semantic-gated, lexical-veto, and margin candidates;
    • independent zero-overlap Recall reporting.
  • Resolve a pre-existing specification conflict before sync:
    • rename A low-cost lexical enhancement is a first-class candidate to A low-cost lexical enhancement is exploratory;
    • preserve terminology-map evaluation as a separately reported candidate;
    • explicitly prevent it from becoming the primary candidate or authorizing production changes by itself, matching v3 task 2.6 and the implemented evaluator contract.
  • Close the two conditional delivery tasks:
    • 5.3 is complete by its fail-closed branch: development produced no eligible candidate, so no lock was generated and holdout was not run;
    • 5.5 records the final green Quality and platform checks from PR P2-A-v3-evaluator-safety-and-no-go #1317.
  • Archive the change as 2026-09-15-refine-kun-semantic-memory-evaluation-v3.

Scope

Tests

  • openspec validate refine-kun-semantic-memory-evaluation-v3 --type change --strict --no-interactive --json
  • openspec validate --specs --strict --no-interactive --json
  • openspec validate --archived --strict --no-interactive --json
  • npm run check:file-lines
  • git diff --check

All validations passed. PR #1317's Quality gate and Windows, macOS, Linux x64, Linux ARM64, and final PR gate also passed before merge.

@SunwardL SunwardL changed the title docs(memory):archive-semantic-evaluation-v3 docs(memory): archive semantic evaluation v3 Sep 14, 2026
@XingYu-Zhong
XingYu-Zhong merged commit 8582d53 into KunAgent:develop Sep 15, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants