Skip to content

perf(context): filter capture noise and scope content retrieval - #502

Merged
cdeust merged 117 commits into
mainfrom
perf/green-response-context-scope
Sep 8, 2026
Merged

cdeust merged 117 commits into
mainfrom
perf/green-response-context-scope

Conversation

@cdeust

@cdeust cdeust commented Sep 7, 2026 •

Copy link
Copy Markdown
Owner

Filter capture noise from methodology context and restrict fetch-by-ID access to the intended agent scope.

Includes current #501 slot/read fixes. Token ceilings remain unchanged; the separate 100-payload provider-token reduction claim is not established.

Validation and review (2026-09-08):

  • Reviewed the implemented diff for correctness, security, lifecycle and ordering; no unresolved source finding.
  • Integrated current main (including deps: refresh compatible dependencies and align plugin launcher pins #491) and every updated parent. Reviewed head: af717ab76d936065233d7d4ec3202b5105ff00aa.
  • Combined runtime tree: locked Ruff/format, craftsmanship and Pyright pass; full suite 8,013 passed, 257 skipped, one stale private dependency-fixture failure. Correcting that fixture without changing assertions yields 4/4 launcher tests passing. The added baseline setup and matrix tests pass 8/8. GitHub CI is running on each new head.
  • Full LongMemEval/LoCoMo comparison against main ca32ba50 is running on separate disposable databases with identical public datasets. It uses the repository's existing 0.005 tolerance; no acceptance result is claimed before completion.

Historical measurements apply to their recorded revisions and scopes. The current PR is authorized for merge after applicable checks; remaining optimization targets above are not presented as completed benefits.

The latest commit only triggers main-targeted security checks. Its tree 2abc1aa73492b4cbf2b1be51705aa73c302ed21a is identical to 5000f75e5d1ee14c5dd62db709a99f86792dab2d. The composed benchmark uses frozen commit 5000f75e5d1ee14c5dd62db709a99f86792dab2d, whose tree matches final PR #502.

@cdeust
cdeust marked this pull request as ready for review September 8, 2026 19:37

@cdeust cdeust left a comment

Copy link
Copy Markdown
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Completed source review of this implemented scope and its parent integration. No unresolved correctness, security or lifecycle finding. The description records limitations rather than claiming unmet optimization targets. Merge remains gated on current required CI and applicable baseline quality evidence. Review includes independent read-only review of the per-PR diff and combined locked local tests.

@cdeust
cdeust changed the base branch from perf/green-batch-memory-reads to main September 8, 2026 20:53

@cdeust cdeust left a comment

Copy link
Copy Markdown
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the CI-trigger commit: git diff from 5000f75 is empty and Git tree 2abc1aa73492b4cbf2b1be51705aa73c302ed21a is unchanged. Previous source review and test evidence apply to this identical tree. Required main-targeted checks are now running; no protection bypass is used.

@cdeust cdeust left a comment

Copy link
Copy Markdown
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed current head e7b86b4 including inherited test fix75fb7740.

The only source delta since the prior review is two PostgreSQL semantic test helpers. Both execute real production SQL with transaction-local exact scans; the scoring helper pins the real executor to the same pooled connection. All assertions are unchanged. Production runtime, scripts and benchmark trees are identical to the reviewed benchmark candidate.

Validation:35 native PostgreSQL tests passed (scoring-debias, near-duplicate pairs, indexed pools), zero skips; planner settings restore on both helpers. A rollback-only mutation removing the two real SQL auto-capture exclusions reverses curated/auto ranking and is rejected by the unchanged assertion. Ruff and formatting pass.

Empirical control: with2000 varied deleted vectors, default near-duplicate search missed a pair which exact search recovered. Forced ANN also changed recall score contributions. The precise CI curated-order inversion was not reproduced; it remains consistent with incomplete ANN membership, rather than proven as that incident's cause. These fixtures assert exact scoring/pair semantics, while ANN plans are covered separately. Fresh CI and the full baseline/candidate quality comparison remain merge gates.

Review recorded as COMMENT because this account owns the PR; no independent approval is claimed.

@cdeust
cdeust merged commit e81735d into main Sep 8, 2026
28 checks passed
@cdeust
cdeust deleted the perf/green-response-context-scope branch September 9, 2026 07:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants