Repository navigation
Reconcile retained data-quality evidence with current gap counts - #976
Draft
seathatflowsinourveins wants to merge 3 commits into
Draft
seathatflowsinourveins wants to merge 3 commits into
seathatflowsinourveins wants to merge 3 commits into
Conversation
Join an explicit layer gap-resolution supplement to the historical crosswalk after checking source text/scope and every retained evidence hash. Preserve historical judgments and all unrelated matrix rows. Five later-evidenced absence claims settle; the measured Temporal scope removes executable work while Modal remains open pending login. Regenerate the matrix with six executable entries becoming zero and nine open entries becoming four. Add a failing-before stale-count regression plus changed/missing evidence, wrong scope and partial-gap controls. Retain the reconciliation receipt and pinned vendor citations. The Dagu/Pandera/DuckDB/Temporal runs are historical native/local evidence, not new host/runtime or production-data acceptance. No winner/pin/platform-status changes. Touched module: 67 tests, zero skips. FULL validate: 70 components, 11417 hashed files, 4 profiles, 239 receipts, exit0. Sources and boundaries are in the dated decision record.
Regenerate new-host-grand-list JSON and Markdown through scripts/new_host_grand_list.py --write, then keep their registered manifest hashes current. This dependent export carries the reconciled six-to-zero executable and nine-to-four open gap counts. CI's existing --check reproduced stale outputs on the previous head; after generation --check passes and its 36-test module passes. No source, winner, pin, host status or gap-evidence decision changes. The current matrix and retained reconciliation remain unchanged.
Correct the four architecture citations shifted by the landscape resolution reference and regenerate the handbook through its unchanged native builder. Retain the failed checks, earlier output hashes and regeneration observations; refresh the four affected evidence registrations. Supported source: native-agent-stack main 0947b01, scripts/build_new_wsl_handbook.py:1334-1374 and tests/test_architecture_pin_source.py:178-196. Winner identities, pin values, gap decisions and host-acceptance evidence stay unchanged. Validation: both failures reproduced before correction; 92 architecture and handbook tests passed; supported builder write/check and FULL validate passed.
6 of 8 tasks
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Scope
The component matrix still counted six executable data-quality/orchestration gaps from its September historical crosswalk, although later native and local receipts supplied their executable evidence. This PR joins an explicit, hash-bound layer supplement and regenerates the matrix: executable gaps 6→0, open gaps 9→4. Five absence claims settle; Temporal's measured portion is credited while Modal remains open for user login. The historical judgments, all 31 other matrix rows, winners, pins and platform statuses stay intact.
0947b01289dcaa9157aa38392a94cf00f592b86d.886fb41de1d8c01bfeb01b4057042aaaeed5c8d0; three forward commits on that base, including the dependent host-export and source-citation refreshes.lane:shared; the trading acknowledgement is required before the CC's landing.scripts/component_matrix.py,tests/test_component_matrix.py, the us-equities landscape row and its new gap supplement, generated matrix and host-export JSON/Markdown, the dated decision, reconciliation receipt and their explicitmanifests/evidence.jsonregistrations. The dependent architecture has four corrected line citations; the two handbook exports and their existing publication receipt bind the changed source hashes. Fifteen paths in one PR for this layer cluster.The generator validates the historical crosswalk hash, exact source-gap text and layer scope, and every cited evidence hash before applying an explicit resolution. Missing or changed inputs refuse generation. Partial evidence stays open with its residual category. This supplies current counting without changing the historical reviewer/model decisions or introducing an orchestration engine.
needs_user_login; Temporal production/server-kill scope remains unqualifiedThe four remaining open entries cover off-host/VM/trading-host qualification, production-data acceptance, Modal login and separate adjudication bookkeeping. The overall matrix executable count changes 238→232. No new service, model, authentication, broker or market-data execution was needed to reconcile these existing records.
SOTA sources
0947b012:scripts/component_matrix.pyandscripts/catalog_decisions.py. The defect was omission of later retained evidence from the count; the regression observes1 != 0before correction.0947b012. The added landscape reference shifted four citations by one line and changed the handbook's source hash; both existing checks failed before their bindings were refreshed.58fed633d58c1dd1319091fdb2c2f6158ecfa053; Dagu v2.17.0 pinf501e3fefb2e52f9430d56b8ac7a055ec97ce320. Existing mirror source corroborates the retained CLI mechanisms.62f55e2dccf0a199cfe4d6ce3eda0c1d29e2e4e6; DuckDB v1.5.5 read_csv, pind8cdaa33fda8df955cc76ef58a280f68f4cd43fa; Python binding conversion, pinb236c8194ed14c7a7c685e0534dde501cc855b3a.1de87a9f26991bf4f5c0a5ff96f2cea8d7a3cbde, bundled server v1.32.0 pind94e34a1ebba5410a2e7d07119a76896909591aa; Python SDK 1.33.0 heartbeat and TracingInterceptor, pinab52fdde33ee8ed193402625bfdba25d240a762d.Evidence-class table
native_provenorlocal_integrationscope of each retained receiptevidence/artifacts/gap-wave2-20260923/us-equities__data-quality-orchestration/andadoption/paired/receipt.jsonsource_reviewevidence/artifacts/data-quality-gap-reconciliation-20261010/receipt.json; 68 raw-artifact entries and 79 evidence references rehashed without mismatchsyntheticlocal_integrationlocal_integrationLocal commands run
Local testing follows the current touched-module plus FULL-validator policy. Hosted CI owns full test discovery. The new reconciliation receipt retains the earlier full-validator pass before its own registration; the final registered-tree pass is recorded above.
Decision record
docs/decisions/2026-10-10-data-quality-gap-reconciliation.mdandcatalogs/landscape/gap-burndown-data-quality-orchestration-20261010.jsonbind each credited scope and explain the residuals. A changed/missing source or evidence binding refuses generation; a later qualified host, production-data or Modal execution can replace the remaining residual through its own evidence.Host evidence
No host receipt or declared platform status is changed. The retained historical source records remain at their original evidence classes and dates. Hosted CI, the designated read and separate trading acknowledgement remain due at the current head before the CC's landing.
Checklist