Skip to content

Fix the two failing hypothesis stateful tests - #2349

Merged
li-em merged 1 commit into
mainfrom
push-kqvzvourrwvq
Aug 26, 2026
Merged

li-em merged 1 commit into
mainfrom
push-kqvzvourrwvq

Conversation

@paraseba

Copy link
Copy Markdown
Collaborator

These errors were found by the nightly upstream-dev job.

zarr >= 3.3's add_array recreates the drawn array in the store under test without the sharding codec the model store got, so an all-fill-value write elides a chunk object on one side only. Override it with the fix from zarr-developers/zarr-python#4288 until that reaches a release.

check_file_invariants required orphan tx logs to equal the pruned-ancestor refs of every snapshot whose file is on disk. This is no longer true now that we keep expired tx logs.

These errors were found by the nightly upstream-dev job.

zarr >= 3.3's `add_array` recreates the drawn array in the store under test
without the sharding codec the model store got, so an all-fill-value write
elides a chunk object on one side only. Override it with the fix from
zarr-developers/zarr-python#4288 until that reaches a release.

`check_file_invariants` required orphan tx logs to equal the pruned-ancestor
refs of every snapshot whose *file* is on disk. This is no longer true now
that we keep expired tx logs.
@paraseba
paraseba requested a review from li-em August 26, 2026 16:16
@codecov-commenter

codecov-commenter commented Aug 26, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 84.82%. Comparing base (224519b) to head (3af634c).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2349   +/-   ##
=======================================
  Coverage   84.82%   84.82%           
=======================================
  Files          88       88           
  Lines       39444    39444           
=======================================
  Hits        33460    33460           
  Misses       5984     5984           
Flag Coverage Δ
python 90.06% <ø> (ø)
rust 84.23% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@paraseba
paraseba requested a review from ianhi August 26, 2026 18:11
return
fi
gh issue comment "$number" --body \
"Failed again in tonight's run: $RUN_URL — the issue body has the current failures."

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@li-em
li-em added this pull request to the merge queue Aug 26, 2026
Merged via the queue into main with commit 7480e73 Aug 26, 2026
37 of 38 checks passed
@li-em
li-em deleted the push-kqvzvourrwvq branch August 26, 2026 19:59
aldenks pushed a commit to aldenks/icechunk that referenced this pull request Sep 15, 2026
N-Clerkx pushed a commit to wolkwork/icechunk that referenced this pull request Sep 24, 2026
Follow-up on earth-mover#2349, also
detected in nightly runs

There are two fixes in this PR:

- a test case where `reset_branch` revived commits after expiration ran,
and model predicted one extra deletion.
```
state.initialize(spec_version=1)
state.set_and_commit(ncommits=7)
state.reset_branch(branch=branches_0, commit=commits_5)
state.expire_snapshots(delete_expired_branches=True, delete_expired_tags=True)
state.reset_branch(branch=branches_0, commit=commits_6)
state.garbage_collect()
```

- an upstream zarr bug, will open a PR there:
```
a = zarr.create_array({}, shape=(4, 4), chunks=(2, 2), shards=(2, 4), dtype="int64")
a.oindex[np.array([0, 1]), np.array([2, 3])] = np.zeros((2, 2), dtype="int64")
# ValueError: shape mismatch: value array of shape (2,2) could not be
# broadcast to indexing result of shape (4,)
```
There is a probe like `ZARR_RECREATES_ARRAYS` in earth-mover#2349 that can be
dropped once it is fixed upstream.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants