Skip to content

Narrow the zstd 0.13 exception: source bundle and include-flate move to 0.14 - #1616

Merged
seeker89 merged 1 commit into
release-0-2-7from
0-2-7/zstd-014
Nov 6, 2026
Merged

seeker89 merged 1 commit into
release-0-2-7from
0-2-7/zstd-014

Conversation

@seeker89

@seeker89 seeker89 commented Nov 6, 2026

Copy link
Copy Markdown
Contributor

Part of #1366. This doesn't close it yet: the 13 zstd 0.13 IDs stay in .cargo/audit.toml.

What moved

  • Reliaburger's own zstd dependency and build dependency (source bundle, Embed the build, test and read set as one zstd tarball #1570): 0.13 -> 0.14.3.
  • include-flate, include-flate-codegen, include-flate-compress (through rust-embed's compression): 0.3.4 -> 0.3.5, which requires zstd ^0.14. A Cargo.lock update only.

cargo tree -i [email protected] -e normal,build --depth 1 now lists only arrow-ipc 59.3.2, parquet 59.3.2, datafusion 55.2.0 and datafusion-datasource 55.2.0.

Why the ignores stay

Parquet and arrow-ipc 59.3.2 (the newest 59 release) require zstd ^0.13. Arrow 60 moves to 0.14, but DataFusion 55.2.0, still the newest on crates.io, requires arrow ^59.2. Log Parquet is written with zstd, so turning the codec off isn't an option. DataFusion 56.0.0 (arrow/parquet 60.1, zstd 0.14) has branch-56 cut and its version PR (apache/datafusion#27098) open since 4 November, but the vote and the crates.io publish haven't happened yet (apache/datafusion#24461). The upgrade guide suggests a small move for us: MSRV 1.95, object_store 0.14 (already ours), arrow's Metadata type, and TableProvider::scan_with_args gaining a defaulted skip.

Nothing durable changed

Both zstd lines link the one zstd-sys 2.1.2 (libzstd 1.5.7), so the source bundle compresses the same way at the same levels. Log and metric Parquet still goes through Parquet's own codec, which this doesn't touch. No CURRENT bump.

Also

  • New test only_arrow_parquet_and_datafusion_still_lock_zstd_0_13 in tests/suite/dependency_audit.rs.
  • New record docs/qualification/2026-11-06-dependency-exceptions.md, linked from docs/testing.md. The .cargo/audit.toml comment is updated.
  • Book chapter 06 tells the zstd part of the arrow story.

make ci is clean, including fmt and clippy -D warnings. No export code changed, so make test-s3 wasn't run.

Reliaburger's own zstd dependency and build dependency go from 0.13 to
0.14, and include-flate 0.3.4 -> 0.3.5 moves rust-embed's compression to
zstd 0.14 too. zstd 0.13.3 and zstd-safe 7.3.0 are now reached only
through arrow-ipc and parquet 59.3.2 and DataFusion 55.2.0, which need
DataFusion 56 (arrow 60) on crates.io before the 13 audit exceptions
can go. A dependency_audit test keeps any other crate off the old line.

Both lines link the same zstd-sys 2.1.2 (libzstd 1.5.7), so the bytes
written don't change and nothing durable moves.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01FPhkektW7i79UFpJaaaqx8
@seeker89
seeker89 merged commit ac3cf49 into release-0-2-7 Nov 6, 2026
20 checks passed
@seeker89
seeker89 deleted the 0-2-7/zstd-014 branch November 6, 2026 10:49
seeker89 added a commit that referenced this pull request Nov 7, 2026
The 0.2.7 merge train, as
[docs/releasing.md](https://github.com/reliaburger/reliaburger/blob/main/docs/releasing.md#merge-trains-and-their-ci)
describes it. 0.2.7's PRs merged into `release-0-2-7`, and this PR takes
the train into `main` at freeze. Plan:
[docs/plans/2026-11-04-plan-0.2.7.md](https://github.com/reliaburger/reliaburger/blob/main/docs/plans/2026-11-04-plan-0.2.7.md).
Milestone:
[0.2.7](https://github.com/reliaburger/reliaburger/milestone/29).

**On the train:**
- #1604 moves the version to 0.2.7.
- #1603, #1585, #1595, #1586, #1596, #1598, #1600, #1613, #1616, #1617,
#1618 and #1614.
- The first integration merge (78b2126): #1624, #1636, #1645,
#1630–#1632, #1642, #1626, #1634, #1629, #1628, #1635, #1646, #1647,
#1637, #1649, #1639 and #1656.
- #1693, the second integration: #1659, #1662, #1665, #1663, #1666,
#1672, #1677, #1668, #1675, #1657 and #1664.

Not on it: #1644 (moved to 0.2.8 with #1584) and #1680 (#1679's
Kubernetes harness, after release).

**Split or moved at freeze:**
- #1694 takes the source-digest remainder of #1570 and #1565.
- #1695 takes the MCP Registry, `.mcpb` and button remainder of #1582.
- #1417, #1527, #1620, #1625, #1641 and #1584 moved to 0.2.8.
- #1578, #1583, #1612, #1678 and #1679 close with the release records
and the post-release docs PR.

**Closes**, one per issue, so each closes when this merges into `main`:

Fixes #1083
Fixes #1086
Fixes #1088
Fixes #1090
Fixes #1093
Fixes #1094
Fixes #1537
Fixes #1565
Fixes #1566
Fixes #1567
Fixes #1568
Fixes #1569
Fixes #1570
Fixes #1571
Fixes #1572
Fixes #1573
Fixes #1574
Fixes #1575
Fixes #1576
Fixes #1577
Fixes #1579
Fixes #1580
Fixes #1581
Fixes #1582
Fixes #1601
Fixes #1602
Fixes #1606
Fixes #1608
Fixes #1619
Fixes #1621
Fixes #1622
Fixes #1623
Fixes #1652
Fixes #1670
Fixes #1674
Fixes #1676

🤖 Generated with [Claude Code](https://claude.com/claude-code)

https://claude.ai/code/session_01FPhkektW7i79UFpJaaaqx8
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant