Repository navigation
Comparing changes
Open a pull request
base repository: klauspost/compress
base: v1.18.6
head repository: klauspost/compress
compare: v1.19.0
- 15 commits
- 50 files changed
- 9 contributors
Commits on May 4, 2026
-
build(deps): bump the github-actions group with 2 updates (#1146)
Bumps the github-actions group with 2 updates: [github/codeql-action](https://github.com/github/codeql-action) and [goreleaser/goreleaser-action](https://github.com/goreleaser/goreleaser-action). Updates `github/codeql-action` from 4.35.1 to 4.35.3 - [Release notes](https://github.com/github/codeql-action/releases) - [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md) - [Commits](github/codeql-action@c10b806...e46ed2c) Updates `goreleaser/goreleaser-action` from 7.0.0 to 7.2.1 - [Release notes](https://github.com/goreleaser/goreleaser-action/releases) - [Commits](goreleaser/goreleaser-action@ec59f47...1a80836) --- updated-dependencies: - dependency-name: github/codeql-action dependency-version: 4.35.3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: github-actions - dependency-name: goreleaser/goreleaser-action dependency-version: 7.2.1 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 28ae503 - Browse repository at this point
Copy the full SHA 28ae503View commit details
Commits on May 7, 2026
-
zstd: avoid unused BuildDict encoder allocation (#1147)
BuildDict initialized a bestFastEncoder before checking whether BuildDictOptions.Level was set. When callers requested an explicit level, that encoder was immediately replaced by eOpts.encoder(), so the large best-compression tables were allocated and discarded without being used. Delay bestFastEncoder construction until the default-level path that actually uses it. This keeps the Level == 0 behavior unchanged while avoiding the unused encoder allocation for explicit levels. Add round-trip coverage for both BuildDict level paths and a benchmark that reports the allocation difference between default and explicit-level dictionary builds.
Configuration menu - View commit details
-
Copy full SHA for fdcc9b6 - Browse repository at this point
Copy the full SHA fdcc9b6View commit details -
snappy/s2: Limit length of varint in
decodedLen(#1148)To match C++ implementation
Configuration menu - View commit details
-
Copy full SHA for 0434480 - Browse repository at this point
Copy the full SHA 0434480View commit details
Commits on May 8, 2026
-
gzhttp: match qvalue parameter case-insensitively (RFC 7231) (#1149)
Co-authored-by: Klaus Post <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for dba8e6f - Browse repository at this point
Copy the full SHA dba8e6fView commit details
Commits on May 21, 2026
-
flate: Add inflate checkpoints (#1154)
Allows adding an inflate end-of-block callback with checkpoint information. Callback is cleared on reset and cannot be re-applied to an existing Reader. For resuming either use `WithResumeFrom` or assert the `ResetCP(io.Reader, flate.InflateCheckpoint) error` interface. The input stream should be forwarded to the compressed offset.
Configuration menu - View commit details
-
Copy full SHA for 5b9abed - Browse repository at this point
Copy the full SHA 5b9abedView commit details -
Configuration menu - View commit details
-
Copy full SHA for 38efa45 - Browse repository at this point
Copy the full SHA 38efa45View commit details -
huff0: Allow building tables from histogram. (#1155)
* huff0: Allow building tables from histogram. Add interface to build tables from the histograms themselves. Adds direct method to export the current table and helpers for size reuse (also via histograms). * Check nil
Configuration menu - View commit details
-
Copy full SHA for ecdb779 - Browse repository at this point
Copy the full SHA ecdb779View commit details
Commits on May 25, 2026
-
huff0: Allow building table from oversized histogram. (#1156)
A histogram of a block larger than max block size could cause huff0 to panic. Scale table down on BuildCTable.
Configuration menu - View commit details
-
Copy full SHA for e9c2e56 - Browse repository at this point
Copy the full SHA e9c2e56View commit details
Commits on Jun 3, 2026
-
build(deps): bump the github-actions group with 3 updates (#1157)
Bumps the github-actions group with 3 updates: [actions/checkout](https://github.com/actions/checkout), [github/codeql-action](https://github.com/github/codeql-action) and [goreleaser/goreleaser-action](https://github.com/goreleaser/goreleaser-action). Updates `actions/checkout` from 6.0.2 to 6.0.3 - [Release notes](https://github.com/actions/checkout/releases) - [Commits](actions/checkout@v6.0.2...v6.0.3) Updates `github/codeql-action` from 4.35.3 to 4.36.1 - [Release notes](https://github.com/github/codeql-action/releases) - [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md) - [Commits](github/codeql-action@e46ed2c...87557b9) Updates `goreleaser/goreleaser-action` from 7.2.1 to 7.2.2 - [Release notes](https://github.com/goreleaser/goreleaser-action/releases) - [Commits](goreleaser/goreleaser-action@1a80836...5daf1e9) --- updated-dependencies: - dependency-name: actions/checkout dependency-version: 6.0.3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: github-actions - dependency-name: github/codeql-action dependency-version: 4.36.1 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions - dependency-name: goreleaser/goreleaser-action dependency-version: 7.2.2 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: github-actions ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 4705fcb - Browse repository at this point
Copy the full SHA 4705fcbView commit details
Commits on Jun 17, 2026
-
zstd: Add true concurrent stream encoding (#1136)
* zstd: Add true concurrent encoding ```go // WithConcurrentBlocks enables job-based parallel compression for streams. // When enabled and concurrent > 1, input is split into large sections (jobs) // that are compressed simultaneously by multiple goroutines. // Each non-first job receives an overlap prefix from the previous job for match context. // Output is flushed in order, producing a valid single-frame zstd stream. // // This is incompatible with dictionary encoding. // Cannot be changed with ResetWithOptions. func WithConcurrentBlocks(b bool) EOption { ``` Example: | Level | 1 thread | 4 threads | 16 threads | 1T ratio | 16T ratio | |---------|:----------:|:------------------:|:-------------------:|:--------:|:---------:| | fastest | 783 MB/s | 2950 MB/s (3.8×) | 6939 MB/s (8.9×) | 12.24% | 12.26% | | default | 728 MB/s | 2533 MB/s (3.5×) | 5340 MB/s (7.3×) | 10.67% | 10.68% | | better | 434 MB/s | 1105 MB/s (2.5×) | 2206 MB/s (5.1×) | 9.14% | 9.21% | | best | 129 MB/s | 367 MB/s (2.8×) | 884 MB/s (6.8×) | 8.48% | 8.63% | * Tweaks * Just disable when using dictionary encoding. * Fix Close nil-writer check ignoring concurrent buffer Close() checked s.w == nil before the e.o.concurrentBlocks branch. In concurrent mode, Write fills js.filling (not s.filling), so the guard len(s.filling) == 0 && s.nInput == 0 would incorrectly return nil even with pending data. Fix: moved the concurrentBlocks branch before the nil-writer check, and added a matching nil-writer guard inside closeJobs() that checks js.filling instead of s.filling. * Clean up reuse * Share encoder channel with single-shot.Configuration menu - View commit details
-
Copy full SHA for 4cc176c - Browse repository at this point
Copy the full SHA 4cc176cView commit details -
Configuration menu - View commit details
-
Copy full SHA for bd9228c - Browse repository at this point
Copy the full SHA bd9228cView commit details
Commits on Jun 29, 2026
-
s2sx: Clean symlink targets (#1163)
When self-extractor is extracting files from TAR validate that symlinks remains inside the destination. Executables are already expected to be trusted and since they are embedded with the archive, so there really is no breach of trust. This change is mainly to discourage false/pointless AI reports.
Configuration menu - View commit details
-
Copy full SHA for 539243b - Browse repository at this point
Copy the full SHA 539243bView commit details
Commits on Jun 30, 2026
-
`int(r)` would wrap negative for r > MaxInt64, slipping past the bounds check and causing an OOB read in encode. Fix & add regression test.
Configuration menu - View commit details
-
Copy full SHA for bb2723d - Browse repository at this point
Copy the full SHA bb2723dView commit details -
zstd: Add arm64 decoder asm (#1160)
* zstd: add arm64 asm implementation of fseDecoder.buildDtable arm64 previously fell through to the pure-Go fse_decoder_generic.go because the decoder asm is avo-generated and avo has no arm64 backend. This adds a hand-written scalar arm64 port of buildDtable, mirroring the avo-generated fse_decoder_amd64.s and the pure-Go reference. The kernel is serial bitfield work (no SIMD), so it needs no NEON/SVE and builds on the stock go1.x assembler. Correctness is covered by a differential test against an in-tree copy of the generic algorithm over the three RFC predefined distributions, plus the full existing decode suite (which runs on macos-latest/arm64 in CI). darwin/arm64 (M4, go1.26), asm vs -tags noasm; the bench's table reset is identical on both sides so the delta is the buildDtable work: litLength ~166 vs ~201 ns/op (+18%) offset ~118 vs ~141 ns/op (+16%) matchLength ~175 vs ~210 ns/op (+17%) Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]> * zstd: add avo-generated arm64 asm sequence decoder Generates the full non-BMI2 zstd sequence decoder for arm64 by lowering the existing amd64 avo program (_generate/gen.go) through a new arm64 backend in avo (a post-pass.Compile lowering printer; see mmcloughlin/avo#486). No asm is hand-written: `go generate` now emits both seqdec_amd64.s and seqdec_arm64.s from the same IR, so they cannot drift, and CI's generate+git-diff job enforces it. - seqdec_arm64.s: generated (6 non-BMI2 functions: decode/_56, executeSimple/ _safe, decodeSync/_safe). - seqdec_arm64.go: shim mirroring seqdec_amd64.go (context structs, noescape decls, dispatch) without the BMI2 paths. - seqdec_generic.go: build tag now excludes arm64. Scalar only — no NEON/SVE (one VLD1/VST1 pair for a 16-byte MOVUPS copy); builds on go1.26. Full zstd decode suite passes on arm64. On Apple M4, BenchmarkDecoder_DecodeAll is ~1.5x faster than the pure-Go fallback on sequence-heavy input (kppkn: 469 vs 304 MB/s). Regeneration requires the avo arm64 backend (mmcloughlin/avo#486) via a local replace directive in _generate/go.mod (not committed). Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]> * zstd: generate arm64 fse decoder via avo + pin avo fork Switches fse_decoder_arm64.s from the hand-written bootstrap to the avo-generated lowering, so the entire arm64 zstd decoder (fse table build + sequence decoder) is produced from the existing, unmodified amd64 avo generators via the arm64 lowering printer (mmcloughlin/avo#486). Supersedes the hand-written fse PR #1159. Pins the printer through a replace to the honeycombio/avo fork (which keeps the github.com/mmcloughlin/avo module path, so the replace resolves) until the printer merges upstream and is released, at which point the replace is dropped for a normal require. Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]> * zstd: asmfmt-style formatting for generated arm64 asm Regenerate the arm64 decoder with the updated avo arm64 printer, which now aligns operands to a common column and emits a blank line before labels — matching avo's amd64 (goasm) output. asmfmt reports zero non-comment differences on the arm64 files (the same standalone-comment indentation residual goasm produces on amd64). Repins the avo fork to the printer commit. Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]> * zstd: address review — dedup shims, -arch generation, asm-vs-nonasm fuzz Responds to maintainer review on the arm64 decoder PR: - Deduplicate the asm Go wrappers: shared seqdec_asm.go holds the context structs, error codes and the decode/decodeSync/executeSimple bodies; each arch keeps only its //go:noescape decls and a small dispatch helper (amd64 selects the BMI2 / 56-bit / safe variant, arm64 the 56-bit / safe variant). The fse Go wrapper is identical across arches and collapses into one fse_decoder_asm.go (per-arch fse_decoder_{amd64,arm64}.go removed). - Generate both architectures via avo's new -arch flag: one `go run gen.go -out ../seqdec.s -arch amd64,arm64` writes seqdec_amd64.s and seqdec_arm64.s from a single compile, so neither file's header references the other architecture. - FuzzDecodeAll now cross-checks the assembly decoder against a non-assembly path (BMI2 disabled on amd64) for byte-identical output; run with -tags=noasm over the shared corpus to cover assembly-vs-generic on arm64. Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]> * ci: run build matrix and zstd fuzzers on linux arm64 Adds ubuntu-24.04-arm to the build matrix (vet/test/noasm/race across Go versions on Linux arm64) and gives the fuzz-zstd job an OS matrix so the zstd decode fuzzers also run on arm64 — exercising the new arm64 decoder assembly directly in CI, as requested in review. Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]> * zstd: defer BMI2 restore in FuzzDecodeAll asm/non-asm comparison Use the defer cpuinfo.DisableBMI2()() idiom so BMI2 is re-enabled on every exit path (panic/return), matching FuzzDecAllNoBMI2. Addresses review feedback. Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]> --------- Co-authored-by: Claude Opus 4.8 (1M context) <[email protected]> Co-authored-by: Klaus Post <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for ab2e3cc - Browse repository at this point
Copy the full SHA ab2e3ccView commit details -
flate: fix buffer formatting in tests (#1165)
Signed-off-by: HNO3Miracle <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for f0953f9 - Browse repository at this point
Copy the full SHA f0953f9View commit details
This comparison is taking too long to generate.
Unfortunately it looks like we can’t render this comparison for you right now. It might be too big, or there might be something weird with your repository.
You can try running this command locally to see the comparison on your machine:
git diff v1.18.6...v1.19.0