Skip to content

fix: hardcode lz4 writer blocksize to 64kb#3258

Merged
dnwe merged 2 commits intomainfrom
dnwe/lz4
Aug 13, 2025
Merged

fix: hardcode lz4 writer blocksize to 64kb#3258
dnwe merged 2 commits intomainfrom
dnwe/lz4

Conversation

@dnwe
Copy link
Copy Markdown
Collaborator

@dnwe dnwe commented Aug 11, 2025

This matches the hardcoded block-size set in the Apache Kafka Java
client.

Ref: Lz4BlockOutputStream.java

Fixes #3252

dnwe added 2 commits August 11, 2025 17:37
Split out the gzip and lz4 case blocks similarly to the zstdCompress
func

Signed-off-by: Dominic Evans <[email protected]>
@dnwe dnwe changed the base branch from main to dnwe/housekeeping August 12, 2025 14:35
Base automatically changed from dnwe/housekeeping to main August 13, 2025 06:13
@dnwe dnwe merged commit 4bbe9f3 into main Aug 13, 2025
21 of 22 checks passed
@dnwe dnwe deleted the dnwe/lz4 branch August 13, 2025 06:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

When using lz4 for message compression and sending, it will cause memory strain on the Kafka Broker

3 participants