Skip to content

Compress keeper snapshots with default ZSTD codec#29417

Merged
alesapin merged 4 commits intomasterfrom
compressed_snapshots
Sep 28, 2021
Merged

Compress keeper snapshots with default ZSTD codec#29417
alesapin merged 4 commits intomasterfrom
compressed_snapshots

Conversation

@alesapin
Copy link
Copy Markdown
Member

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en

Changelog category (leave one):

  • Backward Incompatible Change

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
Now ClickHouse Keeper snapshots compressed with ZSTD codec by default instead of custom ClickHouse LZ4 block compression. This behavior can be turned off with compress_snapshots_with_zstd_format coordination setting (must be equal on all quorum replicas). Backward incompatibility is quite rare and may happen only when new node will send snapshot (happens in case of recovery) to the old node which is unable to read snapshots in ZSTD format.

@robot-clickhouse robot-clickhouse added the pr-backward-incompatible Pull request with backwards incompatible changes label Sep 27, 2021
@alesapin alesapin added the jepsen-test Need to test this PR with jepsen tests label Sep 27, 2021
@kitaisreal kitaisreal self-assigned this Sep 27, 2021
@CLAassistant
Copy link
Copy Markdown

CLAassistant commented Sep 28, 2021

CLA assistant check
All committers have signed the CLA.

@alesapin
Copy link
Copy Markdown
Member Author

OOM unrelated

@alesapin alesapin merged commit 7962ea5 into master Sep 28, 2021
@alesapin alesapin deleted the compressed_snapshots branch September 28, 2021 20:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

jepsen-test Need to test this PR with jepsen tests pr-backward-incompatible Pull request with backwards incompatible changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants