Skip to content

Prohibit specification of delta codecs before floating-point time series codecs#45277

Closed
rschu1ze wants to merge 3 commits intomasterfrom
no-manual-delta-before-ts-codec
Closed

Prohibit specification of delta codecs before floating-point time series codecs#45277
rschu1ze wants to merge 3 commits intomasterfrom
no-manual-delta-before-ts-codec

Conversation

@rschu1ze
Copy link
Copy Markdown
Member

@rschu1ze rschu1ze commented Jan 14, 2023

Fixes #45195

Changelog category (leave one):

  • Backward Incompatible Change

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

It is no longer allowed to specify delta compression (i.e. using codecs "Delta" and "DoubleDelta") before specialized floating-point time series compression (i.e. using codecs "FPC" and "Gorilla"). Floating-point codecs implicitly apply delta compression (or something equivalent) to the data. The previous behavior can be restored with setting "allow_suspicious_codecs = 1".

@robot-ch-test-poll1 robot-ch-test-poll1 added the pr-backward-incompatible Pull request with backwards incompatible changes label Jan 14, 2023
@rschu1ze rschu1ze changed the title No manual delta before ts codec Prohibit specification of delta codecs before floating-point time series codecs Jan 14, 2023
@alesapin
Copy link
Copy Markdown
Member

But it's still allowed if allow_suspicious_codecs is enabled. Maybe worth mentioning in the changelog.

@rschu1ze
Copy link
Copy Markdown
Member Author

I noticed that 99% of this PR slipped into #45252 😱, that's why the diff looks weird. But luckily there seem to be no unwanted side effects.

ClickHouse Integration Tests (tsan) [4/6]

  • test_s3_cluster/test.py::test_wrong_cluster: reports a sanitizer assert (greps for pattern "==================") but I can't find any sanitizer assert in the log files ... looks like a wrong alarm
  • test_s3_cluster/test.py::test_distributed_insert_select_with_replicated: (same)

ClickHouse Integration Tests (tsan) [6/6]

ClickHouse Stress Test *

  • The backward compat check failed to load the persistence generated by the stress test into an old server ... that's expected

@rschu1ze rschu1ze marked this pull request as draft January 16, 2023 16:38
@rschu1ze rschu1ze closed this Jan 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-backward-incompatible Pull request with backwards incompatible changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

data corruption on delta+gorilla+lz4 codec pipeline

3 participants