Skip to content

Fix vertical merges in wide parts#36707

Merged
alexey-milovidov merged 1 commit intoClickHouse:masterfrom
CurtizJ:fix-vertical-merges
Apr 29, 2022
Merged

Fix vertical merges in wide parts#36707
alexey-milovidov merged 1 commit intoClickHouse:masterfrom
CurtizJ:fix-vertical-merges

Conversation

@CurtizJ
Copy link
Copy Markdown
Member

@CurtizJ CurtizJ commented Apr 27, 2022

Changelog category (leave one):

  • Bug Fix (user-visible misbehaviour in official stable or prestable release)

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Fix vertical merges in wide parts. Previously an exception There is no column can be thrown during merge.

Fixes #36687.

@robot-ch-test-poll2 robot-ch-test-poll2 added the pr-bugfix Pull request with bugfix, not backported by default label Apr 27, 2022
@CurtizJ CurtizJ marked this pull request as ready for review April 27, 2022 21:23

/// Add columns because we don't want to read empty blocks
injectRequiredColumns(storage, storage_snapshot, data_part, columns_to_read);
injectRequiredColumns(storage, storage_snapshot, data_part, /*with_subcolumns=*/ false, columns_to_read);
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do I understand correctly that this is the most imprtant line?
Maybe add a comment explaining - why we should not inject subcolumns as required columns here?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. I can add a comment.

Actually the problem is not exactly that we shouldn't require subcolumns, because we will read only columns for requested names and there are no subcolumns. But subcolumn can be added as the smallest column in case when all requested columns are missing.

@alexey-milovidov alexey-milovidov self-assigned this Apr 28, 2022
@alexey-milovidov
Copy link
Copy Markdown
Member

You can also pull this test: #36706
So when we will merge this PR, the other PR will be automatically merged.

@CurtizJ
Copy link
Copy Markdown
Member Author

CurtizJ commented Apr 28, 2022

I've already added tests from #36706. If it's not important to keep the authorship of commits, we can close it.

@alexey-milovidov alexey-milovidov merged commit 9fb1d92 into ClickHouse:master Apr 29, 2022
@alexey-milovidov alexey-milovidov added the pr-must-backport Pull request should be backported intentionally. Use this label with great care! label Apr 29, 2022
Felixoid added a commit that referenced this pull request Apr 29, 2022
Backport #36707 to 22.4: Fix vertical merges in wide parts
CurtizJ added a commit that referenced this pull request May 2, 2022
Backport #36707 to 22.3: Fix vertical merges in wide parts
kaynewu added a commit to kaynewu/ClickHouse that referenced this pull request Jun 9, 2022
* Backport ClickHouse#36167 to 22.3: Fix broken aliases during parsing of special operators

* Backport git fix for /build directory

* Trigger CI

* Update version to 22.3.5.20

* Backport ClickHouse#36637 to 22.3: Fix merges of wide parts with type `Object`

* Backport ClickHouse#36487 to 22.3: Add passphrase for certificates

* Backport ClickHouse#36707 to 22.3: Fix vertical merges in wide parts

* Update version to 22.3.6.5

* Backport ClickHouse#36910 to 22.3: Fix bug in keeper which could lead to corrupted compressed logs

* Update version to 22.3.7.5

* Backport ClickHouse#36866 to 22.3: Integration tests

* Backport ClickHouse#35803 to 22.3: Fix bug in indexes of not presented columns in -WithNames formats

* Backport ClickHouse#37021 to 22.3: Fixed problem with infs in `quantileTDigest`

* Backport ClickHouse#36463 to 22.3: Ignore DNS errors when checking if dictionary source is local

* Backport ClickHouse#37443 to 22.3: Functions normalize utf8 fix

* Backport ClickHouse#37336 to 22.3: Fix clash of constant strings in aggregate function, prewhere and join

* Backport ClickHouse#37690 to 22.3: Fix segfault with mysql db + show create table + named collections

Co-authored-by: robot-clickhouse <[email protected]>
Co-authored-by: Mikhail f. Shiryaev <[email protected]>
Co-authored-by: Anton Popov <[email protected]>
Co-authored-by: Maksim Kita <[email protected]>
Co-authored-by: Alexey Milovidov <[email protected]>
Co-authored-by: alesapin <[email protected]>
Co-authored-by: Kruglov Pavel <[email protected]>
Co-authored-by: Alexander Tokmakov <[email protected]>
Co-authored-by: Vladimir C <[email protected]>
Co-authored-by: Kseniia Sumarokova <[email protected]>
@Felixoid Felixoid added the pr-backports-created Backport PRs are successfully created, it won't be processed by CI script anymore label Jul 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-backports-created Backport PRs are successfully created, it won't be processed by CI script anymore pr-bugfix Pull request with bugfix, not backported by default pr-must-backport Pull request should be backported intentionally. Use this label with great care!

Projects

None yet

Development

Successfully merging this pull request may close these issues.

22.4 Vertical merges of wide parts are broken

4 participants