Skip to content

Fix abnormal termination when hdfs is unreachable#24191

Merged
alesapin merged 3 commits intoClickHouse:masterfrom
kssenii:hdfs-fixes
May 18, 2021
Merged

Fix abnormal termination when hdfs is unreachable#24191
alesapin merged 3 commits intoClickHouse:masterfrom
kssenii:hdfs-fixes

Conversation

@kssenii
Copy link
Copy Markdown
Member

@kssenii kssenii commented May 17, 2021

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en

Changelog category (leave one):

  • Bug Fix

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
Fix abnormal server termination due to hdfs becoming not accessible during query execution. Closes #24117.

Detailed description / Documentation draft:
In #24117 hdfs entered safemode due to unreachable namenodes and the query crashed the server - can be reproduced by starting a long query and while it is not yet finished executing inside hdfs the command: hdfs dfsadmin -safemode enter. (stacktrace).

@robot-clickhouse robot-clickhouse added the pr-bugfix Pull request with bugfix, not backported by default label May 17, 2021

void sync() override;

void finalize() override;
Copy link
Copy Markdown
Member

@alesapin alesapin May 17, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not super-clear that this the fix is the override keyword :)

@alesapin alesapin self-assigned this May 17, 2021
@alesapin
Copy link
Copy Markdown
Member

test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch Flaky, need to fix.

@alesapin alesapin merged commit 64baa52 into ClickHouse:master May 18, 2021
alesapin added a commit that referenced this pull request May 19, 2021
Backport #24191 to 21.3: Fix abnormal termination when hdfs is unreachable
alesapin added a commit that referenced this pull request May 19, 2021
Backport #24191 to 21.4: Fix abnormal termination when hdfs is unreachable
alesapin added a commit that referenced this pull request May 19, 2021
Backport #24191 to 21.5: Fix abnormal termination when hdfs is unreachable
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-bugfix Pull request with bugfix, not backported by default

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Uncaught exception on HDFS write error

3 participants