Skip to content

Increase request_timeout_ms for s3 disks.#42321

Merged
kssenii merged 1 commit intomasterfrom
filimonov-request_timeout_ms
Oct 16, 2022
Merged

Increase request_timeout_ms for s3 disks.#42321
kssenii merged 1 commit intomasterfrom
filimonov-request_timeout_ms

Conversation

@filimonov
Copy link
Copy Markdown
Contributor

Changelog category (leave one):

  • Improvement

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

When uploading big parts to minio, 'Complete Multipart Upload' can take a long time.
Minio sends heartbeats every 10 seconds (see minio/minio#7198). But clickhouse times out earlier, because the default send/receive timeout is set to 5 seconds.

Information about CI checks: https://clickhouse.com/docs/en/development/continuous-integration/

@robot-ch-test-poll robot-ch-test-poll added the pr-improvement Pull request with some product improvements label Oct 14, 2022
@kssenii kssenii self-assigned this Oct 14, 2022
@filimonov filimonov added pr-must-backport Pull request should be backported intentionally. Use this label with great care! can be tested Allows running workflows for external contributors labels Oct 14, 2022
@alexey-milovidov alexey-milovidov removed the pr-must-backport Pull request should be backported intentionally. Use this label with great care! label Oct 14, 2022
@filimonov
Copy link
Copy Markdown
Contributor Author

filimonov commented Oct 14, 2022

Motivation for backport
#40128
(22.3 and 22.8 fails with minio and backblaze when uploading huge parts, while 21.8 works).

So we can call it also a bug fix, because it removes the regression.

@filimonov filimonov added the pr-must-backport Pull request should be backported intentionally. Use this label with great care! label Oct 14, 2022
@alexey-milovidov alexey-milovidov removed the pr-must-backport Pull request should be backported intentionally. Use this label with great care! label Oct 15, 2022
@kssenii
Copy link
Copy Markdown
Member

kssenii commented Oct 16, 2022

AST fuzzer (debug) — Logical error: 'Invalid Field get from type UInt64 to type Int256'.

https://github.com/ClickHouse/ClickHouse/issues

Stateless tests (aarch64) — fail: 1

02267_file_globs_schema_inference

@kssenii kssenii merged commit 3338d76 into master Oct 16, 2022
@kssenii kssenii deleted the filimonov-request_timeout_ms branch October 16, 2022 12:03
Enmk pushed a commit to Altinity/ClickHouse that referenced this pull request Jan 23, 2023
…_timeout_ms

Increase request_timeout_ms for s3 disks.
Enmk added a commit to Altinity/ClickHouse that referenced this pull request Jan 24, 2023
…ut_ms_42321

22.8 Backport of ClickHouse#42321 s3 request_timeout_ms
Enmk pushed a commit to Altinity/ClickHouse that referenced this pull request Feb 7, 2023
…_timeout_ms

Increase request_timeout_ms for s3 disks.
@alexey-milovidov
Copy link
Copy Markdown
Member

This change introduced disastrous consequences - now, reading from S3 has high latencies going up to 30, 60, and 90 seconds - not compatible with production workloads. We have rolled back this change.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

can be tested Allows running workflows for external contributors pr-improvement Pull request with some product improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants