Skip to content

S3Queue improvements, part 2 (Ordered mode related only)#55795

Closed
kssenii wants to merge 2 commits intoClickHouse:masterfrom
kssenii:s3queue-improvements-part2
Closed

S3Queue improvements, part 2 (Ordered mode related only)#55795
kssenii wants to merge 2 commits intoClickHouse:masterfrom
kssenii:s3queue-improvements-part2

Conversation

@kssenii
Copy link
Copy Markdown
Member

@kssenii kssenii commented Oct 18, 2023

Changelog category (leave one):

  • Improvement

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Make Ordered processing mode safely parallelizable. Continuation of #54422.
Before this PR setting s3queue_processing_threads_num was disabled (forcefully set to 1) for Ordered mode, because it was unsafe, and for the same reason, distributed processing was unsafe. (See #54422 (comment))

@robot-ch-test-poll1 robot-ch-test-poll1 added the pr-improvement Pull request with some product improvements label Oct 18, 2023
@robot-ch-test-poll1
Copy link
Copy Markdown
Contributor

robot-ch-test-poll1 commented Oct 18, 2023

This is an automated comment for commit fc1ed16 with description of existing statuses. It's updated for the latest CI running

❌ Click here to open a full report in a separate page

Successful checks
Check nameDescriptionStatus
Fast testNormally this is the first check that is ran for a PR. It builds ClickHouse and runs most of stateless functional tests, omitting some. If it fails, further checks are not started until it is fixed. Look at the report to see which tests fail, then reproduce the failure locally as described here✅ success
Push to DockerhubThe check for building and pushing the CI related docker images to docker hub✅ success
Check nameDescriptionStatus
CI runningA meta-check that indicates the running CI. Normally, it's in success or pending state. The failed status indicates some problems with the PR⏳ pending
Mergeable CheckChecks if all other necessary checks are successful❌ failure
Style CheckRuns a set of checks to keep the code style clean. If some of tests failed, see the related log from the report❌ failure

@kssenii
Copy link
Copy Markdown
Member Author

kssenii commented Dec 12, 2023

Will make a more simple solution.

@kssenii kssenii closed this Dec 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-improvement Pull request with some product improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants