Skip to content

Make test_storage_s3 less flaky#32825

Merged
alesapin merged 1 commit intoClickHouse:masterfrom
azat:fix-test_storage_s3
Dec 16, 2021
Merged

Make test_storage_s3 less flaky#32825
alesapin merged 1 commit intoClickHouse:masterfrom
azat:fix-test_storage_s3

Conversation

@azat
Copy link
Copy Markdown
Member

@azat azat commented Dec 16, 2021

Changelog category (leave one):

  • Not for changelog (changelog entry is not required)

Cc: @kssenii

@robot-clickhouse robot-clickhouse added the pr-not-for-changelog This PR should not be mentioned in the changelog label Dec 16, 2021
@kssenii kssenii self-assigned this Dec 16, 2021
@kssenii
Copy link
Copy Markdown
Member

kssenii commented Dec 16, 2021

test_storage_s3/test.py::test_seekable_formats_url (✕1) | FAIL

😞

@azat
Copy link
Copy Markdown
Member Author

azat commented Dec 16, 2021

The error is different though:

>           raise QueryRuntimeException(
                'Client failed! Return code: {}, stderr: {}'.format(self.process.returncode, stderr), self.process.returncode, stderr)
E           helpers.client.QueryRuntimeException: Client failed! Return code: 243, stderr: Received exception from server (version 21.13.1):
E           Code: 499. DB::Exception: Received from 172.16.1.7:9000. DB::Exception: The specified multipart upload does not exist. The upload ID may be invalid, or the upload may have been aborted or completed.. Stack trace:
E           
E           0. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/exception:133: Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x306aa549 in /usr/bin/clickhouse
E           1. ./obj-x86_64-linux-gnu/../src/Common/Exception.cpp:57: DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, bool) @ 0xbdc42a8 in /usr/bin/clickhouse
E           2. ./obj-x86_64-linux-gnu/../src/IO/WriteBufferFromS3.cpp:194: DB::WriteBufferFromS3::completeMultipartUpload() @ 0x25493c43 in /usr/bin/clickhouse
E           3. ./obj-x86_64-linux-gnu/../src/IO/WriteBuffer.h:122: DB::WriteBuffer::finalize() @ 0xbd89903 in /usr/bin/clickhouse
E           4. ./obj-x86_64-linux-gnu/../src/Storages/StorageS3.cpp:341: DB::StorageS3Sink::onFinish() @ 0x27d95580 in /usr/bin/clickhouse
E           5. ./obj-x86_64-linux-gnu/../src/Processors/Transforms/ExceptionKeepingTransform.cpp:90: DB::runStep(std::__1::function<void ()>, DB::ThreadStatus*, std::__1::atomic<unsigned long>*) @ 0x2917d192 in /usr/bin/clickhouse
E           6. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:2191: DB::ExceptionKeepingTransform::work() @ 0x2917cb06 in /usr/bin/clickhouse
E           7. ./obj-x86_64-linux-gnu/../src/Processors/Executors/ExecutionThreadContext.cpp:0: DB::ExecutionThreadContext::executeTask() @ 0x28d1a5a6 in /usr/bin/clickhouse
E           8. ./obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:213: DB::PipelineExecutor::executeStepImpl(unsigned long, std::__1::atomic<bool>*) @ 0x28cfaa87 in /usr/bin/clickhouse
E           9. ./obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:0: DB::PipelineExecutor::executeImpl(unsigned long) @ 0x28cf8faf in /usr/bin/clickhouse
E           10. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1627: DB::PipelineExecutor::execute(unsigned long) @ 0x28cf8270 in /usr/bin/clickhouse
E           11. ./obj-x86_64-linux-gnu/../src/Processors/Executors/CompletedPipelineExecutor.cpp:49: void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__fun
ction::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), vo
id ()> >(std::__1::__function::__policy_storage const*) @ 0x28cf66c6 in /usr/bin/clickhouse
E           12. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:0: ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xbe3cf0
7 in /usr/bin/clickhouse
E           13. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1655: void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1:
:default_delete<std::__1::__thread_struct> >, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda0
'()> >(void*) @ 0xbe45277 in /usr/bin/clickhouse
E           14. ? @ 0x7fce220b0609 in ?
E           15. clone @ 0x7fce21fd7293 in ?
E           . (S3_ERROR)
E           (query: insert into table function s3(s3_orc, structure='a Int32, b String', format='ORC') select number, randomString(100) from numbers(5000000))

@alesapin alesapin changed the title Fix test_storage_s3 flakiness Make test_storage_s3 less flaky Dec 16, 2021
@alesapin alesapin merged commit fde9416 into ClickHouse:master Dec 16, 2021
@azat azat deleted the fix-test_storage_s3 branch December 17, 2021 07:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-not-for-changelog This PR should not be mentioned in the changelog

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants