/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:07:41.935628 [ 116521 ] {0a2757c6-0435-4cc4-b823-90c718558618} <Fatal> : Logical error: 'Cannot cancel. Either no query sent or already cancelled.'.
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:17.915841 [ 152385 ] {} <Fatal> BaseDaemon: ########################################
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:17.915931 [ 152385 ] {} <Fatal> BaseDaemon: (version 23.4.1.1 (official build), build id: 80EEFB636197BB161578A9AC76D0BF17A37B6E67) (from thread 116521) (query_id: 0a2757c6-0435-4cc4-b823-90c718558618) (query: SELECT count() FROM remote('{1,127}.0.0.{2,3}', system.one) SETTINGS skip_unavailable_shards = 1;) Received signal Aborted (6)
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:17.915968 [ 152385 ] {} <Fatal> BaseDaemon: 
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:17.916023 [ 152385 ] {} <Fatal> BaseDaemon: Stack trace: 0x7fe8f9dd100b 0x7fe8f9db0859 0x24535fec 0x245368ee 0x1ed497ef 0x3225c1a8 0x2f61a315 0x2f61aae9 0x32447405 0x3243fc81 0x32440ca2 0x24648940 0x2464ce2f 0x246465d3 0x2464a3c4 0x7fe8f9f88609 0x7fe8f9ead133
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:17.916079 [ 152385 ] {} <Fatal> BaseDaemon: 3. gsignal @ 0x7fe8f9dd100b in ?
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:17.916122 [ 152385 ] {} <Fatal> BaseDaemon: 4. abort @ 0x7fe8f9db0859 in ?
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:17.946109 [ 152385 ] {} <Fatal> BaseDaemon: 5. ./build_docker/./src/Common/Exception.cpp:48: DB::abortOnFailedAssertion(String const&) @ 0x24535fec in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:17.971845 [ 152385 ] {} <Fatal> BaseDaemon: 6. ./build_docker/./src/Common/Exception.cpp:92: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x245368ee in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.682587 [ 152385 ] {} <Fatal> BaseDaemon: 7. DB::Exception::Exception<char const (&) [58], void>(int, char const (&) [58]) @ 0x1ed497ef in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.722109 [ 152385 ] {} <Fatal> BaseDaemon: 8. ./build_docker/./src/Client/HedgedConnections.cpp:243: DB::HedgedConnections::sendCancel() @ 0x3225c1a8 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.769681 [ 152385 ] {} <Fatal> BaseDaemon: 9. ./build_docker/./src/QueryPipeline/RemoteQueryExecutor.cpp:718: DB::RemoteQueryExecutor::tryCancel(char const*) @ 0x2f61a315 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.817224 [ 152385 ] {} <Fatal> BaseDaemon: 10.1. inlined from ./build_docker/./contrib/llvm-project/libcxx/include/__mutex_base:100: ~lock_guard
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.817283 [ 152385 ] {} <Fatal> BaseDaemon: 10. ./build_docker/./src/QueryPipeline/RemoteQueryExecutor.cpp:616: DB::RemoteQueryExecutor::cancel() @ 0x2f61aae9 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.842218 [ 152385 ] {} <Fatal> BaseDaemon: 11. ./build_docker/./src/Processors/Executors/ExecutingGraph.cpp:417: DB::ExecutingGraph::cancel(bool) @ 0x32447405 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.865743 [ 152385 ] {} <Fatal> BaseDaemon: 12.1. inlined from ./build_docker/./contrib/llvm-project/libcxx/include/atomic:958: bool std::__cxx_atomic_load[abi:v15000]<bool>(std::__cxx_atomic_base_impl<bool> const*, std::memory_order)
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.865795 [ 152385 ] {} <Fatal> BaseDaemon: 12.2. inlined from ./build_docker/./contrib/llvm-project/libcxx/include/atomic:1588: std::__atomic_base<bool, false>::load[abi:v15000](std::memory_order) const
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.865849 [ 152385 ] {} <Fatal> BaseDaemon: 12.3. inlined from ./build_docker/./contrib/llvm-project/libcxx/include/atomic:1592: std::__atomic_base<bool, false>::operator bool[abi:v15000]() const
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.865938 [ 152385 ] {} <Fatal> BaseDaemon: 12.4. inlined from ./build_docker/./src/Processors/Executors/ExecutorTasks.h:53: DB::ExecutorTasks::isFinished() const
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.865978 [ 152385 ] {} <Fatal> BaseDaemon: 12. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:258: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x3243fc81 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.894104 [ 152385 ] {} <Fatal> BaseDaemon: 13.1. inlined from ./build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:833: std::shared_ptr<DB::ThreadGroup>::operator bool[abi:v15000]() const
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.894190 [ 152385 ] {} <Fatal> BaseDaemon: 13.2. inlined from ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:332: operator()
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.894221 [ 152385 ] {} <Fatal> BaseDaemon: 13.3. inlined from ./build_docker/./base/base/../base/scope_guard.h:99: BasicScopeGuard<DB::PipelineExecutor::spawnThreads()::$_0::operator()() const::'lambda'()>::invoke()
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.894251 [ 152385 ] {} <Fatal> BaseDaemon: 13.4. inlined from ./build_docker/./base/base/../base/scope_guard.h:48: ~BasicScopeGuard
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.894289 [ 152385 ] {} <Fatal> BaseDaemon: 13.5. inlined from ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:351: operator()
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.894338 [ 152385 ] {} <Fatal> BaseDaemon: 13.6. inlined from ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval<DB::PipelineExecutor::spawnThreads()::$_0&>()()) std::__invoke[abi:v15000]<DB::PipelineExecutor::spawnThreads()::$_0&>(DB::PipelineExecutor::spawnThreads()::$_0&)
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.894455 [ 152385 ] {} <Fatal> BaseDaemon: 13.7. inlined from ./build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479: void std::__invoke_void_return_wrapper<void, true>::__call<DB::PipelineExecutor::spawnThreads()::$_0&>(DB::PipelineExecutor::spawnThreads()::$_0&)
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.894503 [ 152385 ] {} <Fatal> BaseDaemon: 13.8. inlined from ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>::operator()[abi:v15000]()
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.894535 [ 152385 ] {} <Fatal> BaseDaemon: 13. ./build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::PipelineExecutor::spawnThreads()::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x32440ca2 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.910760 [ 152385 ] {} <Fatal> BaseDaemon: 14.1. inlined from ./build_docker/./base/base/../base/wide_integer_impl.h:789: bool wide::integer<128ul, unsigned int>::_impl::operator_eq<wide::integer<128ul, unsigned int>>(wide::integer<128ul, unsigned int> const&, wide::integer<128ul, unsigned int> const&)
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.910851 [ 152385 ] {} <Fatal> BaseDaemon: 14.2. inlined from ./build_docker/./base/base/../base/wide_integer_impl.h:1456: bool wide::operator==<128ul, unsigned int, 128ul, unsigned int>(wide::integer<128ul, unsigned int> const&, wide::integer<128ul, unsigned int> const&)
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.910882 [ 152385 ] {} <Fatal> BaseDaemon: 14.3. inlined from ./build_docker/./base/base/../base/strong_typedef.h:42: StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>::operator==(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&) const
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.910921 [ 152385 ] {} <Fatal> BaseDaemon: 14.4. inlined from ./build_docker/./src/Common/OpenTelemetryTraceContext.h:65: DB::OpenTelemetry::Span::isTraceEnabled() const
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.910947 [ 152385 ] {} <Fatal> BaseDaemon: 14. ./build_docker/./src/Common/ThreadPool.cpp:415: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x24648940 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.925505 [ 152385 ] {} <Fatal> BaseDaemon: 15. ./build_docker/./src/Common/ThreadPool.cpp:0: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, long, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x2464ce2f in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.941914 [ 152385 ] {} <Fatal> BaseDaemon: 16.1. inlined from ./build_docker/./base/base/../base/wide_integer_impl.h:789: bool wide::integer<128ul, unsigned int>::_impl::operator_eq<wide::integer<128ul, unsigned int>>(wide::integer<128ul, unsigned int> const&, wide::integer<128ul, unsigned int> const&)
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.942014 [ 152385 ] {} <Fatal> BaseDaemon: 16.2. inlined from ./build_docker/./base/base/../base/wide_integer_impl.h:1456: bool wide::operator==<128ul, unsigned int, 128ul, unsigned int>(wide::integer<128ul, unsigned int> const&, wide::integer<128ul, unsigned int> const&)
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.942038 [ 152385 ] {} <Fatal> BaseDaemon: 16.3. inlined from ./build_docker/./base/base/../base/strong_typedef.h:42: StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>::operator==(StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&) const
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.942059 [ 152385 ] {} <Fatal> BaseDaemon: 16.4. inlined from ./build_docker/./src/Common/OpenTelemetryTraceContext.h:65: DB::OpenTelemetry::Span::isTraceEnabled() const
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.942080 [ 152385 ] {} <Fatal> BaseDaemon: 16. ./build_docker/./src/Common/ThreadPool.cpp:415: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x246465d3 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.962244 [ 152385 ] {} <Fatal> BaseDaemon: 17. ./build_docker/./src/Common/ThreadPool.cpp:0: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, long, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x2464a3c4 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.962333 [ 152385 ] {} <Fatal> BaseDaemon: 18. ? @ 0x7fe8f9f88609 in ?
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:21.962363 [ 152385 ] {} <Fatal> BaseDaemon: 19. clone @ 0x7fe8f9ead133 in ?
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:08:22.302314 [ 152385 ] {} <Fatal> BaseDaemon: Integrity check of the executable successfully passed (checksum: B9B805C1FDD8722B837F56148C15C060)
/var/log/clickhouse-server/clickhouse-server.err.log:2023.04.23 22:13:02.977034 [ 1678 ] {} <Fatal> Application: Child process was terminated by signal 6.