-
Notifications
You must be signed in to change notification settings - Fork 8.3k
Logical error: 'Temporary part tmp_clone_all_64_64_0_70 already added' #86050
Copy link
Copy link
Closed
Labels
flaky testflaky test found by CIflaky test found by CI
Description
2025.08.22 15:33:15.872696 [ 3869 ] {e0ce4478-956b-4eb7-95c2-12b5586e53eb::all_64_64_0_70} <Fatal> : Logical error: 'Temporary part tmp_clone_all_64_64_0_70 already added'.
2025.08.22 15:33:15.896211 [ 3869 ] {e0ce4478-956b-4eb7-95c2-12b5586e53eb::all_64_64_0_70} <Fatal> : Stack trace (when copying this message, always include the lines below):
2025.08.22 15:33:15.896431 [ 2289 ] {} <Fatal> BaseDaemon: ########## Short fault info ############
2025.08.22 15:33:15.896450 [ 2289 ] {} <Fatal> BaseDaemon: (version 25.8.1.1, build id: 9F632835F43B6A43F7008DB020A0880A042CBA77, git hash: 813eba7052b4664491523a052835cc41f5ab8f06, architecture: x86_64) (from thread 3869) Received signal 6
2025.08.22 15:33:15.896454 [ 2289 ] {} <Fatal> BaseDaemon: Signal description: Aborted
2025.08.22 15:33:15.896456 [ 2289 ] {} <Fatal> BaseDaemon:
2025.08.22 15:33:15.896473 [ 2289 ] {} <Fatal> BaseDaemon: Stack trace: 0x00007fd9f2b0e9fd 0x00007fd9f2aba476 0x00007fd9f2aa07f3 0x000056345d84ba53 0x000056345d84c2ac 0x000056345d84c56c 0x0000563456e2138e 0x0000563456e20f80 0x0000563457ee03ab 0x00005634670f1c50 0x0000563466d62ae3 0x0000563466db72f4 0x00005634668d22ce 0x00005634667f858b 0x00005634667e7f06 0x000056346703fc5c 0x000056346703ec9f 0x000056346703d7bc 0x0000563466cf0987 0x0000563466cf11b3 0x000056345d998055 0x000056345d99d7a6 0x000056345d995aa0 0x000056345d99b8bb 0x00007fd9f2b0cac3 0x00007fd9f2b9e850
2025.08.22 15:33:15.896485 [ 2289 ] {} <Fatal> BaseDaemon: ########################################
2025.08.22 15:33:15.896493 [ 2289 ] {} <Fatal> BaseDaemon: (version 25.8.1.1, build id: 9F632835F43B6A43F7008DB020A0880A042CBA77, git hash: 813eba7052b4664491523a052835cc41f5ab8f06) (from thread 3869) (query_id: e0ce4478-956b-4eb7-95c2-12b5586e53eb::all_64_64_0_70) (query: ) Received signal Aborted (6)
2025.08.22 15:33:15.896496 [ 2289 ] {} <Fatal> BaseDaemon:
2025.08.22 15:33:15.896497 [ 2289 ] {} <Fatal> BaseDaemon: Stack trace: 0x00007fd9f2b0e9fd 0x00007fd9f2aba476 0x00007fd9f2aa07f3 0x000056345d84ba53 0x000056345d84c2ac 0x000056345d84c56c 0x0000563456e2138e 0x0000563456e20f80 0x0000563457ee03ab 0x00005634670f1c50 0x0000563466d62ae3 0x0000563466db72f4 0x00005634668d22ce 0x00005634667f858b 0x00005634667e7f06 0x000056346703fc5c 0x000056346703ec9f 0x000056346703d7bc 0x0000563466cf0987 0x0000563466cf11b3 0x000056345d998055 0x000056345d99d7a6 0x000056345d995aa0 0x000056345d99b8bb 0x00007fd9f2b0cac3 0x00007fd9f2b9e850
2025.08.22 15:33:15.896530 [ 2289 ] {} <Fatal> BaseDaemon: 3. ? @ 0x00000000000969fd
2025.08.22 15:33:15.896534 [ 2289 ] {} <Fatal> BaseDaemon: 4. ? @ 0x0000000000042476
2025.08.22 15:33:15.896550 [ 2289 ] {} <Fatal> BaseDaemon: 5. ? @ 0x00000000000287f3
2025.08.22 15:33:15.906628 [ 2289 ] {} <Fatal> BaseDaemon: 6. ./ci/tmp/build/./src/Common/Exception.cpp:51: DB::abortOnFailedAssertion(String const&, void* const*, unsigned long, unsigned long) @ 0x000000000f957a53
2025.08.22 15:33:15.915913 [ 2289 ] {} <Fatal> BaseDaemon: 7. ./ci/tmp/build/./src/Common/Exception.cpp:84: DB::handle_error_code(String const&, std::basic_string_view<char, std::char_traits<char>>, int, bool, std::vector<void*, std::allocator<void*>> const&) @ 0x000000000f9582ac
2025.08.22 15:33:15.925868 [ 2289 ] {} <Fatal> BaseDaemon: 8. ./ci/tmp/build/./src/Common/Exception.cpp:135: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000f95856c
2025.08.22 15:33:15.967247 [ 2289 ] {} <Fatal> BaseDaemon: 9. DB::Exception::Exception(String&&, int, String, bool) @ 0x0000000008f2d38e
2025.08.22 15:33:15.993616 [ 2289 ] {} <Fatal> BaseDaemon: 10. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x0000000008f2cf80
2025.08.22 15:33:16.020757 [ 2289 ] {} <Fatal> BaseDaemon: 11. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x0000000009fec3ab
2025.08.22 15:33:16.023959 [ 2289 ] {} <Fatal> BaseDaemon: 12. ./ci/tmp/build/./src/Storages/MergeTree/TemporaryParts.cpp:23: DB::TemporaryParts::add(String const&) @ 0x00000000191fdc50
2025.08.22 15:33:16.145131 [ 2289 ] {} <Fatal> BaseDaemon: 13. ./ci/tmp/build/./src/Storages/MergeTree/MergeTreeData.cpp:3050: DB::MergeTreeData::getTemporaryPartDirectoryHolder(String const&) const @ 0x0000000018e6eae3
2025.08.22 15:33:16.370967 [ 2289 ] {} <Fatal> BaseDaemon: 14. ./ci/tmp/build/./src/Storages/MergeTree/MergeTreeData.cpp:8426: DB::MergeTreeData::cloneAndLoadDataPart(std::shared_ptr<DB::IMergeTreeDataPart const> const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::IDataPartStorage::ClonePartParams const&, DB::ReadSettings const&, DB::WriteSettings const&, bool) @ 0x0000000018ec32f4
2025.08.22 15:33:16.686453 [ 2289 ] {} <Fatal> BaseDaemon: 15.0. inlined from ./ci/tmp/build/./src/Storages/StorageReplicatedMergeTree.cpp:5302: operator()
2025.08.22 15:33:16.686492 [ 2289 ] {} <Fatal> BaseDaemon: 15.1. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:149: decltype(std::declval<DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_3&>()()) std::__invoke[abi:ne190107]<DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_3&>(DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_3&)
2025.08.22 15:33:16.686510 [ 2289 ] {} <Fatal> BaseDaemon: 15.2. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:216: std::shared_ptr<DB::IMergeTreeDataPart> std::__invoke_void_return_wrapper<std::shared_ptr<DB::IMergeTreeDataPart>, false>::__call[abi:ne190107]<DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_3&>(DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_3&)
2025.08.22 15:33:16.686515 [ 2289 ] {} <Fatal> BaseDaemon: 15.3. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:210: ?
2025.08.22 15:33:16.686519 [ 2289 ] {} <Fatal> BaseDaemon: 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:610: ? @ 0x00000000189de2ce
2025.08.22 15:33:16.811972 [ 2289 ] {} <Fatal> BaseDaemon: 16.0. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ?
2025.08.22 15:33:16.811998 [ 2289 ] {} <Fatal> BaseDaemon: 16.1. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:989: ?
2025.08.22 15:33:16.812016 [ 2289 ] {} <Fatal> BaseDaemon: 16. ./ci/tmp/build/./src/Storages/StorageReplicatedMergeTree.cpp:5354: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool) @ 0x000000001890458b
2025.08.22 15:33:17.021730 [ 2289 ] {} <Fatal> BaseDaemon: 17. ./ci/tmp/build/./src/Storages/StorageReplicatedMergeTree.cpp:2598: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000188f3f06
2025.08.22 15:33:17.031020 [ 2289 ] {} <Fatal> BaseDaemon: 18. ./ci/tmp/build/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:168: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x000000001914bc5c
2025.08.22 15:33:17.039335 [ 2289 ] {} <Fatal> BaseDaemon: 19. ./ci/tmp/build/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:224: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x000000001914ac9f
2025.08.22 15:33:17.047266 [ 2289 ] {} <Fatal> BaseDaemon: 20. ./ci/tmp/build/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:56: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000191497bc
2025.08.22 15:33:17.059830 [ 2289 ] {} <Fatal> BaseDaemon: 21. ./ci/tmp/build/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:305: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x0000000018dfc987
2025.08.22 15:33:17.071981 [ 2289 ] {} <Fatal> BaseDaemon: 22. ./ci/tmp/build/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:369: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x0000000018dfd1b3
2025.08.22 15:33:17.082611 [ 2289 ] {} <Fatal> BaseDaemon: 23.0. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ?
2025.08.22 15:33:17.082622 [ 2289 ] {} <Fatal> BaseDaemon: 23.1. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:989: ?
2025.08.22 15:33:17.082625 [ 2289 ] {} <Fatal> BaseDaemon: 23. ./ci/tmp/build/./src/Common/ThreadPool.cpp:802: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::worker() @ 0x000000000faa4055
2025.08.22 15:33:17.091028 [ 2289 ] {} <Fatal> BaseDaemon: 24.0. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:117: decltype(*std::declval<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&>().*std::declval<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)()>()()) std::__invoke[abi:ne190107]<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&, void>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&)
2025.08.22 15:33:17.091046 [ 2289 ] {} <Fatal> BaseDaemon: 24.1. inlined from ./contrib/llvm-project/libcxx/include/tuple:1354: decltype(auto) std::__apply_tuple_impl[abi:ne190107]<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&, 0ul>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&, std::__tuple_indices<0ul>)
2025.08.22 15:33:17.091051 [ 2289 ] {} <Fatal> BaseDaemon: 24.2. inlined from ./contrib/llvm-project/libcxx/include/tuple:1358: decltype(auto) std::apply[abi:ne190107]<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&)
2025.08.22 15:33:17.091054 [ 2289 ] {} <Fatal> BaseDaemon: 24. ./src/Common/ThreadPool.h:312: ThreadFromGlobalPoolImpl<false, true>::ThreadFromGlobalPoolImpl<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&&)::'lambda'()::operator()() @ 0x000000000faa97a6
2025.08.22 15:33:17.098686 [ 2289 ] {} <Fatal> BaseDaemon: 25.0. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ?
2025.08.22 15:33:17.098692 [ 2289 ] {} <Fatal> BaseDaemon: 25.1. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:989: ?
2025.08.22 15:33:17.098697 [ 2289 ] {} <Fatal> BaseDaemon: 25. ./ci/tmp/build/./src/Common/ThreadPool.cpp:812: ThreadPoolImpl<std::thread>::ThreadFromThreadPool::worker() @ 0x000000000faa1aa0
2025.08.22 15:33:17.114232 [ 2289 ] {} <Fatal> BaseDaemon: 26.0. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:117: decltype(*std::declval<ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>().*std::declval<void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)()>()()) std::__invoke[abi:ne190107]<void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*, void>(void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*&&)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*&&)
2025.08.22 15:33:17.114251 [ 2289 ] {} <Fatal> BaseDaemon: 26.1. inlined from ./contrib/llvm-project/libcxx/include/__thread/thread.h:192: void std::__thread_execute[abi:ne190107]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*, 2ul>(std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>&, std::__tuple_indices<2ul>)
2025.08.22 15:33:17.114255 [ 2289 ] {} <Fatal> BaseDaemon: 26. ./contrib/llvm-project/libcxx/include/__thread/thread.h:201: void* std::__thread_proxy[abi:ne190107]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>>(void*) @ 0x000000000faa78bb
2025.08.22 15:33:17.114276 [ 2289 ] {} <Fatal> BaseDaemon: 27. ? @ 0x0000000000094ac3
2025.08.22 15:33:17.114281 [ 2289 ] {} <Fatal> BaseDaemon: 28. ? @ 0x0000000000126850
2025.08.22 15:33:17.114286 [ 2289 ] {} <Fatal> BaseDaemon: Integrity check of the executable skipped because the reference checksum could not be read.
2025.08.22 15:33:19.750594 [ 2289 ] {} <Fatal> BaseDaemon: Changed settings: connect_timeout_with_failover_ms = 2000, connect_timeout_with_failover_secure_ms = 3000, idle_connection_timeout = 36000, s3_max_get_rps = 1000000, s3_max_get_burst = 2000000, s3_max_put_rps = 1000000, s3_max_put_burst = 2000000, s3_check_objects_after_upload = true, max_remote_read_network_bandwidth = 1000000000000, max_remote_write_network_bandwidth = 1000000000000, max_local_read_bandwidth = 1000000000000, max_local_write_bandwidth = 1000000000000, stream_like_engine_allow_direct_select = true, replication_wait_for_inactive_replica_timeout = 30, allow_nonconst_timezone_arguments = true, log_queries = true, insert_quorum_timeout = 60000, fsync_metadata = false, distributed_ddl_task_timeout = 120, http_send_timeout = 60., http_receive_timeout = 60., use_index_for_in_with_subqueries_max_values = 1000000000, opentelemetry_start_trace_probability = 0.10000000149011612, max_rows_to_read = 20000000, max_bytes_to_read = 1000000000000, max_bytes_to_read_leaf = 1000000000000, max_rows_to_group_by = 10000000000, max_rows_to_sort = 10000000000, max_bytes_to_sort = 10000000000, max_result_rows = 1000000000, max_result_bytes = 1000000000, max_execution_speed = 100000000000, max_execution_speed_bytes = 10000000000000, timeout_before_checking_execution_speed = 300., max_estimated_execution_time = 600., max_columns_to_read = 20000, max_temporary_columns = 20000, max_temporary_non_const_columns = 20000, max_rows_in_set = 10000000000, max_bytes_in_set = 10000000000, max_rows_in_join = 10000000000, max_bytes_in_join = 10000000000, max_rows_to_transfer = 1000000000, max_bytes_to_transfer = 1000000000, max_rows_in_distinct = 10000000000, max_bytes_in_distinct = 10000000000, max_memory_usage = 5000000000, max_memory_usage_for_user = 32000000000, max_untracked_memory = 1048576, memory_profiler_step = 1048576, max_network_bandwidth = 100000000000, max_network_bytes = 1000000000000, max_network_bandwidth_for_user = 100000000000, max_network_bandwidth_for_all_users = 100000000000, max_temporary_data_on_disk_size_for_user = 100000000000, max_temporary_data_on_disk_size_for_query = 100000000000, max_backup_bandwidth = 100000000000, max_hyperscan_regexp_length = 1000000, max_hyperscan_regexp_total_length = 10000000, allow_introspection_functions = true, database_atomic_wait_for_drop_and_detach_synchronously = true, lock_acquire_timeout = 60., query_cache_max_size_in_bytes = 10000000, query_cache_max_entries = 100000, database_replicated_initial_query_timeout_sec = 120, database_replicated_enforce_synchronous_settings = true, database_replicated_always_detach_permanently = true, database_replicated_allow_replicated_engine_arguments = 3, distributed_ddl_output_mode = 'none', distributed_ddl_entry_format_version = 6, external_storage_max_read_rows = 10000000000, external_storage_max_read_bytes = 10000000000, async_insert_busy_timeout_max_ms = 5000, enable_filesystem_cache = true, enable_filesystem_cache_on_write_operations = true, filesystem_cache_segments_batch_size = 10, load_marks_asynchronously = true, allow_prefetched_read_pool_for_remote_filesystem = false, allow_prefetched_read_pool_for_local_filesystem = false, filesystem_prefetch_max_memory_usage = 1073741824, max_streams_for_merge_tree_reading = 1000, workload = 'default', insert_keeper_max_retries = 100, insert_keeper_retry_initial_backoff_ms = 1, insert_keeper_retry_max_backoff_ms = 10, insert_keeper_fault_injection_probability = 0.009999999776482582, allow_experimental_analyzer = false
It comes from test 02962_system_sync_replica_lightweight_from_modifier
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
flaky testflaky test found by CIflaky test found by CI