Skip to content

Logical error: 'Temporary part tmp_clone_all_64_64_0_70 already added' #86050

@Avogar

Description

@Avogar

https://s3.amazonaws.com/clickhouse-test-reports/json.html?PR=74079&sha=latest&name_0=PR&name_1=Stateless+tests+%28amd_binary%2C+old+analyzer%2C+s3+storage%2C+DatabaseReplicated%2C+sequential%29&name_2=Tests

2025.08.22 15:33:15.872696 [ 3869 ] {e0ce4478-956b-4eb7-95c2-12b5586e53eb::all_64_64_0_70} <Fatal> : Logical error: 'Temporary part tmp_clone_all_64_64_0_70 already added'.
2025.08.22 15:33:15.896211 [ 3869 ] {e0ce4478-956b-4eb7-95c2-12b5586e53eb::all_64_64_0_70} <Fatal> : Stack trace (when copying this message, always include the lines below):
2025.08.22 15:33:15.896431 [ 2289 ] {} <Fatal> BaseDaemon: ########## Short fault info ############
2025.08.22 15:33:15.896450 [ 2289 ] {} <Fatal> BaseDaemon: (version 25.8.1.1, build id: 9F632835F43B6A43F7008DB020A0880A042CBA77, git hash: 813eba7052b4664491523a052835cc41f5ab8f06, architecture: x86_64) (from thread 3869) Received signal 6
2025.08.22 15:33:15.896454 [ 2289 ] {} <Fatal> BaseDaemon: Signal description: Aborted
2025.08.22 15:33:15.896456 [ 2289 ] {} <Fatal> BaseDaemon:
2025.08.22 15:33:15.896473 [ 2289 ] {} <Fatal> BaseDaemon: Stack trace: 0x00007fd9f2b0e9fd 0x00007fd9f2aba476 0x00007fd9f2aa07f3 0x000056345d84ba53 0x000056345d84c2ac 0x000056345d84c56c 0x0000563456e2138e 0x0000563456e20f80 0x0000563457ee03ab 0x00005634670f1c50 0x0000563466d62ae3 0x0000563466db72f4 0x00005634668d22ce 0x00005634667f858b 0x00005634667e7f06 0x000056346703fc5c 0x000056346703ec9f 0x000056346703d7bc 0x0000563466cf0987 0x0000563466cf11b3 0x000056345d998055 0x000056345d99d7a6 0x000056345d995aa0 0x000056345d99b8bb 0x00007fd9f2b0cac3 0x00007fd9f2b9e850
2025.08.22 15:33:15.896485 [ 2289 ] {} <Fatal> BaseDaemon: ########################################
2025.08.22 15:33:15.896493 [ 2289 ] {} <Fatal> BaseDaemon: (version 25.8.1.1, build id: 9F632835F43B6A43F7008DB020A0880A042CBA77, git hash: 813eba7052b4664491523a052835cc41f5ab8f06) (from thread 3869) (query_id: e0ce4478-956b-4eb7-95c2-12b5586e53eb::all_64_64_0_70) (query: ) Received signal Aborted (6)
2025.08.22 15:33:15.896496 [ 2289 ] {} <Fatal> BaseDaemon:
2025.08.22 15:33:15.896497 [ 2289 ] {} <Fatal> BaseDaemon: Stack trace: 0x00007fd9f2b0e9fd 0x00007fd9f2aba476 0x00007fd9f2aa07f3 0x000056345d84ba53 0x000056345d84c2ac 0x000056345d84c56c 0x0000563456e2138e 0x0000563456e20f80 0x0000563457ee03ab 0x00005634670f1c50 0x0000563466d62ae3 0x0000563466db72f4 0x00005634668d22ce 0x00005634667f858b 0x00005634667e7f06 0x000056346703fc5c 0x000056346703ec9f 0x000056346703d7bc 0x0000563466cf0987 0x0000563466cf11b3 0x000056345d998055 0x000056345d99d7a6 0x000056345d995aa0 0x000056345d99b8bb 0x00007fd9f2b0cac3 0x00007fd9f2b9e850
2025.08.22 15:33:15.896530 [ 2289 ] {} <Fatal> BaseDaemon: 3. ? @ 0x00000000000969fd
2025.08.22 15:33:15.896534 [ 2289 ] {} <Fatal> BaseDaemon: 4. ? @ 0x0000000000042476
2025.08.22 15:33:15.896550 [ 2289 ] {} <Fatal> BaseDaemon: 5. ? @ 0x00000000000287f3
2025.08.22 15:33:15.906628 [ 2289 ] {} <Fatal> BaseDaemon: 6. ./ci/tmp/build/./src/Common/Exception.cpp:51: DB::abortOnFailedAssertion(String const&, void* const*, unsigned long, unsigned long) @ 0x000000000f957a53
2025.08.22 15:33:15.915913 [ 2289 ] {} <Fatal> BaseDaemon: 7. ./ci/tmp/build/./src/Common/Exception.cpp:84: DB::handle_error_code(String const&, std::basic_string_view<char, std::char_traits<char>>, int, bool, std::vector<void*, std::allocator<void*>> const&) @ 0x000000000f9582ac
2025.08.22 15:33:15.925868 [ 2289 ] {} <Fatal> BaseDaemon: 8. ./ci/tmp/build/./src/Common/Exception.cpp:135: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000f95856c
2025.08.22 15:33:15.967247 [ 2289 ] {} <Fatal> BaseDaemon: 9. DB::Exception::Exception(String&&, int, String, bool) @ 0x0000000008f2d38e
2025.08.22 15:33:15.993616 [ 2289 ] {} <Fatal> BaseDaemon: 10. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x0000000008f2cf80
2025.08.22 15:33:16.020757 [ 2289 ] {} <Fatal> BaseDaemon: 11. DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x0000000009fec3ab
2025.08.22 15:33:16.023959 [ 2289 ] {} <Fatal> BaseDaemon: 12. ./ci/tmp/build/./src/Storages/MergeTree/TemporaryParts.cpp:23: DB::TemporaryParts::add(String const&) @ 0x00000000191fdc50
2025.08.22 15:33:16.145131 [ 2289 ] {} <Fatal> BaseDaemon: 13. ./ci/tmp/build/./src/Storages/MergeTree/MergeTreeData.cpp:3050: DB::MergeTreeData::getTemporaryPartDirectoryHolder(String const&) const @ 0x0000000018e6eae3
2025.08.22 15:33:16.370967 [ 2289 ] {} <Fatal> BaseDaemon: 14. ./ci/tmp/build/./src/Storages/MergeTree/MergeTreeData.cpp:8426: DB::MergeTreeData::cloneAndLoadDataPart(std::shared_ptr<DB::IMergeTreeDataPart const> const&, String const&, DB::MergeTreePartInfo const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::IDataPartStorage::ClonePartParams const&, DB::ReadSettings const&, DB::WriteSettings const&, bool) @ 0x0000000018ec32f4
2025.08.22 15:33:16.686453 [ 2289 ] {} <Fatal> BaseDaemon: 15.0. inlined from ./ci/tmp/build/./src/Storages/StorageReplicatedMergeTree.cpp:5302: operator()
2025.08.22 15:33:16.686492 [ 2289 ] {} <Fatal> BaseDaemon: 15.1. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:149: decltype(std::declval<DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_3&>()()) std::__invoke[abi:ne190107]<DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_3&>(DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_3&)
2025.08.22 15:33:16.686510 [ 2289 ] {} <Fatal> BaseDaemon: 15.2. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:216: std::shared_ptr<DB::IMergeTreeDataPart> std::__invoke_void_return_wrapper<std::shared_ptr<DB::IMergeTreeDataPart>, false>::__call[abi:ne190107]<DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_3&>(DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool)::$_3&)
2025.08.22 15:33:16.686515 [ 2289 ] {} <Fatal> BaseDaemon: 15.3. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:210: ?
2025.08.22 15:33:16.686519 [ 2289 ] {} <Fatal> BaseDaemon: 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:610: ? @ 0x00000000189de2ce
2025.08.22 15:33:16.811972 [ 2289 ] {} <Fatal> BaseDaemon: 16.0. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ?
2025.08.22 15:33:16.811998 [ 2289 ] {} <Fatal> BaseDaemon: 16.1. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:989: ?
2025.08.22 15:33:16.812016 [ 2289 ] {} <Fatal> BaseDaemon: 16. ./ci/tmp/build/./src/Storages/StorageReplicatedMergeTree.cpp:5354: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, String const&, String const&, bool, unsigned long, std::shared_ptr<zkutil::ZooKeeper>, bool) @ 0x000000001890458b
2025.08.22 15:33:17.021730 [ 2289 ] {} <Fatal> BaseDaemon: 17. ./ci/tmp/build/./src/Storages/StorageReplicatedMergeTree.cpp:2598: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x00000000188f3f06
2025.08.22 15:33:17.031020 [ 2289 ] {} <Fatal> BaseDaemon: 18. ./ci/tmp/build/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:168: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x000000001914bc5c
2025.08.22 15:33:17.039335 [ 2289 ] {} <Fatal> BaseDaemon: 19. ./ci/tmp/build/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:224: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x000000001914ac9f
2025.08.22 15:33:17.047266 [ 2289 ] {} <Fatal> BaseDaemon: 20. ./ci/tmp/build/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:56: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x00000000191497bc
2025.08.22 15:33:17.059830 [ 2289 ] {} <Fatal> BaseDaemon: 21. ./ci/tmp/build/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:305: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x0000000018dfc987
2025.08.22 15:33:17.071981 [ 2289 ] {} <Fatal> BaseDaemon: 22. ./ci/tmp/build/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:369: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x0000000018dfd1b3
2025.08.22 15:33:17.082611 [ 2289 ] {} <Fatal> BaseDaemon: 23.0. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ?
2025.08.22 15:33:17.082622 [ 2289 ] {} <Fatal> BaseDaemon: 23.1. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:989: ?
2025.08.22 15:33:17.082625 [ 2289 ] {} <Fatal> BaseDaemon: 23. ./ci/tmp/build/./src/Common/ThreadPool.cpp:802: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::worker() @ 0x000000000faa4055
2025.08.22 15:33:17.091028 [ 2289 ] {} <Fatal> BaseDaemon: 24.0. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:117: decltype(*std::declval<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&>().*std::declval<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)()>()()) std::__invoke[abi:ne190107]<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&, void>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&)
2025.08.22 15:33:17.091046 [ 2289 ] {} <Fatal> BaseDaemon: 24.1. inlined from ./contrib/llvm-project/libcxx/include/tuple:1354: decltype(auto) std::__apply_tuple_impl[abi:ne190107]<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&, 0ul>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&, std::__tuple_indices<0ul>)
2025.08.22 15:33:17.091051 [ 2289 ] {} <Fatal> BaseDaemon: 24.2. inlined from ./contrib/llvm-project/libcxx/include/tuple:1358: decltype(auto) std::apply[abi:ne190107]<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&)
2025.08.22 15:33:17.091054 [ 2289 ] {} <Fatal> BaseDaemon: 24. ./src/Common/ThreadPool.h:312: ThreadFromGlobalPoolImpl<false, true>::ThreadFromGlobalPoolImpl<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&&)::'lambda'()::operator()() @ 0x000000000faa97a6
2025.08.22 15:33:17.098686 [ 2289 ] {} <Fatal> BaseDaemon: 25.0. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ?
2025.08.22 15:33:17.098692 [ 2289 ] {} <Fatal> BaseDaemon: 25.1. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:989: ?
2025.08.22 15:33:17.098697 [ 2289 ] {} <Fatal> BaseDaemon: 25. ./ci/tmp/build/./src/Common/ThreadPool.cpp:812: ThreadPoolImpl<std::thread>::ThreadFromThreadPool::worker() @ 0x000000000faa1aa0
2025.08.22 15:33:17.114232 [ 2289 ] {} <Fatal> BaseDaemon: 26.0. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:117: decltype(*std::declval<ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>().*std::declval<void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)()>()()) std::__invoke[abi:ne190107]<void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*, void>(void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*&&)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*&&)
2025.08.22 15:33:17.114251 [ 2289 ] {} <Fatal> BaseDaemon: 26.1. inlined from ./contrib/llvm-project/libcxx/include/__thread/thread.h:192: void std::__thread_execute[abi:ne190107]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*, 2ul>(std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>&, std::__tuple_indices<2ul>)
2025.08.22 15:33:17.114255 [ 2289 ] {} <Fatal> BaseDaemon: 26. ./contrib/llvm-project/libcxx/include/__thread/thread.h:201: void* std::__thread_proxy[abi:ne190107]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>>(void*) @ 0x000000000faa78bb
2025.08.22 15:33:17.114276 [ 2289 ] {} <Fatal> BaseDaemon: 27. ? @ 0x0000000000094ac3
2025.08.22 15:33:17.114281 [ 2289 ] {} <Fatal> BaseDaemon: 28. ? @ 0x0000000000126850
2025.08.22 15:33:17.114286 [ 2289 ] {} <Fatal> BaseDaemon: Integrity check of the executable skipped because the reference checksum could not be read.
2025.08.22 15:33:19.750594 [ 2289 ] {} <Fatal> BaseDaemon: Changed settings: connect_timeout_with_failover_ms = 2000, connect_timeout_with_failover_secure_ms = 3000, idle_connection_timeout = 36000, s3_max_get_rps = 1000000, s3_max_get_burst = 2000000, s3_max_put_rps = 1000000, s3_max_put_burst = 2000000, s3_check_objects_after_upload = true, max_remote_read_network_bandwidth = 1000000000000, max_remote_write_network_bandwidth = 1000000000000, max_local_read_bandwidth = 1000000000000, max_local_write_bandwidth = 1000000000000, stream_like_engine_allow_direct_select = true, replication_wait_for_inactive_replica_timeout = 30, allow_nonconst_timezone_arguments = true, log_queries = true, insert_quorum_timeout = 60000, fsync_metadata = false, distributed_ddl_task_timeout = 120, http_send_timeout = 60., http_receive_timeout = 60., use_index_for_in_with_subqueries_max_values = 1000000000, opentelemetry_start_trace_probability = 0.10000000149011612, max_rows_to_read = 20000000, max_bytes_to_read = 1000000000000, max_bytes_to_read_leaf = 1000000000000, max_rows_to_group_by = 10000000000, max_rows_to_sort = 10000000000, max_bytes_to_sort = 10000000000, max_result_rows = 1000000000, max_result_bytes = 1000000000, max_execution_speed = 100000000000, max_execution_speed_bytes = 10000000000000, timeout_before_checking_execution_speed = 300., max_estimated_execution_time = 600., max_columns_to_read = 20000, max_temporary_columns = 20000, max_temporary_non_const_columns = 20000, max_rows_in_set = 10000000000, max_bytes_in_set = 10000000000, max_rows_in_join = 10000000000, max_bytes_in_join = 10000000000, max_rows_to_transfer = 1000000000, max_bytes_to_transfer = 1000000000, max_rows_in_distinct = 10000000000, max_bytes_in_distinct = 10000000000, max_memory_usage = 5000000000, max_memory_usage_for_user = 32000000000, max_untracked_memory = 1048576, memory_profiler_step = 1048576, max_network_bandwidth = 100000000000, max_network_bytes = 1000000000000, max_network_bandwidth_for_user = 100000000000, max_network_bandwidth_for_all_users = 100000000000, max_temporary_data_on_disk_size_for_user = 100000000000, max_temporary_data_on_disk_size_for_query = 100000000000, max_backup_bandwidth = 100000000000, max_hyperscan_regexp_length = 1000000, max_hyperscan_regexp_total_length = 10000000, allow_introspection_functions = true, database_atomic_wait_for_drop_and_detach_synchronously = true, lock_acquire_timeout = 60., query_cache_max_size_in_bytes = 10000000, query_cache_max_entries = 100000, database_replicated_initial_query_timeout_sec = 120, database_replicated_enforce_synchronous_settings = true, database_replicated_always_detach_permanently = true, database_replicated_allow_replicated_engine_arguments = 3, distributed_ddl_output_mode = 'none', distributed_ddl_entry_format_version = 6, external_storage_max_read_rows = 10000000000, external_storage_max_read_bytes = 10000000000, async_insert_busy_timeout_max_ms = 5000, enable_filesystem_cache = true, enable_filesystem_cache_on_write_operations = true, filesystem_cache_segments_batch_size = 10, load_marks_asynchronously = true, allow_prefetched_read_pool_for_remote_filesystem = false, allow_prefetched_read_pool_for_local_filesystem = false, filesystem_prefetch_max_memory_usage = 1073741824, max_streams_for_merge_tree_reading = 1000, workload = 'default', insert_keeper_max_retries = 100, insert_keeper_retry_initial_backoff_ms = 1, insert_keeper_retry_max_backoff_ms = 10, insert_keeper_fault_injection_probability = 0.009999999776482582, allow_experimental_analyzer = false

It comes from test 02962_system_sync_replica_lightweight_from_modifier

Metadata

Metadata

Assignees

Labels

flaky testflaky test found by CI

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions