-
Notifications
You must be signed in to change notification settings - Fork 8.3k
Potential data loss with use_metadata_cache=1 (an experimantal feature) #51182
Copy link
Copy link
Closed
Labels
experimental featureBug in the feature that should not be used in productionBug in the feature that should not be used in productionfuzzProblem found by one of the fuzzersProblem found by one of the fuzzers
Description
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:18.514254 [ 48914 ] {} <Fatal> : Logical error: 'false'.
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:18.515665 [ 49225 ] {} <Fatal> BaseDaemon: ########################################
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:18.515860 [ 49225 ] {} <Fatal> BaseDaemon: (version 23.6.1.1, build id: EDF57482C94001946F5EA4B0DD06BEDB9761D224, git hash: f268056850666273bac032be30698419db5393fd) (from thread 48914) (no query) Received signal Aborted (6)
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:18.516024 [ 49225 ] {} <Fatal> BaseDaemon:
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:18.516163 [ 49225 ] {} <Fatal> BaseDaemon: Stack trace: 0x00007f6ee206d00b 0x00007f6ee204c859 0x00000000244d807e 0x000000002de487c9 0x000000002de436dc 0x000000002e8f463d 0x000000002e8f12b1 0x000000002e8f5978 0x000000002e8f5955 0x000000002e8f5935 0x000000002e8f5915 0x000000002e8f58dd 0x00000000245314b6 0x00000000245309b5 0x000000002b88b89d 0x000000002b88e5c6 0x000000002b88f638 0x000000002b88f615 0x000000002b88f5f9 0x000000002b88f55d 0x000000002b88f480 0x000000002b88f3f5 0x000000002b88f3d5 0x000000002b88f3b5 0x000000002b88f380 0x00000000245314b6 0x00000000245309b5 0x0000000024636d03 0x000000002463df24 0x000000002463ded5 0x000000002463ddfd 0x000000002463d8e2 0x00007f6ee2224609 0x00007f6ee2149133
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:18.516331 [ 49225 ] {} <Fatal> BaseDaemon: 4. gsignal @ 0x00007f6ee206d00b in ?
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:18.516462 [ 49225 ] {} <Fatal> BaseDaemon: 5. abort @ 0x00007f6ee204c859 in ?
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:18.645858 [ 49225 ] {} <Fatal> BaseDaemon: 6. /build/src/Common/Exception.cpp:42: DB::abortOnFailedAssertion(String const&) @ 0x00000000244d807e in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:19.735566 [ 49225 ] {} <Fatal> BaseDaemon: 7. /build/src/Storages/StorageReplicatedMergeTree.cpp:1265: DB::paranoidCheckForCoveredPartsInZooKeeperOnStart(DB::StorageReplicatedMergeTree const*, std::vector<String, std::allocator<String>> const&, StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>, Poco::Logger*) @ 0x000000002de487c9 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:20.596069 [ 49225 ] {} <Fatal> BaseDaemon: 8. /build/src/Storages/StorageReplicatedMergeTree.cpp:1275: DB::StorageReplicatedMergeTree::checkParts(bool) @ 0x000000002de436dc in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:20.735433 [ 49225 ] {} <Fatal> BaseDaemon: 9. /build/src/Storages/MergeTree/ReplicatedMergeTreeAttachThread.cpp:176: DB::ReplicatedMergeTreeAttachThread::runImpl() @ 0x000000002e8f463d in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:20.873578 [ 49225 ] {} <Fatal> BaseDaemon: 10. /build/src/Storages/MergeTree/ReplicatedMergeTreeAttachThread.cpp:50: DB::ReplicatedMergeTreeAttachThread::run() @ 0x000000002e8f12b1 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:21.028882 [ 49225 ] {} <Fatal> BaseDaemon: 11. /build/src/Storages/MergeTree/ReplicatedMergeTreeAttachThread.cpp:19: DB::ReplicatedMergeTreeAttachThread::ReplicatedMergeTreeAttachThread(DB::StorageReplicatedMergeTree&)::$_0::operator()() const @ 0x000000002e8f5978 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:21.187997 [ 49225 ] {} <Fatal> BaseDaemon: 12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval<DB::ReplicatedMergeTreeAttachThread::ReplicatedMergeTreeAttachThread(DB::StorageReplicatedMergeTree&)::$_0&>()()) std::__invoke[abi:v15000]<DB::ReplicatedMergeTreeAttachThread::ReplicatedMergeTreeAttachThread(DB::StorageReplicatedMergeTree&)::$_0&>(DB::ReplicatedMergeTreeAttachThread::ReplicatedMergeTreeAttachThread(DB::StorageReplicatedMergeTree&)::$_0&) @ 0x000000002e8f5955 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:21.343853 [ 49225 ] {} <Fatal> BaseDaemon: 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper<void, true>::__call<DB::ReplicatedMergeTreeAttachThread::ReplicatedMergeTreeAttachThread(DB::StorageReplicatedMergeTree&)::$_0&>(DB::ReplicatedMergeTreeAttachThread::ReplicatedMergeTreeAttachThread(DB::StorageReplicatedMergeTree&)::$_0&) @ 0x000000002e8f5935 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:21.499273 [ 49225 ] {} <Fatal> BaseDaemon: 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func<DB::ReplicatedMergeTreeAttachThread::ReplicatedMergeTreeAttachThread(DB::StorageReplicatedMergeTree&)::$_0, void ()>::operator()[abi:v15000]() @ 0x000000002e8f5915 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:21.654819 [ 49225 ] {} <Fatal> BaseDaemon: 15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<DB::ReplicatedMergeTreeAttachThread::ReplicatedMergeTreeAttachThread(DB::StorageReplicatedMergeTree&)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x000000002e8f58dd in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:21.706778 [ 49225 ] {} <Fatal> BaseDaemon: 16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func<void ()>::operator()[abi:v15000]() const @ 0x00000000245314b6 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:21.755003 [ 49225 ] {} <Fatal> BaseDaemon: 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function<void ()>::operator()() const @ 0x00000000245309b5 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:21.806845 [ 49225 ] {} <Fatal> BaseDaemon: 18. /build/src/Core/BackgroundSchedulePool.cpp:104: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000002b88b89d in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:21.871899 [ 49225 ] {} <Fatal> BaseDaemon: 19. /build/src/Core/BackgroundSchedulePool.cpp:302: DB::BackgroundSchedulePool::threadFunction() @ 0x000000002b88e5c6 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:21.943574 [ 49225 ] {} <Fatal> BaseDaemon: 20. /build/src/Core/BackgroundSchedulePool.cpp:168: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0::operator()() const @ 0x000000002b88f638 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.018375 [ 49225 ] {} <Fatal> BaseDaemon: 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&>()()) std::__invoke[abi:v15000]<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&) @ 0x000000002b88f615 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.094635 [ 49225 ] {} <Fatal> BaseDaemon: 22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000002b88f5f9 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.169456 [ 49225 ] {} <Fatal> BaseDaemon: 23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&, std::tuple<>&) @ 0x000000002b88f55d in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.227617 [ 49225 ] {} <Fatal> BaseDaemon: 24. /build/src/Common/ThreadPool.h:229: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'()::operator()() @ 0x000000002b88f480 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.302825 [ 49225 ] {} <Fatal> BaseDaemon: 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>()()) std::__invoke[abi:v15000]<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'()&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&) @ 0x000000002b88f3f5 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.379637 [ 49225 ] {} <Fatal> BaseDaemon: 26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'()&) @ 0x000000002b88f3d5 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.451667 [ 49225 ] {} <Fatal> BaseDaemon: 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000002b88f3b5 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.523664 [ 49225 ] {} <Fatal> BaseDaemon: 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker<void ()>::__call_impl<std::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002b88f380 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.575722 [ 49225 ] {} <Fatal> BaseDaemon: 29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func<void ()>::operator()[abi:v15000]() const @ 0x00000000245314b6 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.623986 [ 49225 ] {} <Fatal> BaseDaemon: 30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function<void ()>::operator()() const @ 0x00000000245309b5 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.688004 [ 49225 ] {} <Fatal> BaseDaemon: 31. /build/src/Common/ThreadPool.cpp:416: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x0000000024636d03 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.765212 [ 49225 ] {} <Fatal> BaseDaemon: 32. /build/src/Common/ThreadPool.cpp:180: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x000000002463df24 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.848048 [ 49225 ] {} <Fatal> BaseDaemon: 33. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval<void>()()) std::__invoke[abi:v15000]<void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&) @ 0x000000002463ded5 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:22.930928 [ 49225 ] {} <Fatal> BaseDaemon: 34. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x000000002463ddfd in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:23.013341 [ 49225 ] {} <Fatal> BaseDaemon: 35. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x000000002463d8e2 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.final.log:2023.06.19 23:34:23.013444 [ 49225 ] {} <Fatal> BaseDaemon: 36. ? @ 0x00007f6ee2224609 in ?
cc @tavplubix
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
experimental featureBug in the feature that should not be used in productionBug in the feature that should not be used in productionfuzzProblem found by one of the fuzzersProblem found by one of the fuzzers