-
Notifications
You must be signed in to change notification settings - Fork 8.3k
Liveview-related (?) sigabort #29122
Copy link
Copy link
Closed
Labels
crashCrash / segfault / abortCrash / segfault / abortpotential bugTo be reviewed by developers and confirmed/rejected.To be reviewed by developers and confirmed/rejected.
Description
2021.09.15 06:50:25.803691 [ 91216 ] {9c658a50-6425-4b3d-9704-8a12f812ac5a} <Debug> executeQuery: (from 7.146.10.231:59686, user: xxxxx_user) watch foo
2021.09.15 06:50:25.803844 [ 91216 ] {9c658a50-6425-4b3d-9704-8a12f812ac5a} <Trace> ContextAccess (xxxxx_user): Access granted: SELECT(StartTime, AvgMid, Volume, `bar(Volume, 0, 10000)`) ON xxxxx.foo
2021.09.15 06:50:25.804730 [ 91216 ] {9c658a50-6425-4b3d-9704-8a12f812ac5a} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "SID = 188992" moved to PREWHERE
2021.09.15 06:50:25.805378 [ 91216 ] {9c658a50-6425-4b3d-9704-8a12f812ac5a} <Trace> InterpreterSelectQuery: FetchColumns -> WithMergeableState
2021.09.15 06:50:25.805691 [ 91216 ] {9c658a50-6425-4b3d-9704-8a12f812ac5a} <Debug> xxxxx.livebars_zzzzzz (dfa19a23-f36e-413c-83a1-5fb38c8886b4) (SelectExecutor): Key condition: (column 2 in [188992, 188992]), (column 0 in [20210915, 20210915]), and, (column 2 in [188992, 188992]), and
2021.09.15 06:50:25.815651 [ 91216 ] {9c658a50-6425-4b3d-9704-8a12f812ac5a} <Debug> xxxxx.livebars_zzzzzz (dfa19a23-f36e-413c-83a1-5fb38c8886b4) (SelectExecutor): MinMax index condition: unknown, (column 0 in [20210915, 20210915]), and, unknown, and
2021.09.15 06:50:25.816240 [ 91216 ] {9c658a50-6425-4b3d-9704-8a12f812ac5a} <Debug> xxxxx.livebars_zzzzzz (dfa19a23-f36e-413c-83a1-5fb38c8886b4) (SelectExecutor): Selected 8/328 parts by partition key, 8 parts by primary key, 254/334 marks by primary key, 254 marks to read from 8 ranges
2021.09.15 06:50:25.816581 [ 91216 ] {9c658a50-6425-4b3d-9704-8a12f812ac5a} <Debug> xxxxx.livebars_zzzzzz (dfa19a23-f36e-413c-83a1-5fb38c8886b4) (SelectExecutor): Reading approx. 2079661 rows with 11 streams
2021.09.15 06:50:25.840246 [ 91216 ] {9c658a50-6425-4b3d-9704-8a12f812ac5a} <Debug> InterpreterSelectQuery: MergeTreeWhereOptimizer: condition "SID = 188992" moved to PREWHERE
2021.09.15 06:50:25.840994 [ 91216 ] {9c658a50-6425-4b3d-9704-8a12f812ac5a} <Trace> InterpreterSelectQuery: WithMergeableState -> Complete
2021.09.15 06:50:25.892657 [ 76213 ] {} <Trace> BaseDaemon: Received signal -1
2021.09.15 06:50:25.892735 [ 76213 ] {} <Fatal> BaseDaemon: (version 21.8.5.7 (official build), build id: 002660CFDF969F9EBCB93D09D84DC76B0B469329) (from thread 91216) Terminate called for uncaught exception:
std::exception. Code: 1001, type: std::__1::__fs::filesystem::filesystem_error, e.what() = filesystem error: in posix_stat: failed to determine attributes for the specified path: Permission denied [data/_temporary_and_external_tables/_tmp_140656c1%2D0ffe%2D404f%2D9406%2D56c10ffe904f/], Stack trace (when copying this message, always include the lines below):
0. std::__1::system_error::system_error(std::__1::error_code, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) @ 0x158f85af in ?
1. ? @ 0x1588bddf in ?
2. ? @ 0x1588b7f6 in ?
3. ? @ 0x15896ff4 in ?
4. std::__1::__fs::filesystem::__status(std::__1::__fs::filesystem::path const&, std::__1::error_code*) @ 0x158932c7 in ?
5. DB::DatabaseMemory::dropTable(std::__1::shared_ptr<DB::Context const>, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, bool) @ 0xfe8e02d in /usr/bin/clickhouse
6. DB::TemporaryTableHolder::~TemporaryTableHolder() @ 0x1001fefa in /usr/bin/clickhouse
7. std::__1::__tree<std::__1::__value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::shared_ptr<DB::TemporaryTableHolder> >, std::__1::__map_value_compare<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::__value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::shared_ptr<DB::TemporaryTableHolder> >, std::__1::less<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, true>, std::__1::allocator<std::__1::__value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::shared_ptr<DB::TemporaryTableHolder> > > >::destroy(std::__1::__tree_node<std::__1::__value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::shared_ptr<DB::TemporaryTableHolder> >, void*>*) @ 0xffd764c in /usr/bin/clickhouse
8. DB::Context::~Context() @ 0xffadc21 in /usr/bin/clickhouse
9. std::__1::__shared_ptr_pointer<DB::Context*, std::__1::shared_ptr<DB::Context>::__shared_ptr_default_delete<DB::Context, DB::Context>, std::__1::allocator<DB::Context> >::__on_zero_shared() @ 0xffe2172 in /usr/bin/clickhouse
10. DB::Pipe::Holder::~Holder() @ 0x907f5ce in /usr/bin/clickhouse
11. DB::PipelineExecutingBlockInputStream::~PipelineExecutingBlockInputStream() @ 0x1104bce5 in /usr/bin/clickhouse
12. DB::IBlockInputStream::~IBlockInputStream() @ 0x9082a7e in /usr/bin/clickhouse
13. DB::IBlockInputStream::~IBlockInputStream() @ 0x9082a7e in /usr/bin/clickhouse
14. DB::StorageLiveView::getNewBlocks() @ 0x10eec18c in /usr/bin/clickhouse
15. DB::StorageLiveView::watch(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, DB::SelectQueryInfo const&, std::__1::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum&, unsigned long, unsigned int) @ 0x10eedf4b in /usr/bin/clickhouse
16. DB::InterpreterWatchQuery::execute() @ 0x105aa64d in /usr/bin/clickhouse
17. ? @ 0x10743fc4 in /usr/bin/clickhouse
18. DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, bool) @ 0x10742663 in /usr/bin/clickhouse
19. DB::TCPHandler::runImpl() @ 0x10fd9d4d in /usr/bin/clickhouse
20. DB::TCPHandler::run() @ 0x10fecb99 in /usr/bin/clickhouse
21. Poco::Net::TCPServerConnection::start() @ 0x13b63c6f in /usr/bin/clickhouse
22. Poco::Net::TCPServerDispatcher::run() @ 0x13b656fa in /usr/bin/clickhouse
23. Poco::PooledThread::run() @ 0x13c98579 in /usr/bin/clickhouse
24. Poco::ThreadImpl::runnableEntry(void*) @ 0x13c9480a in /usr/bin/clickhouse
25. start_thread @ 0x7ea5 in /usr/lib64/libpthread-2.17.so
26. __clone @ 0xfe8cd in /usr/lib64/libc-2.17.so
Canno
2021.09.15 06:50:25.904618 [ 76213 ] {} <Trace> BaseDaemon: Received signal 6
2021.09.15 06:50:25.904914 [ 105541 ] {} <Fatal> BaseDaemon: ########################################
2021.09.15 06:50:25.905044 [ 105541 ] {} <Fatal> BaseDaemon: (version 21.8.5.7 (official build), build id: 002660CFDF969F9EBCB93D09D84DC76B0B469329) (from thread 91216) (query_id: 9c658a50-6425-4b3d-9704-8a12f812ac5a) Received signal Aborted (6)
2021.09.15 06:50:25.905083 [ 105541 ] {} <Fatal> BaseDaemon:
2021.09.15 06:50:25.905130 [ 105541 ] {} <Fatal> BaseDaemon: Stack trace: 0x7ffff741b377 0x7ffff741ca68 0xf9b6cc8 0x15914463 0x159143cc 0x8f95a4b 0x1001ffc6 0xffd764c 0xffadc21 0xffe2172 0x907f5ce 0x1104bce5 0x9082a7e 0x9082a7e 0x10eec18c 0x10eedf4b 0x105aa64d 0x10743fc4 0x10742663 0x10fd9d4d 0x10fecb99 0x13b63c6f 0x13b656fa 0x13c98579 0x13c9480a 0x7ffff7bc6ea5 0x7ffff74e38cd
2021.09.15 06:50:25.908635 [ 105541 ] {} <Fatal> BaseDaemon: 1. __GI_raise @ 0x36377 in /usr/lib64/libc-2.17.so
2021.09.15 06:50:25.908674 [ 105541 ] {} <Fatal> BaseDaemon: 2. abort @ 0x37a68 in /usr/lib64/libc-2.17.so
2021.09.15 06:50:25.908697 [ 105541 ] {} <Fatal> BaseDaemon: 3. ? @ 0xf9b6cc8 in /usr/bin/clickhouse
2021.09.15 06:50:25.908720 [ 105541 ] {} <Fatal> BaseDaemon: 4. ? @ 0x15914463 in ?
2021.09.15 06:50:25.908747 [ 105541 ] {} <Fatal> BaseDaemon: 5. std::terminate() @ 0x159143cc in ?
2021.09.15 06:50:25.908775 [ 105541 ] {} <Fatal> BaseDaemon: 6. ? @ 0x8f95a4b in /usr/bin/clickhouse
2021.09.15 06:50:25.908804 [ 105541 ] {} <Fatal> BaseDaemon: 7. DB::TemporaryTableHolder::~TemporaryTableHolder() @ 0x1001ffc6 in /usr/bin/clickhouse
2021.09.15 06:50:25.908846 [ 105541 ] {} <Fatal> BaseDaemon: 8. std::__1::__tree<std::__1::__value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::shared_ptr<DB::TemporaryTableHolder> >, std::__1::__map_value_compare<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::__value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::shared_ptr<DB::TemporaryTableHolder> >, std::__1::less<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, true>, std::__1::allocator<std::__1::__value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::shared_ptr<DB::TemporaryTableHolder> > > >::destroy(std::__1::__tree_node<std::__1::__value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::shared_ptr<DB::TemporaryTableHolder> >, void*>*) @ 0xffd764c in /usr/bin/clickhouse
2021.09.15 06:50:25.908889 [ 105541 ] {} <Fatal> BaseDaemon: 9. DB::Context::~Context() @ 0xffadc21 in /usr/bin/clickhouse
2021.09.15 06:50:25.908926 [ 105541 ] {} <Fatal> BaseDaemon: 10. std::__1::__shared_ptr_pointer<DB::Context*, std::__1::shared_ptr<DB::Context>::__shared_ptr_default_delete<DB::Context, DB::Context>, std::__1::allocator<DB::Context> >::__on_zero_shared() @ 0xffe2172 in /usr/bin/clickhouse
2021.09.15 06:50:25.908955 [ 105541 ] {} <Fatal> BaseDaemon: 11. DB::Pipe::Holder::~Holder() @ 0x907f5ce in /usr/bin/clickhouse
2021.09.15 06:50:25.908980 [ 105541 ] {} <Fatal> BaseDaemon: 12. DB::PipelineExecutingBlockInputStream::~PipelineExecutingBlockInputStream() @ 0x1104bce5 in /usr/bin/clickhouse
2021.09.15 06:50:25.908994 [ 105541 ] {} <Fatal> BaseDaemon: 13. DB::IBlockInputStream::~IBlockInputStream() @ 0x9082a7e in /usr/bin/clickhouse
2021.09.15 06:50:25.909017 [ 105541 ] {} <Fatal> BaseDaemon: 14. DB::IBlockInputStream::~IBlockInputStream() @ 0x9082a7e in /usr/bin/clickhouse
2021.09.15 06:50:25.909045 [ 105541 ] {} <Fatal> BaseDaemon: 15. DB::StorageLiveView::getNewBlocks() @ 0x10eec18c in /usr/bin/clickhouse
2021.09.15 06:50:25.909074 [ 105541 ] {} <Fatal> BaseDaemon: 16. DB::StorageLiveView::watch(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, DB::SelectQueryInfo const&, std::__1::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum&, unsigned long, unsigned int) @ 0x10eedf4b in /usr/bin/clickhouse
2021.09.15 06:50:25.909103 [ 105541 ] {} <Fatal> BaseDaemon: 17. DB::InterpreterWatchQuery::execute() @ 0x105aa64d in /usr/bin/clickhouse
2021.09.15 06:50:25.909121 [ 105541 ] {} <Fatal> BaseDaemon: 18. ? @ 0x10743fc4 in /usr/bin/clickhouse
2021.09.15 06:50:25.909144 [ 105541 ] {} <Fatal> BaseDaemon: 19. DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, bool) @ 0x10742663 in /usr/bin/clickhouse
2021.09.15 06:50:25.909179 [ 105541 ] {} <Fatal> BaseDaemon: 20. DB::TCPHandler::runImpl() @ 0x10fd9d4d in /usr/bin/clickhouse
2021.09.15 06:50:25.909206 [ 105541 ] {} <Fatal> BaseDaemon: 21. DB::TCPHandler::run() @ 0x10fecb99 in /usr/bin/clickhouse
2021.09.15 06:50:25.909240 [ 105541 ] {} <Fatal> BaseDaemon: 22. Poco::Net::TCPServerConnection::start() @ 0x13b63c6f in /usr/bin/clickhouse
2021.09.15 06:50:25.909258 [ 105541 ] {} <Fatal> BaseDaemon: 23. Poco::Net::TCPServerDispatcher::run() @ 0x13b656fa in /usr/bin/clickhouse
2021.09.15 06:50:25.909287 [ 105541 ] {} <Fatal> BaseDaemon: 24. Poco::PooledThread::run() @ 0x13c98579 in /usr/bin/clickhouse
2021.09.15 06:50:25.909316 [ 105541 ] {} <Fatal> BaseDaemon: 25. Poco::ThreadImpl::runnableEntry(void*) @ 0x13c9480a in /usr/bin/clickhouse
2021.09.15 06:50:25.909354 [ 105541 ] {} <Fatal> BaseDaemon: 26. start_thread @ 0x7ea5 in /usr/lib64/libpthread-2.17.so
2021.09.15 06:50:25.909376 [ 105541 ] {} <Fatal> BaseDaemon: 27. __clone @ 0xfe8cd in /usr/lib64/libc-2.17.so
...
2021.09.15 06:50:47.586263 [ 76211 ] {} <Fatal> Application: Child process was terminated by signal 6.
I think "Canno" means (meet that in other log lines around)
Cannot print extra info for Poco::Exception (version 21.8.5.7 (official build))
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
crashCrash / segfault / abortCrash / segfault / abortpotential bugTo be reviewed by developers and confirmed/rejected.To be reviewed by developers and confirmed/rejected.