Skip to content

arrow library runs some threads and does not handle exceptions correctly #44912

@qoega

Description

@qoega

https://s3.amazonaws.com/clickhouse-test-reports/0/fb68fc1bee2930679caa9b68069880194f108131/stress_test__ubsan_/fatal_messages.txt

/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036179 [ 1610 ] {} <Fatal> BaseDaemon: (version 22.13.1.1 (official build), build id: 7B96FB78835B0DE4A5B7483955BF5E8818B4F9D8) (from thread 9359) Terminate called for uncaught exception:
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036230 [ 1610 ] {} <Fatal> BaseDaemon: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 34.36 GiB (attempt to allocate chunk of 1233 bytes), maximum: 34.29 GiB. OvercommitTracker decision: Memory overcommit isn't used. OvercommitTracker isn't set. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036251 [ 1610 ] {} <Fatal> BaseDaemon: 
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036267 [ 1610 ] {} <Fatal> BaseDaemon: 0. ./build_docker/../contrib/llvm-project/libcxx/include/exception:134: Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, int) @ 0x300ae036 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036284 [ 1610 ] {} <Fatal> BaseDaemon: 1. ./build_docker/../src/Common/Exception.cpp:77: DB::Exception::Exception(DB::Exception::MessageMasked const&, int, bool) @ 0x2172e58f in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036307 [ 1610 ] {} <Fatal> BaseDaemon: 2. ./build_docker/../contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<char const*, char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, long&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::basic_string_view<char, std::__1::char_traits<char>>>(int, fmt::v8::basic_format_string<char, fmt::v8::type_identity<char const*>::type, fmt::v8::type_identity<char const*>::type, fmt::v8::type_identity<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>::type, fmt::v8::type_identity<long&>::type, fmt::v8::type_identity<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>::type, fmt::v8::type_identity<std::__1::basic_string_view<char, std::__1::char_traits<char>>>::type>, char const*&&, char const*&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>&&, long&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>&&, std::__1::basic_string_view<char, std::__1::char_traits<char>>&&) @ 0x2173d1cc in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036328 [ 1610 ] {} <Fatal> BaseDaemon: 3. ./build_docker/../src/Common/MemoryTracker.cpp:0: MemoryTracker::allocImpl(long, bool, MemoryTracker*) @ 0x2173c579 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036337 [ 1610 ] {} <Fatal> BaseDaemon: 4. ./build_docker/../src/Common/Allocator.h:96: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x216e5a64 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036352 [ 1610 ] {} <Fatal> BaseDaemon: 5. ./build_docker/../src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x217889af in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036366 [ 1610 ] {} <Fatal> BaseDaemon: 6. ./build_docker/../src/IO/BufferWithOwnMemory.h:159: DB::BufferWithOwnMemory<DB::ReadBuffer>::BufferWithOwnMemory(unsigned long, char*, unsigned long) @ 0x217adc99 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036389 [ 1610 ] {} <Fatal> BaseDaemon: 7. ./build_docker/../src/IO/ReadBufferFromIStream.cpp:36: DB::ReadBufferFromIStream::ReadBufferFromIStream(std::__1::basic_istream<char, std::__1::char_traits<char>>&, unsigned long) @ 0x2762d241 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036400 [ 1610 ] {} <Fatal> BaseDaemon: 8. ./build_docker/../contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::ReadBufferFromS3::initialize() @ 0x2c08fa38 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036420 [ 1610 ] {} <Fatal> BaseDaemon: 9. ./build_docker/../src/IO/ReadBufferFromS3.cpp:115: DB::ReadBufferFromS3::nextImpl() @ 0x2c08b925 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036436 [ 1610 ] {} <Fatal> BaseDaemon: 10. DB::ReadBuffer::next() @ 0x16eb7256 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036452 [ 1610 ] {} <Fatal> BaseDaemon: 11. DB::ReadBuffer::ignore(unsigned long) @ 0x176aded2 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036469 [ 1610 ] {} <Fatal> BaseDaemon: 12. ./build_docker/../src/IO/ReadBufferFromS3.cpp:0: DB::ReadBufferFromS3::seek(long, int) @ 0x2c090621 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036502 [ 1610 ] {} <Fatal> BaseDaemon: 13. ./build_docker/../contrib/arrow/cpp/src/arrow/status.h:157: DB::RandomAccessFileFromSeekableReadBuffer::Seek(long) @ 0x2efee7f6 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036517 [ 1610 ] {} <Fatal> BaseDaemon: 14. ./build_docker/../src/Processors/Formats/Impl/ArrowBufferedStreams.cpp:0: non-virtual thunk to DB::RandomAccessFileFromSeekableReadBuffer::Seek(long) @ 0x2efee872 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036538 [ 1610 ] {} <Fatal> BaseDaemon: 15. arrow::io::RandomAccessFile::ReadAt(long, long) @ 0x31896a9b in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036556 [ 1610 ] {} <Fatal> BaseDaemon: 16. arrow::internal::FnOnce<void ()>::FnImpl<std::__1::__bind<arrow::detail::ContinueFuture, arrow::Future<std::__1::shared_ptr<arrow::Buffer>>&, arrow::io::RandomAccessFile::ReadAsync(arrow::io::IOContext const&, long, long)::$_1>>::invoke() @ 0x318995b7 in /usr/bin/clickhouse
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:33:19.036573 [ 1610 ] {} <Fatal> BaseDaemon: 17. void* std::__1::__thread_proxy[abi:v15000]<std
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:34:13.882847 [ 109078 ] {} <Fatal> BaseDaemon: ########################################
/var/log/clickhouse-server/clickhouse-server.err.log:2023.01.04 06:34:13.883008 [ 109078 ] {} <Fatal> BaseDaemon: (version 22.13.1.1 (official build), build id: 7B96FB78835B0DE4A5B7483955BF5E8818B4F9D8) (from thread 9359) (no query) Received signal Aborted (6)

Metadata

Metadata

Assignees

Labels

testingSpecial issue with list of bugs found by CI

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions