Skip to content

Abort in OpenTelemetry::SpanHolder::finish() #49185

@tavplubix

Description

@tavplubix

https://s3.amazonaws.com/clickhouse-test-reports/0/80c1a4ed88fad4e1a2679d19920eaa3ff63699ea/stateless_tests__debug__[1/5].html

Looks like "terminate called for uncaught exception", but it may be an assertion as well:

2023.04.26 06:58:46.054529 [ 2883 ] {} <Fatal> BaseDaemon: ########################################
2023.04.26 06:58:46.054949 [ 2883 ] {} <Fatal> BaseDaemon: (version 23.4.1.1 (official build), build id: E3E0936B36CD53B684EE940C52D363CE775999A6) (from thread 1412) (query_id: b4c077e1-1807-463c-aaad-7d4959637aa2) (query: kill query where query_id = 'test_pzkratru_test_02585_query_to_kill_id_1' sync) Received signal Aborted (6)
2023.04.26 06:58:46.055147 [ 2883 ] {} <Fatal> BaseDaemon: 
2023.04.26 06:58:46.055344 [ 2883 ] {} <Fatal> BaseDaemon: Stack trace: 0x7f7207c6300b 0x7f7207c42859 0x7f7207c42729 0x7f7207c53fd6 0x22eb0ca4 0x22eb0eb9 0x2d2ed7a6 0x2d0f47ea 0x2d12325d 0x2d1230fe 0x2a3b45c1 0x2a3b3fb6 0x2a3d1682 0x2a3d0398 0x2a3d02c8 0x2a3d0288 0x2a3d01be 0x2a3d003d
2023.04.26 06:58:46.055570 [ 2883 ] {} <Fatal> BaseDaemon: 4. gsignal @ 0x7f7207c6300b in ?
2023.04.26 06:58:46.055756 [ 2883 ] {} <Fatal> BaseDaemon: 5. abort @ 0x7f7207c42859 in ?
2023.04.26 06:58:46.055895 [ 2883 ] {} <Fatal> BaseDaemon: 6. ? @ 0x7f7207c42729 in ?
2023.04.26 06:58:46.056115 [ 2883 ] {} <Fatal> BaseDaemon: 7. ? @ 0x7f7207c53fd6 in ?
2023.04.26 06:58:46.134479 [ 2883 ] {} <Fatal> BaseDaemon: 8. /build/src/Common/OpenTelemetryTraceContext.cpp:0: DB::OpenTelemetry::SpanHolder::finish() @ 0x22eb0ca4 in /usr/bin/clickhouse
2023.04.26 06:58:46.233511 [ 2883 ] {} <Fatal> BaseDaemon: 9. /build/src/Common/OpenTelemetryTraceContext.cpp:170: DB::OpenTelemetry::SpanHolder::~SpanHolder() @ 0x22eb0eb9 in /usr/bin/clickhouse
2023.04.26 06:58:46.349611 [ 2883 ] {} <Fatal> BaseDaemon: 10. /build/src/Processors/Executors/PipelineExecutor.cpp:134: DB::PipelineExecutor::execute(unsigned long) @ 0x2d2ed7a6 in /usr/bin/clickhouse
2023.04.26 06:58:46.592244 [ 2883 ] {} <Fatal> BaseDaemon: 11. /build/src/Client/Connection.cpp:869: DB::Connection::sendExternalTablesData(std::vector<std::unique_ptr<DB::ExternalTableData, std::default_delete<DB::ExternalTableData>>, std::allocator<std::unique_ptr<DB::ExternalTableData, std::default_delete<DB::ExternalTableData>>>>&) @ 0x2d0f47ea in /usr/bin/clickhouse
2023.04.26 06:58:46.792386 [ 2883 ] {} <Fatal> BaseDaemon: 12. /build/src/Client/HedgedConnections.cpp:106: DB::HedgedConnections::sendExternalTablesData(std::vector<std::vector<std::unique_ptr<DB::ExternalTableData, std::default_delete<DB::ExternalTableData>>, std::allocator<std::unique_ptr<DB::ExternalTableData, std::default_delete<DB::ExternalTableData>>>>, std::allocator<std::vector<std::unique_ptr<DB::ExternalTableData, std::default_delete<DB::ExternalTableData>>, std::allocator<std::unique_ptr<DB::ExternalTableData, std::default_delete<DB::ExternalTableData>>>>>>&)::$_2::operator()(DB::HedgedConnections::ReplicaState&) const @ 0x2d12325d in /usr/bin/clickhouse
2023.04.26 06:58:46.980880 [ 2883 ] {} <Fatal> BaseDaemon: 13. /build/src/Client/HedgedConnections.cpp:111: DB::HedgedConnections::sendExternalTablesData(std::vector<std::vector<std::unique_ptr<DB::ExternalTableData, std::default_delete<DB::ExternalTableData>>, std::allocator<std::unique_ptr<DB::ExternalTableData, std::default_delete<DB::ExternalTableData>>>>, std::allocator<std::vector<std::unique_ptr<DB::ExternalTableData, std::default_delete<DB::ExternalTableData>>, std::allocator<std::unique_ptr<DB::ExternalTableData, std::default_delete<DB::ExternalTableData>>>>>>&) @ 0x2d1230fe in /usr/bin/clickhouse
2023.04.26 06:58:47.196219 [ 2883 ] {} <Fatal> BaseDaemon: 14. /build/src/QueryPipeline/RemoteQueryExecutor.cpp:701: DB::RemoteQueryExecutor::sendExternalTables() @ 0x2a3b45c1 in /usr/bin/clickhouse
2023.04.26 06:58:47.426912 [ 2883 ] {} <Fatal> BaseDaemon: 15. /build/src/QueryPipeline/RemoteQueryExecutor.cpp:269: DB::RemoteQueryExecutor::sendQueryUnlocked(DB::ClientInfo::QueryKind, std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>) @ 0x2a3b3fb6 in /usr/bin/clickhouse
2023.04.26 06:58:47.507256 [ 2883 ] {} <Fatal> BaseDaemon: 16. /build/src/QueryPipeline/RemoteQueryExecutorReadContext.cpp:39: DB::RemoteQueryExecutorReadContext::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x2a3d1682 in /usr/bin/clickhouse
2023.04.26 06:58:47.567867 [ 2883 ] {} <Fatal> BaseDaemon: 17. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(boost::context::fiber&&) @ 0x2a3d0398 in /usr/bin/clickhouse
2023.04.26 06:58:47.629997 [ 2883 ] {} <Fatal> BaseDaemon: 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval<DB::AsyncTaskExecutor::Routine&>()(std::declval<boost::context::fiber>())) std::__invoke[abi:v15000]<DB::AsyncTaskExecutor::Routine&, boost::context::fiber>(DB::AsyncTaskExecutor::Routine&, boost::context::fiber&&) @ 0x2a3d02c8 in /usr/bin/clickhouse
2023.04.26 06:58:47.691781 [ 2883 ] {} <Fatal> BaseDaemon: 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: std::invoke_result<DB::AsyncTaskExecutor::Routine&, boost::context::fiber>::type std::invoke<DB::AsyncTaskExecutor::Routine&, boost::context::fiber>(DB::AsyncTaskExecutor::Routine&, boost::context::fiber&&) @ 0x2a3d0288 in /usr/bin/clickhouse
2023.04.26 06:58:47.752637 [ 2883 ] {} <Fatal> BaseDaemon: 20. /build/contrib/boost/boost/context/fiber_fcontext.hpp:140: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, DB::AsyncTaskExecutor::Routine>::run(void*) @ 0x2a3d01be in /usr/bin/clickhouse
2023.04.26 06:58:47.814377 [ 2883 ] {} <Fatal> BaseDaemon: 21. /build/contrib/boost/boost/context/fiber_fcontext.hpp:80: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, DB::AsyncTaskExecutor::Routine>>(boost::context::detail::transfer_t) @ 0x2a3d003d in /usr/bin/clickhouse
2023.04.26 06:58:51.300496 [ 2883 ] {} <Fatal> BaseDaemon: Integrity check of the executable successfully passed (checksum: 2824BEEE901BA995655CF98FC401E68C)
2023.04.26 06:58:54.565147 [ 658 ] {} <Fatal> Application: Child process was terminated by signal 6.

May be related to #47667
cc: @FrankChen021, @nickitat

Metadata

Metadata

Assignees

Labels

fuzzProblem found by one of the fuzzers

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions