2024-07-24 23:17:57 01455_opentelemetry_distributed:                                        [ FAIL ] 600.01 sec.
2024-07-24 23:17:57 Reason: Timeout! 
2024-07-24 23:17:57 
2024-07-24 23:17:57 Database: test_rwwch4hh
2024-07-24 23:17:57 

2024-07-24 23:25:32 Found hung queries in processlist:
2024-07-24 23:25:32 Row 1:
2024-07-24 23:25:32 ──────
2024-07-24 23:25:32 is_initial_query:     1
2024-07-24 23:25:32 user:                 default
2024-07-24 23:25:32 query_id:             b7098fef7037380f654b052d14484d50-12
2024-07-24 23:25:32 address:              ::ffff:127.0.0.1
2024-07-24 23:25:32 port:                 59654
2024-07-24 23:25:32 initial_user:         default
2024-07-24 23:25:32 initial_query_id:     b7098fef7037380f654b052d14484d50-12
2024-07-24 23:25:32 initial_address:      ::ffff:127.0.0.1
2024-07-24 23:25:32 initial_port:         59654
2024-07-24 23:25:32 interface:            1
2024-07-24 23:25:32 os_user:              
2024-07-24 23:25:32 client_hostname:      ip-172-31-85-30.ec2.internal
2024-07-24 23:25:32 client_name:          ClickHouse client
2024-07-24 23:25:32 client_revision:      54468
2024-07-24 23:25:32 client_version_major: 24
2024-07-24 23:25:32 client_version_minor: 8
2024-07-24 23:25:32 client_version_patch: 1
2024-07-24 23:25:32 http_method:          0
2024-07-24 23:25:32 http_user_agent:      
2024-07-24 23:25:32 http_referer:         
2024-07-24 23:25:32 forwarded_for:        
2024-07-24 23:25:32 quota_key:            
2024-07-24 23:25:32 distributed_depth:    0
2024-07-24 23:25:32 elapsed:              933.864376
2024-07-24 23:25:32 is_cancelled:         0
2024-07-24 23:25:32 is_all_data_sent:     0
2024-07-24 23:25:32 read_rows:            0
2024-07-24 23:25:32 read_bytes:           0
2024-07-24 23:25:32 total_rows_approx:    0
2024-07-24 23:25:32 written_rows:         0
2024-07-24 23:25:32 written_bytes:        0
2024-07-24 23:25:32 memory_usage:         3573701
2024-07-24 23:25:32 peak_memory_usage:    3573701
2024-07-24 23:25:32 query:                select 1 from remote('127.0.0.2', system, one) format Null
2024-07-24 23:25:32 query_kind:           Select
2024-07-24 23:25:32 thread_ids:           [196829]
2024-07-24 23:25:32 ProfileEvents:        {'Query':1,'SelectQuery':1,'InitialQuery':1,'ReadCompressedBytes':251,'CompressedReadBufferBlocks':2,'CompressedReadBufferBytes':313,'IOBufferAllocs':4,'IOBufferAllocBytes':3146209,'TableFunctionExecute':1,'NetworkReceiveElapsedMicroseconds':502,'NetworkSendElapsedMicroseconds':69,'NetworkReceiveBytes':330,'NetworkSendBytes':1419,'DistributedConnectionTries':1,'DistributedConnectionUsable':1,'ContextLock':12,'QueryProfilerRuns':934,'LogTrace':2,'LogDebug':1}
2024-07-24 23:25:32 Settings:             {'connect_timeout_with_failover_ms':'2000','connect_timeout_with_failover_secure_ms':'3000','idle_connection_timeout':'36000','s3_check_objects_after_upload':'1','stream_like_engine_allow_direct_select':'1','replication_wait_for_inactive_replica_timeout':'30','allow_nonconst_timezone_arguments':'1','log_queries':'1','insert_quorum_timeout':'60000','fsync_metadata':'0','http_send_timeout':'60','http_receive_timeout':'60','opentelemetry_start_trace_probability':'0.5','max_untracked_memory':'1048576','memory_profiler_step':'1048576','log_comment':'01455_opentelemetry_distributed.sh','send_logs_level':'warning','allow_introspection_functions':'1','database_atomic_wait_for_drop_and_detach_synchronously':'1','distributed_ddl_entry_format_version':'6','async_insert_busy_timeout_max_ms':'5000','load_marks_asynchronously':'1','allow_prefetched_read_pool_for_remote_filesystem':'0','allow_prefetched_read_pool_for_local_filesystem':'0','filesystem_prefetch_max_memory_usage':'1073741824','insert_keeper_max_retries':'100','insert_keeper_retry_initial_backoff_ms':'1','insert_keeper_retry_max_backoff_ms':'10','insert_keeper_fault_injection_probability':'0.01'}
2024-07-24 23:25:32 current_database:     test_rwwch4hh
2024-07-24 23:25:32 stacktraces:          Thread ID 196829
2024-07-24 23:25:32 /fasttest-workspace/build/./src/Common/StackTrace.cpp:349::StackTrace::StackTrace(ucontext const&)
2024-07-24 23:25:32 /fasttest-workspace/build/./src/Storages/System/StorageSystemStackTrace.cpp:108::DB::(anonymous namespace)::signalHandler(int, siginfo_t*, void*)
2024-07-24 23:25:32 None
2024-07-24 23:25:32 
2024-07-24 23:25:32 Located ClickHouse server process 181571 listening at TCP port 9000
2024-07-24 23:25:32 Collecting stacktraces from all running threads with gdb: