Skip to content

Hung check failed on insertion into Distributed #38219

@tavplubix

Description

@tavplubix

https://s3.amazonaws.com/clickhouse-test-reports/0/c941d0c8e23feec5e544a9665c449a4529268903/stress_test__debug__actions_.html

https://pastila.nl/?008065e9/fa1eff2f29cca330ff6a5ea9b711294a

Looks like something's wrong with timeouts:

2022.06.19 22:07:52.845298 [ 2137 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Debug> executeQuery: (from [::1]:38790) (comment: '02232_dist_insert_send_logs_level_hung.sh') insert into function remote('127.2', currentDatabase(), in_02232) select * from numbers(1e6) (stage: Complete)
2022.06.19 22:07:52.847743 [ 2137 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Trace> ContextAccess (default): Access granted: CREATE TEMPORARY TABLE, REMOTE ON *.*
2022.06.19 22:07:52.852698 [ 2137 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Trace> Connection (127.2:9000): Connecting. Database: (not specified). User: default
2022.06.19 22:07:56.342937 [ 2137 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Trace> Connection (127.2:9000): Connected to ClickHouse server version 22.7.1.
2022.06.19 22:07:56.347299 [ 2040 ] {1c91b368-bc7a-45ea-aafe-809c0fdfa05c} <Debug> executeQuery: (from [::ffff:127.0.0.1]:49256, initial_query_id: 1276909a-129d-4b58-a04b-8a1aa5a64706) (comment: '02232_dist_insert_send_logs_level_hung.sh') DESC TABLE test_19.in_02232 (stage: Complete)
2022.06.19 22:07:56.466555 [ 2137 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Trace> ContextAccess (default): Access granted: CREATE TEMPORARY TABLE ON *.*
2022.06.19 22:07:56.468217 [ 2137 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
2022.06.19 22:07:56.477820 [ 2040 ] {12422e09-2118-4719-bdcc-9eca1bd32d47} <Debug> executeQuery: (from [::ffff:127.0.0.1]:49256, initial_query_id: 1276909a-129d-4b58-a04b-8a1aa5a64706) (comment: '02232_dist_insert_send_logs_level_hung.sh') INSERT INTO test_19.in_02232 (key) VALUES (stage: Complete)
2022.06.19 22:12:02.141676 [ 2137 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Information> TCPHandler: Client has dropped the connection, cancel the query.
2022.06.19 22:12:02.163998 [ 42120 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Trace> PipelineExecutor: Thread finished. Total time: 245.691611098 sec. Execution time: 154.195521738 sec. Processing time: 77.16519271 sec. Wait time: 14.33089665 sec.
2022.06.19 22:12:02.164885 [ 2137 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Information> executeQuery: Read 167690 rows, 1.28 MiB in 249.319046933 sec., 672 rows/sec., 5.25 KiB/sec.
2022.06.19 22:26:43.440095 [ 2137 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Error> PushingPipelineExecutor: Code: 394. DB::Exception: Received from 127.2:9000. DB::Exception: Query was cancelled. Stack trace:
2022.06.19 22:26:43.441860 [ 2137 ] {1276909a-129d-4b58-a04b-8a1aa5a64706} <Debug> MemoryTracker: Peak memory usage (for query): 6.47 MiB.

Tests added in #35075

cc: @azat

Metadata

Metadata

Assignees

No one assigned

    Labels

    fuzzProblem found by one of the fuzzers

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions