-
Notifications
You must be signed in to change notification settings - Fork 8.3k
01150_ddl_guard_rwr is flaky #85781
Copy link
Copy link
Closed
Description
Example failure (from here)
2025-08-16 16:20:59 Reason: having exception in stdout:
2025-08-16 16:20:59 Code: 159. DB::Exception: Received from localhost:9000. DB::Exception: Unable to acquire the database lock of test_01150 after 1000 ms. (TIMEOUT_EXCEEDED)
2025-08-16 16:20:59
2025-08-16 16:20:59 /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/test_bzwicrml/01150_ddl_guard_rwr.sh.debuglog:
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:10] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'DROP DATABASE IF EXISTS test_01150'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:11] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'CREATE DATABASE test_01150'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:13] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'CREATE TABLE test_01150.t1 (x UInt64, s Array(Nullable(String))) ENGINE = Memory'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:14] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'CREATE TABLE test_01150.t2 (x UInt64, s Array(Nullable(String))) ENGINE = Memory'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:40] thread_detach_attach
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:42] wait
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:17] local TIMELIMIT=20
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:18] '[' 0 -lt 20 ']'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:41] thread_rename
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:28] local TIMELIMIT=20
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:29] '[' 0 -lt 20 ']'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:20] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'DETACH DATABASE test_01150'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:20] grep -v -F -e 'Received exception from server' -e 'Code: 219' -e 'Code: 741' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:31] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'RENAME TABLE test_01150.t1 TO test_01150.t2_tmp, test_01150.t2 TO test_01150.t1, test_01150.t2_tmp TO test_01150.t2'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:31] grep -v -F -e 'Received exception from server' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:31] grep -v -P 'Code: (81|60|57|521|741)'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:21] sleep 0.023792
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:32] sleep 0.013834
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:33] grep -v -P 'Code: (81|60|57|521|741)'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:33] grep -v -F -e 'Received exception from server' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:33] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'RENAME TABLE test_01150.t2 TO test_01150.t1, test_01150.t2_tmp TO test_01150.t2'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:22] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'ATTACH DATABASE test_01150'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:22] grep -v -F -e 'Received exception from server' -e 'Code: 82' -e 'Code: 741' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:23] sleep 0.029391
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:34] sleep 0.024544
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:18] '[' 1 -lt 20 ']'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:20] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'DETACH DATABASE test_01150'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:20] grep -v -F -e 'Received exception from server' -e 'Code: 219' -e 'Code: 741' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:35] grep -v -F -e 'Received exception from server' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:35] grep -v -P 'Code: (81|60|57|521|741)'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:35] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_colum
Note that the failures started after 15th Aug!
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels