Skip to content

01150_ddl_guard_rwr is flaky #85781

@rschu1ze

Description

@rschu1ze

Example failure (from here)

2025-08-16 16:20:59 Reason: having exception in stdout:  
2025-08-16 16:20:59 Code: 159. DB::Exception: Received from localhost:9000. DB::Exception: Unable to acquire the database lock of test_01150 after 1000 ms. (TIMEOUT_EXCEEDED)
2025-08-16 16:20:59 
2025-08-16 16:20:59 /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/test_bzwicrml/01150_ddl_guard_rwr.sh.debuglog:
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:10] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'DROP DATABASE IF EXISTS test_01150'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:11] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'CREATE DATABASE test_01150'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:13] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'CREATE TABLE test_01150.t1 (x UInt64, s Array(Nullable(String))) ENGINE = Memory'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:14] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'CREATE TABLE test_01150.t2 (x UInt64, s Array(Nullable(String))) ENGINE = Memory'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:40] thread_detach_attach
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:42] wait
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:17] local TIMELIMIT=20
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:18] '[' 0 -lt 20 ']'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:41] thread_rename
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:28] local TIMELIMIT=20
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:29] '[' 0 -lt 20 ']'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:20] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'DETACH DATABASE test_01150'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:20] grep -v -F -e 'Received exception from server' -e 'Code: 219' -e 'Code: 741' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:31] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'RENAME TABLE test_01150.t1 TO test_01150.t2_tmp, test_01150.t2 TO test_01150.t1, test_01150.t2_tmp TO test_01150.t2'
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:31] grep -v -F -e 'Received exception from server' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:38] [:31] grep -v -P 'Code: (81|60|57|521|741)'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:21] sleep 0.023792
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:32] sleep 0.013834
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:33] grep -v -P 'Code: (81|60|57|521|741)'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:33] grep -v -F -e 'Received exception from server' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:33] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'RENAME TABLE test_01150.t2 TO test_01150.t1, test_01150.t2_tmp TO test_01150.t2'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:22] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'ATTACH DATABASE test_01150'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:22] grep -v -F -e 'Received exception from server' -e 'Code: 82' -e 'Code: 741' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:23] sleep 0.029391
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:34] sleep 0.024544
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:18] '[' 1 -lt 20 ']'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:20] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 9 --allow_vertical_merges_from_compact_to_wide_parts 1 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 4320375 --merge_max_block_size 11747 --index_granularity 13389 --min_bytes_for_wide_part 481106417 --marks_compress_block_size 91394 --primary_key_compress_block_size 89225 --replace_long_file_name_to_hash 1 --max_file_name_length 17 --min_bytes_for_full_part_storage 457987796 --compact_parts_max_bytes_to_buffer 61163783 --compact_parts_max_granules_to_buffer 185 --compact_parts_merge_max_bytes_to_prefetch_part 11363429 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 100 --old_parts_lifetime 386 --prewarm_mark_cache 0 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 1 --enable_block_number_column 1 --enable_block_offset_column 0 --use_primary_key_cache 0 --prewarm_primary_key_cache 1 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/01150_ddl_guard_rwr.stderr-fatal --query 'DETACH DATABASE test_01150'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:20] grep -v -F -e 'Received exception from server' -e 'Code: 219' -e 'Code: 741' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:35] grep -v -F -e 'Received exception from server' -e '(query: '
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:35] grep -v -P 'Code: (81|60|57|521|741)'
2025-08-16 16:20:59 + [2025-08-16 16:20:39] [:35] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=fatal --database=test_bzwicrml --log_comment 01150_ddl_guard_rwr.sh --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 7652476721 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_colum

Test case history

Note that the failures started after 15th Aug!

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions