Skip to content

Flaky test: 02943_rmt_alter_metadata_merge_checksum_mismatch #92670

@Avogar

Description

@Avogar

Important: This issue was automatically generated and is used by CI for matching failures. DO NOT modify the body content. DO NOT remove labels.

Test name: 02943_rmt_alter_metadata_merge_checksum_mismatch
Failure reason: result differs with reference
CI report: Stateless tests (amd_binary, old analyzer, s3 storage, DatabaseReplicated, sequential)

CIDB statistics: cidb

Test output:

2025-12-19 02:09:54 Reason: result differs with reference:  
2025-12-19 02:09:54 --- /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/02943_rmt_alter_metadata_merge_checksum_mismatch.reference	2025-12-19 01:58:15.506893318 +0500
2025-12-19 02:09:54 +++ /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/02943_rmt_alter_metadata_merge_checksum_mismatch.stdout	2025-12-19 02:09:54.394084504 +0500
2025-12-19 02:09:54 @@ -0,0 +1 @@
2025-12-19 02:09:54 +all_0_0_0_1	NotAMerge	MutatePart	CHECKSUM_DOESNT_MATCH
2025-12-19 02:09:54 
2025-12-19 02:09:54 
2025-12-19 02:09:54 /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/test_u551v66z/02943_rmt_alter_metadata_merge_checksum_mismatch.sh.debuglog:
2025-12-19 02:09:54 + [2025-12-19 02:09:50] [:10] set -e
2025-12-19 02:09:54 + [2025-12-19 02:09:50] [:36] trap restore_failpoints EXIT
2025-12-19 02:09:54 + [2025-12-19 02:09:50] [:38] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_u551v66z --log_comment 02943_rmt_alter_metadata_merge_checksum_mismatch.sh-test_u551v66z --max_insert_threads 12 --group_by_two_level_threshold 1 --group_by_two_level_threshold_bytes 50000000 --distributed_aggregation_memory_efficient 1 --fsync_metadata 0 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --min_chunk_bytes_for_parallel_parsing 9727693 --max_read_buffer_size 584174 --prefer_localhost_replica 0 --max_block_size 18363 --max_joined_block_size_rows 96128 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 965 --max_threads 1 --optimize_append_index 0 --use_hedged_requests 0 --optimize_if_chain_to_multiif 0 --optimize_if_transform_strings_to_enum 1 --optimize_read_in_order 1 --optimize_or_like_chain 0 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --read_in_order_two_level_merge_threshold 92 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 39846045 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 1 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method mmap --remote_filesystem_read_method threadpool --local_filesystem_read_prefetch 1 --filesystem_cache_segments_batch_size 50 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 128Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 1Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 1 --merge_tree_coarse_index_granularity 30 --optimize_distinct_in_order 0 --max_bytes_before_remerge_sort 1695484711 --min_compress_block_size 2892163 --max_compress_block_size 2289412 --merge_tree_compact_parts_min_granules_to_multibuffer_read 89 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 5623526 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 1 --min_count_to_compile_expression 3 --min_count_to_compile_aggregate_expression 3 --min_count_to_compile_sort_description 0 --session_timezone Africa/Khartoum --use_page_cache_for_disks_without_file_cache True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.2 --prefer_external_sort_block_bytes 100000000 --cross_join_min_rows_to_compress 100000000 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 100000000 --max_parsing_threads 1 --optimize_functions_to_subcolumns 0 --parallel_replicas_local_plan 0 --query_plan_join_swap_table auto --enable_vertical_final 0 --optimize_extract_common_expressions 0 --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 1 --use_skip_indexes_on_data_read 0 --optimize_rewrite_like_perfect_affix 0 --input_format_parquet_use_native_reader_v3 1 --enable_lazy_columns_replication 1 --allow_special_serialization_kinds_in_output_formats 1 --max_bytes_before_external_sort 10737418240 --max_bytes_before_external_group_by 10737418240 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 1 --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 0.0 --prefer_fetch_merged_part_size_threshold 6343637964 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 10737418240 --index_granularity_bytes 22623854 --merge_max_block_size 11687 --index_granularity 10046 --min_bytes_for_wide_part 1073741824 --marks_compress_block_size 44598 --primary_key_compress_block_size 26082 --replace_long_file_name_to_hash 0 --max_file_name_length 128 --min_bytes_for_full_part_storage 5081680 --compact_parts_max_bytes_to_buffer 2919682 --compact_parts_max_granules_to_buffer 35 --compact_parts_merge_max_bytes_to_prefetch_part 9559059 --cache_populated_by_fetch 0 --concurrent_part_removal_threshold 0 --old_parts_lifetime 257 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 1 --enable_block_offset_column 1 --use_primary_key_cache 0 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version map --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 18 --object_shared_data_buckets_for_wide_part 5 --dynamic_serialization_version v2 --serialization_info_version with_types --string_serialization_version with_size_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/02943_rmt_alter_metadata_merge_checksum_mismatch.stderr-fatal -m --insert_keeper_fault_injection_probability=0 -q '
2025-12-19 02:09:54     drop table if exists data_r1;
2025-12-19 02:09:54     drop table if exists data_r2;
2025-12-19 02:09:54 
2025-12-19 02:09:54     create table data_r1 (key Int, value Int, index value_idx value type minmax) engine=ReplicatedMergeTree('\''/clickhouse/tables/{database}/data'\'', '\''{table}'\'') order by key;
2025-12-19 02:09:54     create table data_r2 (key Int, value Int, index value_idx value type minmax) engine=ReplicatedMergeTree('\''/clickhouse/tables/{database}/data'\'', '\''{table}'\'') order by key;
2025-12-19 02:09:54 
2025-12-19 02:09:54     insert into data_r1 (key) values (1); -- part all_0_0_0
2025-12-19 02:09:54 '
2025-12-19 02:09:54 + [2025-12-19 02:09:51] [:49] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_u551v66z --log_comment 02943_rmt_alter_metadata_merge_checksum_mismatch.sh-test_u551v66z --max_insert_threads 12 --group_by_two_level_threshold 1 --group_by_two_level_threshold_bytes 50000000 --distributed_aggregation_memory_efficient 1 --fsync_metadata 0 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --min_chunk_bytes_for_parallel_parsing 9727693 --max_read_buffer_size 584174 --prefer_localhost_replica 0 --max_block_size 18363 --max_joined_block_size_rows 96128 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 965 --max_threads 1 --optimize_append_index 0 --use_hedged_requests 0 --optimize_if_chain_to_multiif 0 --optimize_if_transform_strings_to_enum 1 --optimize_read_in_order 1 --optimize_or_like_chain 0 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --read_in_order_two_level_merge_threshold 92 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 39846045 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 1 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method mmap --remote_filesystem_read_method threadpool --local_filesystem_read_prefetch 1 --filesystem_cache_segments_batch_size 50 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 128Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 1Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 1 --merge_tree_coarse_index_granularity 30 --optimize_distinct_in_order 0 --max_bytes_before_remerge_sort 1695484711 --min_compress_block_size 2892163 --max_compress_block_size 2289412 --merge_tree_compact_parts_min_granules_to_multibuffer_read 89 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 5623526 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 1 --min_count_to_compile_expression 3 --min_count_to_compile_aggregate_expression 3 --min_count_to_compile_sort_description 0 --session_timezone Africa/Khartoum --use_page_cache_for_disks_without_file_cache True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.2 --prefer_external_sort_block_bytes 100000000 --cross_join_min_rows_to_compress 100000000 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 100000000 --max_parsing_threads 1 --optimize_functions_to_subcolumns 0 --parallel_replicas_local_plan 0 --query_plan_join_swap_table auto --enable_vertical_final 0 --optimize_extract_common_expressions 0 --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 1 --use_skip_indexes_on_data_read 0 --optimize_rewrite_like_perfect_affix 0 --input_format_parquet_use_native_reader_v3 1 --enable_lazy_columns_replication 1 --allow_special_serialization_kinds_in_output_formats 1 --max_bytes_before_external_sort 10737418240 --max_bytes_before_external_group_by 10737418240 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 1 --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 0.0 --prefer_fetch_merged_part_size_threshold 6343637964 --vertical_merge_algorithm_min_rows_to_activate 1 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 10737418240 --index_granularity_bytes 22623854 --merge_max_block_size 11687 --index_granularity 10046 --min_bytes_for_wide_part 1073741824 --marks_compress_block_size 44598 --primary_key_compress_block_size 26082 --replace_long_file_name_to_hash 0 --max_file_name_length 128 --min_bytes_for_full_part_storage 5081680 --compact_parts_max_bytes_to_buffer 2919682 --compact_parts_max_granules_to_buffer 35 --compact_parts_merge_max_bytes_to_prefetch_part 9559059 --cache_populated_by_fetch 0 --concurrent_part_removal_threshold 0 --old_parts_lifetime 257 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 1 --enable_block_offset_column 1 --use_primary_key_cache 0 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version map --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 18 --object_shared_data_buckets_for_wide_part 5 --dynamic_serialization_version v2 --serialization_info_version with_types --string_serialization_version with_size_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --allow_repeated_settings --client_logs_file=/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/02943_rmt_alter_metadata_merge_checksum_mismatch.stderr-fatal -m -q '
2025-12-19 02:09:54     system enable failpoint replicated_queue_fail_next_entry;
2025-12-19 02:09:54     alter table data_r1 drop index value_idx settings alter_sync=0; -- part all_0_0_0_1
2025-12-19 02:09:54 
2025-12-19 02:09:54     system sync replica data_r1 pull;
2025-12-19 02:09:54     system sync replica data_r2 pull;
2025-12-19 02:09:54 '
2025-12-19 02:09:54 + [2025-12-19 02:09:51] [:58] success_replica=
2025-12-19 02:09:54 + [2025-12-19 02:09:51] [:59] (( i = 0 ))
2025-12-19 02:09:54 + [2025-12-19 02:09:51] [:59] (( i < 100 ))
2025-12-19 02:09:54 + [2025-12-19 02:09:51] [:60] for table in data_r1 data_r2
2025-12-19 02:09:54 ++ [2025-12-19 02:09:51] [:61] /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_u551v66z --log_comment 02943_rmt_alter_metadata_merge_checksum_mismatch.sh-test_u551v66z --max_insert_threads 12 --group_by_two_level_threshold 1 --group_by_two_level_threshold_bytes 50000000 --distributed_aggregation_memory_efficient 1 --fsync_metadata 0 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --min_chunk_bytes_for_parallel_parsing 9727693 --max_read_buffer_size 584174 --prefer_localhost_replica 0 --max_block_size 18363 --max_joined_block_size_rows 96128 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 965 --max_threads 1 --optimize_append_index 0 --use_hedged_requests 0 --optimize_if_chain_to_multiif 0 --optimize_if_transform_strings_to_enum 1 --optimize_read_in_order 1 --optimize_or_like_chain 0 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --read_in_order_two_level_merge_threshold 92 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 39846045 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 1 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method mmap --remote_filesystem_read_method threadpool --local_filesystem_read_prefetch 1 --filesystem_cache_segments_batch_size 50 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 128Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 1Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 1 --merge_tree_coarse_index_granularity 30 --optimize_distinct_in_order 0 --max_bytes_before_remerge_sort 1695484711 --min_compress_block_size 2892163 --max_compress_block_size 2289412 --merge_tree_compact_parts_min_granules_to_multibuffer_read 89 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 5623526 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 1 --min_count_to_compile_expression 3 --min_count_to_compile_aggregate_expression 3 --min_count_to_compile_sort_description 0 --session_timezone Africa/Khartoum --use_page_cache_for_disks_without_file_cache True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.2 --prefer_external_sort_block_bytes 100000000 --cross_join_min_rows_to_compress 100000000 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 100000000 --max_parsing_threads 1 --optimize_functions_to_subcolumns 0 --parallel_replicas_local_plan 0 --query_plan_join_swap_table auto --enable_vertical_final 0 --optimize_extract_common_expressions 0 --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 1 --use_skip_indexes_on_data_read 0 --optimize_rewrite_like_perfect_affix 0 --input_format_parquet_use_native_reader_v3 1 --enable_lazy_columns_replication 1 --allow_special_serialization_kinds_in_output_formats 1 --max_bytes_before_external_sort 10737418240

Metadata

Metadata

Assignees

Labels

flaky testflaky test found by CItestingSpecial issue with list of bugs found by CI

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions