Skip to content

Enable delta-kernel by default#79541

Merged
kssenii merged 13 commits intomasterfrom
make-delta-kernel-default
May 2, 2025
Merged

Enable delta-kernel by default#79541
kssenii merged 13 commits intomasterfrom
make-delta-kernel-default

Conversation

@kssenii
Copy link
Copy Markdown
Member

@kssenii kssenii commented Apr 24, 2025

Changelog category (leave one):

  • Improvement

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Enable DeltaLake storage delta-kernel implementation by default.

Documentation entry for user-facing changes

  • Documentation is written (mandatory for new features)

@clickhouse-gh
Copy link
Copy Markdown
Contributor

clickhouse-gh bot commented Apr 24, 2025

Workflow [PR], commit [18fbb0c]

@clickhouse-gh clickhouse-gh bot added the pr-improvement Pull request with some product improvements label Apr 24, 2025
@kssenii kssenii enabled auto-merge April 24, 2025 14:39
@kssenii kssenii disabled auto-merge April 24, 2025 14:39
DECLARE(Bool, allow_experimental_delta_kernel_rs, false, R"(
DECLARE(Bool, allow_experimental_delta_kernel_rs, true, R"(
Allow experimental delta-kernel-rs implementation.
)", EXPERIMENTAL) \
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It needs to be promoted to BETA

@Algunenano Algunenano self-assigned this Apr 24, 2025
context->log,
"Scanned file: {}, size: {}, num records: {}, partition columns: {}",
full_path, size, stats->num_records, partitions_info.size());
full_path, size, stats ? DB::toString(stats->num_records) : "Unknown", partitions_info.size());
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moved in a separate PR #79677

@kssenii
Copy link
Copy Markdown
Member Author

kssenii commented May 1, 2025

Integration tests

test_parallel_replicas_insert_select/test.py::test_insert_select[test_1_shard_3_replicas_1_unavailable-3-False-3]
test_replicated_fetches_bandwidth/test.py::test_limited_fetches_for_server

Integration tests (asan, flaky check

test_database_delta are not adjusted for repeatable run, so flaky check always fails for them.

@kssenii kssenii requested a review from Algunenano May 1, 2025 12:15
@kssenii
Copy link
Copy Markdown
Member Author

kssenii commented May 2, 2025

Integration tests (asan, old analyzer, 3/6) — fail: 1

test_covered_by_broken_exists/test.py::test_make_clone_covered_by_broken_detached_dir_exists

@kssenii kssenii added this pull request to the merge queue May 2, 2025
Merged via the queue into master with commit 8c5a8ad May 2, 2025
114 of 122 checks passed
@kssenii kssenii deleted the make-delta-kernel-default branch May 2, 2025 08:32
@robot-ch-test-poll robot-ch-test-poll added the pr-synced-to-cloud The PR is synced to the cloud repo label May 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-improvement Pull request with some product improvements pr-synced-to-cloud The PR is synced to the cloud repo

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants