Skip to content

[GLUTEN-1632][CH]Daily Update Clickhouse Version (20250220)#8783

Merged
baibaichen merged 7 commits intoapache:mainfrom
Kyligence:rebase_ch/20250220
Feb 20, 2025
Merged

[GLUTEN-1632][CH]Daily Update Clickhouse Version (20250220)#8783
baibaichen merged 7 commits intoapache:mainfrom
Kyligence:rebase_ch/20250220

Conversation

@kyligence-git
Copy link
Copy Markdown
Contributor

@kyligence-git kyligence-git commented Feb 19, 2025

Auto commit by gluten daily build, please check the build status and merge it if it's green.

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 19, 2025

#1632

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 19, 2025

Run Gluten Clickhouse CI on x86

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 20, 2025

Run Gluten Clickhouse CI on x86

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 20, 2025

Run Gluten Clickhouse CI on x86

@baibaichen baibaichen merged commit 620d498 into apache:main Feb 20, 2025
8 checks passed
@GlutenPerfBot
Copy link
Copy Markdown
Contributor

GlutenPerfBot commented Feb 20, 2025

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_master_02_20_2025_time.csv log/native_master_02_19_2025_a6369a0bdd_time.csv difference percentage
q1 11.97 11.15 -0.812 93.22%
q2 12.63 12.02 -0.610 95.17%
q3 3.09 3.12 0.038 101.24%
q4 51.40 52.42 1.026 102.00%
q5 9.22 8.32 -0.892 90.33%
q6 4.81 4.41 -0.404 91.60%
q7 5.33 5.45 0.128 102.40%
q8 4.80 3.03 -1.765 63.20%
q9 16.60 13.89 -2.711 83.68%
q10 12.63 13.08 0.449 103.56%
q11 27.40 28.50 1.091 103.98%
q12 2.12 2.73 0.614 129.00%
q13 6.65 7.72 1.065 116.01%
q14a 43.70 43.43 -0.274 99.37%
q14b 41.45 43.08 1.631 103.93%
q15 2.19 2.52 0.327 114.92%
q16 4.93 5.19 0.255 105.16%
q17 6.64 6.64 0.000 100.00%
q18 7.91 8.25 0.338 104.27%
q19 3.72 4.57 0.850 122.83%
q20 1.58 2.72 1.141 172.12%
q21 1.14 1.51 0.370 132.56%
q22 2.65 2.99 0.345 113.02%
q23a 62.19 61.69 -0.498 99.20%
q23b 72.36 72.77 0.407 100.56%
q24a 74.54 72.54 -2.001 97.32%
q24b 65.90 68.53 2.630 103.99%
q25 6.91 5.12 -1.792 74.07%
q26 2.72 2.33 -0.387 85.78%
q27 2.45 3.12 0.673 127.51%
q28 17.57 17.20 -0.365 97.92%
q29 8.05 7.60 -0.443 94.49%
q30 4.95 5.30 0.353 107.14%
q31 9.06 8.10 -0.963 89.38%
q32 1.89 1.46 -0.435 77.05%
q33 3.29 4.90 1.615 149.15%
q34 3.11 3.70 0.593 119.09%
q35 7.52 7.52 -0.006 99.93%
q36 3.15 2.47 -0.680 78.41%
q37 2.92 3.68 0.764 126.20%
q38 11.48 11.85 0.371 103.23%
q39a 4.94 4.16 -0.777 84.26%
q39b 3.70 4.34 0.644 117.41%
q40 3.64 4.31 0.666 118.31%
q41 1.69 0.64 -1.045 37.99%
q42 1.43 1.04 -0.391 72.65%
q43 1.78 2.09 0.314 117.63%
q44 6.20 5.78 -0.420 93.23%
q45 3.23 3.60 0.370 111.46%
q46 4.14 3.95 -0.198 95.22%
q47 9.42 11.45 2.023 121.47%
q48 3.86 3.20 -0.658 82.95%
q49 5.52 5.35 -0.171 96.89%
q50 18.35 16.94 -1.408 92.33%
q51 7.97 7.88 -0.099 98.76%
q52 1.16 0.77 -0.389 66.55%
q53 2.48 1.73 -0.751 69.73%
q54 6.14 6.37 0.230 103.75%
q55 0.87 0.98 0.115 113.24%
q56 3.91 3.61 -0.302 92.29%
q57 6.58 7.45 0.862 113.10%
q58 2.81 2.69 -0.124 95.59%
q59 4.19 4.30 0.110 102.62%
q60 4.41 4.42 0.007 100.16%
q61 5.71 4.22 -1.494 73.86%
q62 2.70 2.82 0.120 104.46%
q63 1.45 1.68 0.227 115.61%
q64 36.86 36.62 -0.239 99.35%
q65 10.66 12.00 1.338 112.54%
q66 3.56 3.91 0.349 109.80%
q67 58.11 59.56 1.450 102.50%
q68 3.43 3.12 -0.311 90.94%
q69 4.69 5.27 0.582 112.41%
q70 5.73 5.79 0.059 101.04%
q71 5.00 5.48 0.479 109.58%
q72 21.15 20.55 -0.598 97.17%
q73 2.30 2.33 0.032 101.38%
q74 17.84 16.99 -0.854 95.21%
q75 25.00 23.95 -1.047 95.81%
q76 7.31 6.86 -0.449 93.85%
q77 2.07 2.72 0.654 131.58%
q78 34.12 32.99 -1.133 96.68%
q79 3.49 3.77 0.281 108.07%
q80 10.64 10.78 0.148 101.39%
q81 6.34 8.22 1.878 129.60%
q82 5.45 5.30 -0.146 97.32%
q83 1.43 1.64 0.209 114.62%
q84 2.40 2.91 0.507 121.15%
q85 5.94 5.60 -0.342 94.25%
q86 2.02 2.05 0.031 101.55%
q87 12.10 11.91 -0.189 98.44%
q88 15.21 15.32 0.104 100.69%
q89 2.31 2.63 0.313 113.54%
q90 2.03 2.63 0.598 129.46%
q91 5.31 4.16 -1.151 78.32%
q92 1.96 1.78 -0.180 90.84%
q93 24.76 23.53 -1.230 95.03%
q94 8.21 8.48 0.267 103.25%
q9 58.52 59.04 0.527 100.90%
q5 2.26 2.33 0.070 103.11%
q96 10.81 10.79 -0.025 99.77%
q97 2.51 3.02 0.505 120.08%
q98 6.41 5.49 -0.916 85.71%
q99 0.32 0.29 -0.029 90.75%
total 1191.15 1192.20 1.044 100.09%

@GlutenPerfBot
Copy link
Copy Markdown
Contributor

GlutenPerfBot commented Feb 20, 2025

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_02_20_2025_time.csv log/native_master_02_19_2025_a6369a0bdd_time.csv difference percentage
q1 24.85 25.37 0.518 102.08%
q2 25.14 26.10 0.955 103.80%
q3 32.69 33.09 0.393 101.20%
q4 28.00 28.17 0.171 100.61%
q5 60.05 60.40 0.350 100.58%
q6 12.16 9.03 -3.129 74.27%
q7 40.96 39.13 -1.828 95.54%
q8 61.95 66.62 4.672 107.54%
q9 102.45 109.57 7.118 106.95%
q10 46.01 48.62 2.604 105.66%
q11 17.26 17.23 -0.032 99.81%
q12 17.18 17.45 0.279 101.62%
q13 25.84 27.66 1.820 107.04%
q14 12.89 12.06 -0.826 93.59%
q15 26.88 28.10 1.217 104.53%
q16 13.59 14.53 0.936 106.88%
q17 76.34 83.01 6.677 108.75%
q18 122.29 125.32 3.032 102.48%
q19 18.66 22.59 3.929 121.06%
q20 25.61 25.70 0.091 100.36%
q21 193.53 195.37 1.839 100.95%
q22 12.62 9.99 -2.627 79.19%
total 996.95 1025.11 28.160 102.82%

kevinw66 pushed a commit to kevinw66/incubator-gluten that referenced this pull request Mar 3, 2025
@kyligence-git @baibaichen @kevinw66
[GLUTEN-1632][CH]Daily Update Clickhouse Version (20250220) (apache#8783
c7875e0 
)

* [GLUTEN-1632][CH]Daily Update Clickhouse Version (20250220)

* Fix build due to ClickHouse/ClickHouse#75474

* Fix build due to ClickHouse/ClickHouse#75452

* Rework "gluten_cache.local.enabled" config due to ClickHouse/ClickHouse#75452

Now, we still use "gluten_cache.local.enabled" in spark, and we will convert it to "enable.gluten_cache.local" when initlize native backend.

* Fix memory access error exposed by ClickHouse/ClickHouse#75452

* Fix  "<Error>... Possibly incorrect column size subtraction" due to  ClickHouse/ClickHouse#75938

* Unified temporary directory

---------

Co-authored-by: kyligence-git <[email protected]>
Co-authored-by: Chang Chen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@baibaichen baibaichen baibaichen approved these changes

Assignees

No one assigned

Labels

CLICKHOUSE

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@kyligence-git @GlutenPerfBot @baibaichen