Skip to content

[Opt](storage) Interger type use plain encoding by default - #57220

Merged
liaoxin01 merged 8 commits into
apache:masterfrom
bobhan1:not-use-bitshuffle-for-integer-type
Oct 27, 2025
Merged

liaoxin01 merged 8 commits into
apache:masterfrom
bobhan1:not-use-bitshuffle-for-integer-type

Conversation

@bobhan1

@bobhan1 bobhan1 commented Oct 22, 2025

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas

Thearas commented Oct 22, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@bobhan1

bobhan1 commented Oct 22, 2025

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

Copy link
Copy Markdown
TPC-DS: Total hot run time: 189864 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 126649b6f225790541b55ada05aebaae5416cbe2, data reload: false

query1	1038	442	404	404
query2	6560	1673	1710	1673
query3	6765	221	218	218
query4	26423	23781	23177	23177
query5	4508	649	488	488
query6	341	250	235	235
query7	4657	511	321	321
query8	319	275	266	266
query9	8740	2628	2599	2599
query10	509	338	272	272
query11	15484	15314	14795	14795
query12	186	118	118	118
query13	1705	556	424	424
query14	11414	9299	9460	9299
query15	213	193	178	178
query16	7681	667	499	499
query17	1216	751	630	630
query18	2055	485	418	418
query19	221	210	179	179
query20	142	127	131	127
query21	226	137	116	116
query22	4542	5027	4523	4523
query23	34660	33620	33583	33583
query24	9003	2522	2561	2522
query25	588	571	448	448
query26	1250	284	177	177
query27	2745	520	369	369
query28	4719	2231	2257	2231
query29	826	649	538	538
query30	320	235	207	207
query31	953	903	828	828
query32	87	72	74	72
query33	607	391	336	336
query34	836	890	543	543
query35	821	890	794	794
query36	965	1001	917	917
query37	129	119	90	90
query38	3589	3556	3531	3531
query39	1471	1427	1402	1402
query40	225	136	121	121
query41	68	63	99	63
query42	122	114	115	114
query43	502	497	481	481
query44	1230	738	736	736
query45	183	181	174	174
query46	901	1013	641	641
query47	1759	1786	1672	1672
query48	407	428	320	320
query49	767	507	420	420
query50	649	698	421	421
query51	3962	3916	3933	3916
query52	113	113	101	101
query53	236	275	207	207
query54	626	616	539	539
query55	91	85	84	84
query56	326	311	326	311
query57	1195	1172	1114	1114
query58	304	277	278	277
query59	2616	2671	2524	2524
query60	351	372	319	319
query61	157	158	158	158
query62	811	760	678	678
query63	235	195	204	195
query64	4393	1131	834	834
query65	4070	3975	3997	3975
query66	1082	422	348	348
query67	15226	15222	14891	14891
query68	7979	943	597	597
query69	498	354	309	309
query70	1308	1236	1228	1228
query71	448	352	334	334
query72	6143	4809	4799	4799
query73	654	581	361	361
query74	8908	9156	8954	8954
query75	3632	3409	2891	2891
query76	3410	1174	808	808
query77	715	440	329	329
query78	9762	9638	8804	8804
query79	2764	879	623	623
query80	778	702	529	529
query81	507	269	230	230
query82	674	165	137	137
query83	268	270	249	249
query84	265	114	91	91
query85	912	478	424	424
query86	395	312	306	306
query87	3711	3687	3673	3673
query88	4060	2318	2250	2250
query89	412	319	306	306
query90	2006	234	235	234
query91	158	190	215	190
query92	87	71	69	69
query93	2506	986	646	646
query94	751	456	346	346
query95	422	328	307	307
query96	503	606	296	296
query97	2969	2962	2872	2872
query98	269	217	214	214
query99	1564	1417	1277	1277
Total cold run time: 280559 ms
Total hot run time: 189864 ms

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 28.7 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 126649b6f225790541b55ada05aebaae5416cbe2, data reload: false

query1	0.06	0.05	0.05
query2	0.10	0.05	0.06
query3	0.27	0.08	0.08
query4	1.62	0.12	0.12
query5	0.28	0.26	0.25
query6	1.18	0.65	0.64
query7	0.03	0.03	0.03
query8	0.05	0.05	0.04
query9	0.63	0.52	0.51
query10	0.58	0.58	0.58
query11	0.19	0.12	0.11
query12	0.15	0.12	0.11
query13	0.64	0.61	0.61
query14	1.05	1.05	1.04
query15	0.89	0.85	0.88
query16	0.39	0.40	0.39
query17	1.02	1.06	1.08
query18	0.21	0.20	0.20
query19	1.95	1.84	1.82
query20	0.02	0.01	0.01
query21	15.43	0.18	0.12
query22	5.15	0.07	0.05
query23	15.67	0.27	0.10
query24	2.65	0.84	0.91
query25	0.09	0.07	0.05
query26	0.14	0.12	0.13
query27	0.06	0.06	0.06
query28	5.44	1.15	0.92
query29	12.55	3.94	3.25
query30	0.28	0.14	0.11
query31	2.82	0.58	0.38
query32	3.24	0.56	0.47
query33	3.11	3.10	3.16
query34	16.13	5.47	4.87
query35	4.89	4.86	4.87
query36	0.68	0.52	0.49
query37	0.10	0.07	0.07
query38	0.07	0.05	0.04
query39	0.04	0.02	0.03
query40	0.18	0.15	0.14
query41	0.09	0.03	0.03
query42	0.04	0.03	0.04
query43	0.04	0.03	0.04
Total cold run time: 100.2 s
Total hot run time: 28.7 s

vectorized::MutableColumnPtr& dst) override {
DCHECK(_parsed);
if (*n == 0) [[unlikely]] {
*n = 0;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

useless

@bobhan1

bobhan1 commented Oct 22, 2025

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

Copy link
Copy Markdown
TPC-DS: Total hot run time: 190205 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d9f6f01ec8cdc286605579ad751deebbef51ae86, data reload: false

query1	1069	425	412	412
query2	6566	1763	1683	1683
query3	6777	226	222	222
query4	26742	23800	23130	23130
query5	5279	673	510	510
query6	347	249	257	249
query7	4668	508	306	306
query8	326	296	267	267
query9	8713	2616	2653	2616
query10	584	342	301	301
query11	15854	15046	14896	14896
query12	194	121	116	116
query13	1670	555	438	438
query14	12634	9298	9206	9206
query15	244	192	183	183
query16	7833	752	572	572
query17	1862	816	663	663
query18	2106	494	333	333
query19	258	214	208	208
query20	148	139	140	139
query21	217	148	116	116
query22	4547	4597	4612	4597
query23	34667	34085	33677	33677
query24	8028	2524	2548	2524
query25	626	562	540	540
query26	766	290	178	178
query27	2628	541	382	382
query28	4378	2294	2265	2265
query29	769	712	514	514
query30	355	251	206	206
query31	948	842	822	822
query32	78	75	67	67
query33	590	382	328	328
query34	811	843	530	530
query35	823	855	736	736
query36	940	976	885	885
query37	127	112	87	87
query38	3492	3535	3495	3495
query39	1462	1408	1409	1408
query40	227	128	113	113
query41	60	62	60	60
query42	122	110	112	110
query43	484	494	465	465
query44	1223	754	741	741
query45	185	187	172	172
query46	891	992	651	651
query47	1806	1792	1731	1731
query48	401	467	326	326
query49	731	511	431	431
query50	645	693	414	414
query51	3913	3894	3803	3803
query52	114	109	100	100
query53	256	267	198	198
query54	605	587	562	562
query55	96	88	96	88
query56	326	316	331	316
query57	1158	1192	1121	1121
query58	288	280	286	280
query59	2578	2585	2574	2574
query60	363	332	338	332
query61	150	151	145	145
query62	796	734	673	673
query63	237	204	198	198
query64	3240	1162	882	882
query65	4031	3950	3959	3950
query66	881	422	344	344
query67	15317	15170	15102	15102
query68	8027	894	605	605
query69	507	323	287	287
query70	1384	1256	1300	1256
query71	490	346	361	346
query72	5781	4894	4851	4851
query73	654	576	362	362
query74	8902	9086	8815	8815
query75	4038	3337	2794	2794
query76	3727	1170	732	732
query77	804	394	323	323
query78	9610	9715	9025	9025
query79	2028	840	593	593
query80	715	605	506	506
query81	503	265	230	230
query82	475	163	135	135
query83	283	270	269	269
query84	255	122	96	96
query85	876	458	428	428
query86	335	338	306	306
query87	3750	3778	3643	3643
query88	3598	2276	2242	2242
query89	397	331	295	295
query90	2017	215	216	215
query91	176	174	132	132
query92	87	74	67	67
query93	1721	997	648	648
query94	697	445	335	335
query95	412	324	322	322
query96	505	572	281	281
query97	2986	2950	2857	2857
query98	248	233	213	213
query99	1451	1411	1307	1307
Total cold run time: 278689 ms
Total hot run time: 190205 ms

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 27.65 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d9f6f01ec8cdc286605579ad751deebbef51ae86, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.05	0.05
query3	0.26	0.08	0.08
query4	1.62	0.12	0.12
query5	0.27	0.27	0.26
query6	1.15	0.66	0.63
query7	0.03	0.03	0.02
query8	0.05	0.05	0.04
query9	0.63	0.52	0.52
query10	0.58	0.57	0.58
query11	0.16	0.11	0.12
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	1.01	1.01	1.04
query15	0.85	0.84	0.86
query16	0.41	0.37	0.39
query17	1.04	1.03	1.06
query18	0.22	0.20	0.20
query19	1.95	1.81	1.84
query20	0.02	0.02	0.02
query21	15.44	0.22	0.13
query22	4.99	0.08	0.05
query23	15.66	0.26	0.11
query24	2.88	0.53	1.21
query25	0.07	0.07	0.06
query26	0.14	0.12	0.14
query27	0.07	0.05	0.06
query28	5.78	1.17	0.95
query29	12.55	4.00	3.26
query30	0.27	0.14	0.12
query31	2.81	0.59	0.39
query32	3.24	0.55	0.46
query33	3.12	3.10	3.02
query34	15.68	5.16	4.52
query35	4.62	4.62	4.59
query36	0.65	0.52	0.48
query37	0.10	0.07	0.07
query38	0.06	0.05	0.04
query39	0.03	0.03	0.03
query40	0.19	0.14	0.13
query41	0.09	0.04	0.03
query42	0.04	0.04	0.03
query43	0.05	0.04	0.03
Total cold run time: 99.7 s
Total hot run time: 27.65 s

dataroaring
dataroaring previously approved these changes Oct 22, 2025

@dataroaring dataroaring left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Oct 22, 2025
@github-actions

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@bobhan1
bobhan1 force-pushed the not-use-bitshuffle-for-integer-type branch from d9f6f01 to b68c754 Compare October 23, 2025 03:09
@github-actions github-actions Bot removed the approved Indicates a PR has been approved by one committer. label Oct 23, 2025
@bobhan1

bobhan1 commented Oct 23, 2025

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 28.11 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b68c75436bf13bc4c4e8a3e1ce0a1880758a68f0, data reload: false

query1	0.07	0.06	0.04
query2	0.10	0.06	0.06
query3	0.26	0.09	0.09
query4	1.61	0.12	0.12
query5	0.30	0.28	0.25
query6	1.17	0.65	0.68
query7	0.03	0.03	0.03
query8	0.06	0.05	0.05
query9	0.62	0.53	0.53
query10	0.59	0.59	0.58
query11	0.17	0.11	0.12
query12	0.16	0.13	0.13
query13	0.63	0.62	0.60
query14	1.02	1.02	1.00
query15	0.88	0.86	0.85
query16	0.42	0.40	0.40
query17	1.04	1.06	1.07
query18	0.23	0.21	0.21
query19	1.96	1.84	1.86
query20	0.02	0.01	0.01
query21	15.46	0.22	0.13
query22	4.94	0.09	0.05
query23	15.63	0.27	0.11
query24	2.13	0.56	0.39
query25	0.07	0.07	0.07
query26	0.15	0.15	0.14
query27	0.07	0.07	0.06
query28	4.23	1.17	0.96
query29	12.57	4.03	3.39
query30	0.32	0.14	0.12
query31	2.83	0.61	0.39
query32	3.24	0.56	0.48
query33	3.03	3.12	3.14
query34	15.88	5.21	4.63
query35	4.59	4.57	4.60
query36	0.68	0.51	0.51
query37	0.12	0.07	0.07
query38	0.07	0.05	0.04
query39	0.04	0.04	0.03
query40	0.18	0.14	0.14
query41	0.10	0.04	0.03
query42	0.05	0.04	0.03
query43	0.04	0.04	0.04
Total cold run time: 97.76 s
Total hot run time: 28.11 s

@bobhan1

bobhan1 commented Oct 23, 2025

Copy link
Copy Markdown
Contributor Author

run buildall

@hello-stephen

Copy link
Copy Markdown
Contributor

BE UT Coverage Report

Increment line coverage 93.98% (78/83) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.65% (17938/34068)
Line Coverage 37.90% (162785/429544)
Region Coverage 32.32% (124249/384403)
Branch Coverage 33.72% (54420/161396)

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 27.73 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a04329705c8877e598041ecc47083a97b6809823, data reload: false

query1	0.06	0.06	0.05
query2	0.10	0.05	0.06
query3	0.26	0.08	0.08
query4	1.61	0.11	0.12
query5	0.30	0.27	0.25
query6	1.18	0.67	0.67
query7	0.04	0.03	0.03
query8	0.05	0.04	0.04
query9	0.64	0.54	0.53
query10	0.60	0.59	0.59
query11	0.17	0.12	0.12
query12	0.17	0.13	0.13
query13	0.64	0.62	0.63
query14	1.01	1.02	1.01
query15	0.86	0.85	0.84
query16	0.41	0.40	0.40
query17	1.04	1.04	1.07
query18	0.22	0.20	0.20
query19	1.95	1.84	1.86
query20	0.02	0.02	0.01
query21	15.46	0.20	0.13
query22	4.95	0.08	0.05
query23	15.64	0.27	0.10
query24	2.69	0.66	0.28
query25	0.08	0.06	0.05
query26	0.15	0.14	0.12
query27	0.07	0.05	0.06
query28	4.00	1.17	0.94
query29	12.56	3.94	3.31
query30	0.27	0.13	0.11
query31	2.82	0.61	0.39
query32	3.23	0.55	0.47
query33	3.03	3.03	3.03
query34	15.80	5.17	4.62
query35	4.56	4.59	4.60
query36	0.67	0.51	0.50
query37	0.11	0.07	0.08
query38	0.07	0.05	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.15
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 97.87 s
Total hot run time: 27.73 s

dataroaring
dataroaring previously approved these changes Oct 25, 2025

@dataroaring dataroaring left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Oct 25, 2025
liaoxin01
liaoxin01 previously approved these changes Oct 25, 2025

@liaoxin01 liaoxin01 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hello-stephen

Copy link
Copy Markdown
Contributor

BE Regression && UT Coverage Report

Increment line coverage 95.18% (79/83) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.38% (23876/33450)
Line Coverage 57.82% (248561/429875)
Region Coverage 52.95% (206335/389666)
Branch Coverage 54.62% (88691/162381)

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 27.7 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b576e70b2d140fa16c42ad6e2b51774d0a53f8e2, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.60	0.12	0.11
query5	0.27	0.26	0.26
query6	1.17	0.67	0.65
query7	0.03	0.03	0.03
query8	0.05	0.04	0.05
query9	0.65	0.54	0.52
query10	0.60	0.57	0.58
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.63	0.61	0.60
query14	1.02	1.02	1.01
query15	0.86	0.85	0.86
query16	0.39	0.40	0.42
query17	1.05	1.03	1.01
query18	0.22	0.20	0.20
query19	1.86	1.81	1.84
query20	0.01	0.01	0.02
query21	15.47	0.19	0.13
query22	5.11	0.06	0.04
query23	15.68	0.26	0.10
query24	2.66	1.17	0.45
query25	0.08	0.06	0.06
query26	0.14	0.14	0.13
query27	0.06	0.06	0.05
query28	4.57	1.16	0.93
query29	12.56	3.98	3.29
query30	0.29	0.14	0.11
query31	2.82	0.59	0.39
query32	3.23	0.55	0.48
query33	3.02	3.12	3.09
query34	15.84	5.13	4.54
query35	4.57	4.61	4.57
query36	0.69	0.51	0.50
query37	0.10	0.06	0.07
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.04
query42	0.03	0.03	0.03
query43	0.04	0.03	0.03
Total cold run time: 98.44 s
Total hot run time: 27.7 s

@bobhan1
bobhan1 force-pushed the not-use-bitshuffle-for-integer-type branch from b576e70 to 48d5ad5 Compare October 27, 2025 08:07
@bobhan1

bobhan1 commented Oct 27, 2025

Copy link
Copy Markdown
Contributor Author

run buildall

@bobhan1

bobhan1 commented Oct 27, 2025

Copy link
Copy Markdown
Contributor Author

run performance

@hello-stephen

Copy link
Copy Markdown
Contributor

BE UT Coverage Report

Increment line coverage 94.74% (90/95) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.65% (17971/34134)
Line Coverage 37.93% (163115/430072)
Region Coverage 32.36% (124501/384762)
Branch Coverage 33.71% (54409/161400)

@doris-robot

Copy link
Copy Markdown
TPC-DS: Total hot run time: 190677 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 48d5ad545562a8a4f8e72f5970b719cc3ee7e717, data reload: false

query1	1086	429	430	429
query2	6577	1754	1734	1734
query3	6761	228	222	222
query4	26500	23864	23511	23511
query5	4429	664	498	498
query6	346	258	241	241
query7	4655	513	303	303
query8	320	276	273	273
query9	8687	2630	2636	2630
query10	532	337	309	309
query11	15455	15051	14888	14888
query12	185	127	116	116
query13	1700	589	464	464
query14	10756	9425	9504	9425
query15	250	188	175	175
query16	7735	678	503	503
query17	1211	776	641	641
query18	2055	468	362	362
query19	246	211	182	182
query20	142	132	143	132
query21	227	156	125	125
query22	4459	4693	4532	4532
query23	34866	34051	33871	33871
query24	8524	2614	2564	2564
query25	621	532	466	466
query26	1319	305	179	179
query27	3382	506	389	389
query28	4434	2266	2208	2208
query29	808	723	508	508
query30	330	249	204	204
query31	916	841	782	782
query32	89	72	76	72
query33	597	407	363	363
query34	829	876	551	551
query35	857	851	800	800
query36	995	1030	912	912
query37	144	134	98	98
query38	3704	3772	3531	3531
query39	1470	1399	1417	1399
query40	223	139	115	115
query41	63	60	60	60
query42	123	112	113	112
query43	511	507	470	470
query44	1264	753	742	742
query45	193	177	172	172
query46	880	993	661	661
query47	1752	1850	1732	1732
query48	402	422	318	318
query49	766	492	429	429
query50	654	687	409	409
query51	3936	3917	3936	3917
query52	115	114	108	108
query53	259	274	196	196
query54	603	594	540	540
query55	94	86	85	85
query56	325	330	307	307
query57	1168	1221	1101	1101
query58	291	278	290	278
query59	2543	2596	2474	2474
query60	341	337	336	336
query61	157	182	159	159
query62	805	746	669	669
query63	240	204	206	204
query64	4509	1169	845	845
query65	4055	3984	3944	3944
query66	1111	422	327	327
query67	15327	15012	14920	14920
query68	8801	905	615	615
query69	508	327	286	286
query70	1335	1267	1249	1249
query71	494	363	311	311
query72	5949	4929	4806	4806
query73	718	598	359	359
query74	8845	9185	8715	8715
query75	4300	3314	2876	2876
query76	3660	1189	783	783
query77	801	422	320	320
query78	9611	9705	8930	8930
query79	2447	814	611	611
query80	680	584	506	506
query81	493	261	229	229
query82	447	168	134	134
query83	294	265	264	264
query84	311	117	93	93
query85	904	484	432	432
query86	339	339	308	308
query87	3682	3697	3639	3639
query88	3186	2301	2267	2267
query89	402	324	294	294
query90	1988	232	230	230
query91	163	166	142	142
query92	76	74	66	66
query93	1185	996	643	643
query94	690	417	353	353
query95	412	329	328	328
query96	502	583	287	287
query97	2955	2986	2853	2853
query98	252	218	206	206
query99	1433	1421	1320	1320
Total cold run time: 278772 ms
Total hot run time: 190677 ms

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 27.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 48d5ad545562a8a4f8e72f5970b719cc3ee7e717, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.05	0.06
query3	0.25	0.08	0.08
query4	1.61	0.13	0.12
query5	0.28	0.26	0.25
query6	1.17	0.65	0.64
query7	0.03	0.02	0.02
query8	0.05	0.05	0.05
query9	0.62	0.52	0.52
query10	0.57	0.59	0.57
query11	0.17	0.11	0.12
query12	0.16	0.12	0.12
query13	0.62	0.60	0.61
query14	1.01	1.02	1.01
query15	0.86	0.84	0.87
query16	0.38	0.39	0.39
query17	1.02	1.02	0.99
query18	0.22	0.20	0.20
query19	1.89	1.82	1.79
query20	0.01	0.01	0.01
query21	15.42	0.20	0.13
query22	4.95	0.07	0.05
query23	15.68	0.27	0.10
query24	2.38	1.12	0.76
query25	0.08	0.07	0.06
query26	0.14	0.13	0.12
query27	0.07	0.05	0.06
query28	5.51	1.17	0.92
query29	12.68	3.92	3.27
query30	0.29	0.14	0.11
query31	2.82	0.59	0.39
query32	3.25	0.54	0.46
query33	3.01	3.07	3.04
query34	15.84	5.21	4.52
query35	4.58	4.60	4.53
query36	0.67	0.52	0.49
query37	0.10	0.06	0.06
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.19	0.15	0.16
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.05	0.04	0.03
Total cold run time: 99.01 s
Total hot run time: 27.77 s

@hello-stephen

Copy link
Copy Markdown
Contributor

BE Regression && UT Coverage Report

Increment line coverage 95.79% (91/95) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.36% (23913/33512)
Line Coverage 57.82% (248873/430414)
Region Coverage 52.89% (206280/390026)
Branch Coverage 54.63% (88718/162393)

@github-actions

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Oct 27, 2025
@liaoxin01
liaoxin01 merged commit d513ae4 into apache:master Oct 27, 2025
12 checks passed
bobhan1 added a commit to bobhan1/doris that referenced this pull request Oct 28, 2025
bobhan1 added a commit to bobhan1/doris that referenced this pull request Oct 30, 2025
dwdwqfwe pushed a commit to dwdwqfwe/doris that referenced this pull request Oct 31, 2025
bobhan1 added a commit to bobhan1/doris that referenced this pull request Dec 17, 2025
yiguolei pushed a commit that referenced this pull request Dec 19, 2025
…57220 #57327 #59075 (#57441)

### What problem does this PR solve?
pick:
- #56815
- #56846
- #57220
- #57327
- #59075

Clickbench result on alicloud c6.4xlarge machine, Intel(R) Xeon(R)
Platinum 8269CY CPU @ 2.50GHz

||(baseline) LZ4F, 64KB data page size, 48 bucket,
binary_plain_encoding_default_impl=v1,
integer_type_default_use_plain_encoding =false| zstd(3), 1MB data page
size, 48 bucket, binary_plain_encoding_default_impl=v1,
integer_type_default_use_plain_encoding =false | zstd(3), 1MB data page
size, 48 bucket, binary_plain_encoding_default_impl=v2,
integer_type_default_use_plain_encoding =true |
|---|---|---|---|
|data size|16.087 GB| 11.016 GB | 8.56 GB |
|load time|592s| 555s | 539s |
|cold run total| 214.22 s | 177.57 s | 131.4 s |
|hot run total| 36.03 s | 39.82 s | 39.05 s |
### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/4.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants