[chore](build) Optimize build script #56027

gavinchou · 2025-09-14T05:22:47Z

No description provided.

Thearas · 2025-09-14T05:22:51Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

gavinchou · 2025-09-14T05:40:10Z

run buildall

pick apache#56027

doris-robot · 2025-09-14T06:18:55Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	84.75% (1523/1797)
Line Coverage	68.15% (27240/39969)
Region Coverage	68.99% (13498/19565)
Branch Coverage	59.14% (7217/12204)

doris-robot · 2025-09-14T06:50:46Z

TPC-H: Total hot run time: 34796 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit be332b85633c379c74f9f530971777d8c8f30879, data reload: false

------ Round 1 ----------------------------------
q1	17616	5263	5060	5060
q2	2000	322	212	212
q3	10259	1310	725	725
q4	10229	1052	533	533
q5	7491	2386	2403	2386
q6	191	171	138	138
q7	929	780	653	653
q8	9361	1307	1068	1068
q9	7127	5126	5156	5126
q10	6997	2447	2010	2010
q11	495	326	289	289
q12	375	367	226	226
q13	17781	3667	3040	3040
q14	240	248	215	215
q15	580	494	500	494
q16	1036	1017	966	966
q17	617	882	369	369
q18	7517	7133	7159	7133
q19	1093	972	599	599
q20	368	349	244	244
q21	3803	2609	2322	2322
q22	1083	1045	988	988
Total cold run time: 107188 ms
Total hot run time: 34796 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5167	5137	5140	5137
q2	252	332	233	233
q3	2172	2709	2331	2331
q4	1386	1790	1377	1377
q5	4230	4509	4548	4509
q6	210	169	131	131
q7	2078	2038	1868	1868
q8	2641	2693	2626	2626
q9	7504	7383	7467	7383
q10	3123	3323	2898	2898
q11	570	530	489	489
q12	738	772	626	626
q13	3776	3889	3253	3253
q14	297	315	304	304
q15	551	485	500	485
q16	1087	1115	1029	1029
q17	1218	1590	1396	1396
q18	7817	7798	7704	7704
q19	814	854	972	854
q20	1906	1995	1821	1821
q21	4822	4361	4327	4327
q22	1064	1045	987	987
Total cold run time: 53423 ms
Total hot run time: 51768 ms

doris-robot · 2025-09-14T07:02:30Z

TPC-DS: Total hot run time: 189430 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit be332b85633c379c74f9f530971777d8c8f30879, data reload: false

query1	1102	440	428	428
query2	6557	1701	1709	1701
query3	6759	228	222	222
query4	26056	23595	23484	23484
query5	4443	631	501	501
query6	353	252	234	234
query7	4656	518	300	300
query8	314	261	268	261
query9	8671	2631	2642	2631
query10	499	354	293	293
query11	15830	15060	14830	14830
query12	171	119	114	114
query13	1691	583	458	458
query14	11025	9285	9287	9285
query15	210	206	184	184
query16	7715	677	487	487
query17	1245	762	651	651
query18	2063	441	394	394
query19	202	199	168	168
query20	136	129	120	120
query21	212	133	117	117
query22	4117	4323	4206	4206
query23	33937	33011	33079	33011
query24	8489	2409	2415	2409
query25	564	500	438	438
query26	1036	281	166	166
query27	2708	514	359	359
query28	4350	2231	2206	2206
query29	716	648	484	484
query30	294	224	201	201
query31	905	843	737	737
query32	83	74	71	71
query33	572	387	321	321
query34	790	867	509	509
query35	816	861	751	751
query36	955	1043	937	937
query37	125	114	85	85
query38	3644	3483	3537	3483
query39	1510	1432	1407	1407
query40	225	131	118	118
query41	71	64	66	64
query42	131	119	116	116
query43	529	507	503	503
query44	1346	868	852	852
query45	188	177	174	174
query46	861	1034	656	656
query47	1792	1836	1748	1748
query48	393	414	313	313
query49	726	515	413	413
query50	665	694	416	416
query51	3931	3920	3899	3899
query52	112	116	101	101
query53	243	263	192	192
query54	599	614	531	531
query55	90	88	85	85
query56	312	344	311	311
query57	1198	1205	1150	1150
query58	278	282	277	277
query59	2649	2670	2614	2614
query60	357	338	322	322
query61	164	169	170	169
query62	823	762	682	682
query63	233	198	195	195
query64	3833	1145	812	812
query65	4061	3967	3977	3967
query66	985	445	341	341
query67	15351	15363	15242	15242
query68	8661	943	586	586
query69	508	367	287	287
query70	1444	1262	1317	1262
query71	566	337	316	316
query72	6068	5056	5152	5056
query73	769	686	368	368
query74	9380	9115	8771	8771
query75	4117	3358	2819	2819
query76	3597	1181	748	748
query77	811	416	322	322
query78	9682	10010	8908	8908
query79	1795	851	587	587
query80	719	559	496	496
query81	476	264	227	227
query82	433	160	141	141
query83	303	267	249	249
query84	309	112	98	98
query85	877	460	427	427
query86	351	321	306	306
query87	3743	3770	3677	3677
query88	2808	2242	2171	2171
query89	404	324	295	295
query90	1910	217	210	210
query91	159	165	135	135
query92	85	73	64	64
query93	1123	1034	645	645
query94	703	443	334	334
query95	398	315	309	309
query96	486	579	271	271
query97	2964	3014	2922	2922
query98	235	214	216	214
query99	1470	1416	1302	1302
Total cold run time: 275021 ms
Total hot run time: 189430 ms

doris-robot · 2025-09-14T07:07:57Z

ClickBench: Total hot run time: 29.63 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit be332b85633c379c74f9f530971777d8c8f30879, data reload: false

query1	0.06	0.05	0.06
query2	0.10	0.05	0.06
query3	0.26	0.08	0.09
query4	1.61	0.12	0.12
query5	0.28	0.27	0.26
query6	1.16	0.64	0.65
query7	0.03	0.03	0.03
query8	0.06	0.04	0.04
query9	0.63	0.53	0.54
query10	0.58	0.59	0.58
query11	0.16	0.11	0.11
query12	0.16	0.12	0.12
query13	0.64	0.63	0.62
query14	1.03	1.03	1.05
query15	0.88	0.86	0.89
query16	0.41	0.42	0.40
query17	1.03	1.06	1.09
query18	0.22	0.20	0.20
query19	1.99	1.79	1.83
query20	0.02	0.01	0.01
query21	15.40	0.93	0.58
query22	0.77	1.25	0.74
query23	14.79	1.37	0.65
query24	7.00	1.03	0.37
query25	0.37	0.20	0.06
query26	0.71	0.16	0.14
query27	0.08	0.05	0.06
query28	9.34	0.92	0.46
query29	12.56	3.90	3.25
query30	0.28	0.14	0.13
query31	2.83	0.58	0.40
query32	3.22	0.57	0.47
query33	3.08	3.16	3.03
query34	16.21	5.48	4.90
query35	4.92	4.93	4.93
query36	0.70	0.52	0.51
query37	0.11	0.08	0.07
query38	0.07	0.05	0.04
query39	0.04	0.04	0.03
query40	0.19	0.15	0.14
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 104.14 s
Total hot run time: 29.63 s

gensrc/script/gen_build_version.sh

gavinchou · 2025-09-14T07:52:23Z

run buildall

doris-robot · 2025-09-14T08:28:58Z

TPC-H: Total hot run time: 34730 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 984579575ba37e073b79302f39dbb4bae39bc96d, data reload: false

------ Round 1 ----------------------------------
q1	17593	5243	5083	5083
q2	2011	317	207	207
q3	10272	1294	728	728
q4	10237	1033	523	523
q5	7561	2322	2407	2322
q6	191	170	137	137
q7	922	774	664	664
q8	9364	1311	1072	1072
q9	6909	5107	5096	5096
q10	6967	2396	2038	2038
q11	484	314	286	286
q12	353	363	230	230
q13	17783	3666	3096	3096
q14	238	250	217	217
q15	575	485	491	485
q16	1003	1003	953	953
q17	596	850	367	367
q18	7297	7076	7076	7076
q19	1411	945	593	593
q20	373	345	229	229
q21	3671	3186	2348	2348
q22	1026	1008	980	980
Total cold run time: 106837 ms
Total hot run time: 34730 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5174	5177	5129	5129
q2	248	330	225	225
q3	2133	2640	2315	2315
q4	1344	1762	1353	1353
q5	4198	4503	4593	4503
q6	221	167	131	131
q7	2027	2027	1809	1809
q8	2585	2630	2563	2563
q9	7406	7297	7424	7297
q10	3070	3364	2873	2873
q11	593	509	507	507
q12	773	802	624	624
q13	3565	3926	3298	3298
q14	294	318	293	293
q15	556	480	475	475
q16	1061	1130	1243	1130
q17	1243	1518	1411	1411
q18	7948	7711	7543	7543
q19	759	755	825	755
q20	1903	1944	1853	1853
q21	4819	4390	4292	4292
q22	1075	1041	997	997
Total cold run time: 52995 ms
Total hot run time: 51376 ms

hello-stephen · 2025-09-14T08:30:42Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	84.75% (1523/1797)
Line Coverage	68.16% (27243/39969)
Region Coverage	68.99% (13498/19565)
Branch Coverage	59.14% (7218/12204)

doris-robot · 2025-09-14T08:40:43Z

TPC-DS: Total hot run time: 188813 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 984579575ba37e073b79302f39dbb4bae39bc96d, data reload: false

query1	1074	464	430	430
query2	6568	1717	1689	1689
query3	6749	222	223	222
query4	26259	23601	23061	23061
query5	4463	660	490	490
query6	337	248	236	236
query7	4667	521	304	304
query8	311	269	264	264
query9	8670	2626	2629	2626
query10	495	355	293	293
query11	15502	15064	15000	15000
query12	169	118	118	118
query13	1681	598	445	445
query14	11225	9543	9334	9334
query15	203	208	173	173
query16	7691	671	498	498
query17	1365	748	627	627
query18	2050	428	340	340
query19	202	200	166	166
query20	156	132	120	120
query21	213	135	133	133
query22	4085	4276	4026	4026
query23	34038	32887	32802	32802
query24	8460	2367	2395	2367
query25	574	515	437	437
query26	1226	280	161	161
query27	2735	518	348	348
query28	4388	2222	2209	2209
query29	779	627	554	554
query30	292	222	199	199
query31	935	804	744	744
query32	80	76	74	74
query33	577	381	330	330
query34	794	860	514	514
query35	812	855	805	805
query36	984	1039	909	909
query37	126	112	91	91
query38	3516	3600	3474	3474
query39	1493	1478	1504	1478
query40	229	139	131	131
query41	71	70	66	66
query42	138	120	121	120
query43	522	506	460	460
query44	1343	867	876	867
query45	192	189	175	175
query46	863	1046	656	656
query47	1780	1817	1767	1767
query48	396	427	317	317
query49	764	519	401	401
query50	646	684	415	415
query51	3980	4118	3928	3928
query52	158	113	104	104
query53	237	265	189	189
query54	601	578	534	534
query55	88	86	90	86
query56	340	339	317	317
query57	1185	1213	1114	1114
query58	275	275	264	264
query59	2623	2705	2522	2522
query60	343	334	337	334
query61	170	170	171	170
query62	830	728	668	668
query63	229	200	189	189
query64	4459	1164	835	835
query65	4035	4008	3997	3997
query66	1115	448	363	363
query67	15249	15129	14943	14943
query68	9493	931	587	587
query69	485	318	284	284
query70	1392	1308	1345	1308
query71	558	339	311	311
query72	5933	5084	5251	5084
query73	753	674	361	361
query74	8982	9211	8854	8854
query75	4467	3339	2809	2809
query76	3908	1183	736	736
query77	1003	410	321	321
query78	9503	9738	8878	8878
query79	1525	851	625	625
query80	703	584	576	576
query81	483	261	223	223
query82	455	174	127	127
query83	302	265	255	255
query84	302	113	101	101
query85	890	469	419	419
query86	343	331	303	303
query87	3760	3756	3666	3666
query88	2821	2273	2271	2271
query89	395	327	310	310
query90	1945	220	216	216
query91	163	168	139	139
query92	80	70	60	60
query93	1128	981	661	661
query94	690	431	306	306
query95	397	324	317	317
query96	493	554	278	278
query97	2946	2957	2873	2873
query98	240	222	215	215
query99	1452	1408	1316	1316
Total cold run time: 276795 ms
Total hot run time: 188813 ms

doris-robot · 2025-09-14T08:46:11Z

ClickBench: Total hot run time: 29.66 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 984579575ba37e073b79302f39dbb4bae39bc96d, data reload: false

query1	0.06	0.05	0.04
query2	0.08	0.05	0.05
query3	0.26	0.08	0.09
query4	1.62	0.12	0.12
query5	0.28	0.28	0.25
query6	1.17	0.66	0.64
query7	0.04	0.03	0.03
query8	0.05	0.05	0.05
query9	0.64	0.52	0.51
query10	0.57	0.57	0.56
query11	0.16	0.11	0.11
query12	0.16	0.12	0.13
query13	0.63	0.63	0.62
query14	1.04	1.03	1.03
query15	0.88	0.85	0.86
query16	0.42	0.41	0.41
query17	1.08	1.06	1.04
query18	0.21	0.21	0.20
query19	1.93	1.83	1.81
query20	0.01	0.02	0.01
query21	15.43	0.93	0.60
query22	0.76	1.18	0.68
query23	14.95	1.40	0.64
query24	7.14	0.99	0.41
query25	0.48	0.24	0.09
query26	0.64	0.16	0.14
query27	0.08	0.06	0.05
query28	9.16	0.91	0.44
query29	12.55	3.98	3.25
query30	0.28	0.13	0.12
query31	2.85	0.60	0.40
query32	3.25	0.56	0.47
query33	3.09	3.16	3.15
query34	16.17	5.46	4.87
query35	4.94	4.96	4.94
query36	0.71	0.51	0.51
query37	0.11	0.08	0.07
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.20	0.14	0.15
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 104.34 s
Total hot run time: 29.66 s

hello-stephen · 2025-09-14T09:09:53Z

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

doris-robot · 2025-09-14T09:16:39Z

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.20% (17431/33394)
Line Coverage	37.42% (158402/423358)
Region Coverage	32.00% (120820/377591)
Branch Coverage	33.37% (53014/158886)

hello-stephen · 2025-09-14T10:45:00Z

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	70.86% (23138/32655)
Line Coverage	57.20% (241589/422351)
Region Coverage	52.60% (201224/382588)
Branch Coverage	54.28% (86629/159591)

github-actions · 2025-09-15T04:27:50Z

PR approved by anyone and no changes requested.

dataroaring

LGTM

github-actions · 2025-09-15T07:16:12Z

PR approved by at least one committer and no changes requested.

pick #56027

…#56028) pick apache#56027

* update .github/actions/action-pr-title * Add secondary_package for cloud conf * process cloud product line specific files: rass-policy.xml * update build script for version configuration, keep update with apache#56027 * add build-for-release-selectdb-cloud.sh * fix difference for cloud conf, script and binaries apache#56031 * fix build-for-release-selectdb.sh and add --build_only option

pick #56027 again

[chore](build) Optimize build script

be332b8

gavinchou added the dev/3.1.x label Sep 14, 2025

gavinchou added a commit to gavinchou/doris that referenced this pull request Sep 14, 2025

[chore](build) Optimize build script apache#56027

fea7a59

pick apache#56027

gavinchou mentioned this pull request Sep 14, 2025

branch-3.1: [chore](build) Optimize build script #56027 #56028

Merged

gavinchou commented Sep 14, 2025

View reviewed changes

gensrc/script/gen_build_version.sh Outdated Show resolved Hide resolved

Update gensrc/script/gen_build_version.sh

9845795

Yukang-Lian approved these changes Sep 15, 2025

View reviewed changes

github-actions bot added the reviewed label Sep 15, 2025

dataroaring approved these changes Sep 15, 2025

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 15, 2025

gavinchou removed the dev/3.1.x label Sep 15, 2025

gavinchou merged commit 7b222ee into apache:master Sep 15, 2025
26 of 29 checks passed

morrySnow pushed a commit that referenced this pull request Sep 15, 2025

branch-3.1: [chore](build) Optimize build script #56027 (#56028)

a18a125

pick #56027

morrySnow added the dev/3.1.1-merged label Sep 15, 2025

gavinchou added the dev/4.0.x label Sep 15, 2025

morrySnow mentioned this pull request Sep 22, 2025

Release Note 3.1.1 #56289

Closed

yiguolei removed the dev/4.0.x label Sep 29, 2025

Hastyshell pushed a commit to Hastyshell/doris that referenced this pull request Oct 23, 2025

branch-3.1: [chore](build) Optimize build script apache#56027 (apache…

be0d094

…#56028) pick apache#56027

gavinchou added the dev/4.0.x label Nov 27, 2025

github-actions bot added the dev/4.0.x-conflict label Nov 27, 2025

gavinchou mentioned this pull request Nov 27, 2025

[chore](build) Optimize build script (#56027) #58464

Merged

gavinchou added a commit to gavinchou/doris that referenced this pull request Nov 27, 2025

[chore](build) Optimize build script (apache#56027)

86006c3

gavinchou removed the dev/4.0.x-conflict label Nov 27, 2025

yiguolei pushed a commit that referenced this pull request Nov 28, 2025

[chore](build) Optimize build script (#56027) (#58464)

80a4232

pick #56027 again

yiguolei added dev/4.0.2-merged and removed dev/4.0.x labels Nov 28, 2025

[chore](build) Optimize build script #56027

[chore](build) Optimize build script #56027

Uh oh!

Conversation

gavinchou commented Sep 14, 2025

Uh oh!

Thearas commented Sep 14, 2025

Uh oh!

gavinchou commented Sep 14, 2025

Uh oh!

doris-robot commented Sep 14, 2025

Cloud UT Coverage Report

Uh oh!

doris-robot commented Sep 14, 2025

Uh oh!

doris-robot commented Sep 14, 2025

Uh oh!

doris-robot commented Sep 14, 2025

Uh oh!

Uh oh!

gavinchou commented Sep 14, 2025

Uh oh!

doris-robot commented Sep 14, 2025

Uh oh!

hello-stephen commented Sep 14, 2025

Cloud UT Coverage Report

Uh oh!

doris-robot commented Sep 14, 2025

Uh oh!

doris-robot commented Sep 14, 2025

Uh oh!

hello-stephen commented Sep 14, 2025

FE UT Coverage Report

Uh oh!

doris-robot commented Sep 14, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Sep 14, 2025

BE Regression && UT Coverage Report

Uh oh!

github-actions bot commented Sep 15, 2025

Uh oh!

dataroaring left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Sep 15, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants