Skip to content

[fix](test) Modify regression test to make stable and change expected log level #55169

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morrySnow merged 5 commits into from
Sep 10, 2025
Merged

[fix](test) Modify regression test to make stable and change expected log level #55169

morrySnow merged 5 commits into from
Sep 10, 2025

Conversation

@seawinde
Copy link
Contributor

@seawinde seawinde commented Aug 22, 2025

What problem does this PR solve?

fix test : regression-test/suites/nereids_rules_p0/mv/date_trunc/mv_with_date_trunc.groovy
and change expected log level

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

hello-stephen commented Aug 22, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@seawinde
Copy link
Contributor Author

seawinde commented Aug 22, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Aug 22, 2025

FE UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉
Increment coverage report
Complete coverage report

morrySnow
morrySnow previously approved these changes Aug 26, 2025
View reviewed changes
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 26, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Aug 26, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Aug 26, 2025

PR approved by anyone and no changes requested.

@doris-robot
Copy link

doris-robot commented Aug 26, 2025

TPC-H: Total hot run time: 33943 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 108bda051786e31e8aeae50fe50043750646e496, data reload: false

------ Round 1 ----------------------------------
q1	17606	5315	5088	5088
q2	1907	293	184	184
q3	10321	1243	729	729
q4	10212	976	523	523
q5	7507	2426	2331	2331
q6	179	156	131	131
q7	919	739	600	600
q8	9304	1268	1120	1120
q9	6808	5168	5150	5150
q10	6989	2378	1985	1985
q11	484	294	261	261
q12	354	349	226	226
q13	17773	3648	3016	3016
q14	237	228	212	212
q15	567	471	480	471
q16	428	420	374	374
q17	599	856	356	356
q18	7391	7115	7043	7043
q19	1308	944	562	562
q20	342	329	214	214
q21	4130	3258	2385	2385
q22	1061	1020	982	982
Total cold run time: 106426 ms
Total hot run time: 33943 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5134	5156	5169	5156
q2	253	320	221	221
q3	2126	2660	2279	2279
q4	1392	1805	1382	1382
q5	4227	4544	4456	4456
q6	211	174	129	129
q7	1985	1942	1797	1797
q8	2608	2623	2644	2623
q9	7373	7284	7288	7284
q10	3127	3273	2994	2994
q11	592	515	531	515
q12	687	808	613	613
q13	3546	3892	3271	3271
q14	285	320	270	270
q15	525	488	493	488
q16	451	489	442	442
q17	1171	1662	1429	1429
q18	7856	7688	7290	7290
q19	837	805	920	805
q20	1878	1942	1817	1817
q21	4801	4363	4285	4285
q22	1092	1050	1016	1016
Total cold run time: 52157 ms
Total hot run time: 50562 ms

@doris-robot
Copy link

doris-robot commented Aug 26, 2025

TPC-DS: Total hot run time: 185176 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 108bda051786e31e8aeae50fe50043750646e496, data reload: false

query1	985	390	395	390
query2	6516	1723	1757	1723
query3	6746	224	217	217
query4	26678	23582	22780	22780
query5	4388	612	507	507
query6	293	206	201	201
query7	4621	496	280	280
query8	278	228	222	222
query9	8595	2868	2874	2868
query10	469	343	280	280
query11	15848	15073	14940	14940
query12	168	115	126	115
query13	1674	552	438	438
query14	9026	5981	5915	5915
query15	210	194	167	167
query16	7471	616	420	420
query17	1209	744	627	627
query18	1999	433	335	335
query19	196	190	171	171
query20	130	133	121	121
query21	217	131	109	109
query22	4235	4354	4007	4007
query23	33833	32978	32974	32974
query24	8171	2382	2375	2375
query25	543	482	411	411
query26	1234	272	157	157
query27	2745	495	347	347
query28	4343	2299	2228	2228
query29	762	553	446	446
query30	284	217	189	189
query31	859	808	702	702
query32	82	76	74	74
query33	543	376	334	334
query34	809	847	510	510
query35	786	824	761	761
query36	963	1001	927	927
query37	124	106	84	84
query38	4092	4058	4017	4017
query39	1525	1414	1417	1414
query40	219	125	112	112
query41	61	58	54	54
query42	121	107	108	107
query43	487	494	474	474
query44	1330	870	870	870
query45	180	174	169	169
query46	856	1005	656	656
query47	1813	1802	1723	1723
query48	383	417	317	317
query49	738	476	394	394
query50	651	684	403	403
query51	4104	4174	4054	4054
query52	118	112	97	97
query53	243	264	196	196
query54	578	587	515	515
query55	89	83	83	83
query56	316	310	309	309
query57	1161	1203	1151	1151
query58	274	267	275	267
query59	2604	2830	2592	2592
query60	339	325	349	325
query61	140	122	124	122
query62	807	721	685	685
query63	233	192	190	190
query64	4360	1070	684	684
query65	4277	4247	4210	4210
query66	1162	411	322	322
query67	15549	15416	15298	15298
query68	8145	925	573	573
query69	474	326	286	286
query70	1248	1186	1087	1087
query71	463	330	324	324
query72	5695	4758	4858	4758
query73	765	630	366	366
query74	9199	9113	8842	8842
query75	3818	3074	2628	2628
query76	3716	1141	750	750
query77	821	392	325	325
query78	9546	9771	8880	8880
query79	2400	789	593	593
query80	610	531	479	479
query81	507	263	229	229
query82	464	135	109	109
query83	256	254	233	233
query84	251	107	94	94
query85	813	363	341	341
query86	395	310	291	291
query87	4296	4270	4303	4270
query88	3573	2237	2252	2237
query89	394	310	332	310
query90	1838	222	217	217
query91	142	144	113	113
query92	83	74	65	65
query93	1749	989	638	638
query94	667	415	311	311
query95	393	311	306	306
query96	491	585	283	283
query97	2634	2673	2598	2598
query98	237	228	222	222
query99	1416	1445	1256	1256
Total cold run time: 274342 ms
Total hot run time: 185176 ms

@doris-robot
Copy link

doris-robot commented Aug 26, 2025

ClickBench: Total hot run time: 32.12 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 108bda051786e31e8aeae50fe50043750646e496, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.05	0.04
query3	0.24	0.07	0.08
query4	1.61	0.11	0.11
query5	0.42	0.42	0.41
query6	1.17	0.63	0.65
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.60	0.52	0.51
query10	0.56	0.58	0.59
query11	0.16	0.10	0.11
query12	0.15	0.12	0.11
query13	0.64	0.61	0.61
query14	0.79	0.83	0.83
query15	0.88	0.83	0.84
query16	0.39	0.39	0.39
query17	1.03	1.04	1.03
query18	0.21	0.20	0.20
query19	1.90	1.80	1.80
query20	0.01	0.01	0.01
query21	15.49	1.00	0.57
query22	0.75	1.14	0.63
query23	15.01	1.37	0.61
query24	6.65	0.82	0.50
query25	0.47	0.07	0.20
query26	0.70	0.16	0.13
query27	0.06	0.06	0.05
query28	9.95	0.91	0.42
query29	12.56	3.91	3.27
query30	3.10	3.04	3.00
query31	2.84	0.57	0.38
query32	3.26	0.55	0.47
query33	3.08	3.04	3.03
query34	16.07	5.50	4.86
query35	4.96	4.93	4.96
query36	0.71	0.51	0.49
query37	0.10	0.07	0.07
query38	0.05	0.04	0.04
query39	0.04	0.02	0.03
query40	0.18	0.15	0.14
query41	0.08	0.03	0.03
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 107.16 s
Total hot run time: 32.12 s

zddr
zddr reviewed Aug 28, 2025
View reviewed changes
...re/src/main/java/org/apache/doris/nereids/trees/plans/visitor/ExpressionLineageReplacer.java Outdated
@Override
public Expression visitGroupPlan(GroupPlan groupPlan, ExpressionReplaceContext context) {
LOG.error("ExpressionLineageReplacer should not meet groupPlan, plan is {}", groupPlan.toString());
LOG.debug("ExpressionLineageReplacer should not meet groupPlan, plan is {}", groupPlan.toString());
Copy link
Contributor

@zddr zddr Aug 28, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if (LOG.isDebugEnabled()) {

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Aug 28, 2025
@seawinde
Copy link
Contributor Author

seawinde commented Aug 28, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Aug 28, 2025

TPC-H: Total hot run time: 34447 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b94f2c2bb182ea8e531c769175096f12b2d8dfd0, data reload: false

------ Round 1 ----------------------------------
q1	17601	5278	5169	5169
q2	2000	372	219	219
q3	10188	1327	733	733
q4	10224	1040	539	539
q5	7545	2474	2353	2353
q6	187	165	136	136
q7	919	784	635	635
q8	9362	1329	1144	1144
q9	6974	5165	5121	5121
q10	6895	2403	1983	1983
q11	488	303	285	285
q12	362	365	228	228
q13	17769	3647	3076	3076
q14	248	238	226	226
q15	568	543	505	505
q16	429	445	380	380
q17	588	872	386	386
q18	7803	7195	7120	7120
q19	1236	971	577	577
q20	348	352	241	241
q21	3982	3189	2392	2392
q22	1065	1024	999	999
Total cold run time: 106781 ms
Total hot run time: 34447 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5179	5179	5141	5141
q2	256	339	238	238
q3	2198	2704	2327	2327
q4	1402	1790	1382	1382
q5	4282	4555	4738	4555
q6	243	191	138	138
q7	2055	1954	1843	1843
q8	2697	2702	2602	2602
q9	7389	7283	7351	7283
q10	3295	3285	2834	2834
q11	570	535	536	535
q12	738	792	652	652
q13	3833	3862	3318	3318
q14	308	328	310	310
q15	515	483	482	482
q16	473	515	457	457
q17	1196	1710	1459	1459
q18	7949	7754	7618	7618
q19	833	814	838	814
q20	2006	2052	1923	1923
q21	5231	4696	4476	4476
q22	1109	1066	1011	1011
Total cold run time: 53757 ms
Total hot run time: 51398 ms

@doris-robot
Copy link

doris-robot commented Aug 28, 2025

TPC-DS: Total hot run time: 186517 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b94f2c2bb182ea8e531c769175096f12b2d8dfd0, data reload: false

query1	1062	443	419	419
query2	6568	1741	1781	1741
query3	6756	228	224	224
query4	26026	23463	23215	23215
query5	4431	636	508	508
query6	330	234	223	223
query7	4643	521	306	306
query8	304	269	238	238
query9	8597	2927	2878	2878
query10	481	362	300	300
query11	15795	15056	14825	14825
query12	173	129	116	116
query13	1673	563	430	430
query14	8748	5892	5758	5758
query15	216	192	173	173
query16	7144	672	497	497
query17	971	740	620	620
query18	2000	431	372	372
query19	207	196	175	175
query20	136	127	127	127
query21	217	126	117	117
query22	4007	4169	4033	4033
query23	33720	32755	32759	32755
query24	8157	2344	2424	2344
query25	588	525	444	444
query26	1264	280	167	167
query27	2734	512	358	358
query28	4415	2294	2270	2270
query29	790	615	495	495
query30	295	231	198	198
query31	867	808	725	725
query32	95	83	81	81
query33	591	433	374	374
query34	829	839	519	519
query35	844	843	749	749
query36	993	1015	919	919
query37	131	118	103	103
query38	4085	4075	3891	3891
query39	1522	1458	1457	1457
query40	233	148	129	129
query41	79	75	70	70
query42	136	123	120	120
query43	536	516	488	488
query44	1364	876	876	876
query45	188	186	179	179
query46	899	1035	655	655
query47	1804	1905	1747	1747
query48	388	447	314	314
query49	737	512	420	420
query50	650	685	392	392
query51	4089	4125	4270	4125
query52	129	115	105	105
query53	243	265	199	199
query54	631	612	545	545
query55	98	96	90	90
query56	356	338	326	326
query57	1193	1236	1143	1143
query58	301	276	285	276
query59	2655	2728	2602	2602
query60	369	353	390	353
query61	169	164	165	164
query62	844	731	683	683
query63	234	195	198	195
query64	4550	1159	834	834
query65	4361	4238	4195	4195
query66	1186	446	353	353
query67	15788	15419	15210	15210
query68	7883	937	580	580
query69	490	338	293	293
query70	1218	1154	1171	1154
query71	463	342	318	318
query72	5953	5014	5121	5014
query73	694	634	356	356
query74	9063	9162	8895	8895
query75	3729	3181	2619	2619
query76	3525	1138	739	739
query77	791	403	360	360
query78	9439	9710	8954	8954
query79	1409	886	587	587
query80	635	627	522	522
query81	474	257	226	226
query82	412	138	111	111
query83	260	269	250	250
query84	360	122	101	101
query85	914	484	435	435
query86	337	314	283	283
query87	4236	4226	4130	4130
query88	2752	2219	2221	2219
query89	391	324	297	297
query90	1959	225	219	219
query91	167	161	132	132
query92	94	75	70	70
query93	1106	994	663	663
query94	707	425	325	325
query95	417	325	315	315
query96	486	598	280	280
query97	2628	2735	2603	2603
query98	242	220	236	220
query99	1608	1406	1315	1315
Total cold run time: 271457 ms
Total hot run time: 186517 ms

@doris-robot
Copy link

doris-robot commented Aug 28, 2025

ClickBench: Total hot run time: 32.78 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b94f2c2bb182ea8e531c769175096f12b2d8dfd0, data reload: false

query1	0.06	0.05	0.04
query2	0.08	0.06	0.06
query3	0.26	0.08	0.08
query4	1.60	0.12	0.12
query5	0.44	0.42	0.42
query6	1.19	0.63	0.66
query7	0.04	0.03	0.02
query8	0.05	0.04	0.04
query9	0.61	0.54	0.54
query10	0.59	0.58	0.57
query11	0.17	0.12	0.12
query12	0.16	0.12	0.12
query13	0.63	0.63	0.61
query14	0.80	0.84	0.85
query15	0.87	0.86	0.86
query16	0.40	0.42	0.40
query17	1.04	1.06	1.03
query18	0.22	0.20	0.19
query19	1.88	1.82	1.79
query20	0.02	0.01	0.01
query21	15.42	0.96	0.58
query22	0.79	1.21	0.70
query23	14.83	1.40	0.67
query24	6.86	1.18	0.58
query25	0.50	0.20	0.23
query26	0.60	0.16	0.14
query27	0.06	0.05	0.04
query28	9.49	0.90	0.42
query29	12.66	3.99	3.37
query30	3.10	2.99	3.02
query31	2.83	0.59	0.38
query32	3.23	0.54	0.48
query33	3.05	3.13	3.08
query34	15.92	5.42	4.87
query35	4.93	4.89	4.91
query36	0.70	0.50	0.52
query37	0.10	0.08	0.08
query38	0.06	0.05	0.04
query39	0.04	0.03	0.04
query40	0.18	0.15	0.15
query41	0.07	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 106.61 s
Total hot run time: 32.78 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Aug 28, 2025

FE UT Coverage Report

Increment line coverage 50.00% (1/2) 🎉
Increment coverage report
Complete coverage report

@seawinde seawinde force-pushed the fix_mv_test_unstable_and_log_warn branch from b94f2c2 to 6b614c8 Compare August 28, 2025 07:16
@seawinde
Copy link
Contributor Author

seawinde commented Aug 28, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Aug 28, 2025

TPC-H: Total hot run time: 34483 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8d9e46902eac49c12a2d6cc79a3515caf081f1e8, data reload: false

------ Round 1 ----------------------------------
q1	17635	5338	5140	5140
q2	1999	331	249	249
q3	10191	1281	741	741
q4	10300	1012	542	542
q5	7577	2564	2354	2354
q6	188	167	137	137
q7	932	779	645	645
q8	9361	1357	1168	1168
q9	6987	5080	5186	5080
q10	6886	2403	1957	1957
q11	477	317	286	286
q12	356	369	251	251
q13	17779	3670	3107	3107
q14	239	241	219	219
q15	553	507	508	507
q16	438	441	391	391
q17	593	870	360	360
q18	7414	7142	7094	7094
q19	1258	972	600	600
q20	357	348	238	238
q21	4027	3281	2406	2406
q22	1053	1042	1011	1011
Total cold run time: 106600 ms
Total hot run time: 34483 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5216	5181	5157	5157
q2	269	344	252	252
q3	2179	2734	2349	2349
q4	1412	1851	1353	1353
q5	4297	4578	4539	4539
q6	218	174	140	140
q7	2140	2041	1800	1800
q8	2883	2641	2533	2533
q9	7465	7474	7365	7365
q10	3086	3251	2875	2875
q11	574	524	559	524
q12	747	767	690	690
q13	3552	4002	3476	3476
q14	310	310	280	280
q15	547	503	496	496
q16	444	524	466	466
q17	1223	1593	1440	1440
q18	7825	7742	7639	7639
q19	862	856	857	856
q20	1980	2054	1961	1961
q21	5201	4433	4278	4278
q22	1045	1034	1023	1023
Total cold run time: 53475 ms
Total hot run time: 51492 ms

@doris-robot
Copy link

doris-robot commented Aug 28, 2025

TPC-DS: Total hot run time: 187444 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8d9e46902eac49c12a2d6cc79a3515caf081f1e8, data reload: false

query1	1072	457	444	444
query2	6627	1825	1796	1796
query3	6771	227	225	225
query4	26264	23333	23068	23068
query5	4379	669	549	549
query6	353	251	237	237
query7	4648	540	305	305
query8	310	268	250	250
query9	8652	2910	2909	2909
query10	500	354	349	349
query11	15426	14944	14763	14763
query12	190	127	125	125
query13	1698	595	455	455
query14	8953	5903	5947	5903
query15	214	189	189	189
query16	7823	678	495	495
query17	1273	782	669	669
query18	2070	451	379	379
query19	205	195	181	181
query20	134	129	122	122
query21	231	128	115	115
query22	4012	4060	4032	4032
query23	34045	32805	33043	32805
query24	8171	2418	2403	2403
query25	590	564	455	455
query26	1247	289	172	172
query27	2675	513	350	350
query28	4357	2271	2250	2250
query29	783	610	502	502
query30	295	232	199	199
query31	916	823	747	747
query32	92	86	84	84
query33	581	415	366	366
query34	808	857	534	534
query35	822	840	752	752
query36	996	1019	940	940
query37	147	119	93	93
query38	4118	4080	4041	4041
query39	1506	1479	1429	1429
query40	234	137	131	131
query41	78	70	65	65
query42	132	129	121	121
query43	500	520	497	497
query44	1415	914	887	887
query45	188	174	168	168
query46	899	1038	670	670
query47	1778	1861	1723	1723
query48	394	445	328	328
query49	777	530	429	429
query50	687	689	421	421
query51	4088	4166	4135	4135
query52	117	119	105	105
query53	256	277	209	209
query54	629	620	549	549
query55	99	97	91	91
query56	359	351	344	344
query57	1216	1196	1135	1135
query58	300	292	291	291
query59	2610	2745	2642	2642
query60	368	372	361	361
query61	171	162	166	162
query62	819	747	696	696
query63	237	209	201	201
query64	4505	1149	857	857
query65	4334	4216	4215	4215
query66	1101	450	370	370
query67	15392	15300	14999	14999
query68	9134	940	628	628
query69	503	334	303	303
query70	1288	1099	1130	1099
query71	485	367	331	331
query72	5976	5121	5130	5121
query73	780	666	363	363
query74	9336	9194	8932	8932
query75	4258	3103	2651	2651
query76	3656	1194	771	771
query77	835	421	343	343
query78	9656	9822	8935	8935
query79	1996	875	594	594
query80	709	608	532	532
query81	498	256	233	233
query82	473	150	116	116
query83	306	331	265	265
query84	313	125	101	101
query85	889	481	433	433
query86	433	336	313	313
query87	4408	4284	4243	4243
query88	2856	2250	2220	2220
query89	416	356	302	302
query90	1932	238	232	232
query91	167	165	132	132
query92	95	81	83	81
query93	1212	1026	661	661
query94	700	428	329	329
query95	419	341	333	333
query96	488	599	279	279
query97	2675	2703	2570	2570
query98	255	225	224	224
query99	1462	1449	1290	1290
Total cold run time: 276246 ms
Total hot run time: 187444 ms

@doris-robot
Copy link

doris-robot commented Aug 28, 2025

ClickBench: Total hot run time: 32.43 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8d9e46902eac49c12a2d6cc79a3515caf081f1e8, data reload: false

query1	0.06	0.05	0.06
query2	0.09	0.06	0.05
query3	0.26	0.08	0.09
query4	1.60	0.11	0.12
query5	0.44	0.44	0.42
query6	1.16	0.64	0.67
query7	0.03	0.02	0.02
query8	0.06	0.05	0.05
query9	0.60	0.52	0.54
query10	0.58	0.57	0.58
query11	0.17	0.12	0.12
query12	0.15	0.12	0.12
query13	0.63	0.63	0.61
query14	0.81	0.88	0.83
query15	0.86	0.85	0.85
query16	0.40	0.41	0.39
query17	1.06	1.08	1.04
query18	0.21	0.21	0.20
query19	1.91	1.89	1.83
query20	0.01	0.01	0.02
query21	15.41	0.93	0.59
query22	0.81	1.34	0.87
query23	14.84	1.42	0.62
query24	6.61	0.81	0.37
query25	0.51	0.16	0.06
query26	0.60	0.17	0.13
query27	0.06	0.05	0.06
query28	9.54	0.99	0.44
query29	12.54	3.89	3.21
query30	3.12	3.08	3.02
query31	2.84	0.58	0.39
query32	3.25	0.55	0.46
query33	3.04	3.07	3.09
query34	15.99	5.47	4.83
query35	4.97	4.95	4.96
query36	0.72	0.51	0.50
query37	0.10	0.08	0.07
query38	0.06	0.05	0.04
query39	0.04	0.03	0.03
query40	0.18	0.14	0.15
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.48 s
Total hot run time: 32.43 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Aug 28, 2025

FE UT Coverage Report

Increment line coverage 50.00% (1/2) 🎉
Increment coverage report
Complete coverage report

@seawinde
Copy link
Contributor Author

seawinde commented Aug 28, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Aug 29, 2025

FE UT Coverage Report

Increment line coverage 50.00% (1/2) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

doris-robot commented Aug 29, 2025

TPC-H: Total hot run time: 34322 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c592226a81f29a8b7a36a7b4a90b28e9a5417fa6, data reload: false

------ Round 1 ----------------------------------
q1	17613	5282	5146	5146
q2	2018	315	205	205
q3	10305	1288	724	724
q4	10244	1033	567	567
q5	7543	2475	2378	2378
q6	186	169	141	141
q7	947	759	632	632
q8	9364	1345	1121	1121
q9	7083	5103	5163	5103
q10	6970	2383	1990	1990
q11	503	296	296	296
q12	376	361	222	222
q13	17792	3653	3048	3048
q14	236	230	219	219
q15	584	501	499	499
q16	442	426	390	390
q17	609	893	354	354
q18	7516	7101	7121	7101
q19	1093	962	594	594
q20	348	361	222	222
q21	3819	3194	2378	2378
q22	1051	1036	992	992
Total cold run time: 106642 ms
Total hot run time: 34322 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5487	5117	5106	5106
q2	259	326	229	229
q3	2231	2709	2313	2313
q4	1392	1826	1363	1363
q5	4266	4637	4503	4503
q6	232	176	132	132
q7	2059	1974	1838	1838
q8	2643	2692	2562	2562
q9	7589	7552	7404	7404
q10	3081	3346	2941	2941
q11	625	526	516	516
q12	737	809	668	668
q13	3542	3921	3510	3510
q14	286	305	288	288
q15	548	505	470	470
q16	431	532	467	467
q17	1198	1679	1362	1362
q18	7898	7716	7686	7686
q19	815	845	852	845
q20	2023	2212	1905	1905
q21	4865	4452	4377	4377
q22	1086	1037	985	985
Total cold run time: 53293 ms
Total hot run time: 51470 ms

@doris-robot
Copy link

doris-robot commented Aug 29, 2025

TPC-DS: Total hot run time: 186882 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c592226a81f29a8b7a36a7b4a90b28e9a5417fa6, data reload: false

query1	1057	463	419	419
query2	6568	1765	1724	1724
query3	6771	231	229	229
query4	26226	23735	23534	23534
query5	4427	648	552	552
query6	356	255	245	245
query7	4640	526	310	310
query8	316	262	245	245
query9	8689	2897	2953	2897
query10	492	360	291	291
query11	15664	14937	14872	14872
query12	169	121	119	119
query13	1669	559	431	431
query14	8874	5811	5778	5778
query15	216	196	179	179
query16	7376	664	463	463
query17	1283	745	620	620
query18	2007	425	336	336
query19	207	198	169	169
query20	135	128	129	128
query21	216	129	117	117
query22	4275	4187	4037	4037
query23	33781	33111	33070	33070
query24	8164	2380	2419	2380
query25	605	515	451	451
query26	1242	285	166	166
query27	2716	521	354	354
query28	4402	2271	2247	2247
query29	849	630	505	505
query30	297	231	203	203
query31	906	831	684	684
query32	95	93	95	93
query33	597	415	372	372
query34	798	853	530	530
query35	843	868	765	765
query36	980	1036	916	916
query37	134	118	97	97
query38	4088	4095	3922	3922
query39	1528	1446	1455	1446
query40	239	148	184	148
query41	76	65	64	64
query42	132	112	120	112
query43	537	528	490	490
query44	1344	883	863	863
query45	182	178	174	174
query46	905	1075	660	660
query47	1810	1826	1726	1726
query48	397	430	340	340
query49	767	512	415	415
query50	658	696	403	403
query51	4103	4131	4098	4098
query52	120	113	109	109
query53	244	268	203	203
query54	625	602	542	542
query55	91	94	97	94
query56	350	342	329	329
query57	1189	1207	1144	1144
query58	299	292	282	282
query59	2753	2773	2597	2597
query60	374	365	353	353
query61	169	165	166	165
query62	810	728	675	675
query63	233	217	205	205
query64	4505	1142	850	850
query65	4348	4213	4238	4213
query66	1181	443	367	367
query67	15500	15414	14977	14977
query68	8990	940	590	590
query69	499	322	294	294
query70	1212	1206	1133	1133
query71	477	374	322	322
query72	5913	5024	4964	4964
query73	718	588	362	362
query74	9129	9110	8659	8659
query75	4243	3125	2657	2657
query76	3679	1177	776	776
query77	814	404	338	338
query78	9696	9873	8866	8866
query79	2110	884	589	589
query80	695	595	526	526
query81	484	257	222	222
query82	430	145	111	111
query83	306	269	249	249
query84	300	109	96	96
query85	947	477	430	430
query86	347	305	304	304
query87	4278	4231	4183	4183
query88	2828	2269	2250	2250
query89	414	325	294	294
query90	1915	237	235	235
query91	167	164	136	136
query92	90	77	77	77
query93	1163	967	649	649
query94	697	424	339	339
query95	427	338	335	335
query96	481	600	286	286
query97	2667	2693	2587	2587
query98	238	222	223	222
query99	1454	1409	1307	1307
Total cold run time: 275407 ms
Total hot run time: 186882 ms

@doris-robot
Copy link

doris-robot commented Aug 29, 2025

ClickBench: Total hot run time: 32.87 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c592226a81f29a8b7a36a7b4a90b28e9a5417fa6, data reload: false

query1	0.06	0.05	0.04
query2	0.09	0.06	0.06
query3	0.26	0.08	0.09
query4	1.61	0.12	0.12
query5	0.44	0.42	0.43
query6	1.17	0.64	0.66
query7	0.05	0.03	0.02
query8	0.05	0.05	0.05
query9	0.60	0.54	0.53
query10	0.59	0.58	0.57
query11	0.18	0.12	0.11
query12	0.16	0.12	0.12
query13	0.63	0.63	0.62
query14	0.81	0.85	0.83
query15	0.86	0.88	0.87
query16	0.39	0.40	0.41
query17	1.04	1.07	1.08
query18	0.22	0.20	0.20
query19	1.92	1.84	1.85
query20	0.02	0.02	0.01
query21	15.40	0.96	0.60
query22	0.79	1.13	0.68
query23	14.97	1.41	0.64
query24	6.58	2.09	0.62
query25	0.47	0.26	0.16
query26	0.61	0.16	0.15
query27	0.07	0.06	0.05
query28	9.76	0.98	0.44
query29	12.80	4.01	3.28
query30	3.16	3.03	3.04
query31	2.83	0.60	0.39
query32	3.23	0.54	0.47
query33	3.08	3.12	3.19
query34	15.92	5.46	4.84
query35	4.97	4.93	4.97
query36	0.72	0.51	0.50
query37	0.11	0.08	0.07
query38	0.06	0.05	0.04
query39	0.04	0.03	0.02
query40	0.19	0.15	0.15
query41	0.09	0.03	0.03
query42	0.04	0.03	0.03
query43	0.05	0.04	0.03
Total cold run time: 107.09 s
Total hot run time: 32.87 s

@seawinde
Copy link
Contributor Author

seawinde commented Aug 29, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Aug 29, 2025

FE UT Coverage Report

Increment line coverage 50.00% (1/2) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

doris-robot commented Aug 29, 2025

TPC-H: Total hot run time: 34477 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7f5b6d030af71f6451af25055db85973fe4d20e9, data reload: false

------ Round 1 ----------------------------------
q1	17645	5274	5132	5132
q2	2006	327	209	209
q3	10268	1307	729	729
q4	10247	1046	523	523
q5	7538	2520	2351	2351
q6	186	168	138	138
q7	959	790	656	656
q8	9372	1560	1139	1139
q9	7073	5173	5166	5166
q10	6986	2396	2008	2008
q11	499	310	295	295
q12	380	359	230	230
q13	17787	3678	3005	3005
q14	228	242	223	223
q15	596	518	518	518
q16	428	435	400	400
q17	618	867	364	364
q18	7674	7133	7204	7133
q19	1153	976	584	584
q20	360	344	235	235
q21	3884	3219	2439	2439
q22	1092	1030	1000	1000
Total cold run time: 106979 ms
Total hot run time: 34477 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5195	5138	5189	5138
q2	251	335	224	224
q3	2161	2705	2299	2299
q4	1339	1796	1351	1351
q5	4238	4525	4566	4525
q6	234	176	140	140
q7	2104	2050	1893	1893
q8	2705	2759	2616	2616
q9	7449	7489	7352	7352
q10	3183	3322	2894	2894
q11	575	520	502	502
q12	735	794	653	653
q13	3624	4068	3335	3335
q14	307	323	277	277
q15	535	472	476	472
q16	453	505	444	444
q17	1205	1668	1409	1409
q18	7853	7984	7777	7777
q19	876	870	918	870
q20	2109	2026	1977	1977
q21	4980	4304	4372	4304
q22	1088	1079	1038	1038
Total cold run time: 53199 ms
Total hot run time: 51490 ms

@doris-robot
Copy link

doris-robot commented Aug 29, 2025

TPC-DS: Total hot run time: 187497 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7f5b6d030af71f6451af25055db85973fe4d20e9, data reload: false

query1	1062	466	442	442
query2	6568	1764	1791	1764
query3	6757	233	228	228
query4	26414	23319	22893	22893
query5	4402	703	542	542
query6	350	262	225	225
query7	4673	520	305	305
query8	303	282	247	247
query9	8636	2922	2900	2900
query10	491	361	294	294
query11	15852	14977	14797	14797
query12	187	124	122	122
query13	1680	566	452	452
query14	9712	5976	5981	5976
query15	224	203	181	181
query16	7691	681	490	490
query17	1257	807	632	632
query18	2057	426	349	349
query19	212	197	174	174
query20	137	131	126	126
query21	227	134	118	118
query22	4211	4291	4084	4084
query23	34056	33320	33263	33263
query24	8163	2398	2434	2398
query25	581	524	459	459
query26	1073	282	165	165
query27	2689	519	361	361
query28	4328	2283	2260	2260
query29	746	613	490	490
query30	295	225	198	198
query31	924	837	724	724
query32	96	84	86	84
query33	571	392	368	368
query34	790	865	521	521
query35	810	826	776	776
query36	995	1012	906	906
query37	127	117	96	96
query38	4105	4095	4025	4025
query39	1507	1442	1489	1442
query40	231	137	134	134
query41	67	62	66	62
query42	131	115	120	115
query43	522	535	502	502
query44	1395	881	885	881
query45	194	180	174	174
query46	889	1028	656	656
query47	1802	1805	1772	1772
query48	394	445	328	328
query49	726	517	413	413
query50	645	709	403	403
query51	4077	4119	4170	4119
query52	117	124	110	110
query53	257	276	202	202
query54	630	608	544	544
query55	100	92	92	92
query56	360	324	322	322
query57	1193	1211	1126	1126
query58	300	280	285	280
query59	2683	2813	2555	2555
query60	373	357	347	347
query61	167	169	163	163
query62	804	733	667	667
query63	235	198	200	198
query64	3966	1255	850	850
query65	4318	4208	4266	4208
query66	974	451	371	371
query67	15511	15273	15051	15051
query68	9548	933	597	597
query69	493	334	306	306
query70	1302	1166	1187	1166
query71	487	361	339	339
query72	5954	5110	5095	5095
query73	772	661	366	366
query74	8954	8873	8859	8859
query75	4325	3154	2660	2660
query76	3777	1150	773	773
query77	981	408	347	347
query78	9706	9754	8844	8844
query79	1277	842	606	606
query80	846	602	531	531
query81	488	262	231	231
query82	212	149	116	116
query83	301	289	261	261
query84	309	110	104	104
query85	874	481	443	443
query86	355	315	310	310
query87	4288	4231	4278	4231
query88	2852	2262	2320	2262
query89	393	336	297	297
query90	2086	239	239	239
query91	168	170	137	137
query92	93	76	75	75
query93	1117	1043	659	659
query94	697	415	333	333
query95	430	341	328	328
query96	495	592	290	290
query97	2624	2703	2608	2608
query98	241	223	219	219
query99	1415	1421	1343	1343
Total cold run time: 275880 ms
Total hot run time: 187497 ms

@doris-robot
Copy link

doris-robot commented Aug 29, 2025

ClickBench: Total hot run time: 32.82 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7f5b6d030af71f6451af25055db85973fe4d20e9, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.61	0.11	0.11
query5	0.44	0.42	0.40
query6	1.17	0.64	0.65
query7	0.03	0.02	0.03
query8	0.06	0.05	0.04
query9	0.60	0.52	0.52
query10	0.58	0.59	0.59
query11	0.17	0.11	0.12
query12	0.15	0.12	0.12
query13	0.63	0.62	0.62
query14	0.81	0.85	0.84
query15	0.88	0.84	0.87
query16	0.40	0.41	0.39
query17	1.07	1.03	1.02
query18	0.22	0.20	0.22
query19	2.00	1.80	1.89
query20	0.01	0.01	0.01
query21	15.39	0.94	0.59
query22	0.78	1.23	0.83
query23	14.73	1.44	0.63
query24	6.94	0.88	0.96
query25	0.46	0.28	0.09
query26	0.54	0.17	0.13
query27	0.06	0.05	0.06
query28	9.74	0.91	0.44
query29	12.53	3.97	3.28
query30	3.06	3.01	2.94
query31	2.83	0.59	0.38
query32	3.26	0.55	0.47
query33	3.07	3.11	3.09
query34	15.90	5.46	4.81
query35	4.91	4.99	4.89
query36	0.71	0.51	0.49
query37	0.10	0.07	0.07
query38	0.06	0.05	0.05
query39	0.04	0.03	0.02
query40	0.18	0.14	0.14
query41	0.09	0.03	0.03
query42	0.03	0.04	0.03
query43	0.04	0.04	0.04
Total cold run time: 106.69 s
Total hot run time: 32.82 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Aug 29, 2025

FE Regression Coverage Report

Increment line coverage 0.00% (0/2) 🎉
Increment coverage report
Complete coverage report

@github-actions
Copy link
Contributor

github-actions bot commented Sep 5, 2025

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 5, 2025
@morrySnow morrySnow merged commit ca17ed1 into apache:master Sep 10, 2025
26 of 28 checks passed
seawinde added a commit to seawinde/doris that referenced this pull request Sep 11, 2025
@seawinde
[fix](test) Modify regression test to make stable and change expected…
d32595b 
… log level (apache#55169)
@seawinde seawinde mentioned this pull request Sep 11, 2025
Merged
morrySnow pushed a commit that referenced this pull request Sep 17, 2025
@seawinde
branch-3.1: [fix](test) Modify regression test to make stable and cha…
5c61f90 
…nge expectedlog level #55169 (#55898)

picked from #55169
@morrySnow morrySnow mentioned this pull request Sep 22, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrySnow morrySnow morrySnow approved these changes

+1 more reviewer

@zddr zddr zddr approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/3.1.1-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@seawinde @hello-stephen @doris-robot @zddr @morrySnow