Skip to content

[testcase](hive)add exception test for hive txn - #33278

Merged
morningman merged 3 commits into
apache:masterfrom
wuwenchi:hive-txn-test
Apr 10, 2024
Merged

morningman merged 3 commits into
apache:masterfrom
wuwenchi:hive-txn-test

Conversation

@wuwenchi

@wuwenchi wuwenchi commented Apr 6, 2024 •

Copy link
Copy Markdown
Contributor

Proposed changes

Issue #31442
#32726

  1. add LocalDfsFileSystem to manipulate local files.
  2. add HMSCachedClientTest to analog HMS services.
  3. add test for rollback commit.

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot

Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@wuwenchi

wuwenchi commented Apr 6, 2024

Copy link
Copy Markdown
Contributor Author

run buildall

@wuwenchi

wuwenchi commented Apr 6, 2024

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

Copy link
Copy Markdown
TPC-H: Total hot run time: 38444 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit acbea5e0ed1fd5538f4720c5efa8c05e20166d2c, data reload: false

------ Round 1 ----------------------------------
q1	17611	4119	4015	4015
q2	2015	184	191	184
q3	10468	1234	1312	1234
q4	10216	807	966	807
q5	7470	2953	2911	2911
q6	223	137	137	137
q7	1092	641	619	619
q8	9402	2043	2006	2006
q9	6724	6177	6129	6129
q10	8532	3582	3595	3582
q11	424	243	248	243
q12	391	228	215	215
q13	17982	2889	2894	2889
q14	270	246	241	241
q15	523	497	491	491
q16	511	372	370	370
q17	950	892	910	892
q18	7274	6476	6331	6331
q19	2125	1517	1524	1517
q20	569	326	305	305
q21	3479	3032	3101	3032
q22	345	294	301	294
Total cold run time: 108596 ms
Total hot run time: 38444 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4028	4035	4047	4035
q2	329	218	213	213
q3	2933	2968	2967	2967
q4	1845	1836	1843	1836
q5	5258	5199	5185	5185
q6	206	125	129	125
q7	2204	1789	1796	1789
q8	3193	3252	3252	3252
q9	8445	8413	8429	8413
q10	3728	3924	3960	3924
q11	550	474	458	458
q12	754	639	600	600
q13	16823	3150	3095	3095
q14	318	287	270	270
q15	522	488	480	480
q16	505	472	446	446
q17	1785	1732	1735	1732
q18	8224	7692	7543	7543
q19	1866	1681	1706	1681
q20	2040	1802	1821	1802
q21	5303	4861	5013	4861
q22	518	442	441	441
Total cold run time: 71377 ms
Total hot run time: 55148 ms

@doris-robot

Copy link
Copy Markdown
TPC-DS: Total hot run time: 181946 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit acbea5e0ed1fd5538f4720c5efa8c05e20166d2c, data reload: false

query1	1239	1117	1122	1117
query2	6345	1958	1968	1958
query3	6656	214	202	202
query4	24461	21389	21456	21389
query5	4207	394	408	394
query6	273	182	177	177
query7	4696	300	306	300
query8	232	180	182	180
query9	8468	2297	2305	2297
query10	446	244	248	244
query11	15015	14503	14367	14367
query12	134	87	86	86
query13	1641	374	381	374
query14	8531	6920	6771	6771
query15	205	182	189	182
query16	6512	264	260	260
query17	1005	596	567	567
query18	1738	264	276	264
query19	196	151	153	151
query20	92	86	89	86
query21	198	130	123	123
query22	4929	4854	4790	4790
query23	33572	32642	32927	32642
query24	10226	3133	3126	3126
query25	651	380	383	380
query26	1504	164	156	156
query27	3174	372	368	368
query28	7298	1946	1897	1897
query29	1050	587	593	587
query30	310	171	164	164
query31	996	778	744	744
query32	101	64	55	55
query33	644	252	244	244
query34	1183	509	510	509
query35	850	713	711	711
query36	1037	869	862	862
query37	162	75	79	75
query38	3616	3624	3632	3624
query39	1646	1602	1628	1602
query40	178	131	135	131
query41	49	50	48	48
query42	114	105	100	100
query43	470	425	416	416
query44	1131	749	735	735
query45	307	281	289	281
query46	1135	856	823	823
query47	1993	1859	1901	1859
query48	372	310	303	303
query49	864	353	368	353
query50	821	402	413	402
query51	6765	6685	6791	6685
query52	104	88	100	88
query53	361	283	287	283
query54	269	236	226	226
query55	84	73	75	73
query56	253	229	235	229
query57	1280	1184	1151	1151
query58	246	212	220	212
query59	2681	2487	2533	2487
query60	263	240	240	240
query61	113	106	108	106
query62	658	438	444	438
query63	307	282	281	281
query64	5114	3164	3099	3099
query65	3020	3001	2998	2998
query66	877	317	316	316
query67	15489	15062	15043	15043
query68	9169	584	579	579
query69	567	313	306	306
query70	1482	1123	1095	1095
query71	498	263	262	262
query72	6488	2583	2425	2425
query73	1594	325	322	322
query74	6751	6405	6347	6347
query75	3731	2302	2270	2270
query76	5939	1218	1226	1218
query77	648	237	236	236
query78	10990	10159	10132	10132
query79	12617	517	525	517
query80	1870	416	408	408
query81	521	242	223	223
query82	581	94	91	91
query83	202	162	164	162
query84	263	86	85	85
query85	1290	289	266	266
query86	379	311	290	290
query87	3676	3466	3452	3452
query88	4389	2359	2372	2359
query89	563	365	362	362
query90	1983	173	177	173
query91	128	103	102	102
query92	61	48	48	48
query93	6737	519	514	514
query94	1207	178	179	178
query95	427	309	320	309
query96	600	281	281	281
query97	2641	2463	2503	2463
query98	235	207	206	206
query99	1290	834	855	834
Total cold run time: 300074 ms
Total hot run time: 181946 ms

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 29.74 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit acbea5e0ed1fd5538f4720c5efa8c05e20166d2c, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.04	0.05
query4	1.68	0.06	0.06
query5	0.48	0.49	0.48
query6	1.12	0.65	0.66
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.56	0.52	0.50
query10	0.56	0.56	0.56
query11	0.15	0.11	0.12
query12	0.14	0.12	0.12
query13	0.62	0.60	0.59
query14	0.79	0.77	0.79
query15	0.84	0.82	0.85
query16	0.36	0.35	0.36
query17	1.00	0.99	0.96
query18	0.25	0.25	0.26
query19	1.86	1.74	1.74
query20	0.02	0.01	0.01
query21	15.44	0.63	0.63
query22	4.10	6.75	1.43
query23	17.99	1.26	1.23
query24	1.40	0.20	0.18
query25	0.16	0.08	0.08
query26	0.27	0.16	0.16
query27	0.08	0.07	0.08
query28	13.90	0.97	0.95
query29	12.52	3.28	3.29
query30	0.25	0.06	0.05
query31	2.87	0.38	0.39
query32	3.29	0.48	0.47
query33	2.82	2.94	2.94
query34	15.48	4.35	4.34
query35	4.37	4.36	4.38
query36	0.68	0.47	0.47
query37	0.17	0.15	0.15
query38	0.15	0.14	0.14
query39	0.04	0.03	0.04
query40	0.17	0.15	0.15
query41	0.09	0.04	0.04
query42	0.05	0.04	0.04
query43	0.04	0.04	0.03
Total cold run time: 107.18 s
Total hot run time: 29.74 s

@doris-robot

Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit acbea5e0ed1fd5538f4720c5efa8c05e20166d2c with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       16.5 seconds inserted 10000000 Rows, about 606K ops/s

@wuwenchi

wuwenchi commented Apr 6, 2024

Copy link
Copy Markdown
Contributor Author

run external

@wuwenchi

wuwenchi commented Apr 6, 2024

Copy link
Copy Markdown
Contributor Author

run p0

@wuwenchi

wuwenchi commented Apr 7, 2024

Copy link
Copy Markdown
Contributor Author

run external

@wuwenchi

wuwenchi commented Apr 7, 2024

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

Copy link
Copy Markdown
TPC-H: Total hot run time: 38482 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a0b4a3d63b413a4ac5308577970f2118b2649a89, data reload: false

------ Round 1 ----------------------------------
q1	18574	4208	4052	4052
q2	2025	187	183	183
q3	10477	1167	1299	1167
q4	10201	822	964	822
q5	7489	2943	2948	2943
q6	220	135	144	135
q7	1091	594	601	594
q8	9388	2061	2027	2027
q9	6792	6217	6202	6202
q10	8398	3502	3520	3502
q11	411	238	235	235
q12	382	207	200	200
q13	17770	2896	2871	2871
q14	266	236	243	236
q15	531	506	467	467
q16	483	385	362	362
q17	946	908	881	881
q18	7344	6494	6405	6405
q19	1611	1528	1529	1528
q20	570	306	312	306
q21	3504	3152	3069	3069
q22	347	298	295	295
Total cold run time: 108820 ms
Total hot run time: 38482 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4026	4023	4015	4015
q2	332	210	217	210
q3	2953	2948	2964	2948
q4	1878	1841	1843	1841
q5	5206	5210	5200	5200
q6	207	121	123	121
q7	2233	1795	1819	1795
q8	3206	3279	3262	3262
q9	8499	8464	8425	8425
q10	3780	3848	3838	3838
q11	537	460	432	432
q12	716	539	562	539
q13	16810	2909	2884	2884
q14	284	252	262	252
q15	503	466	468	466
q16	436	403	386	386
q17	1702	1688	1673	1673
q18	7604	7148	7159	7148
q19	1636	1630	1621	1621
q20	1924	1720	1710	1710
q21	4952	4718	4754	4718
q22	474	409	430	409
Total cold run time: 69898 ms
Total hot run time: 53893 ms

@doris-robot

Copy link
Copy Markdown
TPC-DS: Total hot run time: 180187 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a0b4a3d63b413a4ac5308577970f2118b2649a89, data reload: false

query1	1224	1133	363	363
query2	6472	1881	1954	1881
query3	6668	223	221	221
query4	23996	21431	21568	21431
query5	4236	410	412	410
query6	277	186	188	186
query7	4602	296	289	289
query8	230	177	178	177
query9	8453	2213	2213	2213
query10	574	245	254	245
query11	15029	14712	14614	14614
query12	140	90	88	88
query13	1641	371	382	371
query14	8602	6799	6788	6788
query15	206	179	188	179
query16	7106	272	263	263
query17	1015	573	568	568
query18	1902	292	280	280
query19	203	162	152	152
query20	95	88	90	88
query21	202	128	125	125
query22	5038	4873	4888	4873
query23	33790	32818	32692	32692
query24	11035	3204	3096	3096
query25	692	388	389	388
query26	1903	167	156	156
query27	3037	313	333	313
query28	6740	1833	1824	1824
query29	1337	594	590	590
query30	298	167	173	167
query31	968	716	737	716
query32	94	54	56	54
query33	648	252	245	245
query34	944	479	508	479
query35	817	693	680	680
query36	1025	876	868	868
query37	275	73	71	71
query38	3495	3388	3382	3382
query39	1564	1543	1552	1543
query40	289	129	125	125
query41	48	47	47	47
query42	109	103	98	98
query43	452	417	423	417
query44	1125	716	709	709
query45	283	261	229	229
query46	1081	780	747	747
query47	1903	1809	1807	1807
query48	374	299	302	299
query49	1146	363	371	363
query50	798	396	394	394
query51	6735	6564	6572	6564
query52	103	99	94	94
query53	354	292	285	285
query54	288	232	228	228
query55	84	78	85	78
query56	240	222	225	222
query57	1208	1133	1107	1107
query58	245	213	210	210
query59	2517	2471	2258	2258
query60	261	240	250	240
query61	111	108	110	108
query62	716	450	453	450
query63	305	280	281	280
query64	6465	3196	3189	3189
query65	3076	3016	2975	2975
query66	1434	350	326	326
query67	15635	14810	14885	14810
query68	6723	570	556	556
query69	536	302	293	293
query70	1320	1104	1139	1104
query71	514	268	267	267
query72	6401	2558	2384	2384
query73	804	324	327	324
query74	6761	6491	6380	6380
query75	3632	2293	2264	2264
query76	5790	1195	1232	1195
query77	633	263	243	243
query78	10989	10262	10066	10066
query79	8166	524	528	524
query80	1196	435	411	411
query81	515	232	242	232
query82	746	91	92	91
query83	201	163	161	161
query84	269	90	87	87
query85	1499	283	271	271
query86	473	285	287	285
query87	3684	3460	3469	3460
query88	4311	2341	2353	2341
query89	553	368	369	368
query90	2109	176	179	176
query91	133	111	103	103
query92	60	48	48	48
query93	6602	548	519	519
query94	1152	180	180	180
query95	443	310	324	310
query96	610	267	270	267
query97	2664	2474	2499	2474
query98	230	220	214	214
query99	1244	862	861	861
Total cold run time: 294921 ms
Total hot run time: 180187 ms

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.04 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a0b4a3d63b413a4ac5308577970f2118b2649a89, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.04	0.04
query3	0.23	0.04	0.04
query4	1.68	0.06	0.06
query5	0.50	0.48	0.49
query6	1.15	0.65	0.65
query7	0.02	0.02	0.01
query8	0.04	0.04	0.05
query9	0.54	0.51	0.49
query10	0.57	0.57	0.57
query11	0.15	0.11	0.12
query12	0.14	0.12	0.11
query13	0.60	0.60	0.60
query14	0.76	0.79	0.81
query15	0.87	0.84	0.84
query16	0.35	0.35	0.36
query17	0.98	0.95	0.99
query18	0.24	0.25	0.26
query19	1.84	1.77	1.74
query20	0.02	0.01	0.01
query21	15.43	0.67	0.66
query22	4.12	7.24	1.75
query23	18.10	1.28	1.27
query24	1.63	0.18	0.20
query25	0.16	0.08	0.08
query26	0.27	0.17	0.18
query27	0.08	0.08	0.07
query28	13.79	0.97	0.95
query29	12.58	3.28	3.29
query30	0.25	0.06	0.05
query31	2.88	0.39	0.38
query32	3.27	0.48	0.47
query33	2.86	2.94	2.83
query34	15.50	4.32	4.32
query35	4.37	4.35	4.40
query36	0.69	0.47	0.47
query37	0.18	0.15	0.15
query38	0.15	0.14	0.13
query39	0.04	0.03	0.04
query40	0.17	0.16	0.16
query41	0.10	0.04	0.04
query42	0.05	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 107.49 s
Total hot run time: 30.04 s

@doris-robot

Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a0b4a3d63b413a4ac5308577970f2118b2649a89 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       16.1 seconds inserted 10000000 Rows, about 621K ops/s

@wuwenchi

wuwenchi commented Apr 7, 2024

Copy link
Copy Markdown
Contributor Author

run feut

1 similar comment
@wuwenchi

wuwenchi commented Apr 7, 2024

Copy link
Copy Markdown
Contributor Author

run feut

@wuwenchi

wuwenchi commented Apr 8, 2024

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

Copy link
Copy Markdown
TPC-H: Total hot run time: 38404 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1b2d0a702d6e8dd3bbe3226f4a4a9596b3acc679, data reload: false

------ Round 1 ----------------------------------
q1	17620	4260	4327	4260
q2	2006	189	182	182
q3	10469	1170	1147	1147
q4	10209	773	854	773
q5	7474	2686	2674	2674
q6	217	134	132	132
q7	1010	621	611	611
q8	9211	2071	2035	2035
q9	7940	6532	6488	6488
q10	8558	3536	3508	3508
q11	455	222	228	222
q12	415	219	214	214
q13	18571	2947	2950	2947
q14	283	229	236	229
q15	528	472	471	471
q16	525	405	380	380
q17	955	626	702	626
q18	7306	6746	6625	6625
q19	7794	1530	1499	1499
q20	691	316	305	305
q21	3469	2795	2769	2769
q22	359	307	307	307
Total cold run time: 116065 ms
Total hot run time: 38404 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4352	4221	4212	4212
q2	356	259	263	259
q3	2946	2765	2750	2750
q4	1852	1595	1571	1571
q5	5316	5296	5280	5280
q6	210	125	124	124
q7	2195	1911	1885	1885
q8	3206	3313	3347	3313
q9	8524	8580	8860	8580
q10	4046	3927	4020	3927
q11	606	491	487	487
q12	789	650	617	617
q13	16453	3227	3153	3153
q14	318	288	288	288
q15	519	486	495	486
q16	496	436	449	436
q17	1792	1524	1513	1513
q18	8188	7869	7809	7809
q19	1729	1618	1551	1551
q20	1931	1761	1830	1761
q21	8603	4833	4985	4833
q22	546	494	467	467
Total cold run time: 74973 ms
Total hot run time: 55302 ms

@doris-robot

Copy link
Copy Markdown
TPC-DS: Total hot run time: 183055 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1b2d0a702d6e8dd3bbe3226f4a4a9596b3acc679, data reload: false

query1	884	1121	1110	1110
query2	6920	2018	1983	1983
query3	6665	199	200	199
query4	37355	21766	21320	21320
query5	4175	398	401	398
query6	239	210	191	191
query7	4062	295	285	285
query8	217	173	177	173
query9	5799	2306	2271	2271
query10	365	242	239	239
query11	14503	14343	14123	14123
query12	134	89	86	86
query13	988	368	351	351
query14	9205	7040	6721	6721
query15	217	179	171	171
query16	7275	247	243	243
query17	1718	555	532	532
query18	1649	271	275	271
query19	193	147	147	147
query20	92	89	86	86
query21	201	131	127	127
query22	5101	4832	4833	4832
query23	34139	33111	33263	33111
query24	8065	3109	3108	3108
query25	510	395	402	395
query26	740	163	164	163
query27	2997	358	363	358
query28	6552	1983	1933	1933
query29	879	653	643	643
query30	329	178	180	178
query31	944	776	750	750
query32	70	57	56	56
query33	501	245	245	245
query34	908	495	510	495
query35	797	706	707	706
query36	1033	944	941	941
query37	118	75	76	75
query38	3635	3650	3634	3634
query39	1626	1632	1580	1580
query40	186	135	149	135
query41	51	46	50	46
query42	103	109	102	102
query43	509	468	465	465
query44	1198	741	736	736
query45	300	264	287	264
query46	1109	719	733	719
query47	1997	1924	1936	1924
query48	379	292	291	291
query49	805	375	395	375
query50	784	400	395	395
query51	6929	6764	6808	6764
query52	104	94	98	94
query53	367	291	287	287
query54	276	242	237	237
query55	80	77	72	72
query56	255	240	238	238
query57	1311	1203	1181	1181
query58	223	217	210	210
query59	3065	2757	2652	2652
query60	254	236	236	236
query61	92	85	85	85
query62	563	441	443	441
query63	304	279	279	279
query64	4290	3908	3923	3908
query65	3070	3007	3034	3007
query66	716	306	310	306
query67	15876	15119	14888	14888
query68	10601	531	537	531
query69	620	293	291	291
query70	1189	1133	1187	1133
query71	512	268	273	268
query72	6398	2580	2440	2440
query73	1619	316	323	316
query74	8362	6958	6822	6822
query75	3552	2314	2260	2260
query76	6405	1116	1025	1025
query77	630	239	241	239
query78	10930	10285	10030	10030
query79	11796	516	518	516
query80	2478	408	408	408
query81	547	226	224	224
query82	231	96	89	89
query83	218	164	161	161
query84	270	80	79	79
query85	1090	261	257	257
query86	344	290	273	273
query87	3699	3541	3492	3492
query88	5939	2253	2356	2253
query89	502	358	371	358
query90	2366	175	173	173
query91	119	92	92	92
query92	61	46	47	46
query93	6737	498	488	488
query94	1575	176	179	176
query95	408	300	302	300
query96	608	266	256	256
query97	2703	2471	2457	2457
query98	225	218	216	216
query99	1063	819	842	819
Total cold run time: 310793 ms
Total hot run time: 183055 ms

@doris-robot

Copy link
Copy Markdown
ClickBench: Total hot run time: 29.92 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1b2d0a702d6e8dd3bbe3226f4a4a9596b3acc679, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.69	0.07	0.08
query5	0.50	0.48	0.48
query6	1.12	0.65	0.65
query7	0.02	0.02	0.01
query8	0.05	0.05	0.04
query9	0.54	0.50	0.49
query10	0.56	0.56	0.55
query11	0.17	0.11	0.11
query12	0.15	0.13	0.12
query13	0.59	0.58	0.59
query14	0.79	0.76	0.78
query15	0.82	0.80	0.80
query16	0.36	0.36	0.36
query17	0.94	1.02	0.96
query18	0.20	0.26	0.20
query19	1.79	1.74	1.74
query20	0.01	0.01	0.01
query21	15.41	0.65	0.64
query22	3.63	7.60	1.77
query23	18.25	1.25	1.14
query24	1.97	0.20	0.22
query25	0.14	0.07	0.08
query26	0.26	0.16	0.16
query27	0.08	0.07	0.08
query28	13.37	0.98	0.97
query29	12.58	3.28	3.28
query30	0.25	0.06	0.05
query31	2.86	0.37	0.37
query32	3.32	0.45	0.46
query33	2.89	2.87	2.80
query34	17.04	4.45	4.43
query35	4.53	4.49	4.47
query36	0.64	0.46	0.45
query37	0.19	0.15	0.14
query38	0.15	0.13	0.14
query39	0.05	0.03	0.03
query40	0.17	0.14	0.14
query41	0.08	0.04	0.04
query42	0.06	0.04	0.04
query43	0.04	0.03	0.03
Total cold run time: 108.59 s
Total hot run time: 29.92 s

@doris-robot

Copy link
Copy Markdown

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 1b2d0a702d6e8dd3bbe3226f4a4a9596b3acc679 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       14.3 seconds inserted 10000000 Rows, about 699K ops/s

@morningman morningman left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Apr 9, 2024
@github-actions

github-actions Bot commented Apr 9, 2024

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actions Bot commented Apr 9, 2024

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@wuwenchi

Copy link
Copy Markdown
Contributor Author

run p0

@kaka11chen kaka11chen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@morningman
morningman merged commit ee7c394 into apache:master Apr 10, 2024
seawinde pushed a commit to seawinde/doris that referenced this pull request Apr 10, 2024
Issue apache#31442
apache#32726

1. add LocalDfsFileSystem to manipulate local files.
2. add HMSCachedClientTest to analog HMS services.
3. add test for rollback commit.
morningman pushed a commit that referenced this pull request Apr 12, 2024
Issue #31442
#32726

1. add LocalDfsFileSystem to manipulate local files.
2. add HMSCachedClientTest to analog HMS services.
3. add test for rollback commit.
dataroaring pushed a commit that referenced this pull request Apr 24, 2024
Issue #31442
#32726

1. add LocalDfsFileSystem to manipulate local files.
2. add HMSCachedClientTest to analog HMS services.
3. add test for rollback commit.
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
Issue apache#31442
apache#32726

1. add LocalDfsFileSystem to manipulate local files.
2. add HMSCachedClientTest to analog HMS services.
3. add test for rollback commit.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants