Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](nereids) refine window child's local shuffle dist-expr #39384

Closed
wants to merge 7 commits into from
Closed

[fix](nereids) refine window child's local shuffle dist-expr #39384

wants to merge 7 commits into from

Conversation

xzj7019
Copy link
Contributor

@xzj7019 xzj7019 commented Aug 15, 2024 •
edited
Loading

Proposed changes

Issue Number: close #xxx

Refine window child's local shuffle dist-expr as the partition by keys, to avoid hash skew using original child's distribution exprs. Case's explain after this pr:

| 5:VANALYTIC(282) |
| | functions: [row_number()] |
| | partition by: k1[#17], k2[#18] |
| | order by: k3[#19] ASC NULLS FIRST |
| | window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW |
| | final projections: k2[#16], rn[#20] |
| | final project output tuple id: 6 |
| | distribute expr lists: k1[#17] |
| | |
| 4:VSORT(279) |
| | order by: k1[#17] ASC, k2[#18] ASC, k3[#19] ASC |
| | algorithm: full sort |
| | offset: 0 |
| | distribute expr lists: k1[#17], k2[#18] |

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions github-actions bot added the doing label Aug 15, 2024
@xzj7019 xzj7019 force-pushed the refine_window_child_localshuffle_expr branch from a86dec5 to 2421806 Compare August 15, 2024 10:52
@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 15, 2024

run buildall

2 similar comments
@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 15, 2024

run buildall

@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 16, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38643 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 66ce43c31cdfffeddfcaba640aded68e4be1b818, data reload: false

------ Round 1 ----------------------------------
q1	17948	4467	4386	4386
q2	2053	209	232	209
q3	11917	1133	1129	1129
q4	10532	787	765	765
q5	7830	2903	2836	2836
q6	266	159	160	159
q7	1023	645	646	645
q8	9584	2156	2128	2128
q9	8824	6630	6632	6630
q10	7096	2235	2187	2187
q11	487	278	270	270
q12	442	261	263	261
q13	18810	3024	3012	3012
q14	318	270	257	257
q15	573	521	532	521
q16	531	420	423	420
q17	1014	738	751	738
q18	7412	6724	6795	6724
q19	7049	1110	1079	1079
q20	832	380	372	372
q21	3940	2875	2984	2875
q22	1135	1040	1054	1040
Total cold run time: 119616 ms
Total hot run time: 38643 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4578	4312	4329	4312
q2	428	306	315	306
q3	2857	2755	2776	2755
q4	2005	1716	1738	1716
q5	5686	5716	5642	5642
q6	238	148	149	148
q7	2156	1772	1847	1772
q8	3337	3555	3462	3462
q9	8888	8737	8946	8737
q10	3585	3356	3270	3270
q11	631	526	531	526
q12	867	673	646	646
q13	16344	3098	3104	3098
q14	352	319	306	306
q15	574	520	537	520
q16	522	460	481	460
q17	1854	1582	1546	1546
q18	8207	7966	7795	7795
q19	7074	1532	1738	1532
q20	2176	1921	1913	1913
q21	13387	5333	5402	5333
q22	1202	1107	1058	1058
Total cold run time: 86948 ms
Total hot run time: 56853 ms

@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 16, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39023 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit deb6fd6d0f3f0c10d976fdd447c57f0c2869b315, data reload: false

------ Round 1 ----------------------------------
q1	18271	4446	4428	4428
q2	2063	214	214	214
q3	10449	1233	1103	1103
q4	10185	786	782	782
q5	7784	2913	2844	2844
q6	269	162	162	162
q7	1033	670	660	660
q8	9396	2136	2110	2110
q9	7367	6625	6608	6608
q10	7067	2286	2307	2286
q11	491	268	276	268
q12	438	256	254	254
q13	17787	3043	3033	3033
q14	309	254	261	254
q15	555	522	508	508
q16	532	414	410	410
q17	1012	746	823	746
q18	7656	7022	6827	6827
q19	3891	1095	1123	1095
q20	717	356	358	356
q21	3966	3040	3028	3028
q22	1156	1078	1047	1047
Total cold run time: 112394 ms
Total hot run time: 39023 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4461	4323	4273	4273
q2	433	324	315	315
q3	2917	2699	2608	2608
q4	1925	1706	1632	1632
q5	5397	5431	5445	5431
q6	241	156	163	156
q7	2108	1736	1730	1730
q8	3256	3435	3429	3429
q9	8553	8488	8471	8471
q10	3430	3184	3154	3154
q11	619	550	542	542
q12	823	641	666	641
q13	17565	2990	3034	2990
q14	321	305	310	305
q15	570	526	532	526
q16	518	462	467	462
q17	1844	1520	1484	1484
q18	8027	7697	7478	7478
q19	2438	1618	1538	1538
q20	2097	1822	1866	1822
q21	9744	5083	5288	5083
q22	1125	1065	1065	1065
Total cold run time: 78412 ms
Total hot run time: 55135 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192444 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit deb6fd6d0f3f0c10d976fdd447c57f0c2869b315, data reload: false

query1	998	411	401	401
query2	6736	2107	2021	2021
query3	6668	247	236	236
query4	30277	23254	23480	23254
query5	4376	718	744	718
query6	313	217	209	209
query7	4613	342	341	341
query8	488	443	432	432
query9	8486	2553	2529	2529
query10	504	356	342	342
query11	17687	15078	15128	15078
query12	188	138	137	137
query13	1712	470	452	452
query14	10265	7405	7401	7401
query15	282	196	192	192
query16	7991	550	523	523
query17	1625	603	592	592
query18	2151	344	342	342
query19	276	174	169	169
query20	150	137	138	137
query21	268	144	147	144
query22	4243	4064	4030	4030
query23	34479	33591	33736	33591
query24	7918	3031	3012	3012
query25	620	430	419	419
query26	722	184	186	184
query27	2003	309	308	308
query28	5596	2170	2152	2152
query29	764	460	449	449
query30	337	200	184	184
query31	1045	870	802	802
query32	124	81	85	81
query33	653	360	349	349
query34	928	549	547	547
query35	885	784	788	784
query36	1084	960	956	956
query37	159	106	102	102
query38	3993	3825	3875	3825
query39	1530	1487	1480	1480
query40	247	162	159	159
query41	142	138	140	138
query42	135	119	124	119
query43	558	528	528	528
query44	1133	797	810	797
query45	223	196	196	196
query46	1148	813	820	813
query47	1940	1830	1856	1830
query48	447	340	342	340
query49	1209	594	597	594
query50	865	473	489	473
query51	6932	6817	6768	6768
query52	117	110	112	110
query53	305	240	233	233
query54	707	506	511	506
query55	91	89	90	89
query56	346	316	316	316
query57	1195	1119	1147	1119
query58	309	312	315	312
query59	3073	2994	3046	2994
query60	371	338	337	337
query61	150	150	151	150
query62	896	689	702	689
query63	263	234	230	230
query64	4861	2392	1865	1865
query65	3235	3192	3214	3192
query66	1135	684	676	676
query67	15644	14875	14933	14875
query68	6127	606	608	606
query69	713	413	349	349
query70	1210	1215	1166	1166
query71	532	331	322	322
query72	7704	2344	2100	2100
query73	872	363	365	363
query74	9274	8852	9030	8852
query75	4652	2793	2785	2785
query76	4317	1050	989	989
query77	886	452	453	452
query78	10793	9025	9037	9025
query79	7960	565	568	565
query80	1116	626	622	622
query81	637	264	259	259
query82	784	165	171	165
query83	407	221	266	221
query84	296	101	102	101
query85	1327	358	359	358
query86	436	319	326	319
query87	4475	4277	4150	4150
query88	4974	2540	2526	2526
query89	481	327	322	322
query90	2010	240	242	240
query91	159	133	128	128
query92	89	82	75	75
query93	6069	563	550	550
query94	709	337	316	316
query95	392	298	299	298
query96	621	289	289	289
query97	3240	3053	3088	3053
query98	254	227	225	225
query99	1588	1300	1351	1300
Total cold run time: 305918 ms
Total hot run time: 192444 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.58 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit deb6fd6d0f3f0c10d976fdd447c57f0c2869b315, data reload: false

query1	0.05	0.05	0.04
query2	0.08	0.05	0.04
query3	0.23	0.05	0.05
query4	1.66	0.08	0.08
query5	0.52	0.48	0.47
query6	1.13	0.73	0.74
query7	0.02	0.02	0.02
query8	0.06	0.04	0.05
query9	0.56	0.49	0.50
query10	0.57	0.55	0.55
query11	0.16	0.12	0.13
query12	0.16	0.13	0.14
query13	0.63	0.59	0.59
query14	0.77	0.80	0.78
query15	0.86	0.83	0.83
query16	0.38	0.38	0.37
query17	0.99	1.01	1.01
query18	0.22	0.22	0.22
query19	1.82	1.70	1.72
query20	0.01	0.01	0.02
query21	15.39	0.68	0.68
query22	4.09	7.02	2.17
query23	18.27	1.35	1.20
query24	2.18	0.22	0.23
query25	0.15	0.08	0.09
query26	0.32	0.23	0.21
query27	0.45	0.23	0.23
query28	13.26	1.03	1.00
query29	12.59	3.37	3.37
query30	0.39	0.23	0.25
query31	2.81	0.40	0.40
query32	3.25	0.49	0.50
query33	2.95	2.94	2.97
query34	17.01	4.39	4.38
query35	4.45	4.51	4.51
query36	0.67	0.48	0.48
query37	0.21	0.18	0.18
query38	0.17	0.17	0.18
query39	0.06	0.05	0.06
query40	0.18	0.14	0.15
query41	0.11	0.07	0.06
query42	0.07	0.07	0.06
query43	0.06	0.06	0.06
Total cold run time: 109.97 s
Total hot run time: 31.58 s

@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 19, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38377 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a9597fe3dcb3649854aca1a3fa5a062d188e2931, data reload: false

------ Round 1 ----------------------------------
q1	18298	4453	4371	4371
q2	2520	259	234	234
q3	11568	1159	1169	1159
q4	10572	758	795	758
q5	7809	2911	2798	2798
q6	271	165	165	165
q7	998	682	675	675
q8	9390	2078	2115	2078
q9	7195	6582	6512	6512
q10	7092	2244	2286	2244
q11	476	277	279	277
q12	438	268	273	268
q13	18826	3005	2950	2950
q14	315	264	264	264
q15	566	515	539	515
q16	532	416	423	416
q17	1008	648	719	648
q18	7348	6837	6675	6675
q19	5822	1195	1130	1130
q20	734	364	359	359
q21	3912	2884	2832	2832
q22	1132	1049	1050	1049
Total cold run time: 116822 ms
Total hot run time: 38377 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4468	4363	4303	4303
q2	426	320	318	318
q3	2854	2620	2629	2620
q4	1932	1601	1611	1601
q5	5380	5372	5388	5372
q6	259	157	157	157
q7	2091	1690	1714	1690
q8	3210	3344	3351	3344
q9	8421	8367	8339	8339
q10	3402	3156	3173	3156
q11	645	553	530	530
q12	856	640	622	622
q13	16510	3010	3023	3010
q14	318	279	292	279
q15	560	510	523	510
q16	495	441	453	441
q17	1792	1495	1480	1480
q18	7921	7627	7347	7347
q19	3508	1599	1644	1599
q20	2106	1820	1834	1820
q21	14228	5031	4904	4904
q22	1111	1039	1018	1018
Total cold run time: 82493 ms
Total hot run time: 54460 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190412 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a9597fe3dcb3649854aca1a3fa5a062d188e2931, data reload: false

query1	988	401	392	392
query2	6741	1987	2031	1987
query3	6672	235	243	235
query4	34293	23233	23329	23233
query5	4378	726	741	726
query6	305	208	213	208
query7	4614	336	330	330
query8	488	436	435	435
query9	8822	2596	2573	2573
query10	509	348	331	331
query11	17940	15111	15131	15111
query12	170	125	122	122
query13	1674	426	416	416
query14	9970	6712	6855	6712
query15	243	190	194	190
query16	7767	497	472	472
query17	1605	625	592	592
query18	2016	334	340	334
query19	222	171	171	171
query20	140	138	135	135
query21	246	145	143	143
query22	4200	3925	3889	3889
query23	33994	33463	33384	33384
query24	11548	2962	3059	2962
query25	684	420	420	420
query26	1416	180	182	180
query27	2856	297	299	297
query28	7749	2150	2124	2124
query29	966	466	446	446
query30	328	191	180	180
query31	1052	799	849	799
query32	121	79	81	79
query33	813	357	350	350
query34	910	517	509	509
query35	905	753	779	753
query36	1110	988	958	958
query37	176	103	103	103
query38	3928	3861	3876	3861
query39	1528	1454	1470	1454
query40	306	176	176	176
query41	179	176	177	176
query42	153	126	130	126
query43	582	537	558	537
query44	1266	791	793	791
query45	224	200	197	197
query46	1128	782	828	782
query47	1892	1808	1848	1808
query48	418	349	334	334
query49	1252	601	602	601
query50	868	483	473	473
query51	6834	6860	6846	6846
query52	120	109	111	109
query53	309	241	229	229
query54	959	503	502	502
query55	92	92	90	90
query56	346	314	308	308
query57	1234	1111	1128	1111
query58	314	300	308	300
query59	2970	2761	2876	2761
query60	357	329	336	329
query61	150	144	147	144
query62	895	709	704	704
query63	270	235	232	232
query64	5456	2379	1842	1842
query65	3252	3165	3179	3165
query66	1247	695	723	695
query67	15549	14710	14885	14710
query68	4950	592	614	592
query69	728	428	315	315
query70	1204	1185	1143	1143
query71	516	324	328	324
query72	7571	2338	2062	2062
query73	846	359	359	359
query74	9480	8731	8911	8731
query75	4732	2808	2719	2719
query76	3905	1063	992	992
query77	885	508	449	449
query78	9892	9184	9006	9006
query79	3415	560	557	557
query80	1434	629	609	609
query81	615	271	266	266
query82	858	162	171	162
query83	437	221	227	221
query84	301	99	98	98
query85	1623	362	347	347
query86	457	326	319	319
query87	4542	4278	4180	4180
query88	4923	2500	2453	2453
query89	480	327	358	327
query90	2067	237	234	234
query91	155	128	135	128
query92	91	77	74	74
query93	4985	569	565	565
query94	1104	324	318	318
query95	397	295	296	295
query96	626	286	285	285
query97	3248	3083	3086	3083
query98	253	231	232	231
query99	1692	1321	1294	1294
Total cold run time: 311121 ms
Total hot run time: 190412 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.65 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a9597fe3dcb3649854aca1a3fa5a062d188e2931, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.05
query3	0.23	0.06	0.06
query4	1.66	0.08	0.08
query5	0.52	0.51	0.49
query6	1.14	0.73	0.73
query7	0.02	0.01	0.02
query8	0.06	0.05	0.05
query9	0.54	0.47	0.48
query10	0.56	0.55	0.53
query11	0.17	0.12	0.12
query12	0.16	0.13	0.13
query13	0.62	0.59	0.60
query14	0.77	0.79	0.78
query15	0.87	0.83	0.81
query16	0.37	0.39	0.37
query17	1.05	1.02	1.06
query18	0.23	0.23	0.22
query19	1.94	1.83	1.75
query20	0.01	0.01	0.02
query21	15.42	0.68	0.67
query22	3.65	7.25	2.20
query23	18.28	1.43	1.24
query24	2.08	0.23	0.23
query25	0.17	0.10	0.08
query26	0.32	0.26	0.23
query27	0.46	0.23	0.24
query28	13.32	1.03	1.02
query29	12.64	3.36	3.31
query30	0.43	0.25	0.24
query31	2.80	0.40	0.40
query32	3.26	0.50	0.50
query33	2.97	2.95	3.03
query34	16.94	4.39	4.42
query35	4.50	4.49	4.42
query36	0.66	0.48	0.49
query37	0.21	0.18	0.19
query38	0.18	0.17	0.17
query39	0.07	0.06	0.06
query40	0.19	0.15	0.15
query41	0.12	0.07	0.07
query42	0.09	0.07	0.07
query43	0.07	0.06	0.06
Total cold run time: 109.88 s
Total hot run time: 31.65 s

@xzj7019 xzj7019 force-pushed the refine_window_child_localshuffle_expr branch from a9597fe to 740df95 Compare August 19, 2024 13:20
@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 19, 2024

run buildall

1 similar comment
@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 20, 2024

run buildall

@xzj7019 xzj7019 force-pushed the refine_window_child_localshuffle_expr branch 2 times, most recently from 5485532 to 06e29aa Compare August 21, 2024 05:41
@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 21, 2024

run buildall

@xzj7019 xzj7019 force-pushed the refine_window_child_localshuffle_expr branch from 06e29aa to ee621b4 Compare August 21, 2024 13:35
@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 21, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39295 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ee621b4ca97124788174d06b880e37c921131d8b, data reload: false

------ Round 1 ----------------------------------
q1	18262	4803	4483	4483
q2	2510	221	219	219
q3	11002	1179	1180	1179
q4	10382	817	725	725
q5	7828	3032	2954	2954
q6	271	173	162	162
q7	1044	677	660	660
q8	9529	2161	2114	2114
q9	7308	6595	6613	6595
q10	7067	2253	2266	2253
q11	465	261	279	261
q12	430	259	254	254
q13	17785	3074	3040	3040
q14	302	269	259	259
q15	561	509	518	509
q16	511	411	423	411
q17	1002	742	728	728
q18	7508	6988	7037	6988
q19	1432	1152	1097	1097
q20	707	358	364	358
q21	3968	3173	2988	2988
q22	1133	1059	1058	1058
Total cold run time: 111007 ms
Total hot run time: 39295 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4519	4324	4333	4324
q2	425	293	302	293
q3	2949	2711	2708	2708
q4	2026	1669	1691	1669
q5	5464	5447	5452	5447
q6	243	150	152	150
q7	2170	1830	1800	1800
q8	3320	3399	3432	3399
q9	8507	8424	8453	8424
q10	3477	3204	3227	3204
q11	634	541	527	527
q12	837	638	646	638
q13	11095	3092	3071	3071
q14	358	296	310	296
q15	576	531	530	530
q16	540	465	450	450
q17	1813	1524	1483	1483
q18	7830	7394	7788	7394
q19	1780	1601	1655	1601
q20	2105	1860	1867	1860
q21	5581	5459	5344	5344
q22	1171	1103	1064	1064
Total cold run time: 67420 ms
Total hot run time: 55676 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193366 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ee621b4ca97124788174d06b880e37c921131d8b, data reload: false

query1	966	408	386	386
query2	6758	2091	1989	1989
query3	6672	236	242	236
query4	33985	23232	23439	23232
query5	4418	725	716	716
query6	311	214	215	214
query7	4633	333	328	328
query8	485	435	431	431
query9	8617	2551	2543	2543
query10	525	358	338	338
query11	18001	15045	15016	15016
query12	202	143	160	143
query13	1680	430	432	430
query14	10396	7606	7274	7274
query15	332	193	197	193
query16	8056	478	497	478
query17	1854	620	591	591
query18	2045	390	341	341
query19	356	175	172	172
query20	143	141	141	141
query21	245	143	142	142
query22	4401	4107	4170	4107
query23	34183	33458	33552	33458
query24	11145	2948	2909	2909
query25	666	434	422	422
query26	1176	184	183	183
query27	2249	313	301	301
query28	7068	2135	2109	2109
query29	843	460	453	453
query30	331	187	191	187
query31	1040	853	852	852
query32	124	85	80	80
query33	829	360	352	352
query34	911	513	545	513
query35	916	779	776	776
query36	1099	959	967	959
query37	181	103	107	103
query38	4057	3883	4060	3883
query39	1543	1481	1479	1479
query40	245	155	157	155
query41	144	141	143	141
query42	139	118	119	118
query43	574	522	526	522
query44	1289	797	814	797
query45	228	196	200	196
query46	1155	781	815	781
query47	2005	1888	1867	1867
query48	421	333	349	333
query49	1183	590	600	590
query50	869	492	465	465
query51	7298	7099	7055	7055
query52	121	110	106	106
query53	296	230	225	225
query54	1020	527	525	525
query55	89	91	90	90
query56	335	329	321	321
query57	1246	1160	1160	1160
query58	324	314	317	314
query59	3185	2979	2854	2854
query60	365	333	336	333
query61	155	155	154	154
query62	882	709	724	709
query63	265	233	228	228
query64	5314	2480	1902	1902
query65	3248	3226	3221	3221
query66	1155	692	764	692
query67	15606	15229	15403	15229
query68	4802	676	608	608
query69	484	327	318	318
query70	1202	1206	1057	1057
query71	385	320	323	320
query72	6588	2388	2085	2085
query73	797	370	368	368
query74	9295	8974	9026	8974
query75	3463	2777	2770	2770
query76	2876	1082	1053	1053
query77	631	460	456	456
query78	10942	10252	9508	9508
query79	2181	576	580	576
query80	1141	624	621	621
query81	614	266	264	264
query82	551	162	167	162
query83	294	220	218	218
query84	259	101	104	101
query85	877	377	363	363
query86	505	345	324	324
query87	4472	4245	4405	4245
query88	3938	2557	2534	2534
query89	428	334	331	331
query90	1926	234	235	234
query91	156	130	131	130
query92	94	79	78	78
query93	1110	567	566	566
query94	858	335	341	335
query95	407	312	335	312
query96	602	293	287	287
query97	3234	3058	3102	3058
query98	242	226	228	226
query99	1849	1351	1341	1341
Total cold run time: 299801 ms
Total hot run time: 193366 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.07 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ee621b4ca97124788174d06b880e37c921131d8b, data reload: false

query1	0.04	0.05	0.05
query2	0.09	0.05	0.05
query3	0.23	0.06	0.06
query4	1.67	0.07	0.07
query5	0.51	0.51	0.50
query6	1.14	0.73	0.72
query7	0.02	0.02	0.02
query8	0.06	0.05	0.05
query9	0.55	0.48	0.49
query10	0.54	0.54	0.56
query11	0.15	0.13	0.12
query12	0.16	0.13	0.13
query13	0.61	0.59	0.59
query14	0.76	0.80	0.79
query15	0.84	0.82	0.84
query16	0.38	0.37	0.39
query17	1.06	1.03	1.02
query18	0.21	0.20	0.20
query19	1.94	1.72	1.79
query20	0.01	0.02	0.01
query21	15.42	0.67	0.67
query22	4.29	7.65	1.76
query23	18.28	1.38	1.30
query24	2.11	0.23	0.22
query25	0.16	0.10	0.09
query26	0.26	0.18	0.17
query27	0.08	0.07	0.08
query28	13.34	1.03	1.00
query29	12.68	3.42	3.41
query30	0.44	0.20	0.19
query31	2.80	0.41	0.40
query32	3.24	0.47	0.48
query33	2.94	2.97	3.02
query34	16.99	4.41	4.38
query35	4.46	4.43	4.44
query36	0.67	0.49	0.49
query37	0.20	0.18	0.18
query38	0.19	0.17	0.18
query39	0.06	0.05	0.05
query40	0.18	0.16	0.16
query41	0.12	0.06	0.07
query42	0.08	0.07	0.06
query43	0.07	0.06	0.06
Total cold run time: 110.03 s
Total hot run time: 31.07 s

@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 22, 2024

run external

1 similar comment
@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 22, 2024

run external

@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Aug 22, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@xzj7019 xzj7019 closed this Nov 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@BiteTheDDDDt BiteTheDDDDt BiteTheDDDDt approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. doing reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@xzj7019 @doris-robot @BiteTheDDDDt