Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[opt](profile) Add ExecutedByFrontend in profile #39942

Merged
merged 1 commit into from
Aug 27, 2024

Conversation

zhiqiang-hhhh
Copy link
Contributor

Executed By Frontend: true means query is executed on FE.

image

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37880 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f1b68131f25caa9c70d251432130b173100ac775, data reload: false

------ Round 1 ----------------------------------
q1	17799	4761	4329	4329
q2	2038	183	175	175
q3	11232	972	1151	972
q4	10358	731	802	731
q5	7754	2862	2872	2862
q6	224	136	139	136
q7	984	615	602	602
q8	9327	2080	2113	2080
q9	7208	6555	6581	6555
q10	7079	2302	2196	2196
q11	477	248	255	248
q12	392	220	228	220
q13	18798	3072	3061	3061
q14	282	241	241	241
q15	514	499	496	496
q16	513	401	386	386
q17	996	690	712	690
q18	7387	6853	6795	6795
q19	1428	1031	1036	1031
q20	671	336	333	333
q21	3926	2759	3113	2759
q22	1114	1007	982	982
Total cold run time: 110501 ms
Total hot run time: 37880 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4383	4331	4290	4290
q2	380	282	269	269
q3	2903	2657	2680	2657
q4	1919	1647	1627	1627
q5	5645	5717	5766	5717
q6	231	138	137	137
q7	2221	1865	1812	1812
q8	3243	3429	3516	3429
q9	8857	8770	8870	8770
q10	3618	3388	3374	3374
q11	606	517	516	516
q12	832	687	649	649
q13	15148	3107	3210	3107
q14	329	295	303	295
q15	552	496	484	484
q16	514	446	454	446
q17	1865	1551	1526	1526
q18	8235	7782	7860	7782
q19	1761	1597	1662	1597
q20	2181	1952	1880	1880
q21	5691	5566	5494	5494
q22	1122	1044	1031	1031
Total cold run time: 72236 ms
Total hot run time: 56889 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191104 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f1b68131f25caa9c70d251432130b173100ac775, data reload: false

query1	1264	893	886	886
query2	6299	1978	1929	1929
query3	10604	4075	3930	3930
query4	59642	23704	23139	23139
query5	5409	497	512	497
query6	401	162	168	162
query7	5878	285	286	285
query8	278	206	221	206
query9	8953	2451	2460	2451
query10	500	273	264	264
query11	15773	15104	14984	14984
query12	167	104	110	104
query13	1591	385	376	376
query14	11075	7070	7404	7070
query15	260	172	173	172
query16	7620	463	477	463
query17	1170	579	584	579
query18	2055	293	292	292
query19	304	145	152	145
query20	122	114	115	114
query21	204	106	102	102
query22	4584	4492	4276	4276
query23	34332	33729	33305	33305
query24	5927	2877	2799	2799
query25	538	396	399	396
query26	694	162	161	161
query27	1787	283	276	276
query28	3789	2051	2021	2021
query29	713	434	432	432
query30	238	154	151	151
query31	941	786	739	739
query32	89	54	57	54
query33	462	302	289	289
query34	860	474	478	474
query35	823	753	724	724
query36	1060	931	955	931
query37	144	86	85	85
query38	3955	3892	3973	3892
query39	1459	1380	1392	1380
query40	205	122	117	117
query41	47	46	43	43
query42	122	99	99	99
query43	533	468	468	468
query44	1081	738	764	738
query45	200	164	165	164
query46	1101	746	726	726
query47	1879	1846	1851	1846
query48	369	289	300	289
query49	760	425	429	425
query50	814	418	432	418
query51	7281	7065	6928	6928
query52	99	87	89	87
query53	253	184	185	184
query54	565	451	437	437
query55	76	76	79	76
query56	294	256	279	256
query57	1193	1095	1084	1084
query58	218	222	219	219
query59	3024	2803	2947	2803
query60	288	264	277	264
query61	103	97	98	97
query62	737	646	650	646
query63	215	184	184	184
query64	3933	2236	1707	1707
query65	3219	3166	3145	3145
query66	693	334	333	333
query67	15429	15265	15131	15131
query68	3281	577	576	576
query69	398	278	268	268
query70	1165	1159	1018	1018
query71	368	313	275	275
query72	6217	2281	2050	2050
query73	750	319	332	319
query74	9303	8951	8838	8838
query75	3351	2693	2709	2693
query76	1455	931	939	931
query77	549	351	326	326
query78	9704	9128	9230	9128
query79	1032	542	531	531
query80	691	484	494	484
query81	528	226	223	223
query82	286	137	131	131
query83	167	146	151	146
query84	253	79	82	79
query85	722	281	334	281
query86	310	293	299	293
query87	4327	4281	4277	4277
query88	3321	2296	2295	2295
query89	383	290	285	285
query90	1925	195	200	195
query91	123	100	104	100
query92	58	51	54	51
query93	1056	530	527	527
query94	702	312	296	296
query95	345	264	269	264
query96	588	263	269	263
query97	3235	3057	3096	3057
query98	215	206	211	206
query99	1535	1249	1257	1249
Total cold run time: 305038 ms
Total hot run time: 191104 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.59 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f1b68131f25caa9c70d251432130b173100ac775, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.05
query3	0.22	0.05	0.05
query4	1.68	0.07	0.08
query5	0.52	0.53	0.48
query6	1.13	0.74	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.57	0.47	0.49
query10	0.54	0.55	0.55
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.63	0.59	0.58
query14	0.76	0.82	0.79
query15	0.87	0.84	0.85
query16	0.39	0.38	0.38
query17	1.06	1.08	1.08
query18	0.22	0.20	0.20
query19	1.82	1.87	1.85
query20	0.03	0.01	0.01
query21	15.38	0.67	0.68
query22	3.68	8.27	1.33
query23	18.28	1.52	1.31
query24	2.15	0.22	0.23
query25	0.15	0.08	0.08
query26	0.27	0.18	0.18
query27	0.08	0.08	0.08
query28	13.21	1.09	1.01
query29	12.63	3.34	3.29
query30	0.24	0.06	0.05
query31	2.88	0.42	0.42
query32	3.23	0.50	0.50
query33	3.01	2.97	3.06
query34	16.97	4.47	4.43
query35	4.42	4.52	4.56
query36	0.68	0.48	0.49
query37	0.19	0.16	0.15
query38	0.16	0.14	0.16
query39	0.04	0.04	0.04
query40	0.18	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.05	0.04
Total cold run time: 108.99 s
Total hot run time: 30.59 s

Copy link
Contributor

@yiguolei yiguolei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 27, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@HappenLee HappenLee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yiguolei yiguolei merged commit f33c5cf into apache:master Aug 27, 2024
30 of 33 checks passed
@zhiqiang-hhhh zhiqiang-hhhh deleted the opt-profile-session branch August 27, 2024 07:21
zhiqiang-hhhh added a commit to zhiqiang-hhhh/doris that referenced this pull request Aug 28, 2024
yiguolei pushed a commit that referenced this pull request Aug 28, 2024
dataroaring pushed a commit that referenced this pull request Oct 9, 2024
`Executed  By  Frontend:  true` means query is executed on FE.

<img width="561" alt="image"
src="https://github.com/user-attachments/assets/ce6899f2-55a5-4972-810b-1805f2a0db16">
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.3-merged reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants