Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[api](cache) Add HTTP API to clear data cache #36599

Merged
merged 1 commit into from
Jun 21, 2024
Merged

[api](cache) Add HTTP API to clear data cache #36599

merged 1 commit into from
Jun 21, 2024

Conversation

Gabriel39
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@Gabriel39
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39845 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1e5a9b5f53a1f1c85cd97666c1f57db3369c5fa7, data reload: false

------ Round 1 ----------------------------------
q1	17703	4461	4370	4370
q2	2034	195	194	194
q3	10546	1114	1002	1002
q4	10212	822	784	784
q5	7500	2728	2663	2663
q6	224	134	135	134
q7	989	607	599	599
q8	9235	2124	2075	2075
q9	8957	6503	6521	6503
q10	8980	3714	3720	3714
q11	466	241	245	241
q12	426	241	220	220
q13	17775	3012	2962	2962
q14	261	222	222	222
q15	532	471	495	471
q16	521	411	380	380
q17	985	738	687	687
q18	8097	7589	7354	7354
q19	6821	1550	1489	1489
q20	649	316	341	316
q21	4911	3134	3352	3134
q22	392	338	331	331
Total cold run time: 118216 ms
Total hot run time: 39845 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4389	4238	4267	4238
q2	388	264	270	264
q3	3033	2726	2742	2726
q4	1834	1572	1619	1572
q5	5257	5321	5279	5279
q6	211	129	129	129
q7	2107	1695	1712	1695
q8	3173	3356	3320	3320
q9	8352	8273	8369	8273
q10	3879	3667	3670	3667
q11	601	497	483	483
q12	778	603	612	603
q13	16596	2977	2989	2977
q14	297	245	263	245
q15	534	480	483	480
q16	472	415	404	404
q17	1815	1497	1463	1463
q18	7754	7552	7404	7404
q19	1757	1539	1612	1539
q20	2005	1793	1769	1769
q21	4821	4745	4807	4745
q22	667	586	572	572
Total cold run time: 70720 ms
Total hot run time: 53847 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 172406 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1e5a9b5f53a1f1c85cd97666c1f57db3369c5fa7, data reload: false

query1	936	398	393	393
query2	6465	2465	2417	2417
query3	6668	204	210	204
query4	19659	17345	17218	17218
query5	4180	510	469	469
query6	251	164	164	164
query7	4583	294	284	284
query8	326	295	289	289
query9	8788	2457	2433	2433
query10	605	316	299	299
query11	10551	10016	10006	10006
query12	141	85	86	85
query13	1632	358	365	358
query14	10044	7674	6487	6487
query15	233	193	188	188
query16	7826	275	265	265
query17	1903	537	519	519
query18	1948	283	288	283
query19	201	167	159	159
query20	101	85	88	85
query21	214	131	133	131
query22	4254	4052	4155	4052
query23	33758	33498	33171	33171
query24	10773	2901	2799	2799
query25	582	376	350	350
query26	706	152	157	152
query27	2299	312	311	311
query28	6044	2076	2073	2073
query29	844	640	605	605
query30	294	156	154	154
query31	943	719	750	719
query32	89	59	56	56
query33	693	284	290	284
query34	868	486	451	451
query35	729	626	618	618
query36	1097	942	967	942
query37	143	74	71	71
query38	2861	2768	2748	2748
query39	849	779	794	779
query40	214	128	127	127
query41	57	56	55	55
query42	131	101	100	100
query43	589	565	556	556
query44	1105	730	728	728
query45	203	167	168	167
query46	1083	724	704	704
query47	1858	1789	1781	1781
query48	371	299	298	298
query49	1045	410	407	407
query50	790	372	382	372
query51	6926	6800	6777	6777
query52	107	91	97	91
query53	353	286	290	286
query54	895	440	445	440
query55	76	76	74	74
query56	300	264	265	264
query57	1131	1063	1034	1034
query58	260	245	255	245
query59	3367	3357	3149	3149
query60	300	289	285	285
query61	106	124	99	99
query62	647	448	450	448
query63	322	293	285	285
query64	8591	2227	1798	1798
query65	3159	3080	3102	3080
query66	821	382	336	336
query67	15417	14970	14842	14842
query68	4608	519	535	519
query69	469	318	316	316
query70	1190	1142	1164	1142
query71	363	286	272	272
query72	7056	5730	5282	5282
query73	759	324	324	324
query74	5987	5509	5521	5509
query75	3377	2666	2617	2617
query76	2250	940	891	891
query77	488	321	312	312
query78	10297	9691	9708	9691
query79	2698	513	506	506
query80	1045	497	475	475
query81	552	224	223	223
query82	787	109	104	104
query83	266	174	170	170
query84	247	93	89	89
query85	1434	408	270	270
query86	467	351	321	321
query87	3272	3083	3099	3083
query88	4215	2344	2349	2344
query89	463	388	388	388
query90	1733	192	194	192
query91	128	99	101	99
query92	63	51	51	51
query93	1870	519	492	492
query94	1162	204	187	187
query95	402	320	324	320
query96	582	270	265	265
query97	3195	3038	3080	3038
query98	228	204	189	189
query99	1180	845	826	826
Total cold run time: 268138 ms
Total hot run time: 172406 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.43 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1e5a9b5f53a1f1c85cd97666c1f57db3369c5fa7, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.06	0.07
query5	0.50	0.49	0.48
query6	1.13	0.74	0.72
query7	0.03	0.02	0.01
query8	0.05	0.04	0.04
query9	0.54	0.49	0.50
query10	0.57	0.56	0.53
query11	0.15	0.11	0.11
query12	0.16	0.12	0.13
query13	0.59	0.60	0.61
query14	0.75	0.81	0.77
query15	0.82	0.82	0.81
query16	0.37	0.34	0.37
query17	1.05	0.98	1.03
query18	0.22	0.24	0.25
query19	1.93	1.69	1.66
query20	0.01	0.00	0.00
query21	15.42	0.65	0.64
query22	4.31	7.56	1.87
query23	18.25	1.38	1.27
query24	2.04	0.23	0.22
query25	0.15	0.09	0.08
query26	0.27	0.18	0.18
query27	0.08	0.08	0.08
query28	13.30	1.02	0.99
query29	12.64	3.33	3.30
query30	0.26	0.06	0.07
query31	2.84	0.41	0.38
query32	3.27	0.47	0.46
query33	2.88	2.93	2.87
query34	17.13	4.44	4.41
query35	4.58	4.50	4.47
query36	0.65	0.47	0.47
query37	0.20	0.16	0.15
query38	0.15	0.15	0.14
query39	0.04	0.03	0.04
query40	0.18	0.14	0.14
query41	0.09	0.05	0.05
query42	0.06	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.73 s
Total hot run time: 30.43 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.47% (9007/24699)
Line Coverage: 28.02% (73861/263645)
Region Coverage: 27.50% (38354/139491)
Branch Coverage: 24.21% (19557/80792)
Coverage Report: http://coverage.selectdb-in.cc/coverage/1e5a9b5f53a1f1c85cd97666c1f57db3369c5fa7_1e5a9b5f53a1f1c85cd97666c1f57db3369c5fa7/report/index.html

xinyiZzz
xinyiZzz approved these changes Jun 20, 2024
View reviewed changes
Copy link
Contributor

@xinyiZzz xinyiZzz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 20, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@hello-stephen hello-stephen merged commit 1a1baa3 into apache:master Jun 21, 2024
27 of 32 checks passed
iszhangpch pushed a commit to iszhangpch/doris-p that referenced this pull request Jun 21, 2024
@Gabriel39
[api](cache) Add HTTP API to clear data cache (apache#36599)
49a6928 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
dataroaring pushed a commit that referenced this pull request Jun 21, 2024
@Gabriel39 @dataroaring
[api](cache) Add HTTP API to clear data cache (#36599)
c1615ad 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
xinyiZzz pushed a commit to xinyiZzz/incubator-doris that referenced this pull request Jul 11, 2024
@Gabriel39 @xinyiZzz
[api](cache) Add HTTP API to clear data cache (apache#36599)
b502314 
Issue Number: close #xxx

<!--Describe your changes.-->
@xinyiZzz xinyiZzz mentioned this pull request Jul 11, 2024
Merged
xinyiZzz pushed a commit to xinyiZzz/incubator-doris that referenced this pull request Jul 12, 2024
@Gabriel39 @xinyiZzz
[api](cache) Add HTTP API to clear data cache (apache#36599)
2f1034c 
Issue Number: close #xxx

<!--Describe your changes.-->
@xinyiZzz xinyiZzz mentioned this pull request Jul 12, 2024
Merged
HappenLee pushed a commit that referenced this pull request Jul 12, 2024
@xinyiZzz @Gabriel39
[branch-2.1](memory) Add HTTP API to clear data cache (#37704)
326b40c 
pick #36599

Co-authored-by: Gabriel <[email protected]>
@yiguolei yiguolei mentioned this pull request Jul 19, 2024
Open
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@xinyiZzz xinyiZzz xinyiZzz approved these changes

@hello-stephen hello-stephen hello-stephen approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.5-merged dev/3.0.0-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@Gabriel39 @doris-robot @xinyiZzz @hello-stephen @wm1581066 @dataroaring