Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improve](cloud-mow)Add more metrics about delete bitmap lock key #48157

Closed
wants to merge 3 commits into from

Conversation

hust-hhb
Copy link
Contributor

Add more metrics about delete bitmap lock key

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@hust-hhb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity cloud ut coverage result:
Function Coverage: 82.25% (1061/1290)
Line Coverage: 65.78% (17616/26782)
Region Coverage: 65.24% (8672/13293)
Branch Coverage: 55.12% (4676/8484)
Coverage Report: http://coverage.selectdb-in.cc/coverage/95312c5aeefa35c816586ac8527a690774112194_95312c5aeefa35c816586ac8527a690774112194_cloud/report/index.html

@hust-hhb
Copy link
Contributor Author

run buildall

@hust-hhb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity cloud ut coverage result:
Function Coverage: 82.25% (1061/1290)
Line Coverage: 65.66% (17586/26782)
Region Coverage: 65.19% (8666/13293)
Branch Coverage: 55.13% (4677/8484)
Coverage Report: http://coverage.selectdb-in.cc/coverage/7f9a76dd71eaef50d43aa744516d13def079c8ad_7f9a76dd71eaef50d43aa744516d13def079c8ad_cloud/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 31883 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7f9a76dd71eaef50d43aa744516d13def079c8ad, data reload: false

------ Round 1 ----------------------------------
q1	17598	5401	5140	5140
q2	2048	296	169	169
q3	10409	1366	757	757
q4	10222	1014	534	534
q5	7520	2511	2319	2319
q6	189	174	132	132
q7	915	769	614	614
q8	9314	1356	1228	1228
q9	5125	4707	4703	4703
q10	6844	2327	1900	1900
q11	478	274	253	253
q12	359	358	228	228
q13	17772	3674	3164	3164
q14	221	231	213	213
q15	502	469	448	448
q16	634	612	582	582
q17	577	894	334	334
q18	6643	6177	6124	6124
q19	1207	963	562	562
q20	314	330	199	199
q21	2852	2270	1970	1970
q22	367	329	310	310
Total cold run time: 102110 ms
Total hot run time: 31883 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5133	5187	5138	5138
q2	238	329	240	240
q3	2194	2680	2280	2280
q4	1460	1807	1353	1353
q5	4200	4132	4163	4132
q6	204	165	125	125
q7	1860	1798	1724	1724
q8	2617	2550	2510	2510
q9	7286	7090	7172	7090
q10	3071	3296	2819	2819
q11	583	516	495	495
q12	691	787	674	674
q13	3722	4019	3332	3332
q14	293	317	289	289
q15	521	470	475	470
q16	649	684	643	643
q17	1147	1631	1306	1306
q18	7631	7465	7246	7246
q19	827	881	970	881
q20	1994	1997	1895	1895
q21	5453	4997	4957	4957
q22	629	556	511	511
Total cold run time: 52403 ms
Total hot run time: 50110 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184243 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7f9a76dd71eaef50d43aa744516d13def079c8ad, data reload: false

query1	964	373	371	371
query2	6521	1992	1934	1934
query3	6789	214	223	214
query4	25988	24170	23646	23646
query5	4314	660	471	471
query6	294	188	171	171
query7	4601	496	284	284
query8	288	232	235	232
query9	8630	2541	2558	2541
query10	489	313	244	244
query11	15407	15104	14911	14911
query12	154	109	105	105
query13	1669	534	394	394
query14	8837	6248	6414	6248
query15	216	207	181	181
query16	7072	659	490	490
query17	917	728	572	572
query18	1924	407	320	320
query19	197	191	157	157
query20	127	122	120	120
query21	207	121	107	107
query22	4319	4410	4131	4131
query23	33981	32996	33066	32996
query24	7970	2462	2379	2379
query25	529	454	384	384
query26	1235	275	157	157
query27	2624	458	343	343
query28	4304	2439	2404	2404
query29	736	537	481	481
query30	230	184	158	158
query31	913	894	786	786
query32	72	65	65	65
query33	553	359	286	286
query34	780	833	527	527
query35	807	798	757	757
query36	951	968	895	895
query37	121	91	72	72
query38	4232	4133	4053	4053
query39	1471	1456	1406	1406
query40	201	114	99	99
query41	58	51	50	50
query42	124	110	102	102
query43	516	500	482	482
query44	1299	825	817	817
query45	184	165	163	163
query46	867	1026	638	638
query47	1748	1765	1733	1733
query48	383	428	308	308
query49	783	496	417	417
query50	683	712	422	422
query51	4208	4153	4106	4106
query52	112	109	98	98
query53	229	265	183	183
query54	483	485	423	423
query55	86	78	80	78
query56	263	261	270	261
query57	1143	1143	1079	1079
query58	248	235	246	235
query59	2698	2740	2568	2568
query60	286	286	265	265
query61	115	113	113	113
query62	805	736	644	644
query63	237	194	195	194
query64	4402	984	632	632
query65	3258	3149	3158	3149
query66	1169	388	306	306
query67	15810	15470	15444	15444
query68	7838	837	517	517
query69	481	297	269	269
query70	1204	1147	1113	1113
query71	387	297	265	265
query72	6093	3617	3674	3617
query73	727	758	361	361
query74	9254	9320	8980	8980
query75	3197	3137	2691	2691
query76	3186	1173	736	736
query77	468	365	278	278
query78	9978	10073	9293	9293
query79	2457	851	625	625
query80	649	523	451	451
query81	530	271	242	242
query82	465	133	93	93
query83	177	173	156	156
query84	292	103	73	73
query85	824	349	295	295
query86	375	301	314	301
query87	4394	4576	4433	4433
query88	4191	2246	2202	2202
query89	406	320	282	282
query90	1878	190	194	190
query91	142	143	107	107
query92	80	58	62	58
query93	2137	1004	573	573
query94	683	412	288	288
query95	349	264	258	258
query96	489	547	275	275
query97	2792	2894	2739	2739
query98	249	205	199	199
query99	1331	1405	1281	1281
Total cold run time: 271534 ms
Total hot run time: 184243 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.65 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7f9a76dd71eaef50d43aa744516d13def079c8ad, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.06	0.07
query4	1.61	0.10	0.10
query5	0.44	0.42	0.40
query6	1.15	0.67	0.65
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.52	0.51
query10	0.59	0.57	0.56
query11	0.15	0.10	0.10
query12	0.14	0.11	0.12
query13	0.63	0.60	0.59
query14	2.72	2.73	2.73
query15	0.92	0.85	0.87
query16	0.38	0.38	0.37
query17	1.01	1.02	1.00
query18	0.22	0.20	0.20
query19	1.92	1.80	2.02
query20	0.01	0.01	0.01
query21	15.37	0.91	0.55
query22	0.79	1.38	0.74
query23	14.73	1.42	0.61
query24	7.51	1.34	0.84
query25	0.53	0.25	0.12
query26	0.60	0.16	0.14
query27	0.05	0.04	0.06
query28	9.24	0.86	0.44
query29	12.52	3.90	3.23
query30	0.25	0.09	0.06
query31	2.82	0.60	0.39
query32	3.23	0.54	0.45
query33	3.12	3.12	3.09
query34	15.87	5.21	4.49
query35	4.57	4.52	4.54
query36	0.66	0.48	0.48
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 105.23 s
Total hot run time: 30.65 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 43.83% (11641/26557)
Line Coverage: 33.76% (97598/289100)
Region Coverage: 32.85% (49961/152069)
Branch Coverage: 28.56% (25103/87902)
Coverage Report: http://coverage.selectdb-in.cc/coverage/7f9a76dd71eaef50d43aa744516d13def079c8ad_7f9a76dd71eaef50d43aa744516d13def079c8ad/report/index.html

@hust-hhb hust-hhb closed this Feb 24, 2025
mymeiyi pushed a commit to mymeiyi/doris that referenced this pull request Feb 24, 2025
mymeiyi pushed a commit to mymeiyi/doris that referenced this pull request Mar 4, 2025
mymeiyi pushed a commit to mymeiyi/doris that referenced this pull request Mar 5, 2025
mymeiyi pushed a commit to mymeiyi/doris that referenced this pull request Mar 6, 2025
mymeiyi pushed a commit to mymeiyi/doris that referenced this pull request Mar 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants