Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improve](ip) update ip for bloom_filter index #39253

Merged
merged 1 commit into from
Aug 15, 2024

Conversation

amorynan
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@amorynan
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added the doing label Aug 12, 2024
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39655 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0397939d3a7941b8a82d868cf6f4716dbb5aa49b, data reload: false

------ Round 1 ----------------------------------
q1	18072	4861	4347	4347
q2	2023	181	173	173
q3	10507	1196	1111	1111
q4	10147	775	744	744
q5	7513	2565	2546	2546
q6	222	142	141	141
q7	976	595	591	591
q8	9230	1906	1932	1906
q9	8773	6529	6592	6529
q10	7046	2246	2227	2227
q11	445	261	252	252
q12	390	231	225	225
q13	18826	3001	2995	2995
q14	284	242	244	242
q15	540	520	484	484
q16	505	396	394	394
q17	986	669	760	669
q18	8226	7716	7463	7463
q19	7391	1118	952	952
q20	703	333	348	333
q21	5186	4359	4527	4359
q22	1109	996	972	972
Total cold run time: 119100 ms
Total hot run time: 39655 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4529	4277	4259	4259
q2	375	275	267	267
q3	2816	2643	2626	2626
q4	1905	1663	1608	1608
q5	5245	5266	5238	5238
q6	221	130	134	130
q7	2086	1686	1639	1639
q8	3143	3350	3302	3302
q9	8480	8343	8425	8343
q10	3368	3198	3143	3143
q11	590	488	496	488
q12	780	610	583	583
q13	16319	2964	2971	2964
q14	312	275	287	275
q15	517	475	471	471
q16	476	403	419	403
q17	1798	1492	1451	1451
q18	7750	7665	7464	7464
q19	1650	1713	1580	1580
q20	2001	1757	1798	1757
q21	5256	5209	5046	5046
q22	1094	994	963	963
Total cold run time: 70711 ms
Total hot run time: 54000 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 199645 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0397939d3a7941b8a82d868cf6f4716dbb5aa49b, data reload: false

query1	912	360	362	360
query2	6444	1859	1904	1859
query3	6648	209	228	209
query4	34194	23166	23072	23072
query5	4186	474	494	474
query6	254	163	168	163
query7	4583	298	303	298
query8	242	204	195	195
query9	8492	2477	2443	2443
query10	539	449	463	449
query11	17814	14931	14915	14915
query12	151	97	97	97
query13	1656	373	374	373
query14	10168	7845	6850	6850
query15	272	219	243	219
query16	7775	479	422	422
query17	1749	561	549	549
query18	1900	295	278	278
query19	197	150	142	142
query20	112	106	105	105
query21	215	104	103	103
query22	4279	4041	3961	3961
query23	33970	33347	33088	33088
query24	11788	2620	2585	2585
query25	685	390	412	390
query26	1777	161	158	158
query27	2815	286	283	283
query28	7522	2039	2023	2023
query29	1117	424	433	424
query30	309	153	164	153
query31	969	728	769	728
query32	101	56	56	56
query33	750	298	292	292
query34	914	461	470	461
query35	950	838	785	785
query36	1102	911	927	911
query37	178	84	80	80
query38	4263	4108	4127	4108
query39	1550	1403	1381	1381
query40	277	116	119	116
query41	48	49	49	49
query42	113	103	105	103
query43	504	474	479	474
query44	1234	726	742	726
query45	226	208	203	203
query46	1096	718	709	709
query47	1855	1794	1783	1783
query48	373	299	305	299
query49	1183	428	433	428
query50	805	407	418	407
query51	6833	6684	6685	6684
query52	101	91	93	91
query53	253	184	179	179
query54	1056	458	450	450
query55	74	76	78	76
query56	279	249	286	249
query57	1147	1055	1076	1055
query58	245	230	239	230
query59	3105	3058	2747	2747
query60	303	278	271	271
query61	117	119	216	119
query62	865	661	639	639
query63	213	181	177	177
query64	10469	2250	1802	1802
query65	3189	3129	3149	3129
query66	1337	346	335	335
query67	15460	14740	14788	14740
query68	7430	548	544	544
query69	441	439	407	407
query70	1163	1068	1108	1068
query71	550	273	283	273
query72	19703	16128	16131	16128
query73	849	350	333	333
query74	9150	8812	8716	8716
query75	5040	2714	2643	2643
query76	4881	967	966	966
query77	819	325	312	312
query78	9627	9046	8951	8951
query79	8311	520	513	513
query80	2220	497	491	491
query81	609	226	224	224
query82	807	139	133	133
query83	279	143	149	143
query84	277	77	77	77
query85	1410	310	271	271
query86	432	285	307	285
query87	4671	4488	4534	4488
query88	5067	2497	2522	2497
query89	527	298	294	294
query90	2065	193	189	189
query91	124	98	95	95
query92	65	50	49	49
query93	6498	540	529	529
query94	964	300	281	281
query95	355	257	259	257
query96	624	276	277	276
query97	3233	3058	3089	3058
query98	214	203	196	196
query99	1740	1274	1246	1246
Total cold run time: 336447 ms
Total hot run time: 199645 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.41 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0397939d3a7941b8a82d868cf6f4716dbb5aa49b, data reload: false

query1	0.05	0.04	0.05
query2	0.09	0.04	0.04
query3	0.23	0.06	0.06
query4	1.64	0.08	0.09
query5	0.50	0.49	0.48
query6	1.12	0.72	0.72
query7	0.03	0.01	0.01
query8	0.05	0.04	0.05
query9	0.54	0.50	0.48
query10	0.54	0.54	0.54
query11	0.15	0.12	0.11
query12	0.15	0.12	0.12
query13	0.60	0.59	0.59
query14	0.77	0.78	0.80
query15	0.85	0.81	0.82
query16	0.38	0.37	0.38
query17	1.05	1.03	1.01
query18	0.23	0.22	0.22
query19	1.91	1.73	1.74
query20	0.01	0.00	0.01
query21	15.39	0.74	0.67
query22	3.31	7.04	2.67
query23	18.25	1.40	1.31
query24	2.16	0.23	0.24
query25	0.16	0.09	0.10
query26	0.30	0.22	0.22
query27	0.45	0.24	0.24
query28	13.23	1.02	0.99
query29	12.62	3.28	3.26
query30	0.23	0.05	0.04
query31	2.88	0.39	0.38
query32	3.26	0.48	0.47
query33	2.94	2.86	2.91
query34	17.06	4.35	4.32
query35	4.44	4.38	4.39
query36	0.66	0.45	0.48
query37	0.19	0.17	0.16
query38	0.16	0.15	0.16
query39	0.05	0.04	0.03
query40	0.16	0.13	0.12
query41	0.10	0.05	0.05
query42	0.05	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 108.99 s
Total hot run time: 31.41 s

Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 13, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@amorynan
Copy link
Contributor Author

run p0

@eldenmoon eldenmoon merged commit 196e343 into apache:master Aug 15, 2024
29 of 31 checks passed
@xiaokang xiaokang added dev/2.1.x and removed doing labels Aug 15, 2024
yiguolei pushed a commit that referenced this pull request Aug 16, 2024
## Proposed changes
backport: #39253
Issue Number: close #xxx

<!--Describe your changes.-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.2-merged reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants