Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [fix](routine load) fix invalid EOF tasks scheduling delay #44949 #45087

Merged
merged 1 commit into from
Dec 6, 2024

Conversation

github-actions[bot]
Copy link
Contributor

@github-actions github-actions bot commented Dec 6, 2024

Cherry-picked from #44949

Related PR: #39975
In the above PR, we introduce delay schedule EOF tasks to avoid too many
small transactions, but it is invalid, the pr fix the issue.
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Dec 6, 2024
@dataroaring dataroaring reopened this Dec 6, 2024
@doris-robot
Copy link

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40180 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 192b4ac88ab2d553e9ade42b170675a5d70101f2, data reload: false

------ Round 1 ----------------------------------
q1	17568	7486	7269	7269
q2	2057	167	160	160
q3	10714	1059	1125	1059
q4	10561	723	672	672
q5	7740	2820	2814	2814
q6	236	144	142	142
q7	978	611	584	584
q8	9585	1941	1955	1941
q9	7658	6383	6444	6383
q10	6989	2288	2303	2288
q11	451	265	264	264
q12	400	207	211	207
q13	17773	2967	2950	2950
q14	243	217	207	207
q15	553	508	520	508
q16	640	601	601	601
q17	986	546	506	506
q18	7256	6562	6567	6562
q19	1569	1047	1014	1014
q20	476	192	187	187
q21	4126	3135	2905	2905
q22	1057	973	957	957
Total cold run time: 109616 ms
Total hot run time: 40180 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7294	7226	7237	7226
q2	329	231	231	231
q3	2892	2874	2857	2857
q4	2027	1837	1809	1809
q5	5646	5685	5679	5679
q6	218	138	138	138
q7	2222	1733	1816	1733
q8	3321	3544	3503	3503
q9	8703	8818	8808	8808
q10	3546	3494	3510	3494
q11	595	501	499	499
q12	791	628	599	599
q13	16504	3157	3173	3157
q14	308	282	282	282
q15	563	524	513	513
q16	710	662	664	662
q17	1839	1586	1579	1579
q18	8122	7764	7502	7502
q19	5836	1575	1547	1547
q20	2117	1894	1833	1833
q21	5412	5262	5260	5260
q22	1121	983	1012	983
Total cold run time: 80116 ms
Total hot run time: 59894 ms

@dataroaring dataroaring merged commit 0525ed7 into branch-3.0 Dec 6, 2024
19 of 21 checks passed
@github-actions github-actions bot deleted the auto-pick-44949-branch-3.0 branch December 6, 2024 11:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants