Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improvement](partition rebalance) improve partition rebalance choose candidate speed #36509 #36976

Merged

Conversation

yujun777
Copy link
Collaborator

cherry pick from #36509

… candidate speed (apache#36509)

When partition reblancer choose candidate tablets, it will call
tabletListOfA.removeAll(tabletListOfB), but list.removeAll(list)'s
runtime is O(n^2). Then if each BE contains 10w+ tablets, it's rather
slow. And we found a online case the tablet scheduler thread is busy at
it.

So need improve this search.
@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@yujun777
Copy link
Collaborator Author

run p0

@dataroaring dataroaring merged commit b46c86f into apache:branch-2.1 Jun 28, 2024
21 of 22 checks passed
@yiguolei yiguolei mentioned this pull request Jul 19, 2024
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants