-
Notifications
You must be signed in to change notification settings - Fork 3.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[improvement](cloud) manage node via sql like non cloud mode #40264
Conversation
Thank you for your contribution to Apache Doris. Since 2024-03-18, the Document has been moved to doris-website. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
clang-tidy made some suggestions
bdf9d4a
to
68e9c9d
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
clang-tidy made some suggestions
2e4f889
to
f43e7e7
Compare
run buildall |
f43e7e7
to
31fc019
Compare
fe/fe-core/src/main/java/org/apache/doris/cloud/system/CloudSystemInfoService.java
Show resolved
Hide resolved
fe/fe-core/src/main/java/org/apache/doris/cloud/catalog/CloudEnv.java
Outdated
Show resolved
Hide resolved
fe/fe-core/src/main/java/org/apache/doris/cloud/catalog/CloudEnv.java
Outdated
Show resolved
Hide resolved
fe/fe-core/src/main/java/org/apache/doris/cloud/rpc/MetaServiceProxy.java
Show resolved
Hide resolved
fe/fe-core/src/main/java/org/apache/doris/cloud/system/CloudSystemInfoService.java
Show resolved
Hide resolved
fe/fe-core/src/main/java/org/apache/doris/cloud/system/CloudSystemInfoService.java
Show resolved
Hide resolved
fe/fe-core/src/main/java/org/apache/doris/cloud/system/CloudSystemInfoService.java
Outdated
Show resolved
Hide resolved
31fc019
to
7cd8aaa
Compare
run buildall |
1 similar comment
run buildall |
run buildall |
TeamCity be ut coverage result: |
run buildall |
TeamCity be ut coverage result: |
TPC-H: Total hot run time: 38370 ms
|
TPC-DS: Total hot run time: 187461 ms
|
ClickBench: Total hot run time: 32.71 s
|
5767a7d
to
3a1bfb2
Compare
run buildall |
TeamCity be ut coverage result: |
TPC-H: Total hot run time: 38003 ms
|
TPC-DS: Total hot run time: 192166 ms
|
ClickBench: Total hot run time: 31.89 s
|
TeamCity be ut coverage result: |
TPC-H: Total hot run time: 38747 ms
|
TPC-DS: Total hot run time: 199431 ms
|
ClickBench: Total hot run time: 32.08 s
|
run buildall |
TPC-H: Total hot run time: 40423 ms
|
TeamCity be ut coverage result: |
TPC-DS: Total hot run time: 199116 ms
|
ClickBench: Total hot run time: 30.93 s
|
PR approved by at least one committer and no changes requested. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
PR approved by anyone and no changes requested. |
1. add a config deploy_mode to enable disaggregated mode. In this mode users have to config cloud_instance_id and meta_service_endpoint. 2. When a fe starts from empty, it would try to create instance. 3. If the instance does not exists, it creates and starts from master role. If the instance exists, then it stats with its role got from ms. 4. Frontends are added via sql alter system add frontend. Backends are added via sql alter system add backend. 5. Users do not need config cloud_instance_id and meta_service_endpoint in be.conf, because fe sends them to be via heartbeat. 6. Builtin vault is not needed any more, internal tabels are stored in default vault. TODO: 1. decomission fe and be via sql 2. change cloud_instance_id to cluster id. doc pr apache/doris-website#1072
Proposed changes
add a config deploy_mode to enable disaggregated mode. In this mode users have to config cloud_instance_id and meta_service_endpoint.
When a fe starts from empty, it would try to create instance.
If the instance does not exists, it creates and starts from master role. If the instance exists, then it stats with its role got from ms.
Frontends are added via sql alter system add frontend. Backends are added via sql alter system add backend.
Users do not need config cloud_instance_id and meta_service_endpoint in be.conf, because fe sends them to be via heartbeat.
Builtin vault is not needed any more, internal tabels are stored in default vault.
TODO:
doc pr apache/doris-website#1072