You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/04/02 16:28:48 UTC
[GitHub] [dolphinscheduler] huagetai opened a new issue #9337: [Feature][master] When deployed on k8s and yarn, dolphinscheduler supports worker elastic scaling
huagetai opened a new issue #9337:
URL: https://github.com/apache/dolphinscheduler/issues/9337
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.
### Description
When deployed on cluster managers such as k8s and yarn, dolphinscheduler supports worker elastic scaling
The initial idea is as follows：
1. Add ResourceManager to the master server.
2. ResourceManager is responsible for the management and application of worker resources.
3. ResourceManager perceives the online and offline of worker nodes through the register.
4. The ResourceManager goes to the cluster manager to apply for resources according to the per workflow. The resources are released at the end of the workflow.
### Use case
worker elastic scaling
### Related issues
_No response_
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #9337: [Feature][master] When deployed on k8s and yarn, dolphinscheduler supports worker elastic scaling
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #9337:
URL: https://github.com/apache/dolphinscheduler/issues/9337#issuecomment-1086672894
Hi:
* Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org