You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/01/21 09:34:13 UTC
[GitHub] [incubator-dolphinscheduler] sqxiayaoshun opened a new issue #4520: Can I control the parallelism of tasks？
sqxiayaoshun opened a new issue #4520:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4520
When multitasking is scheduled, the memory and CPU are 100% all the time. Is there any way to control it, so that it can be up to 80%, and it will not run at full load for a long time. ?
example：
some moment，5 jobs running，the memory and CPU are 100% all the time;
expect：
3 jobs running，2 jobs wait （5 jobs suppose to be running at the same time）
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sqxiayaoshun commented on issue #4520: Can I control the parallelism of tasks？
Posted by GitBox <gi...@apache.org>.
sqxiayaoshun commented on issue #4520:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4520#issuecomment-764509305
Supplementary notes：
When the upstream tasks are completed, the downstream tasks start at the same time, which is a great pressure for the cluster; but for developers, it is not realistic to sort out the running time of all tasks;
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sqxiayaoshun commented on issue #4520: Can I control the parallelism of tasks？
Posted by GitBox <gi...@apache.org>.
sqxiayaoshun commented on issue #4520:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4520#issuecomment-764509305
Supplementary notes：
When the upstream tasks are completed, the downstream tasks start at the same time, which is a great pressure for the cluster; but for developers, it is not realistic to sort out the running time of all tasks;
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org