You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "Radeity (via GitHub)" <gi...@apache.org> on 2023/09/09 07:17:02 UTC
[GitHub] [dolphinscheduler] Radeity opened a new issue, #14884: [Improvement][Master] Master overload will delay scheduling of high priority process
Radeity opened a new issue, #14884:
URL: https://github.com/apache/dolphinscheduler/issues/14884
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.
### Description
We have the conception `Process priority`:
> Process priority: The priority of process operation, divide into five levels: highest (HIGHEST), high (HIGH), medium (MEDIUM), low (LOW), and lowest (LOWEST). When the number of master threads is insufficient, high priority processes will execute first in the execution queue, and processes with the same priority will execute in the order of first in, first out.
However, in cluster mode, when we have several `Master` nodes, it's possible that one master node becomes overload and do not consume new command (including some process with the highest priority). Some processes with low priority handled by other Master may run earlier. **Thus, the actual behavior may not be same with priority order.**
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Radeity commented on issue #14884: [Improvement][Master] Master overload will delay scheduling of high priority process
Posted by "Radeity (via GitHub)" <gi...@apache.org>.
Radeity commented on issue #14884:
URL: https://github.com/apache/dolphinscheduler/issues/14884#issuecomment-1712752338
After some discussion, I will add overload states in master heartbeat first (slot change solution) which makes the minimal change.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Radeity commented on issue #14884: [Improvement][Master] Master overload will delay scheduling of high priority process
Posted by "Radeity (via GitHub)" <gi...@apache.org>.
Radeity commented on issue #14884:
URL: https://github.com/apache/dolphinscheduler/issues/14884#issuecomment-1712443860
cc @ruanwenjun
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ruanwenjun commented on issue #14884: [Improvement][Master] Master overload will delay scheduling of high priority process
Posted by "ruanwenjun (via GitHub)" <gi...@apache.org>.
ruanwenjun commented on issue #14884:
URL: https://github.com/apache/dolphinscheduler/issues/14884#issuecomment-1712839770
> After some discussion, I will add overload states in master heartbeat first (slot change solution) which makes the minimal change.
Yes, we need to redesign the master heartbeat info, and add server status in master heartbeat.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ruanwenjun closed issue #14884: [Improvement][Master] Master overload will delay scheduling of high priority process
Posted by "ruanwenjun (via GitHub)" <gi...@apache.org>.
ruanwenjun closed issue #14884: [Improvement][Master] Master overload will delay scheduling of high priority process
URL: https://github.com/apache/dolphinscheduler/issues/14884
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org