[GitHub] [incubator-dolphinscheduler] KEN-LJQ opened a new issue #1319: [Feature] Parallel complement data support concurrency control

[GitBox <gi...@apache.org>]

KEN-LJQ opened a new issue #1319: [Feature] Parallel complement data support concurrency control
URL: https://github.com/apache/incubator-dolphinscheduler/issues/1319
 
 
   **New feature expected**
   When complement data with parallel execution mode, consider add a concurrency control configuration would be better, so that we can limit how many process instance are running at the same time.
   
   **Current problem**
   Sometimes we will complement data for many days, like several  weeks or month, and we will choose parallel execution mode to make it run faster. But we found out dolphin scheduler will generate all process instance and submit all of them.
   That's not what we want, because we just want the complement to run faster, like only 3 instance at the same time, and don't want it use all cluster resource.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services