You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Fabian Hueske (JIRA)" <ji...@apache.org> on 2015/03/09 18:00:44 UTC

[jira] [Created] (FLINK-1663) Add a FIFO job scheduler to the JobManager

Fabian Hueske created FLINK-1663:
------------------------------------

             Summary: Add a FIFO job scheduler to the JobManager
                 Key: FLINK-1663
                 URL: https://issues.apache.org/jira/browse/FLINK-1663
             Project: Flink
          Issue Type: New Feature
          Components: JobManager
            Reporter: Fabian Hueske
            Priority: Minor


Right now, the JobManager rejects jobs that cannot be immediately executed due to lack of available slots.
In case some slots are occupied by currently running jobs, it would be good if the JM would put the job in a FIFO and execute it as soon as enough resources became available. The scheduler should also monitor the total amount of slots such that a job does not become a blocker if one or more TMs go down.

A nice addition could be the option to define job interdependencies, i.e., a job does only execute if some other job has been successfully executed. If that other job failed, the job is dropped as well.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)