[jira] Created: (MAPREDUCE-2218) schedule additional tasks when killactions are being dispatched

["Joydeep Sen Sarma (JIRA)" <ji...@apache.org>]

schedule additional tasks when killactions are being dispatched
---------------------------------------------------------------

                 Key: MAPREDUCE-2218
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2218
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: jobtracker
            Reporter: Joydeep Sen Sarma


we see a very high turnaround time for preemption (from the time preemption happens to the time other jobs are scheduled). part of the reason is that we do not dispatch new tasks until the TT confirms termination of killed tasks. The high turnaround time causes all kinds of issues (we keep issuing preemptions repeatedly. other jobs of higher priority arrive and get scheduled).

One remediation is that one can dispatch additional tasks equal to the number of tasks killed whenever we send killaction to a TT. that would reduce the turnaround time somewhat.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.