You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-dev@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2017/08/15 21:23:00 UTC

[jira] [Created] (YARN-7019) Ability for applications to notify YARN about container reuse

Jason Lowe created YARN-7019:
--------------------------------

             Summary: Ability for applications to notify YARN about container reuse
                 Key: YARN-7019
                 URL: https://issues.apache.org/jira/browse/YARN-7019
             Project: Hadoop YARN
          Issue Type: New Feature
            Reporter: Jason Lowe


During preemption calculations YARN can try to reduce the amount of work lost by considering how long a container has been running.  However when an application framework like Tez reuses a container across multiple tasks it changes the work lost calculation since the container has essentially checkpointed between task assignments.  It would be nice if applications could inform YARN when a container has been reused/checkpointed and therefore is a better candidate for preemption wrt. lost work than other, younger containers.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org