You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Arun Suresh (JIRA)" <ji...@apache.org> on 2017/06/05 23:54:12 UTC
[jira] [Comment Edited] (YARN-6692) Delay pause when container is
localizing
[ https://issues.apache.org/jira/browse/YARN-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037865#comment-16037865 ]
Arun Suresh edited comment on YARN-6692 at 6/5/17 11:53 PM:
------------------------------------------------------------
This situation cannot really happen, since, after YARN-4597, container queuing happens only AFTER the localization completes. Since queuing happens before running, and only running containers can be paused, it will not be possible to pause a container during localization.
There might be some deployments where the localization of opportunistic containers must also be delayed till right before running (essentially, localize after queuing - which would be how it was done earlier with the QueueingContainerManager). To address these use-cases, we should probably first raise a JIRA to introduce a configuration flag, based on which the NM can decide if queuing should happen before or after localization, then have this JIRA depend on that.
was (Author: asuresh):
This situation cannot really happen, since, after YARN-4597, container queuing happens only AFTER the localization completes. Since queuing happens before running, and only running containers can be paused, it will not be possible to pause a container during localization.
There might be some deployments where the localization of opportunistic containers must also be delayed till right before running (essentially, localize after queuing - which would be how it was done earlier with the QueueingContainerManager). For these situations, we should probably first raise a JIRA to introduce a configuration flag, based on which the NM can decide if queuing should happen before or after localization, then have this JIRA depend on that.
> Delay pause when container is localizing
> ----------------------------------------
>
> Key: YARN-6692
> URL: https://issues.apache.org/jira/browse/YARN-6692
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: nodemanager
> Reporter: Jose Miguel Arreola
> Assignee: Jose Miguel Arreola
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> If a container receives a Pause event while localizing, allow container finish localizing and then pause it
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org