You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Robert Kanter (JIRA)" <ji...@apache.org> on 2017/06/01 20:38:04 UTC

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

    [ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033637#comment-16033637 ] 

Robert Kanter commented on YARN-5464:
-------------------------------------

I won't have time to work on this for quite a while, so I'm unassigning myself in case someone else wants to pick it up.  I did manage to implement the state store logic (storing the decommissioning nodes data, updating the data, recovering the data, unit tests, etc).  However, it's incomplete because recovery doesn't work properly: the problem is that there's a timing issue between recovering the node data, loading in the include and exclude files, and the NMs heartbeating.  As it stands, when the data gets recovered, it can't find the {{NodeId}} because it's been removed due to the exclude file.  I'll attach the wip patch in case anyone picks this up.

> Server-Side NM Graceful Decommissioning with RM HA
> --------------------------------------------------
>
>                 Key: YARN-5464
>                 URL: https://issues.apache.org/jira/browse/YARN-5464
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: graceful
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>            Priority: Blocker
>         Attachments: YARN-5464.wip.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org