[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase

["Rohith Sharma K S (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16538556#comment-16538556 ] 

Rohith Sharma K S commented on YARN-8512:
-----------------------------------------

Attached the patch with following modifications to update FlowContext in ApplicationImpl
 # _if_ ApplicationImpl reference found in context while starting master container _then_
 ** create new reference to ApplicationImpl
 ** update the context.
 ** update the NMStateStore so that NM recovery will pick newer ApplicationImpl.

> ATSv2 entities are not published to HBase
> -----------------------------------------
>
>                 Key: YARN-8512
>                 URL: https://issues.apache.org/jira/browse/YARN-8512
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 3.1.0, 2.10.0, 3.2.0, 3.0.3
>            Reporter: Yesha Vora
>            Assignee: Rohith Sharma K S
>            Priority: Major
>         Attachments: YARN-8512.01.patch
>
>
> It is observed that if 1st attempt master container is died and 2nd attempt master container is launched in a NM where old containers are running but not master container. 
> ||Attempt||NM1||NM2||Action||
> |attempt-1|master container i.e container-1-1|container-1-2|master container died|
> |attempt-2|NA|container-1-2 and master container container-2-1|NA|
> In the above scenario, NM doesn't identifies flowContext and will get log below
> {noformat}
> 2018-07-10 00:44:38,285 WARN  storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:write(170)) - Found null for one of: flowName=null appId=application_1531175172425_0001 userId=hbase clusterId=yarn-cluster . Not proceeding with writing to hbase
> 2018-07-10 00:44:38,560 WARN  storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:write(170)) - Found null for one of: flowName=null appId=application_1531175172425_0001 userId=hbase clusterId=yarn-cluster . Not proceeding with writing to hbase
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org