[jira] [Commented] (YARN-10263) Application summary is logged multiple times due to RM recovery

["Jonathan Hung (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157748#comment-17157748 ] 

Jonathan Hung commented on YARN-10263:
--------------------------------------

My understanding is that the sequence looks like:

(1) app finishes -> (2) app saved to state store -> (3) app summary is logged

I think if we only check that an app is recovered or not, we will miss some apps if the RM is restarted between states 2 and 3. We would somehow need to tell the state store whether something has been logged, but it seems a bit overkill to add a new event for this.

Any other thoughts?

> Application summary is logged multiple times due to RM recovery
> ---------------------------------------------------------------
>
>                 Key: YARN-10263
>                 URL: https://issues.apache.org/jira/browse/YARN-10263
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Jonathan Hung
>            Assignee: Bilwa S T
>            Priority: Major
>
> App finishes, and is logged to RM app summary. Restart RM. Then this app is logged to RM app summary again.
> We would somehow need to know cross-restart whether an app has been logged or not.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org