You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-dev@hadoop.apache.org by "Daryn Sharp (JIRA)" <ji...@apache.org> on 2017/08/23 15:16:00 UTC

[jira] [Created] (YARN-7083) Log aggregation deletes/renames while file is open

Daryn Sharp created YARN-7083:
---------------------------------

             Summary: Log aggregation deletes/renames while file is open
                 Key: YARN-7083
                 URL: https://issues.apache.org/jira/browse/YARN-7083
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 2.8.2
            Reporter: Daryn Sharp
            Priority: Critical


YARN-6288 changes the log aggregation writer to be an autoclosable.  Unfortunately the try-with-resources block for the writer will either rename or delete the log while open.

Assuming the NM's behavior is correct, deleting open files only results in ominous WARNs in the nodemanager log and increases the rate of logging in the NN when the implicit try-with-resource close fails.  These red herrings complicate debugging efforts.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org