You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Akira Ajisaka (JIRA)" <ji...@apache.org> on 2017/05/30 06:28:04 UTC

[jira] [Updated] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

     [ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Akira Ajisaka updated YARN-3760:
--------------------------------
    Fix Version/s: 2.9.0

> FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()
> ----------------------------------------------------------------
>
>                 Key: YARN-3760
>                 URL: https://issues.apache.org/jira/browse/YARN-3760
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 2.4.0
>            Reporter: Daryn Sharp
>            Assignee: Haibo Chen
>            Priority: Critical
>             Fix For: 2.9.0, 2.8.1, 3.0.0-alpha4
>
>         Attachments: YARN-3760.00.patch, YARN-3760.01.patch, YARN-3760.02.patch
>
>
> The aggregated log file does not appear to be properly closed when writes fail.  This leaves a lease renewer active in the NM that spams the NN with lease renewals.  If the token is marked not to be cancelled, the renewals appear to continue until the token expires.  If the token is cancelled, the periodic renew spam turns into a flood of failed connections until the lease renewer gives up.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org