[jira] [Commented] (YARN-9526) NM invariably dies if log aggregation is enabled

["Prabhu Joseph (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831779#comment-16831779 ] 

Prabhu Joseph commented on YARN-9526:
-------------------------------------

[~ppp] This happens if either yarn-default.xml or yarn-site.xml does not have {{yarn.log-aggregation.file-formats}} defined. By default yarn-default.xml part of hadoop-yarn-api-3.2.0.jar has this config defined. Looks there is a yarn-default.xml in NM classpath without this config. Can you try adding below in yarn-site.xml.

{code}
<property>
<name>yarn.log-aggregation.file-formats</name>
<value>TFile</value>
</property>
{code}

We can log a meaningful message instead of java.util.NoSuchElementException. 



> NM invariably dies if log aggregation is enabled
> ------------------------------------------------
>
>                 Key: YARN-9526
>                 URL: https://issues.apache.org/jira/browse/YARN-9526
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: log-aggregation
>    Affects Versions: 3.2.0
>         Environment: Binary 3.2.0 hadoop release
>            Reporter: ggg
>            Priority: Major
>         Attachments: nm.log, yarn-site.xml
>
>
> NM dies as soon as first task is scheduled if log aggregation is enabled. Log attached.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org