You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Wilfred Spiegelenburg (JIRA)" <ji...@apache.org> on 2015/03/16 04:45:38 UTC

[jira] [Updated] (YARN-3350) YARN RackResolver spams logs with messages at info level

     [ https://issues.apache.org/jira/browse/YARN-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wilfred Spiegelenburg updated YARN-3350:
----------------------------------------
    Attachment: yarn-RackResolver-log.txt

Extract from a log which shows the messages logged by the RackResolver

> YARN RackResolver spams logs with messages at info level
> --------------------------------------------------------
>
>                 Key: YARN-3350
>                 URL: https://issues.apache.org/jira/browse/YARN-3350
>             Project: Hadoop YARN
>          Issue Type: Improvement
>    Affects Versions: 2.6.0
>            Reporter: Wilfred Spiegelenburg
>            Assignee: Wilfred Spiegelenburg
>         Attachments: yarn-RackResolver-log.txt
>
>
> When you run an application the container logs shows a lot of messages for the RackResolver:
> 2015-03-10 00:58:30,483 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved node175.example.com to /rack15
> A real world example for a large job was generating 20+ messages in 2 milliseconds during a sustained period of time flooding the logs causing the node to run out of disk space.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)