You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2014/03/14 22:16:43 UTC
Review Request 19233: yarn.exclude FileNotFoundException during RM startup
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19233/
-----------------------------------------------------------
Review request for Ambari and Vitalyi Brodetskyi.
Bugs: AMBARI-5094
https://issues.apache.org/jira/browse/AMBARI-5094
Repository: ambari
Description
-------
On an Ambari deployed cluster, the following configs are set in yarn-site.xml:
<property>
<name>yarn.resourcemanager.nodes.exclude-path</name>
<value>/etc/hadoop/conf/yarn.exclude</value>
</property>
and /etc/hadoop/conf/yarn.exclude does not exist.
This causes an error to be thrown in RM logs:
{noformat}
2014-02-26 15:34:19,721 WARN org.apache.hadoop.yarn.server.resourcemanager.NodesListManager: Failed to init hostsReader, disabling
java.io.FileNotFoundException: /etc/hadoop/conf/yarn.exclude (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at java.io.FileInputStream.<init>(FileInputStream.java:97)
at org.apache.hadoop.yarn.LocalConfigurationProvider.getConfigurationInputStream(LocalConfigurationProvider.java:45)
at org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.createHostsFileReader(NodesListManager.java:219)
at org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.serviceInit(NodesListManager.java:76)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:451)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:804)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:217)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1016)
2014-02-26 15:34:19,723 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list
{noformat}
The error is harmless and RM starts up fine but with this exception in the logs. Either an empty file should be created or the property has to be removed from yarn-site.xml
Diffs
-----
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/params.py 9d69013
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/yarn.py 108eb89
ambari-server/src/test/python/stacks/2.0.6/YARN/test_historyserver.py 98bc3a6
ambari-server/src/test/python/stacks/2.0.6/YARN/test_mapreduce2_client.py ef5c05f
ambari-server/src/test/python/stacks/2.0.6/YARN/test_nodemanager.py a28a47e
ambari-server/src/test/python/stacks/2.0.6/YARN/test_resourcemanager.py f8ff29e
ambari-server/src/test/python/stacks/2.0.6/YARN/test_yarn_client.py 59ac114
ambari-server/src/test/python/stacks/2.1/YARN/test_apptimelineserver.py fc1f547
Diff: https://reviews.apache.org/r/19233/diff/
Testing
-------
Thanks,
Andrew Onischuk
Re: Review Request 19233: yarn.exclude FileNotFoundException during RM
startup
Posted by Vitalyi Brodetskyi <vb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19233/#review37272
-----------------------------------------------------------
Ship it!
Ship It!
- Vitalyi Brodetskyi
On March 14, 2014, 9:16 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/19233/
> -----------------------------------------------------------
>
> (Updated March 14, 2014, 9:16 p.m.)
>
>
> Review request for Ambari and Vitalyi Brodetskyi.
>
>
> Bugs: AMBARI-5094
> https://issues.apache.org/jira/browse/AMBARI-5094
>
>
> Repository: ambari
>
>
> Description
> -------
>
> On an Ambari deployed cluster, the following configs are set in yarn-site.xml:
> <property>
> <name>yarn.resourcemanager.nodes.exclude-path</name>
> <value>/etc/hadoop/conf/yarn.exclude</value>
> </property>
>
> and /etc/hadoop/conf/yarn.exclude does not exist.
>
> This causes an error to be thrown in RM logs:
> {noformat}
> 2014-02-26 15:34:19,721 WARN org.apache.hadoop.yarn.server.resourcemanager.NodesListManager: Failed to init hostsReader, disabling
> java.io.FileNotFoundException: /etc/hadoop/conf/yarn.exclude (No such file or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.<init>(FileInputStream.java:138)
> at java.io.FileInputStream.<init>(FileInputStream.java:97)
> at org.apache.hadoop.yarn.LocalConfigurationProvider.getConfigurationInputStream(LocalConfigurationProvider.java:45)
> at org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.createHostsFileReader(NodesListManager.java:219)
> at org.apache.hadoop.yarn.server.resourcemanager.NodesListManager.serviceInit(NodesListManager.java:76)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
> at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:451)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:804)
> at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:217)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1016)
> 2014-02-26 15:34:19,723 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list
> {noformat}
>
> The error is harmless and RM starts up fine but with this exception in the logs. Either an empty file should be created or the property has to be removed from yarn-site.xml
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/params.py 9d69013
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/yarn.py 108eb89
> ambari-server/src/test/python/stacks/2.0.6/YARN/test_historyserver.py 98bc3a6
> ambari-server/src/test/python/stacks/2.0.6/YARN/test_mapreduce2_client.py ef5c05f
> ambari-server/src/test/python/stacks/2.0.6/YARN/test_nodemanager.py a28a47e
> ambari-server/src/test/python/stacks/2.0.6/YARN/test_resourcemanager.py f8ff29e
> ambari-server/src/test/python/stacks/2.0.6/YARN/test_yarn_client.py 59ac114
> ambari-server/src/test/python/stacks/2.1/YARN/test_apptimelineserver.py fc1f547
>
> Diff: https://reviews.apache.org/r/19233/diff/
>
>
> Testing
> -------
>
>
> Thanks,
>
> Andrew Onischuk
>
>