You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2015/09/21 18:59:08 UTC
Review Request 38560: One of the nodemanagers failed to start on
Ubuntu14+secure+ranger cluster
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38560/
-----------------------------------------------------------
Review request for Ambari and Vitalyi Brodetskyi.
Bugs: AMBARI-13170
https://issues.apache.org/jira/browse/AMBARI-13170
Repository: ambari
Description
-------
In Ubuntu14+secure+ranger cluster, one of the nodemanager (72.22.74.87) failed
with below error.
The node manager was dead before test could start.
The nodemanager pid is present on the machine
root@os-u14-qubazs-tez-2-3:~# ps aux | grep nodemanager
yarn 4029 0.0 0.9 1639500 162764 ? Sl Sep17 0:31 /usr/lib/jvm/java-7-openjdk-amd64/bin/java -Dproc_nodemanager -Xmx1024m -Dhdp.version=2.3.2.0-2862 -Dhadoop.log.dir=/grid/0/log/hadoop/yarn -Dyarn.log.dir=/grid/0/log/hadoop/yarn -Dhadoop.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.home.dir= -Dyarn.id.str=yarn -Dhadoop.root.logger=INFO,EWMA,RFA -Dyarn.root.logger=INFO,EWMA,RFA -Djava.library.path=:/usr/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -Dyarn.policy.file=hadoop-policy.xml -Djava.io.tmpdir=/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -server -Dhadoop.log.dir=/grid/0/log/hadoop/yarn -Dyarn.log.dir=/grid/0/log/hadoop/yarn -Dhadoop.l
og.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.home.dir=/usr/hdp/current/hadoop-yarn-nodemanager -Dhadoop.home.dir=/grid/0/hdp/2.3.2.0-2862/hadoop -Dhadoop.root.logger=INFO,EWMA,RFA -Dyarn.root.logger=INFO,EWMA,RFA -Djava.library.path=:/usr/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -classpath /usr/hdp/current/hadoop-client/conf:/usr/hdp/current/hadoop-client/conf:/usr/hdp/current/hadoop-client/conf:/usr/hdp/2.3.2.0-2862/hadoop/lib/*:/usr/hdp/2.3.2.0-2862/hadoop/.//*:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/./:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/.//*:/usr/hdp/2.3.2.0-2862/hadoop-yarn/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-yarn/.//*:/us
r/hdp/2.3.2.0-2862/hadoop-mapreduce/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-mapreduce/.//*:::/usr/share/java/jdbc-mysql.jar:/usr/share/java/mysql-connector-java.jar:/usr/share/java/mysql-jdbc-qe.jar:/usr/hdp/2.3.2.0-2862/tez/*:/usr/hdp/2.3.2.0-2862/tez/lib/*:/usr/hdp/2.3.2.0-2862/tez/conf::/usr/share/java/jdbc-mysql.jar:/usr/share/java/mysql-connector-java.jar:/usr/share/java/mysql-jdbc-qe.jar:/usr/hdp/2.3.2.0-2862/tez/*:/usr/hdp/2.3.2.0-2862/tez/lib/*:/usr/hdp/2.3.2.0-2862/tez/conf:/usr/hdp/current/hadoop-yarn-nodemanager/.//*:/usr/hdp/current/hadoop-yarn-nodemanager/lib/*:/usr/hdp/current/hadoop-client/conf/nm-config/log4j.properties org.apache.hadoop.yarn.server.nodemanager.NodeManager
**nodemanager log**
STARTUP_MSG: build = git@github.com:hortonworks/hadoop.git -r b3f6bbba22d986059b77f46a96a523d6db679d50; compiled by 'jenkins' on 2015-09-17T11:58Z
STARTUP_MSG: java = 1.7.0_79
************************************************************/
2015-09-17 23:09:23,120 INFO nodemanager.NodeManager (LogAdapter.java:info(45)) - registered UNIX signal handlers for [TERM, HUP, INT]
2015-09-17 23:09:25,804 FATAL conf.Configuration (Configuration.java:loadResource(2644)) - error parsing conf yarn-site.xml
org.xml.sax.SAXParseException; Premature end of file.
at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2492)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1143)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1115)
at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1451)
at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)
at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:572)
2015-09-17 23:09:25,833 ERROR yarn.YarnUncaughtExceptionHandler (YarnUncaughtExceptionHandler.java:uncaughtException(68)) - Thread Thread[main,5,main] threw an Exception.
java.lang.RuntimeException: org.xml.sax.SAXParseException; Premature end of file.
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2645)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2492)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1143)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1115)
at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1451)
at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)
at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:572)
Caused by: org.xml.sax.SAXParseException; Premature end of file.
at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
... 10 more
Diffs
-----
ambari-agent/src/test/python/resource_management/TestXmlConfigResource.py 6092717
ambari-common/src/main/python/resource_management/libraries/providers/xml_config.py 0fed503
Diff: https://reviews.apache.org/r/38560/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 38560: One of the nodemanagers failed to start on
Ubuntu14+secure+ranger cluster
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38560/
-----------------------------------------------------------
(Updated Sept. 22, 2015, 10:29 a.m.)
Review request for Ambari and Vitalyi Brodetskyi.
Bugs: AMBARI-13170
https://issues.apache.org/jira/browse/AMBARI-13170
Repository: ambari
Description
-------
In Ubuntu14+secure+ranger cluster, one of the nodemanager (72.22.74.87) failed
with below error.
The node manager was dead before test could start.
The nodemanager pid is present on the machine
root@os-u14-qubazs-tez-2-3:~# ps aux | grep nodemanager
yarn 4029 0.0 0.9 1639500 162764 ? Sl Sep17 0:31 /usr/lib/jvm/java-7-openjdk-amd64/bin/java -Dproc_nodemanager -Xmx1024m -Dhdp.version=2.3.2.0-2862 -Dhadoop.log.dir=/grid/0/log/hadoop/yarn -Dyarn.log.dir=/grid/0/log/hadoop/yarn -Dhadoop.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.home.dir= -Dyarn.id.str=yarn -Dhadoop.root.logger=INFO,EWMA,RFA -Dyarn.root.logger=INFO,EWMA,RFA -Djava.library.path=:/usr/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -Dyarn.policy.file=hadoop-policy.xml -Djava.io.tmpdir=/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -server -Dhadoop.log.dir=/grid/0/log/hadoop/yarn -Dyarn.log.dir=/grid/0/log/hadoop/yarn -Dhadoop.l
og.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.home.dir=/usr/hdp/current/hadoop-yarn-nodemanager -Dhadoop.home.dir=/grid/0/hdp/2.3.2.0-2862/hadoop -Dhadoop.root.logger=INFO,EWMA,RFA -Dyarn.root.logger=INFO,EWMA,RFA -Djava.library.path=:/usr/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -classpath /usr/hdp/current/hadoop-client/conf:/usr/hdp/current/hadoop-client/conf:/usr/hdp/current/hadoop-client/conf:/usr/hdp/2.3.2.0-2862/hadoop/lib/*:/usr/hdp/2.3.2.0-2862/hadoop/.//*:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/./:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/.//*:/usr/hdp/2.3.2.0-2862/hadoop-yarn/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-yarn/.//*:/us
r/hdp/2.3.2.0-2862/hadoop-mapreduce/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-mapreduce/.//*:::/usr/share/java/jdbc-mysql.jar:/usr/share/java/mysql-connector-java.jar:/usr/share/java/mysql-jdbc-qe.jar:/usr/hdp/2.3.2.0-2862/tez/*:/usr/hdp/2.3.2.0-2862/tez/lib/*:/usr/hdp/2.3.2.0-2862/tez/conf::/usr/share/java/jdbc-mysql.jar:/usr/share/java/mysql-connector-java.jar:/usr/share/java/mysql-jdbc-qe.jar:/usr/hdp/2.3.2.0-2862/tez/*:/usr/hdp/2.3.2.0-2862/tez/lib/*:/usr/hdp/2.3.2.0-2862/tez/conf:/usr/hdp/current/hadoop-yarn-nodemanager/.//*:/usr/hdp/current/hadoop-yarn-nodemanager/lib/*:/usr/hdp/current/hadoop-client/conf/nm-config/log4j.properties org.apache.hadoop.yarn.server.nodemanager.NodeManager
**nodemanager log**
STARTUP_MSG: build = git@github.com:hortonworks/hadoop.git -r b3f6bbba22d986059b77f46a96a523d6db679d50; compiled by 'jenkins' on 2015-09-17T11:58Z
STARTUP_MSG: java = 1.7.0_79
************************************************************/
2015-09-17 23:09:23,120 INFO nodemanager.NodeManager (LogAdapter.java:info(45)) - registered UNIX signal handlers for [TERM, HUP, INT]
2015-09-17 23:09:25,804 FATAL conf.Configuration (Configuration.java:loadResource(2644)) - error parsing conf yarn-site.xml
org.xml.sax.SAXParseException; Premature end of file.
at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2492)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1143)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1115)
at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1451)
at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)
at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:572)
2015-09-17 23:09:25,833 ERROR yarn.YarnUncaughtExceptionHandler (YarnUncaughtExceptionHandler.java:uncaughtException(68)) - Thread Thread[main,5,main] threw an Exception.
java.lang.RuntimeException: org.xml.sax.SAXParseException; Premature end of file.
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2645)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2492)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1143)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1115)
at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1451)
at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)
at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:572)
Caused by: org.xml.sax.SAXParseException; Premature end of file.
at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
... 10 more
Diffs (updated)
-----
ambari-agent/src/test/python/resource_management/TestXmlConfigResource.py 6092717
ambari-common/src/main/python/resource_management/libraries/providers/xml_config.py 0fed503
Diff: https://reviews.apache.org/r/38560/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 38560: One of the nodemanagers failed to start on
Ubuntu14+secure+ranger cluster
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38560/
-----------------------------------------------------------
(Updated Sept. 22, 2015, 10:21 a.m.)
Review request for Ambari and Vitalyi Brodetskyi.
Bugs: AMBARI-13170
https://issues.apache.org/jira/browse/AMBARI-13170
Repository: ambari
Description
-------
In Ubuntu14+secure+ranger cluster, one of the nodemanager (72.22.74.87) failed
with below error.
The node manager was dead before test could start.
The nodemanager pid is present on the machine
root@os-u14-qubazs-tez-2-3:~# ps aux | grep nodemanager
yarn 4029 0.0 0.9 1639500 162764 ? Sl Sep17 0:31 /usr/lib/jvm/java-7-openjdk-amd64/bin/java -Dproc_nodemanager -Xmx1024m -Dhdp.version=2.3.2.0-2862 -Dhadoop.log.dir=/grid/0/log/hadoop/yarn -Dyarn.log.dir=/grid/0/log/hadoop/yarn -Dhadoop.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.home.dir= -Dyarn.id.str=yarn -Dhadoop.root.logger=INFO,EWMA,RFA -Dyarn.root.logger=INFO,EWMA,RFA -Djava.library.path=:/usr/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -Dyarn.policy.file=hadoop-policy.xml -Djava.io.tmpdir=/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -server -Dhadoop.log.dir=/grid/0/log/hadoop/yarn -Dyarn.log.dir=/grid/0/log/hadoop/yarn -Dhadoop.l
og.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.home.dir=/usr/hdp/current/hadoop-yarn-nodemanager -Dhadoop.home.dir=/grid/0/hdp/2.3.2.0-2862/hadoop -Dhadoop.root.logger=INFO,EWMA,RFA -Dyarn.root.logger=INFO,EWMA,RFA -Djava.library.path=:/usr/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -classpath /usr/hdp/current/hadoop-client/conf:/usr/hdp/current/hadoop-client/conf:/usr/hdp/current/hadoop-client/conf:/usr/hdp/2.3.2.0-2862/hadoop/lib/*:/usr/hdp/2.3.2.0-2862/hadoop/.//*:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/./:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/.//*:/usr/hdp/2.3.2.0-2862/hadoop-yarn/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-yarn/.//*:/us
r/hdp/2.3.2.0-2862/hadoop-mapreduce/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-mapreduce/.//*:::/usr/share/java/jdbc-mysql.jar:/usr/share/java/mysql-connector-java.jar:/usr/share/java/mysql-jdbc-qe.jar:/usr/hdp/2.3.2.0-2862/tez/*:/usr/hdp/2.3.2.0-2862/tez/lib/*:/usr/hdp/2.3.2.0-2862/tez/conf::/usr/share/java/jdbc-mysql.jar:/usr/share/java/mysql-connector-java.jar:/usr/share/java/mysql-jdbc-qe.jar:/usr/hdp/2.3.2.0-2862/tez/*:/usr/hdp/2.3.2.0-2862/tez/lib/*:/usr/hdp/2.3.2.0-2862/tez/conf:/usr/hdp/current/hadoop-yarn-nodemanager/.//*:/usr/hdp/current/hadoop-yarn-nodemanager/lib/*:/usr/hdp/current/hadoop-client/conf/nm-config/log4j.properties org.apache.hadoop.yarn.server.nodemanager.NodeManager
**nodemanager log**
STARTUP_MSG: build = git@github.com:hortonworks/hadoop.git -r b3f6bbba22d986059b77f46a96a523d6db679d50; compiled by 'jenkins' on 2015-09-17T11:58Z
STARTUP_MSG: java = 1.7.0_79
************************************************************/
2015-09-17 23:09:23,120 INFO nodemanager.NodeManager (LogAdapter.java:info(45)) - registered UNIX signal handlers for [TERM, HUP, INT]
2015-09-17 23:09:25,804 FATAL conf.Configuration (Configuration.java:loadResource(2644)) - error parsing conf yarn-site.xml
org.xml.sax.SAXParseException; Premature end of file.
at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2492)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1143)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1115)
at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1451)
at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)
at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:572)
2015-09-17 23:09:25,833 ERROR yarn.YarnUncaughtExceptionHandler (YarnUncaughtExceptionHandler.java:uncaughtException(68)) - Thread Thread[main,5,main] threw an Exception.
java.lang.RuntimeException: org.xml.sax.SAXParseException; Premature end of file.
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2645)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2492)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1143)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1115)
at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1451)
at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)
at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:572)
Caused by: org.xml.sax.SAXParseException; Premature end of file.
at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
... 10 more
Diffs (updated)
-----
ambari-agent/src/test/python/resource_management/TestXmlConfigResource.py 7a0d52d
ambari-common/src/main/python/resource_management/libraries/providers/xml_config.py 0fed503
Diff: https://reviews.apache.org/r/38560/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 38560: One of the nodemanagers failed to start on
Ubuntu14+secure+ranger cluster
Posted by Vitalyi Brodetskyi <vb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38560/#review99765
-----------------------------------------------------------
Ship it!
Ship It!
- Vitalyi Brodetskyi
On Вер. 21, 2015, 4:59 після полудня, Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38560/
> -----------------------------------------------------------
>
> (Updated Вер. 21, 2015, 4:59 після полудня)
>
>
> Review request for Ambari and Vitalyi Brodetskyi.
>
>
> Bugs: AMBARI-13170
> https://issues.apache.org/jira/browse/AMBARI-13170
>
>
> Repository: ambari
>
>
> Description
> -------
>
> In Ubuntu14+secure+ranger cluster, one of the nodemanager (72.22.74.87) failed
> with below error.
> The node manager was dead before test could start.
>
> The nodemanager pid is present on the machine
>
>
>
>
> root@os-u14-qubazs-tez-2-3:~# ps aux | grep nodemanager
> yarn 4029 0.0 0.9 1639500 162764 ? Sl Sep17 0:31 /usr/lib/jvm/java-7-openjdk-amd64/bin/java -Dproc_nodemanager -Xmx1024m -Dhdp.version=2.3.2.0-2862 -Dhadoop.log.dir=/grid/0/log/hadoop/yarn -Dyarn.log.dir=/grid/0/log/hadoop/yarn -Dhadoop.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.home.dir= -Dyarn.id.str=yarn -Dhadoop.root.logger=INFO,EWMA,RFA -Dyarn.root.logger=INFO,EWMA,RFA -Djava.library.path=:/usr/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -Dyarn.policy.file=hadoop-policy.xml -Djava.io.tmpdir=/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -server -Dhadoop.log.dir=/grid/0/log/hadoop/yarn -Dyarn.log.dir=/grid/0/log/hadoop/yarn -Dhadoop
.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.log.file=yarn-yarn-nodemanager-os-u14-qubazs-tez-2-3.log -Dyarn.home.dir=/usr/hdp/current/hadoop-yarn-nodemanager -Dhadoop.home.dir=/grid/0/hdp/2.3.2.0-2862/hadoop -Dhadoop.root.logger=INFO,EWMA,RFA -Dyarn.root.logger=INFO,EWMA,RFA -Djava.library.path=:/usr/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native/Linux-amd64-64:/grid/0/hdp/2.3.2.0-2862/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir -classpath /usr/hdp/current/hadoop-client/conf:/usr/hdp/current/hadoop-client/conf:/usr/hdp/current/hadoop-client/conf:/usr/hdp/2.3.2.0-2862/hadoop/lib/*:/usr/hdp/2.3.2.0-2862/hadoop/.//*:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/./:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-hdfs/.//*:/usr/hdp/2.3.2.0-2862/hadoop-yarn/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-yarn/.//*:/
usr/hdp/2.3.2.0-2862/hadoop-mapreduce/lib/*:/usr/hdp/2.3.2.0-2862/hadoop-mapreduce/.//*:::/usr/share/java/jdbc-mysql.jar:/usr/share/java/mysql-connector-java.jar:/usr/share/java/mysql-jdbc-qe.jar:/usr/hdp/2.3.2.0-2862/tez/*:/usr/hdp/2.3.2.0-2862/tez/lib/*:/usr/hdp/2.3.2.0-2862/tez/conf::/usr/share/java/jdbc-mysql.jar:/usr/share/java/mysql-connector-java.jar:/usr/share/java/mysql-jdbc-qe.jar:/usr/hdp/2.3.2.0-2862/tez/*:/usr/hdp/2.3.2.0-2862/tez/lib/*:/usr/hdp/2.3.2.0-2862/tez/conf:/usr/hdp/current/hadoop-yarn-nodemanager/.//*:/usr/hdp/current/hadoop-yarn-nodemanager/lib/*:/usr/hdp/current/hadoop-client/conf/nm-config/log4j.properties org.apache.hadoop.yarn.server.nodemanager.NodeManager
>
>
> **nodemanager log**
>
>
>
> STARTUP_MSG: build = git@github.com:hortonworks/hadoop.git -r b3f6bbba22d986059b77f46a96a523d6db679d50; compiled by 'jenkins' on 2015-09-17T11:58Z
> STARTUP_MSG: java = 1.7.0_79
> ************************************************************/
> 2015-09-17 23:09:23,120 INFO nodemanager.NodeManager (LogAdapter.java:info(45)) - registered UNIX signal handlers for [TERM, HUP, INT]
> 2015-09-17 23:09:25,804 FATAL conf.Configuration (Configuration.java:loadResource(2644)) - error parsing conf yarn-site.xml
> org.xml.sax.SAXParseException; Premature end of file.
> at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
> at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
> at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480)
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
> at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
> at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2492)
> at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405)
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1143)
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1115)
> at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1451)
> at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)
> at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)
> at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
> at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
> at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:572)
> 2015-09-17 23:09:25,833 ERROR yarn.YarnUncaughtExceptionHandler (YarnUncaughtExceptionHandler.java:uncaughtException(68)) - Thread Thread[main,5,main] threw an Exception.
> java.lang.RuntimeException: org.xml.sax.SAXParseException; Premature end of file.
> at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2645)
> at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2492)
> at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405)
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1143)
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1115)
> at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1451)
> at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:321)
> at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:487)
> at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
> at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
> at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:572)
> Caused by: org.xml.sax.SAXParseException; Premature end of file.
> at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
> at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
> at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480)
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2468)
> at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2539)
> ... 10 more
>
>
> Diffs
> -----
>
> ambari-agent/src/test/python/resource_management/TestXmlConfigResource.py 6092717
> ambari-common/src/main/python/resource_management/libraries/providers/xml_config.py 0fed503
>
> Diff: https://reviews.apache.org/r/38560/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>