[jira] [Updated] (AMBARI-12057) RU - MR service check failed with unknown host exception because HistoryServer died since hdfs-site.xml is missing

["Alejandro Fernandez (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/AMBARI-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Fernandez updated AMBARI-12057:
-----------------------------------------
    Attachment: AMBARI-12057.patch
                AMBARI-12057.branch-2.1.patch

> RU - MR service check failed with unknown host exception because HistoryServer died since hdfs-site.xml is missing
> ------------------------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-12057
>                 URL: https://issues.apache.org/jira/browse/AMBARI-12057
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 2.1.0
>            Reporter: Alejandro Fernandez
>            Assignee: Alejandro Fernandez
>            Priority: Blocker
>             Fix For: 2.1.0
>
>         Attachments: AMBARI-12057.branch-2.1.patch, AMBARI-12057.patch
>
>
> STR:
> * Installed Ambari 2.1.0 at build 2216
> * Deployed HDP 2.2.7 with HDFS, YARN, MR, Pig, Tez, Oozie, ZK, and the host containing HistoryServer only also having DataNode, and NodeManager.
> * Enabled NameNode and ResourceManager HA
> * Installed repo for HDP 2.3
> * Performed an RU
> The MR and Oozie Service Checks failed because HistorySever died immediately after being started because hdfs-site.xml was missing from /etc/hadoop/2.3.0.0-2425/0/
> {code}
> resource_management.core.exceptions.Fail: Execution of 'hadoop --config /usr/hdp/2.3.0.0-2425/hadoop/conf jar /usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-examples-2.*.jar wordcount /user/ambari-qa/mapredsmokeinput /user/ambari-qa/mapredsmokeoutput' returned 255. java.lang.IllegalArgumentException: java.net.UnknownHostException: nameservice
> 	at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:374)
> 	at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:312)
> 	at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:178)
> 	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:665)
> 	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:601)
> 	at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:148)
> 	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2596)
> 	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
> 	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
> 	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:354)
> 	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
> 	at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.addInputPath(FileInputFormat.java:518)
> 	at org.apache.hadoop.examples.WordCount.main(WordCount.java:83)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
> 	at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> 	at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> Caused by: java.net.UnknownHostException: nameservice
> {code}
> That means there was some issue with the hdfs-site.xml i think. the 2nd All service check passed so may be after a while stuff was correct but this points to some orchestration issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)