You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by "MrAsanjar ." <af...@gmail.com> on 2014/07/23 20:13:54 UTC

HDP hadoop 2.4.1 fails to run mapreduce app

please help;
i have verified mapre-site.xml => mapreduce.framework.name=yarn
verified HADOOP_CLASS_PATH in hadoop-env.sh

 /usr/lib/hadoop/bin/hadoop jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar pi 2 5
...........
.................
.................
Wrote input for Map #0
Wrote input for Map #1
Starting Job
14/07/23 13:06:47 INFO client.RMProxy: Connecting to ResourceManager at /
0.0.0.0:8032
14/07/23 13:06:47 INFO mapreduce.Cluster: Failed to use
org.apache.hadoop.mapred.YarnClientProtocolProvider due to error: Error in
instantiating YarnClient
java.io.IOException: Cannot initialize Cluster. Please check your
configuration for mapreduce.framework.name and the correspond server
addresses.
    at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
    at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
    at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
    at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
    at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
    at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
    at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)
    at
org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:306)
    at
org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:354)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at
org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:363)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
    at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:145)
    at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

Re: HDP hadoop 2.4.1 fails to run mapreduce app

Posted by Zhijie Shen <zs...@hortonworks.com>.
Would you please change the log level to DEBUG to see what happens when
creating the client protocol provider?

On Thu, Jul 24, 2014 at 2:13 AM, MrAsanjar . <af...@gmail.com> wrote:

> please help;
> i have verified mapre-site.xml => mapreduce.framework.name=yarn
> verified HADOOP_CLASS_PATH in hadoop-env.sh
>
>  /usr/lib/hadoop/bin/hadoop jar
> /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar pi 2 5
> ...........
> .................
> .................
> Wrote input for Map #0
> Wrote input for Map #1
> Starting Job
> 14/07/23 13:06:47 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/07/23 13:06:47 INFO mapreduce.Cluster: Failed to use
> org.apache.hadoop.mapred.YarnClientProtocolProvider due to error: Error in
> instantiating YarnClient
> java.io.IOException: Cannot initialize Cluster. Please check your
> configuration for mapreduce.framework.name and the correspond server
> addresses.
>     at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
>     at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
>     at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
>     at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
>     at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
>     at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
>     at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
>     at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:306)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:354)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:363)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
>     at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:145)
>     at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
>


-- 
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: HDP hadoop 2.4.1 fails to run mapreduce app

Posted by Zhijie Shen <zs...@hortonworks.com>.
Would you please change the log level to DEBUG to see what happens when
creating the client protocol provider?

On Thu, Jul 24, 2014 at 2:13 AM, MrAsanjar . <af...@gmail.com> wrote:

> please help;
> i have verified mapre-site.xml => mapreduce.framework.name=yarn
> verified HADOOP_CLASS_PATH in hadoop-env.sh
>
>  /usr/lib/hadoop/bin/hadoop jar
> /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar pi 2 5
> ...........
> .................
> .................
> Wrote input for Map #0
> Wrote input for Map #1
> Starting Job
> 14/07/23 13:06:47 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/07/23 13:06:47 INFO mapreduce.Cluster: Failed to use
> org.apache.hadoop.mapred.YarnClientProtocolProvider due to error: Error in
> instantiating YarnClient
> java.io.IOException: Cannot initialize Cluster. Please check your
> configuration for mapreduce.framework.name and the correspond server
> addresses.
>     at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
>     at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
>     at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
>     at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
>     at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
>     at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
>     at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
>     at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:306)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:354)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:363)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
>     at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:145)
>     at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
>


-- 
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: HDP hadoop 2.4.1 fails to run mapreduce app

Posted by Zhijie Shen <zs...@hortonworks.com>.
Would you please change the log level to DEBUG to see what happens when
creating the client protocol provider?

On Thu, Jul 24, 2014 at 2:13 AM, MrAsanjar . <af...@gmail.com> wrote:

> please help;
> i have verified mapre-site.xml => mapreduce.framework.name=yarn
> verified HADOOP_CLASS_PATH in hadoop-env.sh
>
>  /usr/lib/hadoop/bin/hadoop jar
> /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar pi 2 5
> ...........
> .................
> .................
> Wrote input for Map #0
> Wrote input for Map #1
> Starting Job
> 14/07/23 13:06:47 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/07/23 13:06:47 INFO mapreduce.Cluster: Failed to use
> org.apache.hadoop.mapred.YarnClientProtocolProvider due to error: Error in
> instantiating YarnClient
> java.io.IOException: Cannot initialize Cluster. Please check your
> configuration for mapreduce.framework.name and the correspond server
> addresses.
>     at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
>     at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
>     at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
>     at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
>     at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
>     at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
>     at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
>     at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:306)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:354)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:363)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
>     at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:145)
>     at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
>


-- 
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: HDP hadoop 2.4.1 fails to run mapreduce app

Posted by Zhijie Shen <zs...@hortonworks.com>.
Would you please change the log level to DEBUG to see what happens when
creating the client protocol provider?

On Thu, Jul 24, 2014 at 2:13 AM, MrAsanjar . <af...@gmail.com> wrote:

> please help;
> i have verified mapre-site.xml => mapreduce.framework.name=yarn
> verified HADOOP_CLASS_PATH in hadoop-env.sh
>
>  /usr/lib/hadoop/bin/hadoop jar
> /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar pi 2 5
> ...........
> .................
> .................
> Wrote input for Map #0
> Wrote input for Map #1
> Starting Job
> 14/07/23 13:06:47 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/07/23 13:06:47 INFO mapreduce.Cluster: Failed to use
> org.apache.hadoop.mapred.YarnClientProtocolProvider due to error: Error in
> instantiating YarnClient
> java.io.IOException: Cannot initialize Cluster. Please check your
> configuration for mapreduce.framework.name and the correspond server
> addresses.
>     at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
>     at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
>     at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
>     at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
>     at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
>     at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
>     at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
>     at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:306)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:354)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>     at
> org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:363)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
>     at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:145)
>     at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
>


-- 
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.