You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Tony Mullins <to...@gmail.com> on 2014/03/22 17:03:56 UTC
Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Hi,
I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can
successfully run distributedshell-2.2.0.jar example. But when I try to run
any mapreduce job I get error. I have setup MapRed.xml and other configs
for running MapReduce job according to (
http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
but I am getting following error :
14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed
with state FAILED due to: Application application_1395502230567_0001 failed
2 times due to AM Container for appattempt_1395502230567_0001_000002 exited
with exitCode: 1 due to: Exception from container-launch:
org.apache.hadoop.util.Shell$ExitCodeException:
org.apache.hadoop.util.Shell$ExitCodeException: at
org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at
org.apache.hadoop.util.Shell.run(Shell.java:418) at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Container exited with a non-zero exit code 1
.Failing this attempt.. Failing the application.
14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
Job ended: Sat Mar 22 20:31:17 PKT 2014
The job took 6 seconds.
And if look at stderr (log of job) there is only one line
*"Could not find or load main class 614"*
Now I have googled it and usually this issues comes when you have different
JAVA versions or in yarn-site.xml classpath is not properly set , my
yarn-site.xml has this
<property>
<name>yarn.application.classpath</name>
<value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
</property>
So any other ideas what could be the issue here ?
I am running my mapreduce job like this:
$HADOOP_PREFIX/bin/hadoop jar
$HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar
randomwriter out
Thanks, Tony
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Tony Mullins <to...@gmail.com>.
Ok , my bad , I fixed the issue it was due to bad classpaths. I was not
giving complete lib dir paths.
Thanks Vinod for your time & help.
Regards,
Tony
On Sat, Mar 22, 2014 at 11:41 PM, Vinod Kumar Vavilapalli <
vinodkv@apache.org> wrote:
> Given your earlier mail about the paths in /opt, shouldn't mapreduce
> classpath also point to /opt/yarn/hadoop-2.3.0 etc?
>
> +Vinod
>
>
> On Mar 22, 2014, at 11:33 AM, Tony Mullins <to...@gmail.com>
> wrote:
>
> That I also dont know what 614... Its the exact and single line in stderr
> of Jobs logs.
> And regarding MapRed classpath , defaults are good as there are only two
> vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
> $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
>
> Is there any other place to look for detailed & meaningfull error info ?
> or any huntch to how to fix it ?
>
> Thanks,
> Tony
>
>
> On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <
> vinodkv@apache.org> wrote:
>
>> What is "614" here?
>>
>> The other relevant thing to check is the MapReduce specific config
>> mapreduce.application.classpath.
>>
>> +Vinod
>>
>> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com>
>> wrote:
>>
>> Hi,
>>
>> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can
>> successfully run distributedshell-2.2.0.jar example. But when I try to run
>> any mapreduce job I get error. I have setup MapRed.xml and other configs
>> for running MapReduce job according to (
>> http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
>> but I am getting following error :
>>
>> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed
>> with state FAILED due to: Application application_1395502230567_0001 failed
>> 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited
>> with exitCode: 1 due to: Exception from container-launch:
>> org.apache.hadoop.util.Shell$ExitCodeException:
>> org.apache.hadoop.util.Shell$ExitCodeException: at
>> org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at
>> org.apache.hadoop.util.Shell.run(Shell.java:418) at
>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>>
>> Container exited with a non-zero exit code 1
>> .Failing this attempt.. Failing the application.
>> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
>> Job ended: Sat Mar 22 20:31:17 PKT 2014
>> The job took 6 seconds.
>>
>> And if look at stderr (log of job) there is only one line
>>
>> *"Could not find or load main class 614"*
>>
>> Now I have googled it and usually this issues comes when you have
>> different JAVA versions or in yarn-site.xml classpath is not properly set ,
>> my yarn-site.xml has this
>>
>>
>> <property>
>> <name>yarn.application.classpath</name>
>> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>>
>>
>> </property>
>>
>> So any other ideas what could be the issue here ?
>>
>> I am running my mapreduce job like this:
>>
>> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>>
>> Thanks, Tony
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Tony Mullins <to...@gmail.com>.
Ok , my bad , I fixed the issue it was due to bad classpaths. I was not
giving complete lib dir paths.
Thanks Vinod for your time & help.
Regards,
Tony
On Sat, Mar 22, 2014 at 11:41 PM, Vinod Kumar Vavilapalli <
vinodkv@apache.org> wrote:
> Given your earlier mail about the paths in /opt, shouldn't mapreduce
> classpath also point to /opt/yarn/hadoop-2.3.0 etc?
>
> +Vinod
>
>
> On Mar 22, 2014, at 11:33 AM, Tony Mullins <to...@gmail.com>
> wrote:
>
> That I also dont know what 614... Its the exact and single line in stderr
> of Jobs logs.
> And regarding MapRed classpath , defaults are good as there are only two
> vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
> $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
>
> Is there any other place to look for detailed & meaningfull error info ?
> or any huntch to how to fix it ?
>
> Thanks,
> Tony
>
>
> On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <
> vinodkv@apache.org> wrote:
>
>> What is "614" here?
>>
>> The other relevant thing to check is the MapReduce specific config
>> mapreduce.application.classpath.
>>
>> +Vinod
>>
>> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com>
>> wrote:
>>
>> Hi,
>>
>> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can
>> successfully run distributedshell-2.2.0.jar example. But when I try to run
>> any mapreduce job I get error. I have setup MapRed.xml and other configs
>> for running MapReduce job according to (
>> http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
>> but I am getting following error :
>>
>> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed
>> with state FAILED due to: Application application_1395502230567_0001 failed
>> 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited
>> with exitCode: 1 due to: Exception from container-launch:
>> org.apache.hadoop.util.Shell$ExitCodeException:
>> org.apache.hadoop.util.Shell$ExitCodeException: at
>> org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at
>> org.apache.hadoop.util.Shell.run(Shell.java:418) at
>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>>
>> Container exited with a non-zero exit code 1
>> .Failing this attempt.. Failing the application.
>> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
>> Job ended: Sat Mar 22 20:31:17 PKT 2014
>> The job took 6 seconds.
>>
>> And if look at stderr (log of job) there is only one line
>>
>> *"Could not find or load main class 614"*
>>
>> Now I have googled it and usually this issues comes when you have
>> different JAVA versions or in yarn-site.xml classpath is not properly set ,
>> my yarn-site.xml has this
>>
>>
>> <property>
>> <name>yarn.application.classpath</name>
>> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>>
>>
>> </property>
>>
>> So any other ideas what could be the issue here ?
>>
>> I am running my mapreduce job like this:
>>
>> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>>
>> Thanks, Tony
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Tony Mullins <to...@gmail.com>.
Ok , my bad , I fixed the issue it was due to bad classpaths. I was not
giving complete lib dir paths.
Thanks Vinod for your time & help.
Regards,
Tony
On Sat, Mar 22, 2014 at 11:41 PM, Vinod Kumar Vavilapalli <
vinodkv@apache.org> wrote:
> Given your earlier mail about the paths in /opt, shouldn't mapreduce
> classpath also point to /opt/yarn/hadoop-2.3.0 etc?
>
> +Vinod
>
>
> On Mar 22, 2014, at 11:33 AM, Tony Mullins <to...@gmail.com>
> wrote:
>
> That I also dont know what 614... Its the exact and single line in stderr
> of Jobs logs.
> And regarding MapRed classpath , defaults are good as there are only two
> vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
> $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
>
> Is there any other place to look for detailed & meaningfull error info ?
> or any huntch to how to fix it ?
>
> Thanks,
> Tony
>
>
> On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <
> vinodkv@apache.org> wrote:
>
>> What is "614" here?
>>
>> The other relevant thing to check is the MapReduce specific config
>> mapreduce.application.classpath.
>>
>> +Vinod
>>
>> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com>
>> wrote:
>>
>> Hi,
>>
>> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can
>> successfully run distributedshell-2.2.0.jar example. But when I try to run
>> any mapreduce job I get error. I have setup MapRed.xml and other configs
>> for running MapReduce job according to (
>> http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
>> but I am getting following error :
>>
>> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed
>> with state FAILED due to: Application application_1395502230567_0001 failed
>> 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited
>> with exitCode: 1 due to: Exception from container-launch:
>> org.apache.hadoop.util.Shell$ExitCodeException:
>> org.apache.hadoop.util.Shell$ExitCodeException: at
>> org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at
>> org.apache.hadoop.util.Shell.run(Shell.java:418) at
>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>>
>> Container exited with a non-zero exit code 1
>> .Failing this attempt.. Failing the application.
>> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
>> Job ended: Sat Mar 22 20:31:17 PKT 2014
>> The job took 6 seconds.
>>
>> And if look at stderr (log of job) there is only one line
>>
>> *"Could not find or load main class 614"*
>>
>> Now I have googled it and usually this issues comes when you have
>> different JAVA versions or in yarn-site.xml classpath is not properly set ,
>> my yarn-site.xml has this
>>
>>
>> <property>
>> <name>yarn.application.classpath</name>
>> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>>
>>
>> </property>
>>
>> So any other ideas what could be the issue here ?
>>
>> I am running my mapreduce job like this:
>>
>> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>>
>> Thanks, Tony
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Tony Mullins <to...@gmail.com>.
Ok , my bad , I fixed the issue it was due to bad classpaths. I was not
giving complete lib dir paths.
Thanks Vinod for your time & help.
Regards,
Tony
On Sat, Mar 22, 2014 at 11:41 PM, Vinod Kumar Vavilapalli <
vinodkv@apache.org> wrote:
> Given your earlier mail about the paths in /opt, shouldn't mapreduce
> classpath also point to /opt/yarn/hadoop-2.3.0 etc?
>
> +Vinod
>
>
> On Mar 22, 2014, at 11:33 AM, Tony Mullins <to...@gmail.com>
> wrote:
>
> That I also dont know what 614... Its the exact and single line in stderr
> of Jobs logs.
> And regarding MapRed classpath , defaults are good as there are only two
> vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
> $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
>
> Is there any other place to look for detailed & meaningfull error info ?
> or any huntch to how to fix it ?
>
> Thanks,
> Tony
>
>
> On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <
> vinodkv@apache.org> wrote:
>
>> What is "614" here?
>>
>> The other relevant thing to check is the MapReduce specific config
>> mapreduce.application.classpath.
>>
>> +Vinod
>>
>> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com>
>> wrote:
>>
>> Hi,
>>
>> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can
>> successfully run distributedshell-2.2.0.jar example. But when I try to run
>> any mapreduce job I get error. I have setup MapRed.xml and other configs
>> for running MapReduce job according to (
>> http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
>> but I am getting following error :
>>
>> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed
>> with state FAILED due to: Application application_1395502230567_0001 failed
>> 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited
>> with exitCode: 1 due to: Exception from container-launch:
>> org.apache.hadoop.util.Shell$ExitCodeException:
>> org.apache.hadoop.util.Shell$ExitCodeException: at
>> org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at
>> org.apache.hadoop.util.Shell.run(Shell.java:418) at
>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>> at
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>>
>> Container exited with a non-zero exit code 1
>> .Failing this attempt.. Failing the application.
>> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
>> Job ended: Sat Mar 22 20:31:17 PKT 2014
>> The job took 6 seconds.
>>
>> And if look at stderr (log of job) there is only one line
>>
>> *"Could not find or load main class 614"*
>>
>> Now I have googled it and usually this issues comes when you have
>> different JAVA versions or in yarn-site.xml classpath is not properly set ,
>> my yarn-site.xml has this
>>
>>
>> <property>
>> <name>yarn.application.classpath</name>
>> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>>
>>
>> </property>
>>
>> So any other ideas what could be the issue here ?
>>
>> I am running my mapreduce job like this:
>>
>> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>>
>> Thanks, Tony
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
Given your earlier mail about the paths in /opt, shouldn't mapreduce classpath also point to /opt/yarn/hadoop-2.3.0 etc?
+Vinod
On Mar 22, 2014, at 11:33 AM, Tony Mullins <to...@gmail.com> wrote:
> That I also dont know what 614... Its the exact and single line in stderr of Jobs logs.
> And regarding MapRed classpath , defaults are good as there are only two vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*, $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
>
> Is there any other place to look for detailed & meaningfull error info ? or any huntch to how to fix it ?
>
> Thanks,
> Tony
>
>
> On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
> What is "614" here?
>
> The other relevant thing to check is the MapReduce specific config mapreduce.application.classpath.
>
> +Vinod
>
> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com> wrote:
>
>> Hi,
>>
>> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can successfully run distributedshell-2.2.0.jar example. But when I try to run any mapreduce job I get error. I have setup MapRed.xml and other configs for running MapReduce job according to (http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide) but I am getting following error :
>>
>> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed with state FAILED due to: Application application_1395502230567_0001 failed 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException: at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at org.apache.hadoop.util.Shell.run(Shell.java:418) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)
>>
>> Container exited with a non-zero exit code 1
>> .Failing this attempt.. Failing the application.
>> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
>> Job ended: Sat Mar 22 20:31:17 PKT 2014
>> The job took 6 seconds.
>> And if look at stderr (log of job) there is only one line
>>
>> "Could not find or load main class 614"
>>
>> Now I have googled it and usually this issues comes when you have different JAVA versions or in yarn-site.xml classpath is not properly set , my yarn-site.xml has this
>>
>>
>> <property>
>> <name>yarn.application.classpath</name>
>> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>>
>>
>> </property>
>> So any other ideas what could be the issue here ?
>>
>> I am running my mapreduce job like this:
>>
>> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>> Thanks, Tony
>>
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
Given your earlier mail about the paths in /opt, shouldn't mapreduce classpath also point to /opt/yarn/hadoop-2.3.0 etc?
+Vinod
On Mar 22, 2014, at 11:33 AM, Tony Mullins <to...@gmail.com> wrote:
> That I also dont know what 614... Its the exact and single line in stderr of Jobs logs.
> And regarding MapRed classpath , defaults are good as there are only two vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*, $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
>
> Is there any other place to look for detailed & meaningfull error info ? or any huntch to how to fix it ?
>
> Thanks,
> Tony
>
>
> On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
> What is "614" here?
>
> The other relevant thing to check is the MapReduce specific config mapreduce.application.classpath.
>
> +Vinod
>
> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com> wrote:
>
>> Hi,
>>
>> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can successfully run distributedshell-2.2.0.jar example. But when I try to run any mapreduce job I get error. I have setup MapRed.xml and other configs for running MapReduce job according to (http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide) but I am getting following error :
>>
>> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed with state FAILED due to: Application application_1395502230567_0001 failed 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException: at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at org.apache.hadoop.util.Shell.run(Shell.java:418) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)
>>
>> Container exited with a non-zero exit code 1
>> .Failing this attempt.. Failing the application.
>> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
>> Job ended: Sat Mar 22 20:31:17 PKT 2014
>> The job took 6 seconds.
>> And if look at stderr (log of job) there is only one line
>>
>> "Could not find or load main class 614"
>>
>> Now I have googled it and usually this issues comes when you have different JAVA versions or in yarn-site.xml classpath is not properly set , my yarn-site.xml has this
>>
>>
>> <property>
>> <name>yarn.application.classpath</name>
>> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>>
>>
>> </property>
>> So any other ideas what could be the issue here ?
>>
>> I am running my mapreduce job like this:
>>
>> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>> Thanks, Tony
>>
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
Given your earlier mail about the paths in /opt, shouldn't mapreduce classpath also point to /opt/yarn/hadoop-2.3.0 etc?
+Vinod
On Mar 22, 2014, at 11:33 AM, Tony Mullins <to...@gmail.com> wrote:
> That I also dont know what 614... Its the exact and single line in stderr of Jobs logs.
> And regarding MapRed classpath , defaults are good as there are only two vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*, $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
>
> Is there any other place to look for detailed & meaningfull error info ? or any huntch to how to fix it ?
>
> Thanks,
> Tony
>
>
> On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
> What is "614" here?
>
> The other relevant thing to check is the MapReduce specific config mapreduce.application.classpath.
>
> +Vinod
>
> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com> wrote:
>
>> Hi,
>>
>> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can successfully run distributedshell-2.2.0.jar example. But when I try to run any mapreduce job I get error. I have setup MapRed.xml and other configs for running MapReduce job according to (http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide) but I am getting following error :
>>
>> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed with state FAILED due to: Application application_1395502230567_0001 failed 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException: at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at org.apache.hadoop.util.Shell.run(Shell.java:418) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)
>>
>> Container exited with a non-zero exit code 1
>> .Failing this attempt.. Failing the application.
>> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
>> Job ended: Sat Mar 22 20:31:17 PKT 2014
>> The job took 6 seconds.
>> And if look at stderr (log of job) there is only one line
>>
>> "Could not find or load main class 614"
>>
>> Now I have googled it and usually this issues comes when you have different JAVA versions or in yarn-site.xml classpath is not properly set , my yarn-site.xml has this
>>
>>
>> <property>
>> <name>yarn.application.classpath</name>
>> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>>
>>
>> </property>
>> So any other ideas what could be the issue here ?
>>
>> I am running my mapreduce job like this:
>>
>> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>> Thanks, Tony
>>
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
Given your earlier mail about the paths in /opt, shouldn't mapreduce classpath also point to /opt/yarn/hadoop-2.3.0 etc?
+Vinod
On Mar 22, 2014, at 11:33 AM, Tony Mullins <to...@gmail.com> wrote:
> That I also dont know what 614... Its the exact and single line in stderr of Jobs logs.
> And regarding MapRed classpath , defaults are good as there are only two vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*, $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
>
> Is there any other place to look for detailed & meaningfull error info ? or any huntch to how to fix it ?
>
> Thanks,
> Tony
>
>
> On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
> What is "614" here?
>
> The other relevant thing to check is the MapReduce specific config mapreduce.application.classpath.
>
> +Vinod
>
> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com> wrote:
>
>> Hi,
>>
>> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can successfully run distributedshell-2.2.0.jar example. But when I try to run any mapreduce job I get error. I have setup MapRed.xml and other configs for running MapReduce job according to (http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide) but I am getting following error :
>>
>> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed with state FAILED due to: Application application_1395502230567_0001 failed 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException: at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at org.apache.hadoop.util.Shell.run(Shell.java:418) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)
>>
>> Container exited with a non-zero exit code 1
>> .Failing this attempt.. Failing the application.
>> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
>> Job ended: Sat Mar 22 20:31:17 PKT 2014
>> The job took 6 seconds.
>> And if look at stderr (log of job) there is only one line
>>
>> "Could not find or load main class 614"
>>
>> Now I have googled it and usually this issues comes when you have different JAVA versions or in yarn-site.xml classpath is not properly set , my yarn-site.xml has this
>>
>>
>> <property>
>> <name>yarn.application.classpath</name>
>> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>>
>>
>> </property>
>> So any other ideas what could be the issue here ?
>>
>> I am running my mapreduce job like this:
>>
>> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>> Thanks, Tony
>>
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Tony Mullins <to...@gmail.com>.
That I also dont know what 614... Its the exact and single line in stderr
of Jobs logs.
And regarding MapRed classpath , defaults are good as there are only two
vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
Is there any other place to look for detailed & meaningfull error info ? or
any huntch to how to fix it ?
Thanks,
Tony
On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <
vinodkv@apache.org> wrote:
> What is "614" here?
>
> The other relevant thing to check is the MapReduce specific config
> mapreduce.application.classpath.
>
> +Vinod
>
> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com>
> wrote:
>
> Hi,
>
> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can
> successfully run distributedshell-2.2.0.jar example. But when I try to run
> any mapreduce job I get error. I have setup MapRed.xml and other configs
> for running MapReduce job according to (
> http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
> but I am getting following error :
>
> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed
> with state FAILED due to: Application application_1395502230567_0001 failed
> 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited
> with exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> org.apache.hadoop.util.Shell$ExitCodeException: at
> org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at
> org.apache.hadoop.util.Shell.run(Shell.java:418) at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
>
> Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
> Job ended: Sat Mar 22 20:31:17 PKT 2014
> The job took 6 seconds.
>
> And if look at stderr (log of job) there is only one line
>
> *"Could not find or load main class 614"*
>
> Now I have googled it and usually this issues comes when you have
> different JAVA versions or in yarn-site.xml classpath is not properly set ,
> my yarn-site.xml has this
>
>
> <property>
> <name>yarn.application.classpath</name>
> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>
> </property>
>
> So any other ideas what could be the issue here ?
>
> I am running my mapreduce job like this:
>
> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>
> Thanks, Tony
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Tony Mullins <to...@gmail.com>.
That I also dont know what 614... Its the exact and single line in stderr
of Jobs logs.
And regarding MapRed classpath , defaults are good as there are only two
vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
Is there any other place to look for detailed & meaningfull error info ? or
any huntch to how to fix it ?
Thanks,
Tony
On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <
vinodkv@apache.org> wrote:
> What is "614" here?
>
> The other relevant thing to check is the MapReduce specific config
> mapreduce.application.classpath.
>
> +Vinod
>
> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com>
> wrote:
>
> Hi,
>
> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can
> successfully run distributedshell-2.2.0.jar example. But when I try to run
> any mapreduce job I get error. I have setup MapRed.xml and other configs
> for running MapReduce job according to (
> http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
> but I am getting following error :
>
> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed
> with state FAILED due to: Application application_1395502230567_0001 failed
> 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited
> with exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> org.apache.hadoop.util.Shell$ExitCodeException: at
> org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at
> org.apache.hadoop.util.Shell.run(Shell.java:418) at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
>
> Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
> Job ended: Sat Mar 22 20:31:17 PKT 2014
> The job took 6 seconds.
>
> And if look at stderr (log of job) there is only one line
>
> *"Could not find or load main class 614"*
>
> Now I have googled it and usually this issues comes when you have
> different JAVA versions or in yarn-site.xml classpath is not properly set ,
> my yarn-site.xml has this
>
>
> <property>
> <name>yarn.application.classpath</name>
> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>
> </property>
>
> So any other ideas what could be the issue here ?
>
> I am running my mapreduce job like this:
>
> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>
> Thanks, Tony
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Tony Mullins <to...@gmail.com>.
That I also dont know what 614... Its the exact and single line in stderr
of Jobs logs.
And regarding MapRed classpath , defaults are good as there are only two
vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
Is there any other place to look for detailed & meaningfull error info ? or
any huntch to how to fix it ?
Thanks,
Tony
On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <
vinodkv@apache.org> wrote:
> What is "614" here?
>
> The other relevant thing to check is the MapReduce specific config
> mapreduce.application.classpath.
>
> +Vinod
>
> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com>
> wrote:
>
> Hi,
>
> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can
> successfully run distributedshell-2.2.0.jar example. But when I try to run
> any mapreduce job I get error. I have setup MapRed.xml and other configs
> for running MapReduce job according to (
> http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
> but I am getting following error :
>
> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed
> with state FAILED due to: Application application_1395502230567_0001 failed
> 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited
> with exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> org.apache.hadoop.util.Shell$ExitCodeException: at
> org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at
> org.apache.hadoop.util.Shell.run(Shell.java:418) at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
>
> Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
> Job ended: Sat Mar 22 20:31:17 PKT 2014
> The job took 6 seconds.
>
> And if look at stderr (log of job) there is only one line
>
> *"Could not find or load main class 614"*
>
> Now I have googled it and usually this issues comes when you have
> different JAVA versions or in yarn-site.xml classpath is not properly set ,
> my yarn-site.xml has this
>
>
> <property>
> <name>yarn.application.classpath</name>
> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>
> </property>
>
> So any other ideas what could be the issue here ?
>
> I am running my mapreduce job like this:
>
> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>
> Thanks, Tony
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Tony Mullins <to...@gmail.com>.
That I also dont know what 614... Its the exact and single line in stderr
of Jobs logs.
And regarding MapRed classpath , defaults are good as there are only two
vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*.
Is there any other place to look for detailed & meaningfull error info ? or
any huntch to how to fix it ?
Thanks,
Tony
On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli <
vinodkv@apache.org> wrote:
> What is "614" here?
>
> The other relevant thing to check is the MapReduce specific config
> mapreduce.application.classpath.
>
> +Vinod
>
> On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com>
> wrote:
>
> Hi,
>
> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can
> successfully run distributedshell-2.2.0.jar example. But when I try to run
> any mapreduce job I get error. I have setup MapRed.xml and other configs
> for running MapReduce job according to (
> http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide)
> but I am getting following error :
>
> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed
> with state FAILED due to: Application application_1395502230567_0001 failed
> 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited
> with exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> org.apache.hadoop.util.Shell$ExitCodeException: at
> org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at
> org.apache.hadoop.util.Shell.run(Shell.java:418) at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
>
> Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
> Job ended: Sat Mar 22 20:31:17 PKT 2014
> The job took 6 seconds.
>
> And if look at stderr (log of job) there is only one line
>
> *"Could not find or load main class 614"*
>
> Now I have googled it and usually this issues comes when you have
> different JAVA versions or in yarn-site.xml classpath is not properly set ,
> my yarn-site.xml has this
>
>
> <property>
> <name>yarn.application.classpath</name>
> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>
> </property>
>
> So any other ideas what could be the issue here ?
>
> I am running my mapreduce job like this:
>
> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
>
> Thanks, Tony
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
What is "614" here?
The other relevant thing to check is the MapReduce specific config mapreduce.application.classpath.
+Vinod
On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com> wrote:
> Hi,
>
> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can successfully run distributedshell-2.2.0.jar example. But when I try to run any mapreduce job I get error. I have setup MapRed.xml and other configs for running MapReduce job according to (http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide) but I am getting following error :
>
> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed with state FAILED due to: Application application_1395502230567_0001 failed 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException: at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at org.apache.hadoop.util.Shell.run(Shell.java:418) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)
>
> Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
> Job ended: Sat Mar 22 20:31:17 PKT 2014
> The job took 6 seconds.
> And if look at stderr (log of job) there is only one line
>
> "Could not find or load main class 614"
>
> Now I have googled it and usually this issues comes when you have different JAVA versions or in yarn-site.xml classpath is not properly set , my yarn-site.xml has this
>
>
> <property>
> <name>yarn.application.classpath</name>
> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>
> </property>
> So any other ideas what could be the issue here ?
>
> I am running my mapreduce job like this:
>
> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
> Thanks, Tony
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
What is "614" here?
The other relevant thing to check is the MapReduce specific config mapreduce.application.classpath.
+Vinod
On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com> wrote:
> Hi,
>
> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can successfully run distributedshell-2.2.0.jar example. But when I try to run any mapreduce job I get error. I have setup MapRed.xml and other configs for running MapReduce job according to (http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide) but I am getting following error :
>
> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed with state FAILED due to: Application application_1395502230567_0001 failed 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException: at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at org.apache.hadoop.util.Shell.run(Shell.java:418) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)
>
> Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
> Job ended: Sat Mar 22 20:31:17 PKT 2014
> The job took 6 seconds.
> And if look at stderr (log of job) there is only one line
>
> "Could not find or load main class 614"
>
> Now I have googled it and usually this issues comes when you have different JAVA versions or in yarn-site.xml classpath is not properly set , my yarn-site.xml has this
>
>
> <property>
> <name>yarn.application.classpath</name>
> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>
> </property>
> So any other ideas what could be the issue here ?
>
> I am running my mapreduce job like this:
>
> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
> Thanks, Tony
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
What is "614" here?
The other relevant thing to check is the MapReduce specific config mapreduce.application.classpath.
+Vinod
On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com> wrote:
> Hi,
>
> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can successfully run distributedshell-2.2.0.jar example. But when I try to run any mapreduce job I get error. I have setup MapRed.xml and other configs for running MapReduce job according to (http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide) but I am getting following error :
>
> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed with state FAILED due to: Application application_1395502230567_0001 failed 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException: at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at org.apache.hadoop.util.Shell.run(Shell.java:418) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)
>
> Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
> Job ended: Sat Mar 22 20:31:17 PKT 2014
> The job took 6 seconds.
> And if look at stderr (log of job) there is only one line
>
> "Could not find or load main class 614"
>
> Now I have googled it and usually this issues comes when you have different JAVA versions or in yarn-site.xml classpath is not properly set , my yarn-site.xml has this
>
>
> <property>
> <name>yarn.application.classpath</name>
> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>
> </property>
> So any other ideas what could be the issue here ?
>
> I am running my mapreduce job like this:
>
> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
> Thanks, Tony
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
What is "614" here?
The other relevant thing to check is the MapReduce specific config mapreduce.application.classpath.
+Vinod
On Mar 22, 2014, at 9:03 AM, Tony Mullins <to...@gmail.com> wrote:
> Hi,
>
> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can successfully run distributedshell-2.2.0.jar example. But when I try to run any mapreduce job I get error. I have setup MapRed.xml and other configs for running MapReduce job according to (http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide) but I am getting following error :
>
> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed with state FAILED due to: Application application_1395502230567_0001 failed 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: org.apache.hadoop.util.Shell$ExitCodeException: at org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at org.apache.hadoop.util.Shell.run(Shell.java:418) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)
>
> Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0
> Job ended: Sat Mar 22 20:31:17 PKT 2014
> The job took 6 seconds.
> And if look at stderr (log of job) there is only one line
>
> "Could not find or load main class 614"
>
> Now I have googled it and usually this issues comes when you have different JAVA versions or in yarn-site.xml classpath is not properly set , my yarn-site.xml has this
>
>
> <property>
> <name>yarn.application.classpath</name>
> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value>
>
> </property>
> So any other ideas what could be the issue here ?
>
> I am running my mapreduce job like this:
>
> $HADOOP_PREFIX/bin/hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar randomwriter out
> Thanks, Tony
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.