You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Caesar Samsi <cm...@hotmail.com> on 2015/11/24 03:16:08 UTC
Container errors running Terasort
Hi there,
I’m running Hadoop on a cluster of 4 Raspberry Pi’s for my project.
I am getting errors benchmarking the cluster using Terasort as shown below.
I’ve adjusted the memory & task numbers in mapred-site.xml as follows but still getting the errors.
What can I do?
Thanks, Caesar.
<property>
<name>mapred.map.child.java.opts</name>
<value>-Xmx180M</value>
</property>
<property>
<name>mapred.reduce.child.java.opts</name>
<value>-Xmx180M</value>
</property>
<property>
<name>mapred.tasktracker.map.tasks.maximum</name>
<value>2</value>
</property>
<property>
<name>mapred.tasktracker.reduce.tasks.maximum</name>
<value>2</value>
</property>
==============
15/11/23 16:49:41 INFO mapreduce.Job: Task Id : attempt_1448325816071_0002_m_000051_0, Status : FAILED
Container killed on request. Exit code is 137
Container exited with a non-zero exit code 137
Killed by external signal
==============
15/11/23 16:49:26 INFO mapreduce.Job: Task Id : attempt_1448325816071_0002_m_000003_0, Status : FAILED
Exception from container-launch.
Container id: container_1448325816071_0002_01_000011
Exit code: 134
Exception message: /bin/bash: line 1: 6147 Aborted /usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx180M -Djava.io.tmpdir=/usr/local/hadoop/data/nm-local-dir/usercache/hduser/appcache/application_1448325816071_0002/container_1448325816071_0002_01_000011/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild 192.168.1.15 36720 attempt_1448325816071_0002_m_000003_0 11 > /usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stdout 2> /usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stderr
Stack trace: ExitCodeException exitCode=134: /bin/bash: line 1: 6147 Aborted /usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx180M -Djava.io.tmpdir=/usr/local/hadoop/data/nm-local-dir/usercache/hduser/appcache/application_1448325816071_0002/container_1448325816071_0002_01_000011/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild 192.168.1.15 36720 attempt_1448325816071_0002_m_000003_0 11 > /usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stdout 2> /usr/local/hadoop-2.6.0/logs/userlogs/application_1448325816071_0002/container_1448325816071_0002_01_000011/stderr
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:744)
Container exited with a non-zero exit code 134
==============
15/11/23 16:49:43 INFO mapreduce.Job: Task Id : attempt_1448325816071_0002_m_000050_0, Status : FAILED
Exception from container-launch.
Container id: container_1448325816071_0002_01_000005
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:744)
Container exited with a non-zero exit code 1
==============
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: Container errors running Terasort
Posted by Tsuyoshi Ozawa <oz...@apache.org>.
Hi,
To get entire log, yarn logs command can help you.
yarn logs -applicationId application_1448325816071_0002
Thanks,
- Tsuyoshi
On Tue, Nov 24, 2015 at 7:43 PM, Namikaze Minato <ll...@gmail.com> wrote:
> Have a look at the logs for your attempt_1448325816071_0002_m_000003_0.
>
> Regards,
> LLoyd
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: user-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: Container errors running Terasort
Posted by Tsuyoshi Ozawa <oz...@apache.org>.
Hi,
To get entire log, yarn logs command can help you.
yarn logs -applicationId application_1448325816071_0002
Thanks,
- Tsuyoshi
On Tue, Nov 24, 2015 at 7:43 PM, Namikaze Minato <ll...@gmail.com> wrote:
> Have a look at the logs for your attempt_1448325816071_0002_m_000003_0.
>
> Regards,
> LLoyd
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: user-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: Container errors running Terasort
Posted by Tsuyoshi Ozawa <oz...@apache.org>.
Hi,
To get entire log, yarn logs command can help you.
yarn logs -applicationId application_1448325816071_0002
Thanks,
- Tsuyoshi
On Tue, Nov 24, 2015 at 7:43 PM, Namikaze Minato <ll...@gmail.com> wrote:
> Have a look at the logs for your attempt_1448325816071_0002_m_000003_0.
>
> Regards,
> LLoyd
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: user-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: Container errors running Terasort
Posted by Tsuyoshi Ozawa <oz...@apache.org>.
Hi,
To get entire log, yarn logs command can help you.
yarn logs -applicationId application_1448325816071_0002
Thanks,
- Tsuyoshi
On Tue, Nov 24, 2015 at 7:43 PM, Namikaze Minato <ll...@gmail.com> wrote:
> Have a look at the logs for your attempt_1448325816071_0002_m_000003_0.
>
> Regards,
> LLoyd
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: user-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: Container errors running Terasort
Posted by Namikaze Minato <ll...@gmail.com>.
Have a look at the logs for your attempt_1448325816071_0002_m_000003_0.
Regards,
LLoyd
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: Container errors running Terasort
Posted by Namikaze Minato <ll...@gmail.com>.
Have a look at the logs for your attempt_1448325816071_0002_m_000003_0.
Regards,
LLoyd
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: Container errors running Terasort
Posted by Namikaze Minato <ll...@gmail.com>.
Have a look at the logs for your attempt_1448325816071_0002_m_000003_0.
Regards,
LLoyd
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org
Re: Container errors running Terasort
Posted by Namikaze Minato <ll...@gmail.com>.
Have a look at the logs for your attempt_1448325816071_0002_m_000003_0.
Regards,
LLoyd
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org