You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Kevin Burton <bu...@spinn3r.com> on 2014/05/24 00:17:01 UTC
2.4 / yarn pig jobs fail due to exit code 1 from container.
Trying to track down exactly what's happening.
Right now I'm getting this (see below).
The setup documentation for 2.4 could definitely be better. Probably with
a sample/working config. Looks like too much of this is left up as an
exercise to the user.
2014-05-23 21:20:30,652 INFO
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
launchContainer: [nice, -n, 0, bash,
/data/2/yarn/local/usercache/root/appcache/application_1400821083545_0004/container_1400821083545_0004_01_000001/default_container_executor.sh]
2014-05-23 21:20:30,771 WARN
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit
code from container container_1400821083545_0004_01_000001 is : 1
2014-05-23 21:20:30,771 WARN
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
Exception from container-launch with container ID:
container_1400821083545_0004_01_000001 and exit code: 1
org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
at org.apache.hadoop.util.Shell.run(Shell.java:418)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
--
Founder/CEO Spinn3r.com
Location: *San Francisco, CA*
Skype: *burtonator*
blog: http://burtonator.wordpress.com
… or check out my Google+
profile<https://plus.google.com/102718274791889610666/posts>
<http://spinn3r.com>
War is peace. Freedom is slavery. Ignorance is strength. Corporations are
people.
Re: 2.4 / yarn pig jobs fail due to exit code 1 from container.
Posted by Wangda Tan <wh...@gmail.com>.
Kevin,
NM logs you provided can only know container exit with code=1, logs of
container can be helpful to understand what happened.
Thanks,
On Sat, May 24, 2014 at 6:17 AM, Kevin Burton <bu...@spinn3r.com> wrote:
> Trying to track down exactly what's happening.
>
> Right now I'm getting this (see below).
>
> The setup documentation for 2.4 could definitely be better. Probably with
> a sample/working config. Looks like too much of this is left up as an
> exercise to the user.
>
> 2014-05-23 21:20:30,652 INFO
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
> launchContainer: [nice, -n, 0, bash,
> /data/2/yarn/local/usercache/root/appcache/application_1400821083545_0004/container_1400821083545_0004_01_000001/default_container_executor.sh]
> 2014-05-23 21:20:30,771 WARN
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit
> code from container container_1400821083545_0004_01_000001 is : 1
> 2014-05-23 21:20:30,771 WARN
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
> Exception from container-launch with container ID:
> container_1400821083545_0004_01_000001 and exit code: 1
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
> at org.apache.hadoop.util.Shell.run(Shell.java:418)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
> at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
>
>
> --
>
> Founder/CEO Spinn3r.com
> Location: *San Francisco, CA*
> Skype: *burtonator*
> blog: http://burtonator.wordpress.com
> … or check out my Google+ profile<https://plus.google.com/102718274791889610666/posts>
> <http://spinn3r.com>
> War is peace. Freedom is slavery. Ignorance is strength. Corporations are
> people.
>
>
Re: 2.4 / yarn pig jobs fail due to exit code 1 from container.
Posted by Wangda Tan <wh...@gmail.com>.
Kevin,
NM logs you provided can only know container exit with code=1, logs of
container can be helpful to understand what happened.
Thanks,
On Sat, May 24, 2014 at 6:17 AM, Kevin Burton <bu...@spinn3r.com> wrote:
> Trying to track down exactly what's happening.
>
> Right now I'm getting this (see below).
>
> The setup documentation for 2.4 could definitely be better. Probably with
> a sample/working config. Looks like too much of this is left up as an
> exercise to the user.
>
> 2014-05-23 21:20:30,652 INFO
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
> launchContainer: [nice, -n, 0, bash,
> /data/2/yarn/local/usercache/root/appcache/application_1400821083545_0004/container_1400821083545_0004_01_000001/default_container_executor.sh]
> 2014-05-23 21:20:30,771 WARN
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit
> code from container container_1400821083545_0004_01_000001 is : 1
> 2014-05-23 21:20:30,771 WARN
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
> Exception from container-launch with container ID:
> container_1400821083545_0004_01_000001 and exit code: 1
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
> at org.apache.hadoop.util.Shell.run(Shell.java:418)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
> at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
>
>
> --
>
> Founder/CEO Spinn3r.com
> Location: *San Francisco, CA*
> Skype: *burtonator*
> blog: http://burtonator.wordpress.com
> … or check out my Google+ profile<https://plus.google.com/102718274791889610666/posts>
> <http://spinn3r.com>
> War is peace. Freedom is slavery. Ignorance is strength. Corporations are
> people.
>
>
Re: 2.4 / yarn pig jobs fail due to exit code 1 from container.
Posted by Wangda Tan <wh...@gmail.com>.
Kevin,
NM logs you provided can only know container exit with code=1, logs of
container can be helpful to understand what happened.
Thanks,
On Sat, May 24, 2014 at 6:17 AM, Kevin Burton <bu...@spinn3r.com> wrote:
> Trying to track down exactly what's happening.
>
> Right now I'm getting this (see below).
>
> The setup documentation for 2.4 could definitely be better. Probably with
> a sample/working config. Looks like too much of this is left up as an
> exercise to the user.
>
> 2014-05-23 21:20:30,652 INFO
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
> launchContainer: [nice, -n, 0, bash,
> /data/2/yarn/local/usercache/root/appcache/application_1400821083545_0004/container_1400821083545_0004_01_000001/default_container_executor.sh]
> 2014-05-23 21:20:30,771 WARN
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit
> code from container container_1400821083545_0004_01_000001 is : 1
> 2014-05-23 21:20:30,771 WARN
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
> Exception from container-launch with container ID:
> container_1400821083545_0004_01_000001 and exit code: 1
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
> at org.apache.hadoop.util.Shell.run(Shell.java:418)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
> at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
>
>
> --
>
> Founder/CEO Spinn3r.com
> Location: *San Francisco, CA*
> Skype: *burtonator*
> blog: http://burtonator.wordpress.com
> … or check out my Google+ profile<https://plus.google.com/102718274791889610666/posts>
> <http://spinn3r.com>
> War is peace. Freedom is slavery. Ignorance is strength. Corporations are
> people.
>
>
Re: 2.4 / yarn pig jobs fail due to exit code 1 from container.
Posted by Wangda Tan <wh...@gmail.com>.
Kevin,
NM logs you provided can only know container exit with code=1, logs of
container can be helpful to understand what happened.
Thanks,
On Sat, May 24, 2014 at 6:17 AM, Kevin Burton <bu...@spinn3r.com> wrote:
> Trying to track down exactly what's happening.
>
> Right now I'm getting this (see below).
>
> The setup documentation for 2.4 could definitely be better. Probably with
> a sample/working config. Looks like too much of this is left up as an
> exercise to the user.
>
> 2014-05-23 21:20:30,652 INFO
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
> launchContainer: [nice, -n, 0, bash,
> /data/2/yarn/local/usercache/root/appcache/application_1400821083545_0004/container_1400821083545_0004_01_000001/default_container_executor.sh]
> 2014-05-23 21:20:30,771 WARN
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit
> code from container container_1400821083545_0004_01_000001 is : 1
> 2014-05-23 21:20:30,771 WARN
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor:
> Exception from container-launch with container ID:
> container_1400821083545_0004_01_000001 and exit code: 1
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
> at org.apache.hadoop.util.Shell.run(Shell.java:418)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
> at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
>
>
> --
>
> Founder/CEO Spinn3r.com
> Location: *San Francisco, CA*
> Skype: *burtonator*
> blog: http://burtonator.wordpress.com
> … or check out my Google+ profile<https://plus.google.com/102718274791889610666/posts>
> <http://spinn3r.com>
> War is peace. Freedom is slavery. Ignorance is strength. Corporations are
> people.
>
>