You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by EdwardKing <zh...@neusoft.com> on 2014/06/30 04:24:16 UTC
hadoop-mapreduce-examples-2.2.0 : Exception from container-launch
I run hadoop-mapreduce-examples-2.2.0.jar,it can get correct result,but it raise error "exitCode: 1 due to: Exception from container-launch". Why? How to solve it? Thanks.
[yarn@localhost sbin]$ hadoop jar /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar pi -Dmapreduce.clientfactory.class.name=org.apache.hadoop.mapred.YarnClientFactory -libjars /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar 16 10000
Number of Maps = 16
Samples per Map = 10000
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Wrote input for Map #4
Wrote input for Map #5
Wrote input for Map #6
Wrote input for Map #7
Wrote input for Map #8
Wrote input for Map #9
Wrote input for Map #10
Wrote input for Map #11
Wrote input for Map #12
Wrote input for Map #13
Wrote input for Map #14
Wrote input for Map #15
Starting Job
14/06/29 18:45:51 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
14/06/29 18:45:52 INFO input.FileInputFormat: Total input paths to process : 16
14/06/29 18:45:52 INFO mapreduce.JobSubmitter: number of splits:16
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
14/06/29 18:45:53 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
14/06/29 18:45:53 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
14/06/29 18:45:53 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1404092671820_0001
14/06/29 18:45:54 INFO impl.YarnClientImpl: Submitted application application_1404092671820_0001 to ResourceManager at /0.0.0.0:8032
14/06/29 18:45:54 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1404092671820_0001/
14/06/29 18:45:54 INFO mapreduce.Job: Running job: job_1404092671820_0001
14/06/29 18:46:40 INFO mapreduce.Job: Job job_1404092671820_0001 running in uber mode : false
14/06/29 18:46:40 INFO mapreduce.Job: map 0% reduce 0%
14/06/29 18:50:40 INFO mapreduce.Job: map 13% reduce 0%
14/06/29 18:50:46 INFO mapreduce.Job: map 25% reduce 0%
14/06/29 18:50:49 INFO mapreduce.Job: map 38% reduce 0%
14/06/29 18:51:49 INFO mapreduce.Job: map 38% reduce 13%
14/06/29 18:51:54 INFO mapreduce.Job: map 44% reduce 13%
14/06/29 18:51:55 INFO mapreduce.Job: map 63% reduce 13%
14/06/29 18:51:56 INFO mapreduce.Job: map 63% reduce 21%
14/06/29 18:51:57 INFO mapreduce.Job: map 69% reduce 21%
14/06/29 18:51:59 INFO mapreduce.Job: map 69% reduce 23%
14/06/29 18:52:25 INFO mapreduce.Job: map 75% reduce 23%
14/06/29 18:52:27 INFO mapreduce.Job: map 100% reduce 23%
14/06/29 18:52:28 INFO mapreduce.Job: map 100% reduce 29%
14/06/29 18:52:29 INFO mapreduce.Job: map 100% reduce 100%
14/06/29 18:53:05 INFO mapreduce.Job: map 0% reduce 0%
14/06/29 18:53:05 INFO mapreduce.Job: Job job_1404092671820_0001 failed with state FAILED due to: Application application_1404092671820_0001 failed 2 times due to AM Container for appattempt_1404092671820_0001_000002 exited with exitCode: 1 due to: Exception from container-launch:
org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
at org.apache.hadoop.util.Shell.run(Shell.java:379)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
.Failing this attempt.. Failing the application.
14/06/29 18:53:05 INFO mapreduce.Job: Counters: 0
Job Finished in 434.023 seconds
Estimated value of Pi is 3.14127500000000000000
[yarn@localhost sbin]$
---------------------------------------------------------------------------------------------------
Confidentiality Notice: The information contained in this e-mail and any accompanying attachment(s)
is intended only for the use of the intended recipient and may be confidential and/or privileged of
Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader of this communication is
not the intended recipient, unauthorized use, forwarding, printing, storing, disclosure or copying
is strictly prohibited, and may be unlawful.If you have received this communication in error,please
immediately notify the sender by return e-mail, and delete the original message and all copies from
your system. Thank you.
---------------------------------------------------------------------------------------------------
Re: hadoop-mapreduce-examples-2.2.0 : Exception from container-launch
Posted by Li Lu <ll...@hortonworks.com>.
Hi Edward,
This is Li Lu from Hortonworks, and I’m looking into possible solutions and improvements to this confusing “Shell$ExitCodeException”. For now, one typical solution is to check the log on the NM where the container throws the exception. But some improvements could be made here. I’m wondering whether you have the access to the cluster information webpage, and whether your cluster’s log aggregator is enabled? If that’s the case then you can check the log out from the cluster’s webpage by clicking the “History” link of the application id, then “logs” of each attempt.
Best regards,
Li Lu
On Jun 29, 2014, at 7:24 PM, EdwardKing <zh...@neusoft.com> wrote:
> I run hadoop-mapreduce-examples-2.2.0.jar,it can get correct result,but it raise error "exitCode: 1 due to: Exception from container-launch". Why? How to solve it? Thanks.
>
> [yarn@localhost sbin]$ hadoop jar /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar pi -Dmapreduce.clientfactory.class.name=org.apache.hadoop.mapred.YarnClientFactory -libjars /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar 16 10000
> Number of Maps = 16
> Samples per Map = 10000
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 14/06/29 18:45:51 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> 14/06/29 18:45:52 INFO input.FileInputFormat: Total input paths to process : 16
> 14/06/29 18:45:52 INFO mapreduce.JobSubmitter: number of splits:16
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
> 14/06/29 18:45:53 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
> 14/06/29 18:45:53 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1404092671820_0001
> 14/06/29 18:45:54 INFO impl.YarnClientImpl: Submitted application application_1404092671820_0001 to ResourceManager at /0.0.0.0:8032
> 14/06/29 18:45:54 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1404092671820_0001/
> 14/06/29 18:45:54 INFO mapreduce.Job: Running job: job_1404092671820_0001
> 14/06/29 18:46:40 INFO mapreduce.Job: Job job_1404092671820_0001 running in uber mode : false
> 14/06/29 18:46:40 INFO mapreduce.Job: map 0% reduce 0%
> 14/06/29 18:50:40 INFO mapreduce.Job: map 13% reduce 0%
> 14/06/29 18:50:46 INFO mapreduce.Job: map 25% reduce 0%
> 14/06/29 18:50:49 INFO mapreduce.Job: map 38% reduce 0%
> 14/06/29 18:51:49 INFO mapreduce.Job: map 38% reduce 13%
> 14/06/29 18:51:54 INFO mapreduce.Job: map 44% reduce 13%
> 14/06/29 18:51:55 INFO mapreduce.Job: map 63% reduce 13%
> 14/06/29 18:51:56 INFO mapreduce.Job: map 63% reduce 21%
> 14/06/29 18:51:57 INFO mapreduce.Job: map 69% reduce 21%
> 14/06/29 18:51:59 INFO mapreduce.Job: map 69% reduce 23%
> 14/06/29 18:52:25 INFO mapreduce.Job: map 75% reduce 23%
> 14/06/29 18:52:27 INFO mapreduce.Job: map 100% reduce 23%
> 14/06/29 18:52:28 INFO mapreduce.Job: map 100% reduce 29%
> 14/06/29 18:52:29 INFO mapreduce.Job: map 100% reduce 100%
> 14/06/29 18:53:05 INFO mapreduce.Job: map 0% reduce 0%
> 14/06/29 18:53:05 INFO mapreduce.Job: Job job_1404092671820_0001 failed with state FAILED due to: Application application_1404092671820_0001 failed 2 times due to AM Container for appattempt_1404092671820_0001_000002 exited with exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> at org.apache.hadoop.util.Shell.run(Shell.java:379)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
> .Failing this attempt.. Failing the application.
> 14/06/29 18:53:05 INFO mapreduce.Job: Counters: 0
> Job Finished in 434.023 seconds
> Estimated value of Pi is 3.14127500000000000000
> [yarn@localhost sbin]$
> ---------------------------------------------------------------------------------------------------
> Confidentiality Notice: The information contained in this e-mail and any accompanying attachment(s)
> is intended only for the use of the intended recipient and may be confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader of this communication is
> not the intended recipient, unauthorized use, forwarding, printing, storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this communication in error,please
> immediately notify the sender by return e-mail, and delete the original message and all copies from
> your system. Thank you.
> ---------------------------------------------------------------------------------------------------
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: hadoop-mapreduce-examples-2.2.0 : Exception from container-launch
Posted by Li Lu <ll...@hortonworks.com>.
Hi Edward,
This is Li Lu from Hortonworks, and I’m looking into possible solutions and improvements to this confusing “Shell$ExitCodeException”. For now, one typical solution is to check the log on the NM where the container throws the exception. But some improvements could be made here. I’m wondering whether you have the access to the cluster information webpage, and whether your cluster’s log aggregator is enabled? If that’s the case then you can check the log out from the cluster’s webpage by clicking the “History” link of the application id, then “logs” of each attempt.
Best regards,
Li Lu
On Jun 29, 2014, at 7:24 PM, EdwardKing <zh...@neusoft.com> wrote:
> I run hadoop-mapreduce-examples-2.2.0.jar,it can get correct result,but it raise error "exitCode: 1 due to: Exception from container-launch". Why? How to solve it? Thanks.
>
> [yarn@localhost sbin]$ hadoop jar /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar pi -Dmapreduce.clientfactory.class.name=org.apache.hadoop.mapred.YarnClientFactory -libjars /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar 16 10000
> Number of Maps = 16
> Samples per Map = 10000
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 14/06/29 18:45:51 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> 14/06/29 18:45:52 INFO input.FileInputFormat: Total input paths to process : 16
> 14/06/29 18:45:52 INFO mapreduce.JobSubmitter: number of splits:16
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
> 14/06/29 18:45:53 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
> 14/06/29 18:45:53 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1404092671820_0001
> 14/06/29 18:45:54 INFO impl.YarnClientImpl: Submitted application application_1404092671820_0001 to ResourceManager at /0.0.0.0:8032
> 14/06/29 18:45:54 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1404092671820_0001/
> 14/06/29 18:45:54 INFO mapreduce.Job: Running job: job_1404092671820_0001
> 14/06/29 18:46:40 INFO mapreduce.Job: Job job_1404092671820_0001 running in uber mode : false
> 14/06/29 18:46:40 INFO mapreduce.Job: map 0% reduce 0%
> 14/06/29 18:50:40 INFO mapreduce.Job: map 13% reduce 0%
> 14/06/29 18:50:46 INFO mapreduce.Job: map 25% reduce 0%
> 14/06/29 18:50:49 INFO mapreduce.Job: map 38% reduce 0%
> 14/06/29 18:51:49 INFO mapreduce.Job: map 38% reduce 13%
> 14/06/29 18:51:54 INFO mapreduce.Job: map 44% reduce 13%
> 14/06/29 18:51:55 INFO mapreduce.Job: map 63% reduce 13%
> 14/06/29 18:51:56 INFO mapreduce.Job: map 63% reduce 21%
> 14/06/29 18:51:57 INFO mapreduce.Job: map 69% reduce 21%
> 14/06/29 18:51:59 INFO mapreduce.Job: map 69% reduce 23%
> 14/06/29 18:52:25 INFO mapreduce.Job: map 75% reduce 23%
> 14/06/29 18:52:27 INFO mapreduce.Job: map 100% reduce 23%
> 14/06/29 18:52:28 INFO mapreduce.Job: map 100% reduce 29%
> 14/06/29 18:52:29 INFO mapreduce.Job: map 100% reduce 100%
> 14/06/29 18:53:05 INFO mapreduce.Job: map 0% reduce 0%
> 14/06/29 18:53:05 INFO mapreduce.Job: Job job_1404092671820_0001 failed with state FAILED due to: Application application_1404092671820_0001 failed 2 times due to AM Container for appattempt_1404092671820_0001_000002 exited with exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> at org.apache.hadoop.util.Shell.run(Shell.java:379)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
> .Failing this attempt.. Failing the application.
> 14/06/29 18:53:05 INFO mapreduce.Job: Counters: 0
> Job Finished in 434.023 seconds
> Estimated value of Pi is 3.14127500000000000000
> [yarn@localhost sbin]$
> ---------------------------------------------------------------------------------------------------
> Confidentiality Notice: The information contained in this e-mail and any accompanying attachment(s)
> is intended only for the use of the intended recipient and may be confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader of this communication is
> not the intended recipient, unauthorized use, forwarding, printing, storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this communication in error,please
> immediately notify the sender by return e-mail, and delete the original message and all copies from
> your system. Thank you.
> ---------------------------------------------------------------------------------------------------
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: hadoop-mapreduce-examples-2.2.0 : Exception from container-launch
Posted by Li Lu <ll...@hortonworks.com>.
Hi Edward,
This is Li Lu from Hortonworks, and I’m looking into possible solutions and improvements to this confusing “Shell$ExitCodeException”. For now, one typical solution is to check the log on the NM where the container throws the exception. But some improvements could be made here. I’m wondering whether you have the access to the cluster information webpage, and whether your cluster’s log aggregator is enabled? If that’s the case then you can check the log out from the cluster’s webpage by clicking the “History” link of the application id, then “logs” of each attempt.
Best regards,
Li Lu
On Jun 29, 2014, at 7:24 PM, EdwardKing <zh...@neusoft.com> wrote:
> I run hadoop-mapreduce-examples-2.2.0.jar,it can get correct result,but it raise error "exitCode: 1 due to: Exception from container-launch". Why? How to solve it? Thanks.
>
> [yarn@localhost sbin]$ hadoop jar /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar pi -Dmapreduce.clientfactory.class.name=org.apache.hadoop.mapred.YarnClientFactory -libjars /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar 16 10000
> Number of Maps = 16
> Samples per Map = 10000
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 14/06/29 18:45:51 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> 14/06/29 18:45:52 INFO input.FileInputFormat: Total input paths to process : 16
> 14/06/29 18:45:52 INFO mapreduce.JobSubmitter: number of splits:16
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
> 14/06/29 18:45:53 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
> 14/06/29 18:45:53 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1404092671820_0001
> 14/06/29 18:45:54 INFO impl.YarnClientImpl: Submitted application application_1404092671820_0001 to ResourceManager at /0.0.0.0:8032
> 14/06/29 18:45:54 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1404092671820_0001/
> 14/06/29 18:45:54 INFO mapreduce.Job: Running job: job_1404092671820_0001
> 14/06/29 18:46:40 INFO mapreduce.Job: Job job_1404092671820_0001 running in uber mode : false
> 14/06/29 18:46:40 INFO mapreduce.Job: map 0% reduce 0%
> 14/06/29 18:50:40 INFO mapreduce.Job: map 13% reduce 0%
> 14/06/29 18:50:46 INFO mapreduce.Job: map 25% reduce 0%
> 14/06/29 18:50:49 INFO mapreduce.Job: map 38% reduce 0%
> 14/06/29 18:51:49 INFO mapreduce.Job: map 38% reduce 13%
> 14/06/29 18:51:54 INFO mapreduce.Job: map 44% reduce 13%
> 14/06/29 18:51:55 INFO mapreduce.Job: map 63% reduce 13%
> 14/06/29 18:51:56 INFO mapreduce.Job: map 63% reduce 21%
> 14/06/29 18:51:57 INFO mapreduce.Job: map 69% reduce 21%
> 14/06/29 18:51:59 INFO mapreduce.Job: map 69% reduce 23%
> 14/06/29 18:52:25 INFO mapreduce.Job: map 75% reduce 23%
> 14/06/29 18:52:27 INFO mapreduce.Job: map 100% reduce 23%
> 14/06/29 18:52:28 INFO mapreduce.Job: map 100% reduce 29%
> 14/06/29 18:52:29 INFO mapreduce.Job: map 100% reduce 100%
> 14/06/29 18:53:05 INFO mapreduce.Job: map 0% reduce 0%
> 14/06/29 18:53:05 INFO mapreduce.Job: Job job_1404092671820_0001 failed with state FAILED due to: Application application_1404092671820_0001 failed 2 times due to AM Container for appattempt_1404092671820_0001_000002 exited with exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> at org.apache.hadoop.util.Shell.run(Shell.java:379)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
> .Failing this attempt.. Failing the application.
> 14/06/29 18:53:05 INFO mapreduce.Job: Counters: 0
> Job Finished in 434.023 seconds
> Estimated value of Pi is 3.14127500000000000000
> [yarn@localhost sbin]$
> ---------------------------------------------------------------------------------------------------
> Confidentiality Notice: The information contained in this e-mail and any accompanying attachment(s)
> is intended only for the use of the intended recipient and may be confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader of this communication is
> not the intended recipient, unauthorized use, forwarding, printing, storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this communication in error,please
> immediately notify the sender by return e-mail, and delete the original message and all copies from
> your system. Thank you.
> ---------------------------------------------------------------------------------------------------
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: hadoop-mapreduce-examples-2.2.0 : Exception from container-launch
Posted by Li Lu <ll...@hortonworks.com>.
Hi Edward,
This is Li Lu from Hortonworks, and I’m looking into possible solutions and improvements to this confusing “Shell$ExitCodeException”. For now, one typical solution is to check the log on the NM where the container throws the exception. But some improvements could be made here. I’m wondering whether you have the access to the cluster information webpage, and whether your cluster’s log aggregator is enabled? If that’s the case then you can check the log out from the cluster’s webpage by clicking the “History” link of the application id, then “logs” of each attempt.
Best regards,
Li Lu
On Jun 29, 2014, at 7:24 PM, EdwardKing <zh...@neusoft.com> wrote:
> I run hadoop-mapreduce-examples-2.2.0.jar,it can get correct result,but it raise error "exitCode: 1 due to: Exception from container-launch". Why? How to solve it? Thanks.
>
> [yarn@localhost sbin]$ hadoop jar /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar pi -Dmapreduce.clientfactory.class.name=org.apache.hadoop.mapred.YarnClientFactory -libjars /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar 16 10000
> Number of Maps = 16
> Samples per Map = 10000
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 14/06/29 18:45:51 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> 14/06/29 18:45:52 INFO input.FileInputFormat: Total input paths to process : 16
> 14/06/29 18:45:52 INFO mapreduce.JobSubmitter: number of splits:16
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
> 14/06/29 18:45:53 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
> 14/06/29 18:45:53 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
> 14/06/29 18:45:53 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1404092671820_0001
> 14/06/29 18:45:54 INFO impl.YarnClientImpl: Submitted application application_1404092671820_0001 to ResourceManager at /0.0.0.0:8032
> 14/06/29 18:45:54 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1404092671820_0001/
> 14/06/29 18:45:54 INFO mapreduce.Job: Running job: job_1404092671820_0001
> 14/06/29 18:46:40 INFO mapreduce.Job: Job job_1404092671820_0001 running in uber mode : false
> 14/06/29 18:46:40 INFO mapreduce.Job: map 0% reduce 0%
> 14/06/29 18:50:40 INFO mapreduce.Job: map 13% reduce 0%
> 14/06/29 18:50:46 INFO mapreduce.Job: map 25% reduce 0%
> 14/06/29 18:50:49 INFO mapreduce.Job: map 38% reduce 0%
> 14/06/29 18:51:49 INFO mapreduce.Job: map 38% reduce 13%
> 14/06/29 18:51:54 INFO mapreduce.Job: map 44% reduce 13%
> 14/06/29 18:51:55 INFO mapreduce.Job: map 63% reduce 13%
> 14/06/29 18:51:56 INFO mapreduce.Job: map 63% reduce 21%
> 14/06/29 18:51:57 INFO mapreduce.Job: map 69% reduce 21%
> 14/06/29 18:51:59 INFO mapreduce.Job: map 69% reduce 23%
> 14/06/29 18:52:25 INFO mapreduce.Job: map 75% reduce 23%
> 14/06/29 18:52:27 INFO mapreduce.Job: map 100% reduce 23%
> 14/06/29 18:52:28 INFO mapreduce.Job: map 100% reduce 29%
> 14/06/29 18:52:29 INFO mapreduce.Job: map 100% reduce 100%
> 14/06/29 18:53:05 INFO mapreduce.Job: map 0% reduce 0%
> 14/06/29 18:53:05 INFO mapreduce.Job: Job job_1404092671820_0001 failed with state FAILED due to: Application application_1404092671820_0001 failed 2 times due to AM Container for appattempt_1404092671820_0001_000002 exited with exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> at org.apache.hadoop.util.Shell.run(Shell.java:379)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
> .Failing this attempt.. Failing the application.
> 14/06/29 18:53:05 INFO mapreduce.Job: Counters: 0
> Job Finished in 434.023 seconds
> Estimated value of Pi is 3.14127500000000000000
> [yarn@localhost sbin]$
> ---------------------------------------------------------------------------------------------------
> Confidentiality Notice: The information contained in this e-mail and any accompanying attachment(s)
> is intended only for the use of the intended recipient and may be confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader of this communication is
> not the intended recipient, unauthorized use, forwarding, printing, storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this communication in error,please
> immediately notify the sender by return e-mail, and delete the original message and all copies from
> your system. Thank you.
> ---------------------------------------------------------------------------------------------------
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.