You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by xeonmailinglist-gmail <xe...@gmail.com> on 2015/05/28 15:42:49 UTC

can't submit a job

Hi,

I am trying to launch a job that I have configured in in java, but I get 
an error related to the containers [1]. I don’t understand why I can’t 
submit the a job. Why get this error? What can I do to fix it?

Thanks,

[1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|

|15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032
15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job: http://192.168.56.101:9046/proxy/application_1432817967879_0003/
15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1432817967879_0003_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
         at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
         at org.apache.hadoop.util.Shell.run(Shell.java:455)
         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
         at java.lang.Thread.run(Thread.java:745)
|



-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

For this error, do I need to set |yarn.application.classpath|? If so, 
what should I put?

Any help for this question, please?

thanks,

On 05/28/2015 06:39 PM, xeonmailinglist-gmail wrote:

> Hi,
>
> But I still have a problem, and it is because I can’t launch a job. 
> After I launch |wordcount| example, I get the error [1]. After 
> inspecting the error, I have found this error in the job history [2], 
> and maybe this is the reason. So, I have looked to my |.bashrc| [3], 
> but it seems that everything is well configured. Thus, the question 
> remains. Why I can’t launch this job? Am I configuring something wrong?
>
> [1]
>
> |15/05/28 13:33:43 INFO mapreduce.Job: Job job_1432834333314_0002 failed with state FAILED due to: Application application_1432834333314_0002 failed 2 times due to AM Container for appattempt_1432834333314_0002_000002 exited with  exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432834333314_0002/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432834333314_0002_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>          at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>          at org.apache.hadoop.util.Shell.run(Shell.java:455)
>          at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>          at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>          at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>          at java.lang.Thread.run(Thread.java:745)
> |
>
> [2]
>
> |
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> |
>
> [3] .bashrc
>
> |export JAVA_HOME=/usr/lib/jvm/java-8-oracle
> export HADOOP_HOME=$HOME/Programs/hadoop
> export HADOOP_INSTALL=$HOME/Programs/hadoop
> export HADOOP_COMMON_HOME=$HADOOP_HOME
> export HADOOP_HDFS_HOME=$HADOOP_HOME
> export YARN_HOME=$HADOOP_HOME
> export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
>
> export PATH=$JAVA_HOME/bin:${HADOOP_INSTALL}/bin:${HADOOP_INSTALL}/sbin:$PATH
> |
>
> On 05/28/2015 04:13 PM, xeonmailinglist-gmail wrote:
>
>> I have found why I couldn’t access the container. I needed to have in 
>> |yarn-site.xml| the property:
>>
>> |<property> <name>yarn.log.server.url</name> <value>http://192.168.56.101:19888/jobhistory/logs/</value> </property>
>> |
>>
>> On 05/28/2015 04:01 PM, xeonmailinglist-gmail wrote:
>>
>>> If I click in the logs link, I get the error. So it seems that my 
>>> job isn't launching and the container aren't working. I need to fix 
>>> both errors. Any suggestion?
>>>
>>> ```
>>>
>>>
>>>   Failed redirect for container_1432817967879_0003_01_000001
>>>
>>>
>>>       ResourceManager
>>>
>>>   * RM Home <http://hadoop-coc-1:8088/>
>>>
>>>
>>>       NodeManager
>>>
>>>
>>>       Tools
>>>
>>> 	
>>>
>>>
>>>   Failed while trying to construct the redirect url to the log
>>>   server. Log Server url may not be configured
>>>
>>>
>>>   java.lang.Exception: Unknown container. Container either has not
>>>   started or has already completed or doesn't belong to this node at
>>>   all.
>>>
>>>
>>>
>>> ```
>>>
>>> On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>>>>
>>>> The error that I got is [1], but I still don’t understand why I get 
>>>> this error. I couldn’t find more detail about it. Any suggestion?
>>>>
>>>> [1]
>>>>
>>>> |
>>>> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
>>>> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>>> Diagnostics: Exception from container-launch.
>>>> Container id: container_1432817967879_0003_02_000001
>>>> Exit code: 1
>>>> Stack trace: ExitCodeException exitCode=1:
>>>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>>> at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>>> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> Container exited with a non-zero exit code 1
>>>> Failing this attempt. Failing the application.
>>>> |
>>>>
>>>> ———— Forwarded Message ————
>>>>
>>>> Subject: Re: can’t submit a job
>>>>
>>>> Date: Thu, 28 May 2015 07:48:46 -0700
>>>>
>>>> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>>>>
>>>> Reply-To: user@hadoop.apache.org
>>>>
>>>> To: common-user@hadoop.apache.org user@hadoop.apache.org 
>>>> <ht...@hadoop.apache.org>
>>>>
>>>> Have you checked the link 
>>>> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
>>>> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> 
>>>> ?
>>>> You should get come clue from logs of the 2 attempts.
>>>>
>>>> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
>>>> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
>>>> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
>>>> wrote:
>>>>
>>>>     Hi,
>>>>
>>>>     I am trying to launch a job that I have configured in in java,
>>>>     but I get an error related to the containers [1]. I don’t
>>>>     understand why I can’t submit the a job. Why get this error?
>>>>     What can I do to fix it?
>>>>
>>>>     Thanks,
>>>>
>>>>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>>>>
>>>>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>>>>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>>>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>>>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>>>>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>>>>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>>>>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>>>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>>>>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>>>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>>>>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>>>>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>>>     Diagnostics: Exception from container-launch.
>>>>     Container id: container_1432817967879_0003_02_000001
>>>>     Exit code: 1
>>>>     Stack trace: ExitCodeException exitCode=1:
>>>>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>>>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>>>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>>>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>>              at java.lang.Thread.run(Thread.java:745)
>>>>     |
>>>>
>>>>     
>>>>
>>>>     -- 
>>>>     --
>>>>
>>>> 
>>>
>>> -- 
>>> --
>> 
>> -- 
>> --
> 
> -- 
> --



-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

For this error, do I need to set |yarn.application.classpath|? If so, 
what should I put?

Any help for this question, please?

thanks,

On 05/28/2015 06:39 PM, xeonmailinglist-gmail wrote:

> Hi,
>
> But I still have a problem, and it is because I can’t launch a job. 
> After I launch |wordcount| example, I get the error [1]. After 
> inspecting the error, I have found this error in the job history [2], 
> and maybe this is the reason. So, I have looked to my |.bashrc| [3], 
> but it seems that everything is well configured. Thus, the question 
> remains. Why I can’t launch this job? Am I configuring something wrong?
>
> [1]
>
> |15/05/28 13:33:43 INFO mapreduce.Job: Job job_1432834333314_0002 failed with state FAILED due to: Application application_1432834333314_0002 failed 2 times due to AM Container for appattempt_1432834333314_0002_000002 exited with  exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432834333314_0002/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432834333314_0002_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>          at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>          at org.apache.hadoop.util.Shell.run(Shell.java:455)
>          at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>          at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>          at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>          at java.lang.Thread.run(Thread.java:745)
> |
>
> [2]
>
> |
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> |
>
> [3] .bashrc
>
> |export JAVA_HOME=/usr/lib/jvm/java-8-oracle
> export HADOOP_HOME=$HOME/Programs/hadoop
> export HADOOP_INSTALL=$HOME/Programs/hadoop
> export HADOOP_COMMON_HOME=$HADOOP_HOME
> export HADOOP_HDFS_HOME=$HADOOP_HOME
> export YARN_HOME=$HADOOP_HOME
> export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
>
> export PATH=$JAVA_HOME/bin:${HADOOP_INSTALL}/bin:${HADOOP_INSTALL}/sbin:$PATH
> |
>
> On 05/28/2015 04:13 PM, xeonmailinglist-gmail wrote:
>
>> I have found why I couldn’t access the container. I needed to have in 
>> |yarn-site.xml| the property:
>>
>> |<property> <name>yarn.log.server.url</name> <value>http://192.168.56.101:19888/jobhistory/logs/</value> </property>
>> |
>>
>> On 05/28/2015 04:01 PM, xeonmailinglist-gmail wrote:
>>
>>> If I click in the logs link, I get the error. So it seems that my 
>>> job isn't launching and the container aren't working. I need to fix 
>>> both errors. Any suggestion?
>>>
>>> ```
>>>
>>>
>>>   Failed redirect for container_1432817967879_0003_01_000001
>>>
>>>
>>>       ResourceManager
>>>
>>>   * RM Home <http://hadoop-coc-1:8088/>
>>>
>>>
>>>       NodeManager
>>>
>>>
>>>       Tools
>>>
>>> 	
>>>
>>>
>>>   Failed while trying to construct the redirect url to the log
>>>   server. Log Server url may not be configured
>>>
>>>
>>>   java.lang.Exception: Unknown container. Container either has not
>>>   started or has already completed or doesn't belong to this node at
>>>   all.
>>>
>>>
>>>
>>> ```
>>>
>>> On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>>>>
>>>> The error that I got is [1], but I still don’t understand why I get 
>>>> this error. I couldn’t find more detail about it. Any suggestion?
>>>>
>>>> [1]
>>>>
>>>> |
>>>> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
>>>> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>>> Diagnostics: Exception from container-launch.
>>>> Container id: container_1432817967879_0003_02_000001
>>>> Exit code: 1
>>>> Stack trace: ExitCodeException exitCode=1:
>>>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>>> at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>>> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> Container exited with a non-zero exit code 1
>>>> Failing this attempt. Failing the application.
>>>> |
>>>>
>>>> ———— Forwarded Message ————
>>>>
>>>> Subject: Re: can’t submit a job
>>>>
>>>> Date: Thu, 28 May 2015 07:48:46 -0700
>>>>
>>>> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>>>>
>>>> Reply-To: user@hadoop.apache.org
>>>>
>>>> To: common-user@hadoop.apache.org user@hadoop.apache.org 
>>>> <ht...@hadoop.apache.org>
>>>>
>>>> Have you checked the link 
>>>> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
>>>> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> 
>>>> ?
>>>> You should get come clue from logs of the 2 attempts.
>>>>
>>>> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
>>>> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
>>>> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
>>>> wrote:
>>>>
>>>>     Hi,
>>>>
>>>>     I am trying to launch a job that I have configured in in java,
>>>>     but I get an error related to the containers [1]. I don’t
>>>>     understand why I can’t submit the a job. Why get this error?
>>>>     What can I do to fix it?
>>>>
>>>>     Thanks,
>>>>
>>>>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>>>>
>>>>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>>>>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>>>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>>>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>>>>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>>>>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>>>>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>>>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>>>>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>>>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>>>>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>>>>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>>>     Diagnostics: Exception from container-launch.
>>>>     Container id: container_1432817967879_0003_02_000001
>>>>     Exit code: 1
>>>>     Stack trace: ExitCodeException exitCode=1:
>>>>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>>>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>>>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>>>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>>              at java.lang.Thread.run(Thread.java:745)
>>>>     |
>>>>
>>>>     
>>>>
>>>>     -- 
>>>>     --
>>>>
>>>> 
>>>
>>> -- 
>>> --
>> 
>> -- 
>> --
> 
> -- 
> --



-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

For this error, do I need to set |yarn.application.classpath|? If so, 
what should I put?

Any help for this question, please?

thanks,

On 05/28/2015 06:39 PM, xeonmailinglist-gmail wrote:

> Hi,
>
> But I still have a problem, and it is because I can’t launch a job. 
> After I launch |wordcount| example, I get the error [1]. After 
> inspecting the error, I have found this error in the job history [2], 
> and maybe this is the reason. So, I have looked to my |.bashrc| [3], 
> but it seems that everything is well configured. Thus, the question 
> remains. Why I can’t launch this job? Am I configuring something wrong?
>
> [1]
>
> |15/05/28 13:33:43 INFO mapreduce.Job: Job job_1432834333314_0002 failed with state FAILED due to: Application application_1432834333314_0002 failed 2 times due to AM Container for appattempt_1432834333314_0002_000002 exited with  exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432834333314_0002/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432834333314_0002_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>          at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>          at org.apache.hadoop.util.Shell.run(Shell.java:455)
>          at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>          at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>          at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>          at java.lang.Thread.run(Thread.java:745)
> |
>
> [2]
>
> |
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> |
>
> [3] .bashrc
>
> |export JAVA_HOME=/usr/lib/jvm/java-8-oracle
> export HADOOP_HOME=$HOME/Programs/hadoop
> export HADOOP_INSTALL=$HOME/Programs/hadoop
> export HADOOP_COMMON_HOME=$HADOOP_HOME
> export HADOOP_HDFS_HOME=$HADOOP_HOME
> export YARN_HOME=$HADOOP_HOME
> export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
>
> export PATH=$JAVA_HOME/bin:${HADOOP_INSTALL}/bin:${HADOOP_INSTALL}/sbin:$PATH
> |
>
> On 05/28/2015 04:13 PM, xeonmailinglist-gmail wrote:
>
>> I have found why I couldn’t access the container. I needed to have in 
>> |yarn-site.xml| the property:
>>
>> |<property> <name>yarn.log.server.url</name> <value>http://192.168.56.101:19888/jobhistory/logs/</value> </property>
>> |
>>
>> On 05/28/2015 04:01 PM, xeonmailinglist-gmail wrote:
>>
>>> If I click in the logs link, I get the error. So it seems that my 
>>> job isn't launching and the container aren't working. I need to fix 
>>> both errors. Any suggestion?
>>>
>>> ```
>>>
>>>
>>>   Failed redirect for container_1432817967879_0003_01_000001
>>>
>>>
>>>       ResourceManager
>>>
>>>   * RM Home <http://hadoop-coc-1:8088/>
>>>
>>>
>>>       NodeManager
>>>
>>>
>>>       Tools
>>>
>>> 	
>>>
>>>
>>>   Failed while trying to construct the redirect url to the log
>>>   server. Log Server url may not be configured
>>>
>>>
>>>   java.lang.Exception: Unknown container. Container either has not
>>>   started or has already completed or doesn't belong to this node at
>>>   all.
>>>
>>>
>>>
>>> ```
>>>
>>> On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>>>>
>>>> The error that I got is [1], but I still don’t understand why I get 
>>>> this error. I couldn’t find more detail about it. Any suggestion?
>>>>
>>>> [1]
>>>>
>>>> |
>>>> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
>>>> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>>> Diagnostics: Exception from container-launch.
>>>> Container id: container_1432817967879_0003_02_000001
>>>> Exit code: 1
>>>> Stack trace: ExitCodeException exitCode=1:
>>>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>>> at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>>> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> Container exited with a non-zero exit code 1
>>>> Failing this attempt. Failing the application.
>>>> |
>>>>
>>>> ———— Forwarded Message ————
>>>>
>>>> Subject: Re: can’t submit a job
>>>>
>>>> Date: Thu, 28 May 2015 07:48:46 -0700
>>>>
>>>> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>>>>
>>>> Reply-To: user@hadoop.apache.org
>>>>
>>>> To: common-user@hadoop.apache.org user@hadoop.apache.org 
>>>> <ht...@hadoop.apache.org>
>>>>
>>>> Have you checked the link 
>>>> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
>>>> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> 
>>>> ?
>>>> You should get come clue from logs of the 2 attempts.
>>>>
>>>> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
>>>> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
>>>> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
>>>> wrote:
>>>>
>>>>     Hi,
>>>>
>>>>     I am trying to launch a job that I have configured in in java,
>>>>     but I get an error related to the containers [1]. I don’t
>>>>     understand why I can’t submit the a job. Why get this error?
>>>>     What can I do to fix it?
>>>>
>>>>     Thanks,
>>>>
>>>>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>>>>
>>>>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>>>>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>>>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>>>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>>>>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>>>>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>>>>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>>>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>>>>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>>>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>>>>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>>>>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>>>     Diagnostics: Exception from container-launch.
>>>>     Container id: container_1432817967879_0003_02_000001
>>>>     Exit code: 1
>>>>     Stack trace: ExitCodeException exitCode=1:
>>>>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>>>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>>>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>>>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>>              at java.lang.Thread.run(Thread.java:745)
>>>>     |
>>>>
>>>>     
>>>>
>>>>     -- 
>>>>     --
>>>>
>>>> 
>>>
>>> -- 
>>> --
>> 
>> -- 
>> --
> 
> -- 
> --



-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

For this error, do I need to set |yarn.application.classpath|? If so, 
what should I put?

Any help for this question, please?

thanks,

On 05/28/2015 06:39 PM, xeonmailinglist-gmail wrote:

> Hi,
>
> But I still have a problem, and it is because I can’t launch a job. 
> After I launch |wordcount| example, I get the error [1]. After 
> inspecting the error, I have found this error in the job history [2], 
> and maybe this is the reason. So, I have looked to my |.bashrc| [3], 
> but it seems that everything is well configured. Thus, the question 
> remains. Why I can’t launch this job? Am I configuring something wrong?
>
> [1]
>
> |15/05/28 13:33:43 INFO mapreduce.Job: Job job_1432834333314_0002 failed with state FAILED due to: Application application_1432834333314_0002 failed 2 times due to AM Container for appattempt_1432834333314_0002_000002 exited with  exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432834333314_0002/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432834333314_0002_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>          at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>          at org.apache.hadoop.util.Shell.run(Shell.java:455)
>          at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>          at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>          at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>          at java.lang.Thread.run(Thread.java:745)
> |
>
> [2]
>
> |
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> |
>
> [3] .bashrc
>
> |export JAVA_HOME=/usr/lib/jvm/java-8-oracle
> export HADOOP_HOME=$HOME/Programs/hadoop
> export HADOOP_INSTALL=$HOME/Programs/hadoop
> export HADOOP_COMMON_HOME=$HADOOP_HOME
> export HADOOP_HDFS_HOME=$HADOOP_HOME
> export YARN_HOME=$HADOOP_HOME
> export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
>
> export PATH=$JAVA_HOME/bin:${HADOOP_INSTALL}/bin:${HADOOP_INSTALL}/sbin:$PATH
> |
>
> On 05/28/2015 04:13 PM, xeonmailinglist-gmail wrote:
>
>> I have found why I couldn’t access the container. I needed to have in 
>> |yarn-site.xml| the property:
>>
>> |<property> <name>yarn.log.server.url</name> <value>http://192.168.56.101:19888/jobhistory/logs/</value> </property>
>> |
>>
>> On 05/28/2015 04:01 PM, xeonmailinglist-gmail wrote:
>>
>>> If I click in the logs link, I get the error. So it seems that my 
>>> job isn't launching and the container aren't working. I need to fix 
>>> both errors. Any suggestion?
>>>
>>> ```
>>>
>>>
>>>   Failed redirect for container_1432817967879_0003_01_000001
>>>
>>>
>>>       ResourceManager
>>>
>>>   * RM Home <http://hadoop-coc-1:8088/>
>>>
>>>
>>>       NodeManager
>>>
>>>
>>>       Tools
>>>
>>> 	
>>>
>>>
>>>   Failed while trying to construct the redirect url to the log
>>>   server. Log Server url may not be configured
>>>
>>>
>>>   java.lang.Exception: Unknown container. Container either has not
>>>   started or has already completed or doesn't belong to this node at
>>>   all.
>>>
>>>
>>>
>>> ```
>>>
>>> On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>>>>
>>>> The error that I got is [1], but I still don’t understand why I get 
>>>> this error. I couldn’t find more detail about it. Any suggestion?
>>>>
>>>> [1]
>>>>
>>>> |
>>>> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
>>>> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>>> Diagnostics: Exception from container-launch.
>>>> Container id: container_1432817967879_0003_02_000001
>>>> Exit code: 1
>>>> Stack trace: ExitCodeException exitCode=1:
>>>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>>> at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>>> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> Container exited with a non-zero exit code 1
>>>> Failing this attempt. Failing the application.
>>>> |
>>>>
>>>> ———— Forwarded Message ————
>>>>
>>>> Subject: Re: can’t submit a job
>>>>
>>>> Date: Thu, 28 May 2015 07:48:46 -0700
>>>>
>>>> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>>>>
>>>> Reply-To: user@hadoop.apache.org
>>>>
>>>> To: common-user@hadoop.apache.org user@hadoop.apache.org 
>>>> <ht...@hadoop.apache.org>
>>>>
>>>> Have you checked the link 
>>>> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
>>>> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> 
>>>> ?
>>>> You should get come clue from logs of the 2 attempts.
>>>>
>>>> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
>>>> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
>>>> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
>>>> wrote:
>>>>
>>>>     Hi,
>>>>
>>>>     I am trying to launch a job that I have configured in in java,
>>>>     but I get an error related to the containers [1]. I don’t
>>>>     understand why I can’t submit the a job. Why get this error?
>>>>     What can I do to fix it?
>>>>
>>>>     Thanks,
>>>>
>>>>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>>>>
>>>>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>>>>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>>>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>>>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>>>>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>>>>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>>>>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>>>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>>>>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>>>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>>>>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>>>>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>>>     Diagnostics: Exception from container-launch.
>>>>     Container id: container_1432817967879_0003_02_000001
>>>>     Exit code: 1
>>>>     Stack trace: ExitCodeException exitCode=1:
>>>>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>>>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>>>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>>>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>>              at java.lang.Thread.run(Thread.java:745)
>>>>     |
>>>>
>>>>     
>>>>
>>>>     -- 
>>>>     --
>>>>
>>>> 
>>>
>>> -- 
>>> --
>> 
>> -- 
>> --
> 
> -- 
> --



-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

I have found why I couldn’t access the container. I needed to have in 
|yarn-site.xml| the property:

|<property> <name>yarn.log.server.url</name> <value>http://192.168.56.101:19888/jobhistory/logs/</value> </property>
|

On 05/28/2015 04:01 PM, xeonmailinglist-gmail wrote:

> If I click in the logs link, I get the error. So it seems that my job 
> isn't launching and the container aren't working. I need to fix both 
> errors. Any suggestion?
>
> ```
>
>
>   Failed redirect for container_1432817967879_0003_01_000001
>
>
>       ResourceManager
>
>   * RM Home <http://hadoop-coc-1:8088/>
>
>
>       NodeManager
>
>
>       Tools
>
> 	
>
>
>   Failed while trying to construct the redirect url to the log server.
>   Log Server url may not be configured
>
>
>   java.lang.Exception: Unknown container. Container either has not
>   started or has already completed or doesn't belong to this node at all.
>
>
>
> ```
>
> On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>>
>> The error that I got is [1], but I still don’t understand why I get 
>> this error. I couldn’t find more detail about it. Any suggestion?
>>
>> [1]
>>
>> |
>> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
>> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>> Diagnostics: Exception from container-launch.
>> Container id: container_1432817967879_0003_02_000001
>> Exit code: 1
>> Stack trace: ExitCodeException exitCode=1:
>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>> at org.apache.hadoop.util.Shell.run(Shell.java:455)
>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> at java.lang.Thread.run(Thread.java:745)
>> Container exited with a non-zero exit code 1
>> Failing this attempt. Failing the application.
>> |
>>
>> ———— Forwarded Message ————
>>
>> Subject: Re: can’t submit a job
>>
>> Date: Thu, 28 May 2015 07:48:46 -0700
>>
>> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>>
>> Reply-To: user@hadoop.apache.org
>>
>> To: common-user@hadoop.apache.org user@hadoop.apache.org 
>> <ht...@hadoop.apache.org>
>>
>> Have you checked the link 
>> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
>> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
>> You should get come clue from logs of the 2 attempts.
>>
>> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
>> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
>> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
>> wrote:
>>
>>     Hi,
>>
>>     I am trying to launch a job that I have configured in in java,
>>     but I get an error related to the containers [1]. I don’t
>>     understand why I can’t submit the a job. Why get this error? What
>>     can I do to fix it?
>>
>>     Thanks,
>>
>>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>>
>>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>     Diagnostics: Exception from container-launch.
>>     Container id: container_1432817967879_0003_02_000001
>>     Exit code: 1
>>     Stack trace: ExitCodeException exitCode=1:
>>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>              at java.lang.Thread.run(Thread.java:745)
>>     |
>>
>>     
>>
>>     -- 
>>     --
>>
>> 
>
> -- 
> --



-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

I have found why I couldn’t access the container. I needed to have in 
|yarn-site.xml| the property:

|<property> <name>yarn.log.server.url</name> <value>http://192.168.56.101:19888/jobhistory/logs/</value> </property>
|

On 05/28/2015 04:01 PM, xeonmailinglist-gmail wrote:

> If I click in the logs link, I get the error. So it seems that my job 
> isn't launching and the container aren't working. I need to fix both 
> errors. Any suggestion?
>
> ```
>
>
>   Failed redirect for container_1432817967879_0003_01_000001
>
>
>       ResourceManager
>
>   * RM Home <http://hadoop-coc-1:8088/>
>
>
>       NodeManager
>
>
>       Tools
>
> 	
>
>
>   Failed while trying to construct the redirect url to the log server.
>   Log Server url may not be configured
>
>
>   java.lang.Exception: Unknown container. Container either has not
>   started or has already completed or doesn't belong to this node at all.
>
>
>
> ```
>
> On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>>
>> The error that I got is [1], but I still don’t understand why I get 
>> this error. I couldn’t find more detail about it. Any suggestion?
>>
>> [1]
>>
>> |
>> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
>> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>> Diagnostics: Exception from container-launch.
>> Container id: container_1432817967879_0003_02_000001
>> Exit code: 1
>> Stack trace: ExitCodeException exitCode=1:
>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>> at org.apache.hadoop.util.Shell.run(Shell.java:455)
>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> at java.lang.Thread.run(Thread.java:745)
>> Container exited with a non-zero exit code 1
>> Failing this attempt. Failing the application.
>> |
>>
>> ———— Forwarded Message ————
>>
>> Subject: Re: can’t submit a job
>>
>> Date: Thu, 28 May 2015 07:48:46 -0700
>>
>> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>>
>> Reply-To: user@hadoop.apache.org
>>
>> To: common-user@hadoop.apache.org user@hadoop.apache.org 
>> <ht...@hadoop.apache.org>
>>
>> Have you checked the link 
>> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
>> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
>> You should get come clue from logs of the 2 attempts.
>>
>> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
>> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
>> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
>> wrote:
>>
>>     Hi,
>>
>>     I am trying to launch a job that I have configured in in java,
>>     but I get an error related to the containers [1]. I don’t
>>     understand why I can’t submit the a job. Why get this error? What
>>     can I do to fix it?
>>
>>     Thanks,
>>
>>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>>
>>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>     Diagnostics: Exception from container-launch.
>>     Container id: container_1432817967879_0003_02_000001
>>     Exit code: 1
>>     Stack trace: ExitCodeException exitCode=1:
>>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>              at java.lang.Thread.run(Thread.java:745)
>>     |
>>
>>     
>>
>>     -- 
>>     --
>>
>> 
>
> -- 
> --



-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

I have found why I couldn’t access the container. I needed to have in 
|yarn-site.xml| the property:

|<property> <name>yarn.log.server.url</name> <value>http://192.168.56.101:19888/jobhistory/logs/</value> </property>
|

On 05/28/2015 04:01 PM, xeonmailinglist-gmail wrote:

> If I click in the logs link, I get the error. So it seems that my job 
> isn't launching and the container aren't working. I need to fix both 
> errors. Any suggestion?
>
> ```
>
>
>   Failed redirect for container_1432817967879_0003_01_000001
>
>
>       ResourceManager
>
>   * RM Home <http://hadoop-coc-1:8088/>
>
>
>       NodeManager
>
>
>       Tools
>
> 	
>
>
>   Failed while trying to construct the redirect url to the log server.
>   Log Server url may not be configured
>
>
>   java.lang.Exception: Unknown container. Container either has not
>   started or has already completed or doesn't belong to this node at all.
>
>
>
> ```
>
> On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>>
>> The error that I got is [1], but I still don’t understand why I get 
>> this error. I couldn’t find more detail about it. Any suggestion?
>>
>> [1]
>>
>> |
>> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
>> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>> Diagnostics: Exception from container-launch.
>> Container id: container_1432817967879_0003_02_000001
>> Exit code: 1
>> Stack trace: ExitCodeException exitCode=1:
>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>> at org.apache.hadoop.util.Shell.run(Shell.java:455)
>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> at java.lang.Thread.run(Thread.java:745)
>> Container exited with a non-zero exit code 1
>> Failing this attempt. Failing the application.
>> |
>>
>> ———— Forwarded Message ————
>>
>> Subject: Re: can’t submit a job
>>
>> Date: Thu, 28 May 2015 07:48:46 -0700
>>
>> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>>
>> Reply-To: user@hadoop.apache.org
>>
>> To: common-user@hadoop.apache.org user@hadoop.apache.org 
>> <ht...@hadoop.apache.org>
>>
>> Have you checked the link 
>> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
>> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
>> You should get come clue from logs of the 2 attempts.
>>
>> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
>> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
>> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
>> wrote:
>>
>>     Hi,
>>
>>     I am trying to launch a job that I have configured in in java,
>>     but I get an error related to the containers [1]. I don’t
>>     understand why I can’t submit the a job. Why get this error? What
>>     can I do to fix it?
>>
>>     Thanks,
>>
>>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>>
>>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>     Diagnostics: Exception from container-launch.
>>     Container id: container_1432817967879_0003_02_000001
>>     Exit code: 1
>>     Stack trace: ExitCodeException exitCode=1:
>>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>              at java.lang.Thread.run(Thread.java:745)
>>     |
>>
>>     
>>
>>     -- 
>>     --
>>
>> 
>
> -- 
> --



-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

I have found why I couldn’t access the container. I needed to have in 
|yarn-site.xml| the property:

|<property> <name>yarn.log.server.url</name> <value>http://192.168.56.101:19888/jobhistory/logs/</value> </property>
|

On 05/28/2015 04:01 PM, xeonmailinglist-gmail wrote:

> If I click in the logs link, I get the error. So it seems that my job 
> isn't launching and the container aren't working. I need to fix both 
> errors. Any suggestion?
>
> ```
>
>
>   Failed redirect for container_1432817967879_0003_01_000001
>
>
>       ResourceManager
>
>   * RM Home <http://hadoop-coc-1:8088/>
>
>
>       NodeManager
>
>
>       Tools
>
> 	
>
>
>   Failed while trying to construct the redirect url to the log server.
>   Log Server url may not be configured
>
>
>   java.lang.Exception: Unknown container. Container either has not
>   started or has already completed or doesn't belong to this node at all.
>
>
>
> ```
>
> On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>>
>> The error that I got is [1], but I still don’t understand why I get 
>> this error. I couldn’t find more detail about it. Any suggestion?
>>
>> [1]
>>
>> |
>> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
>> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>> Diagnostics: Exception from container-launch.
>> Container id: container_1432817967879_0003_02_000001
>> Exit code: 1
>> Stack trace: ExitCodeException exitCode=1:
>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>> at org.apache.hadoop.util.Shell.run(Shell.java:455)
>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> at java.lang.Thread.run(Thread.java:745)
>> Container exited with a non-zero exit code 1
>> Failing this attempt. Failing the application.
>> |
>>
>> ———— Forwarded Message ————
>>
>> Subject: Re: can’t submit a job
>>
>> Date: Thu, 28 May 2015 07:48:46 -0700
>>
>> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>>
>> Reply-To: user@hadoop.apache.org
>>
>> To: common-user@hadoop.apache.org user@hadoop.apache.org 
>> <ht...@hadoop.apache.org>
>>
>> Have you checked the link 
>> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
>> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
>> You should get come clue from logs of the 2 attempts.
>>
>> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
>> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
>> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
>> wrote:
>>
>>     Hi,
>>
>>     I am trying to launch a job that I have configured in in java,
>>     but I get an error related to the containers [1]. I don’t
>>     understand why I can’t submit the a job. Why get this error? What
>>     can I do to fix it?
>>
>>     Thanks,
>>
>>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>>
>>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>>     Diagnostics: Exception from container-launch.
>>     Container id: container_1432817967879_0003_02_000001
>>     Exit code: 1
>>     Stack trace: ExitCodeException exitCode=1:
>>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>              at java.lang.Thread.run(Thread.java:745)
>>     |
>>
>>     
>>
>>     -- 
>>     --
>>
>> 
>
> -- 
> --



-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

If I click in the logs link, I get the error. So it seems that my job 
isn't launching and the container aren't working. I need to fix both 
errors. Any suggestion?

```


  Failed redirect for container_1432817967879_0003_01_000001


      ResourceManager

  * RM Home <http://hadoop-coc-1:8088/>


      NodeManager


      Tools

	


  Failed while trying to construct the redirect url to the log server.
  Log Server url may not be configured


  java.lang.Exception: Unknown container. Container either has not
  started or has already completed or doesn't belong to this node at all.



```

On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>
> The error that I got is [1], but I still don’t understand why I get 
> this error. I couldn’t find more detail about it. Any suggestion?
>
> [1]
>
> |
> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432817967879_0003_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1
> Failing this attempt. Failing the application.
> |
>
> ———— Forwarded Message ————
>
> Subject: Re: can’t submit a job
>
> Date: Thu, 28 May 2015 07:48:46 -0700
>
> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>
> Reply-To: user@hadoop.apache.org
>
> To: common-user@hadoop.apache.org user@hadoop.apache.org 
> <ht...@hadoop.apache.org>
>
> Have you checked the link 
> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
> You should get come clue from logs of the 2 attempts.
>
> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
> wrote:
>
>     Hi,
>
>     I am trying to launch a job that I have configured in in java, but
>     I get an error related to the containers [1]. I don’t understand
>     why I can’t submit the a job. Why get this error? What can I do to
>     fix it?
>
>     Thanks,
>
>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>
>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>     Diagnostics: Exception from container-launch.
>     Container id: container_1432817967879_0003_02_000001
>     Exit code: 1
>     Stack trace: ExitCodeException exitCode=1:
>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>              at java.lang.Thread.run(Thread.java:745)
>     |
>
>     
>
>     -- 
>     --
>
> 

-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

If I click in the logs link, I get the error. So it seems that my job 
isn't launching and the container aren't working. I need to fix both 
errors. Any suggestion?

```


  Failed redirect for container_1432817967879_0003_01_000001


      ResourceManager

  * RM Home <http://hadoop-coc-1:8088/>


      NodeManager


      Tools

	


  Failed while trying to construct the redirect url to the log server.
  Log Server url may not be configured


  java.lang.Exception: Unknown container. Container either has not
  started or has already completed or doesn't belong to this node at all.



```

On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>
> The error that I got is [1], but I still don’t understand why I get 
> this error. I couldn’t find more detail about it. Any suggestion?
>
> [1]
>
> |
> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432817967879_0003_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1
> Failing this attempt. Failing the application.
> |
>
> ———— Forwarded Message ————
>
> Subject: Re: can’t submit a job
>
> Date: Thu, 28 May 2015 07:48:46 -0700
>
> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>
> Reply-To: user@hadoop.apache.org
>
> To: common-user@hadoop.apache.org user@hadoop.apache.org 
> <ht...@hadoop.apache.org>
>
> Have you checked the link 
> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
> You should get come clue from logs of the 2 attempts.
>
> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
> wrote:
>
>     Hi,
>
>     I am trying to launch a job that I have configured in in java, but
>     I get an error related to the containers [1]. I don’t understand
>     why I can’t submit the a job. Why get this error? What can I do to
>     fix it?
>
>     Thanks,
>
>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>
>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>     Diagnostics: Exception from container-launch.
>     Container id: container_1432817967879_0003_02_000001
>     Exit code: 1
>     Stack trace: ExitCodeException exitCode=1:
>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>              at java.lang.Thread.run(Thread.java:745)
>     |
>
>     
>
>     -- 
>     --
>
> 

-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

If I click in the logs link, I get the error. So it seems that my job 
isn't launching and the container aren't working. I need to fix both 
errors. Any suggestion?

```


  Failed redirect for container_1432817967879_0003_01_000001


      ResourceManager

  * RM Home <http://hadoop-coc-1:8088/>


      NodeManager


      Tools

	


  Failed while trying to construct the redirect url to the log server.
  Log Server url may not be configured


  java.lang.Exception: Unknown container. Container either has not
  started or has already completed or doesn't belong to this node at all.



```

On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>
> The error that I got is [1], but I still don’t understand why I get 
> this error. I couldn’t find more detail about it. Any suggestion?
>
> [1]
>
> |
> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432817967879_0003_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1
> Failing this attempt. Failing the application.
> |
>
> ———— Forwarded Message ————
>
> Subject: Re: can’t submit a job
>
> Date: Thu, 28 May 2015 07:48:46 -0700
>
> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>
> Reply-To: user@hadoop.apache.org
>
> To: common-user@hadoop.apache.org user@hadoop.apache.org 
> <ht...@hadoop.apache.org>
>
> Have you checked the link 
> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
> You should get come clue from logs of the 2 attempts.
>
> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
> wrote:
>
>     Hi,
>
>     I am trying to launch a job that I have configured in in java, but
>     I get an error related to the containers [1]. I don’t understand
>     why I can’t submit the a job. Why get this error? What can I do to
>     fix it?
>
>     Thanks,
>
>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>
>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>     Diagnostics: Exception from container-launch.
>     Container id: container_1432817967879_0003_02_000001
>     Exit code: 1
>     Stack trace: ExitCodeException exitCode=1:
>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>              at java.lang.Thread.run(Thread.java:745)
>     |
>
>     
>
>     -- 
>     --
>
> 

-- 
--

Re: Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

If I click in the logs link, I get the error. So it seems that my job 
isn't launching and the container aren't working. I need to fix both 
errors. Any suggestion?

```


  Failed redirect for container_1432817967879_0003_01_000001


      ResourceManager

  * RM Home <http://hadoop-coc-1:8088/>


      NodeManager


      Tools

	


  Failed while trying to construct the redirect url to the log server.
  Log Server url may not be configured


  java.lang.Exception: Unknown container. Container either has not
  started or has already completed or doesn't belong to this node at all.



```

On 05/28/2015 03:59 PM, xeonmailinglist-gmail wrote:
>
> The error that I got is [1], but I still don’t understand why I get 
> this error. I couldn’t find more detail about it. Any suggestion?
>
> [1]
>
> |
> Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432817967879_0003_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1
> Failing this attempt. Failing the application.
> |
>
> ———— Forwarded Message ————
>
> Subject: Re: can’t submit a job
>
> Date: Thu, 28 May 2015 07:48:46 -0700
>
> From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>
>
> Reply-To: user@hadoop.apache.org
>
> To: common-user@hadoop.apache.org user@hadoop.apache.org 
> <ht...@hadoop.apache.org>
>
> Have you checked the link 
> http://192.168.56.101:9046/proxy/application_1432817967879_0003 
> <http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
> You should get come clue from logs of the 2 attempts.
>
> On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
> [xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
> <http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
> wrote:
>
>     Hi,
>
>     I am trying to launch a job that I have configured in in java, but
>     I get an error related to the containers [1]. I don’t understand
>     why I can’t submit the a job. Why get this error? What can I do to
>     fix it?
>
>     Thanks,
>
>     [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|
>
>     |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
>     15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
>     15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
>     15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
>     15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
>     15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
>     15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
>     15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
>     ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
>     For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
>     Diagnostics: Exception from container-launch.
>     Container id: container_1432817967879_0003_02_000001
>     Exit code: 1
>     Stack trace: ExitCodeException exitCode=1:
>              at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>              at org.apache.hadoop.util.Shell.run(Shell.java:455)
>              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>              at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>              at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>              at java.lang.Thread.run(Thread.java:745)
>     |
>
>     
>
>     -- 
>     --
>
> 

-- 
--

Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

The error that I got is [1], but I still don’t understand why I get this 
error. I couldn’t find more detail about it. Any suggestion?

[1]

|
Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1432817967879_0003_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
|

———— Forwarded Message ————

Subject: Re: can’t submit a job

Date: Thu, 28 May 2015 07:48:46 -0700

From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>

Reply-To: user@hadoop.apache.org

To: common-user@hadoop.apache.org user@hadoop.apache.org 
<ht...@hadoop.apache.org>

Have you checked the link 
http://192.168.56.101:9046/proxy/application_1432817967879_0003 
<http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
You should get come clue from logs of the 2 attempts.

On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
[xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
<http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
wrote:

    Hi,

    I am trying to launch a job that I have configured in in java, but I
    get an error related to the containers [1]. I don’t understand why I
    can’t submit the a job. Why get this error? What can I do to fix it?

    Thanks,

    [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|

    |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
    15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
    15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
    15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
    15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
    15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
    15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
    15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
    15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
    15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
    ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
    For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
    Diagnostics: Exception from container-launch.
    Container id: container_1432817967879_0003_02_000001
    Exit code: 1
    Stack trace: ExitCodeException exitCode=1:
             at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
             at org.apache.hadoop.util.Shell.run(Shell.java:455)
             at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
             at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
             at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
             at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
             at java.util.concurrent.FutureTask.run(FutureTask.java:266)
             at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
             at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
             at java.lang.Thread.run(Thread.java:745)
    |

    

    -- 
    --

Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

The error that I got is [1], but I still don’t understand why I get this 
error. I couldn’t find more detail about it. Any suggestion?

[1]

|
Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1432817967879_0003_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
|

———— Forwarded Message ————

Subject: Re: can’t submit a job

Date: Thu, 28 May 2015 07:48:46 -0700

From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>

Reply-To: user@hadoop.apache.org

To: common-user@hadoop.apache.org user@hadoop.apache.org 
<ht...@hadoop.apache.org>

Have you checked the link 
http://192.168.56.101:9046/proxy/application_1432817967879_0003 
<http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
You should get come clue from logs of the 2 attempts.

On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
[xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
<http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
wrote:

    Hi,

    I am trying to launch a job that I have configured in in java, but I
    get an error related to the containers [1]. I don’t understand why I
    can’t submit the a job. Why get this error? What can I do to fix it?

    Thanks,

    [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|

    |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
    15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
    15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
    15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
    15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
    15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
    15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
    15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
    15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
    15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
    ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
    For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
    Diagnostics: Exception from container-launch.
    Container id: container_1432817967879_0003_02_000001
    Exit code: 1
    Stack trace: ExitCodeException exitCode=1:
             at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
             at org.apache.hadoop.util.Shell.run(Shell.java:455)
             at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
             at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
             at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
             at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
             at java.util.concurrent.FutureTask.run(FutureTask.java:266)
             at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
             at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
             at java.lang.Thread.run(Thread.java:745)
    |

    

    -- 
    --

Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

The error that I got is [1], but I still don’t understand why I get this 
error. I couldn’t find more detail about it. Any suggestion?

[1]

|
Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1432817967879_0003_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
|

———— Forwarded Message ————

Subject: Re: can’t submit a job

Date: Thu, 28 May 2015 07:48:46 -0700

From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>

Reply-To: user@hadoop.apache.org

To: common-user@hadoop.apache.org user@hadoop.apache.org 
<ht...@hadoop.apache.org>

Have you checked the link 
http://192.168.56.101:9046/proxy/application_1432817967879_0003 
<http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
You should get come clue from logs of the 2 attempts.

On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
[xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
<http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
wrote:

    Hi,

    I am trying to launch a job that I have configured in in java, but I
    get an error related to the containers [1]. I don’t understand why I
    can’t submit the a job. Why get this error? What can I do to fix it?

    Thanks,

    [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|

    |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
    15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
    15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
    15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
    15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
    15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
    15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
    15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
    15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
    15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
    ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
    For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
    Diagnostics: Exception from container-launch.
    Container id: container_1432817967879_0003_02_000001
    Exit code: 1
    Stack trace: ExitCodeException exitCode=1:
             at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
             at org.apache.hadoop.util.Shell.run(Shell.java:455)
             at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
             at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
             at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
             at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
             at java.util.concurrent.FutureTask.run(FutureTask.java:266)
             at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
             at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
             at java.lang.Thread.run(Thread.java:745)
    |

    

    -- 
    --

Fwd: Re: can't submit a job

Posted by xeonmailinglist-gmail <xe...@gmail.com>.

The error that I got is [1], but I still don’t understand why I get this 
error. I couldn’t find more detail about it. Any suggestion?

[1]

|
Application application_1432817967879_0003 failed 2 times due to AM Container for appattempt_1432817967879_0003_000002 exited with exitCode: 1
For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1432817967879_0003_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
|

———— Forwarded Message ————

Subject: Re: can’t submit a job

Date: Thu, 28 May 2015 07:48:46 -0700

From: Ted Yu yuzhihong@gmail.com <ht...@gmail.com>

Reply-To: user@hadoop.apache.org

To: common-user@hadoop.apache.org user@hadoop.apache.org 
<ht...@hadoop.apache.org>

Have you checked the link 
http://192.168.56.101:9046/proxy/application_1432817967879_0003 
<http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?
You should get come clue from logs of the 2 attempts.

On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail 
[xeonmailinglist@gmail.com](mailto:xeonmailinglist@gmail.com) 
<http://mailto:[xeonmailinglist@gmail.com]%28mailto:xeonmailinglist@gmail.com%29> 
wrote:

    Hi,

    I am trying to launch a job that I have configured in in java, but I
    get an error related to the containers [1]. I don’t understand why I
    can’t submit the a job. Why get this error? What can I do to fix it?

    Thanks,

    [1] Log of |logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log|

    |15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032  <http://192.168.56.101:8032>
    15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
    15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
    15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
    15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
    15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job:http://192.168.56.101:9046/proxy/application_1432817967879_0003/
    15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
    15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
    15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
    15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
    ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
    For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
    Diagnostics: Exception from container-launch.
    Container id: container_1432817967879_0003_02_000001
    Exit code: 1
    Stack trace: ExitCodeException exitCode=1:
             at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
             at org.apache.hadoop.util.Shell.run(Shell.java:455)
             at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
             at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
             at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
             at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
             at java.util.concurrent.FutureTask.run(FutureTask.java:266)
             at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
             at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
             at java.lang.Thread.run(Thread.java:745)
    |

    

    -- 
    --

Re: can't submit a job

Posted by Ted Yu <yu...@gmail.com>.

Have you checked the link
http://192.168.56.101:9046/proxy/application_1432817967879_0003
<http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?

You should get come clue from logs of the 2 attempts.

On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail <
xeonmailinglist@gmail.com> wrote:

>  Hi,
>
> I am trying to launch a job that I have configured in in java, but I get
> an error related to the containers [1]. I don’t understand why I can’t
> submit the a job. Why get this error? What can I do to fix it?
>
> Thanks,
>
> [1] Log of logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log
>
> 15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032
> 15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
> 15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
> 15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
> 15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
> 15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job: http://192.168.56.101:9046/proxy/application_1432817967879_0003/
> 15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
> 15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
> 15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
> 15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
> ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432817967879_0003_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>         at org.apache.hadoop.util.Shell.run(Shell.java:455)
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> 
>
> --
> --
>
>

Re: can't submit a job

Posted by Ted Yu <yu...@gmail.com>.

Have you checked the link
http://192.168.56.101:9046/proxy/application_1432817967879_0003
<http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?

You should get come clue from logs of the 2 attempts.

On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail <
xeonmailinglist@gmail.com> wrote:

>  Hi,
>
> I am trying to launch a job that I have configured in in java, but I get
> an error related to the containers [1]. I don’t understand why I can’t
> submit the a job. Why get this error? What can I do to fix it?
>
> Thanks,
>
> [1] Log of logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log
>
> 15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032
> 15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
> 15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
> 15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
> 15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
> 15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job: http://192.168.56.101:9046/proxy/application_1432817967879_0003/
> 15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
> 15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
> 15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
> 15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
> ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432817967879_0003_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>         at org.apache.hadoop.util.Shell.run(Shell.java:455)
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> 
>
> --
> --
>
>

Re: can't submit a job

Posted by Ted Yu <yu...@gmail.com>.

Have you checked the link
http://192.168.56.101:9046/proxy/application_1432817967879_0003
<http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?

You should get come clue from logs of the 2 attempts.

On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail <
xeonmailinglist@gmail.com> wrote:

>  Hi,
>
> I am trying to launch a job that I have configured in in java, but I get
> an error related to the containers [1]. I don’t understand why I can’t
> submit the a job. Why get this error? What can I do to fix it?
>
> Thanks,
>
> [1] Log of logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log
>
> 15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032
> 15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
> 15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
> 15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
> 15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
> 15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job: http://192.168.56.101:9046/proxy/application_1432817967879_0003/
> 15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
> 15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
> 15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
> 15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
> ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432817967879_0003_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>         at org.apache.hadoop.util.Shell.run(Shell.java:455)
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> 
>
> --
> --
>
>

Re: can't submit a job

Posted by Ted Yu <yu...@gmail.com>.

Have you checked the link
http://192.168.56.101:9046/proxy/application_1432817967879_0003
<http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then> ?

You should get come clue from logs of the 2 attempts.

On Thu, May 28, 2015 at 6:42 AM, xeonmailinglist-gmail <
xeonmailinglist@gmail.com> wrote:

>  Hi,
>
> I am trying to launch a job that I have configured in in java, but I get
> an error related to the containers [1]. I don’t understand why I can’t
> submit the a job. Why get this error? What can I do to fix it?
>
> Thanks,
>
> [1] Log of logs/yarn-xubuntu-nodemanager-hadoop-coc-1.log
>
> 15/05/28 09:28:21 INFO client.RMProxy: Connecting to ResourceManager at /192.168.56.101:8032
> 15/05/28 09:28:24 INFO input.FileInputFormat: Total input paths to process : 5
> 15/05/28 09:28:24 INFO mapreduce.JobSubmitter: number of splits:5
> 15/05/28 09:28:24 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1432817967879_0003
> 15/05/28 09:28:25 INFO impl.YarnClientImpl: Submitted application application_1432817967879_0003
> 15/05/28 09:28:25 INFO mapreduce.Job: The url to track the job: http://192.168.56.101:9046/proxy/application_1432817967879_0003/
> 15/05/28 09:28:25 INFO mapreduce.Job: Running job: job_1432817967879_0003
> 15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 running in uber mode : false
> 15/05/28 09:28:29 INFO mapreduce.Job:  map 0% reduce 0%
> 15/05/28 09:28:29 INFO mapreduce.Job: Job job_1432817967879_0003 failed with state FAILED due to: Application application_1432817967879_0003 failed 2 times due to AM Cont
> ainer for appattempt_1432817967879_0003_000002 exited with  exitCode: 1
> For more detailed output, check application tracking page:http://192.168.56.101:9046/proxy/application_1432817967879_0003/Then, click on links to logs of each attempt.
> Diagnostics: Exception from container-launch.
> Container id: container_1432817967879_0003_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>         at org.apache.hadoop.util.Shell.run(Shell.java:455)
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
>         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> 
>
> --
> --
>
>