You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Rahul Singh <sm...@gmail.com> on 2014/05/21 16:19:33 UTC
hadoop job stuck in accepted state
Hi,
I am trying to run the wordcount example on single node cluster but my
job is stuck in accepted state. Various details metioned below(ScreenShot
attached):
hadoop version
Hadoop 2.3.0
Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
Compiled by jenkins on 2014-02-11T13:40Z
Compiled with protoc 2.5.0
>From source with checksum dfe46336fbc6a044bc124392ec06b85
machine details:
Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
2014 x86_64 x86_64 x86_64 GNU/Linux
Command line:
hduser@L-user-Tech:~$ hadoop jar
/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
wordcount /user/hduser/input /user/hduser/output
14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
0.0.0.0:8032
14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process
: 1
14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
job_1400678752370_0003
14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
application_1400678752370_0003
14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
http://L-user-Tech:8088/proxy/application_1400678752370_0003/
14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
There are no logs generated.
Let me know any if any resolutions available?
Thanks and Regards,
-Rahul Singh
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
attaching the job.xml for the above issue. Also it is stuck when i user map
reduce framework as yarn, otherwise running fine.
-Thanks,
Rahul Singh
On Wed, May 21, 2014 at 7:49 PM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run the wordcount example on single node cluster but my
> job is stuck in accepted state. Various details metioned below(ScreenShot
> attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
> 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
> wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
> application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
> http://L-user-Tech:8088/proxy/application_1400678752370_0003/
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
attaching the job.xml for the above issue. Also it is stuck when i user map
reduce framework as yarn, otherwise running fine.
-Thanks,
Rahul Singh
On Wed, May 21, 2014 at 7:49 PM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run the wordcount example on single node cluster but my
> job is stuck in accepted state. Various details metioned below(ScreenShot
> attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
> 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
> wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
> application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
> http://L-user-Tech:8088/proxy/application_1400678752370_0003/
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
Thanks Sebastian. The job was stuck due to memory issues. I found the below
mentioned link very useful in configuring the yarn.
http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/content/rpm-chap1-11.html
Regards,
-Rahul Singh
On Fri, May 23, 2014 at 9:59 AM, Rahul Singh <sm...@gmail.com>wrote:
> Thanks. The job was stuck be
>
>
> On Wed, May 21, 2014 at 11:10 PM, Sebastian Gäde <s1...@hft-leipzig.de>wrote:
>
>> Hi,
>>
>> I remember having a similar issue. My job was demanding for more memory
>> then available in the cluster, that’s why it was waiting forever.
>>
>> Could you check the resource-/nodemanager logs? Also the „Scheduler" page
>> in the Webapp might give a hint whether the job is not starting because of
>> unsufficient resources.
>>
>> Cheers
>> Seb.
>>
>> Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
>>
>> Hi,
>> I am trying to run the wordcount example on single node cluster but my
>> job is stuck in accepted state. Various details metioned below(ScreenShot
>> attached):
>>
>> hadoop version
>> Hadoop 2.3.0
>> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
>> Compiled by jenkins on 2014-02-11T13:40Z
>> Compiled with protoc 2.5.0
>> From source with checksum dfe46336fbc6a044bc124392ec06b85
>>
>>
>> machine details:
>> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
>> 2014 x86_64 x86_64 x86_64 GNU/Linux
>>
>>
>>
>> Command line:
>> hduser@L-user-Tech:~$ hadoop jar
>> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
>> wordcount /user/hduser/input /user/hduser/output
>> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
>> 0.0.0.0:8032
>> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to
>> process : 1
>> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
>> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
>> job_1400678752370_0003
>> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
>> application_1400678752370_0003
>> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
>> http://L-user-Tech:8088/proxy/application_1400678752370_0003/<http://l-user-tech:8088/proxy/application_1400678752370_0003/>
>> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>>
>>
>> There are no logs generated.
>>
>> Let me know any if any resolutions available?
>>
>> Thanks and Regards,
>> -Rahul Singh
>> <Screenshot from 2014-05-21 19:39:28.png>
>>
>>
>>
>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
Thanks Sebastian. The job was stuck due to memory issues. I found the below
mentioned link very useful in configuring the yarn.
http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/content/rpm-chap1-11.html
Regards,
-Rahul Singh
On Fri, May 23, 2014 at 9:59 AM, Rahul Singh <sm...@gmail.com>wrote:
> Thanks. The job was stuck be
>
>
> On Wed, May 21, 2014 at 11:10 PM, Sebastian Gäde <s1...@hft-leipzig.de>wrote:
>
>> Hi,
>>
>> I remember having a similar issue. My job was demanding for more memory
>> then available in the cluster, that’s why it was waiting forever.
>>
>> Could you check the resource-/nodemanager logs? Also the „Scheduler" page
>> in the Webapp might give a hint whether the job is not starting because of
>> unsufficient resources.
>>
>> Cheers
>> Seb.
>>
>> Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
>>
>> Hi,
>> I am trying to run the wordcount example on single node cluster but my
>> job is stuck in accepted state. Various details metioned below(ScreenShot
>> attached):
>>
>> hadoop version
>> Hadoop 2.3.0
>> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
>> Compiled by jenkins on 2014-02-11T13:40Z
>> Compiled with protoc 2.5.0
>> From source with checksum dfe46336fbc6a044bc124392ec06b85
>>
>>
>> machine details:
>> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
>> 2014 x86_64 x86_64 x86_64 GNU/Linux
>>
>>
>>
>> Command line:
>> hduser@L-user-Tech:~$ hadoop jar
>> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
>> wordcount /user/hduser/input /user/hduser/output
>> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
>> 0.0.0.0:8032
>> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to
>> process : 1
>> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
>> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
>> job_1400678752370_0003
>> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
>> application_1400678752370_0003
>> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
>> http://L-user-Tech:8088/proxy/application_1400678752370_0003/<http://l-user-tech:8088/proxy/application_1400678752370_0003/>
>> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>>
>>
>> There are no logs generated.
>>
>> Let me know any if any resolutions available?
>>
>> Thanks and Regards,
>> -Rahul Singh
>> <Screenshot from 2014-05-21 19:39:28.png>
>>
>>
>>
>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
Thanks Sebastian. The job was stuck due to memory issues. I found the below
mentioned link very useful in configuring the yarn.
http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/content/rpm-chap1-11.html
Regards,
-Rahul Singh
On Fri, May 23, 2014 at 9:59 AM, Rahul Singh <sm...@gmail.com>wrote:
> Thanks. The job was stuck be
>
>
> On Wed, May 21, 2014 at 11:10 PM, Sebastian Gäde <s1...@hft-leipzig.de>wrote:
>
>> Hi,
>>
>> I remember having a similar issue. My job was demanding for more memory
>> then available in the cluster, that’s why it was waiting forever.
>>
>> Could you check the resource-/nodemanager logs? Also the „Scheduler" page
>> in the Webapp might give a hint whether the job is not starting because of
>> unsufficient resources.
>>
>> Cheers
>> Seb.
>>
>> Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
>>
>> Hi,
>> I am trying to run the wordcount example on single node cluster but my
>> job is stuck in accepted state. Various details metioned below(ScreenShot
>> attached):
>>
>> hadoop version
>> Hadoop 2.3.0
>> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
>> Compiled by jenkins on 2014-02-11T13:40Z
>> Compiled with protoc 2.5.0
>> From source with checksum dfe46336fbc6a044bc124392ec06b85
>>
>>
>> machine details:
>> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
>> 2014 x86_64 x86_64 x86_64 GNU/Linux
>>
>>
>>
>> Command line:
>> hduser@L-user-Tech:~$ hadoop jar
>> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
>> wordcount /user/hduser/input /user/hduser/output
>> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
>> 0.0.0.0:8032
>> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to
>> process : 1
>> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
>> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
>> job_1400678752370_0003
>> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
>> application_1400678752370_0003
>> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
>> http://L-user-Tech:8088/proxy/application_1400678752370_0003/<http://l-user-tech:8088/proxy/application_1400678752370_0003/>
>> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>>
>>
>> There are no logs generated.
>>
>> Let me know any if any resolutions available?
>>
>> Thanks and Regards,
>> -Rahul Singh
>> <Screenshot from 2014-05-21 19:39:28.png>
>>
>>
>>
>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
Thanks Sebastian. The job was stuck due to memory issues. I found the below
mentioned link very useful in configuring the yarn.
http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/content/rpm-chap1-11.html
Regards,
-Rahul Singh
On Fri, May 23, 2014 at 9:59 AM, Rahul Singh <sm...@gmail.com>wrote:
> Thanks. The job was stuck be
>
>
> On Wed, May 21, 2014 at 11:10 PM, Sebastian Gäde <s1...@hft-leipzig.de>wrote:
>
>> Hi,
>>
>> I remember having a similar issue. My job was demanding for more memory
>> then available in the cluster, that’s why it was waiting forever.
>>
>> Could you check the resource-/nodemanager logs? Also the „Scheduler" page
>> in the Webapp might give a hint whether the job is not starting because of
>> unsufficient resources.
>>
>> Cheers
>> Seb.
>>
>> Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
>>
>> Hi,
>> I am trying to run the wordcount example on single node cluster but my
>> job is stuck in accepted state. Various details metioned below(ScreenShot
>> attached):
>>
>> hadoop version
>> Hadoop 2.3.0
>> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
>> Compiled by jenkins on 2014-02-11T13:40Z
>> Compiled with protoc 2.5.0
>> From source with checksum dfe46336fbc6a044bc124392ec06b85
>>
>>
>> machine details:
>> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
>> 2014 x86_64 x86_64 x86_64 GNU/Linux
>>
>>
>>
>> Command line:
>> hduser@L-user-Tech:~$ hadoop jar
>> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
>> wordcount /user/hduser/input /user/hduser/output
>> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
>> 0.0.0.0:8032
>> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to
>> process : 1
>> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
>> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
>> job_1400678752370_0003
>> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
>> application_1400678752370_0003
>> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
>> http://L-user-Tech:8088/proxy/application_1400678752370_0003/<http://l-user-tech:8088/proxy/application_1400678752370_0003/>
>> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>>
>>
>> There are no logs generated.
>>
>> Let me know any if any resolutions available?
>>
>> Thanks and Regards,
>> -Rahul Singh
>> <Screenshot from 2014-05-21 19:39:28.png>
>>
>>
>>
>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
Thanks. The job was stuck be
On Wed, May 21, 2014 at 11:10 PM, Sebastian Gäde <s1...@hft-leipzig.de>wrote:
> Hi,
>
> I remember having a similar issue. My job was demanding for more memory
> then available in the cluster, that’s why it was waiting forever.
>
> Could you check the resource-/nodemanager logs? Also the „Scheduler" page
> in the Webapp might give a hint whether the job is not starting because of
> unsufficient resources.
>
> Cheers
> Seb.
>
> Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
>
> Hi,
> I am trying to run the wordcount example on single node cluster but my
> job is stuck in accepted state. Various details metioned below(ScreenShot
> attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
> 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
> wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
> application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
> http://L-user-Tech:8088/proxy/application_1400678752370_0003/<http://l-user-tech:8088/proxy/application_1400678752370_0003/>
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
> <Screenshot from 2014-05-21 19:39:28.png>
>
>
>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
Thanks. The job was stuck be
On Wed, May 21, 2014 at 11:10 PM, Sebastian Gäde <s1...@hft-leipzig.de>wrote:
> Hi,
>
> I remember having a similar issue. My job was demanding for more memory
> then available in the cluster, that’s why it was waiting forever.
>
> Could you check the resource-/nodemanager logs? Also the „Scheduler" page
> in the Webapp might give a hint whether the job is not starting because of
> unsufficient resources.
>
> Cheers
> Seb.
>
> Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
>
> Hi,
> I am trying to run the wordcount example on single node cluster but my
> job is stuck in accepted state. Various details metioned below(ScreenShot
> attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
> 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
> wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
> application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
> http://L-user-Tech:8088/proxy/application_1400678752370_0003/<http://l-user-tech:8088/proxy/application_1400678752370_0003/>
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
> <Screenshot from 2014-05-21 19:39:28.png>
>
>
>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
Thanks. The job was stuck be
On Wed, May 21, 2014 at 11:10 PM, Sebastian Gäde <s1...@hft-leipzig.de>wrote:
> Hi,
>
> I remember having a similar issue. My job was demanding for more memory
> then available in the cluster, that’s why it was waiting forever.
>
> Could you check the resource-/nodemanager logs? Also the „Scheduler" page
> in the Webapp might give a hint whether the job is not starting because of
> unsufficient resources.
>
> Cheers
> Seb.
>
> Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
>
> Hi,
> I am trying to run the wordcount example on single node cluster but my
> job is stuck in accepted state. Various details metioned below(ScreenShot
> attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
> 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
> wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
> application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
> http://L-user-Tech:8088/proxy/application_1400678752370_0003/<http://l-user-tech:8088/proxy/application_1400678752370_0003/>
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
> <Screenshot from 2014-05-21 19:39:28.png>
>
>
>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
Thanks. The job was stuck be
On Wed, May 21, 2014 at 11:10 PM, Sebastian Gäde <s1...@hft-leipzig.de>wrote:
> Hi,
>
> I remember having a similar issue. My job was demanding for more memory
> then available in the cluster, that’s why it was waiting forever.
>
> Could you check the resource-/nodemanager logs? Also the „Scheduler" page
> in the Webapp might give a hint whether the job is not starting because of
> unsufficient resources.
>
> Cheers
> Seb.
>
> Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
>
> Hi,
> I am trying to run the wordcount example on single node cluster but my
> job is stuck in accepted state. Various details metioned below(ScreenShot
> attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
> 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
> wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
> application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
> http://L-user-Tech:8088/proxy/application_1400678752370_0003/<http://l-user-tech:8088/proxy/application_1400678752370_0003/>
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
> <Screenshot from 2014-05-21 19:39:28.png>
>
>
>
Re: hadoop job stuck in accepted state
Posted by Sebastian Gäde <s1...@hft-leipzig.de>.
Hi,
I remember having a similar issue. My job was demanding for more memory then available in the cluster, that’s why it was waiting forever.
Could you check the resource-/nodemanager logs? Also the „Scheduler" page in the Webapp might give a hint whether the job is not starting because of unsufficient resources.
Cheers
Seb.
Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
> Hi,
> I am trying to run the wordcount example on single node cluster but my job is stuck in accepted state. Various details metioned below(ScreenShot attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job: http://L-user-Tech:8088/proxy/application_1400678752370_0003/
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
> <Screenshot from 2014-05-21 19:39:28.png>
Re: hadoop job stuck in accepted state
Posted by Sebastian Gäde <s1...@hft-leipzig.de>.
Hi,
I remember having a similar issue. My job was demanding for more memory then available in the cluster, that’s why it was waiting forever.
Could you check the resource-/nodemanager logs? Also the „Scheduler" page in the Webapp might give a hint whether the job is not starting because of unsufficient resources.
Cheers
Seb.
Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
> Hi,
> I am trying to run the wordcount example on single node cluster but my job is stuck in accepted state. Various details metioned below(ScreenShot attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job: http://L-user-Tech:8088/proxy/application_1400678752370_0003/
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
> <Screenshot from 2014-05-21 19:39:28.png>
Re: hadoop job stuck in accepted state
Posted by Sebastian Gäde <s1...@hft-leipzig.de>.
Hi,
I remember having a similar issue. My job was demanding for more memory then available in the cluster, that’s why it was waiting forever.
Could you check the resource-/nodemanager logs? Also the „Scheduler" page in the Webapp might give a hint whether the job is not starting because of unsufficient resources.
Cheers
Seb.
Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
> Hi,
> I am trying to run the wordcount example on single node cluster but my job is stuck in accepted state. Various details metioned below(ScreenShot attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job: http://L-user-Tech:8088/proxy/application_1400678752370_0003/
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
> <Screenshot from 2014-05-21 19:39:28.png>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
attaching the job.xml for the above issue. Also it is stuck when i user map
reduce framework as yarn, otherwise running fine.
-Thanks,
Rahul Singh
On Wed, May 21, 2014 at 7:49 PM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run the wordcount example on single node cluster but my
> job is stuck in accepted state. Various details metioned below(ScreenShot
> attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
> 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
> wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
> application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
> http://L-user-Tech:8088/proxy/application_1400678752370_0003/
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
>
Re: hadoop job stuck in accepted state
Posted by Rahul Singh <sm...@gmail.com>.
attaching the job.xml for the above issue. Also it is stuck when i user map
reduce framework as yarn, otherwise running fine.
-Thanks,
Rahul Singh
On Wed, May 21, 2014 at 7:49 PM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run the wordcount example on single node cluster but my
> job is stuck in accepted state. Various details metioned below(ScreenShot
> attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC
> 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar
> /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar
> wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application
> application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job:
> http://L-user-Tech:8088/proxy/application_1400678752370_0003/
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
>
Re: hadoop job stuck in accepted state
Posted by Sebastian Gäde <s1...@hft-leipzig.de>.
Hi,
I remember having a similar issue. My job was demanding for more memory then available in the cluster, that’s why it was waiting forever.
Could you check the resource-/nodemanager logs? Also the „Scheduler" page in the Webapp might give a hint whether the job is not starting because of unsufficient resources.
Cheers
Seb.
Am 21.05.2014 um 16:19 schrieb Rahul Singh <sm...@gmail.com>:
> Hi,
> I am trying to run the wordcount example on single node cluster but my job is stuck in accepted state. Various details metioned below(ScreenShot attached):
>
> hadoop version
> Hadoop 2.3.0
> Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123
> Compiled by jenkins on 2014-02-11T13:40Z
> Compiled with protoc 2.5.0
> From source with checksum dfe46336fbc6a044bc124392ec06b85
>
>
> machine details:
> Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
>
>
>
> Command line:
> hduser@L-user-Tech:~$ hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount /user/hduser/input /user/hduser/output
> 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process : 1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1
> 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1400678752370_0003
> 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application application_1400678752370_0003
> 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job: http://L-user-Tech:8088/proxy/application_1400678752370_0003/
> 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003
>
>
> There are no logs generated.
>
> Let me know any if any resolutions available?
>
> Thanks and Regards,
> -Rahul Singh
> <Screenshot from 2014-05-21 19:39:28.png>