You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Rahul Singh <sm...@gmail.com> on 2014/04/14 05:37:12 UTC
job getting hung
Hi,
I am trying to run wordcount example(input file contains just few words)
but the job seems to be stuck. How do i debug what went wrong?
[hduser@poc-hadoop04 sbin]$ hadoop jar
../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
/user/hduser/input /user/hduser/output_wordcount
14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
localhost/127.0.0.1:8032
14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process
: 1
14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
job_1397446243581_0001
14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
application_1397446243581_0001
14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
Thanks and Regards,
Rahul Singh
Re: job getting hung
Posted by Shengjun Xin <sx...@gopivotal.com>.
Check resourcemamager log and nodemanager log
On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run wordcount example(input file contains just few words)
> but the job seems to be stuck. How do i debug what went wrong?
>
> [hduser@poc-hadoop04 sbin]$ hadoop jar
> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
> /user/hduser/input /user/hduser/output_wordcount
>
> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
> localhost/127.0.0.1:8032
> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1397446243581_0001
> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
> application_1397446243581_0001
> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>
>
> Thanks and Regards,
> Rahul Singh
>
--
Regards
Shengjun
Re: job getting hung
Posted by Rahul Singh <sm...@gmail.com>.
thanks for the tip.. looking at the logs i found nodemanager was not able
to comunicate to the server (i assume resourcemanager).
On Mon, Apr 14, 2014 at 11:12 AM, Stanley Shi <ss...@gopivotal.com> wrote:
> do you any node manager running?
>
> Regards,
> *Stanley Shi,*
>
>
>
> On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
>
>> Hi,
>> I am trying to run wordcount example(input file contains just few
>> words) but the job seems to be stuck. How do i debug what went wrong?
>>
>> [hduser@poc-hadoop04 sbin]$ hadoop jar
>> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
>> /user/hduser/input /user/hduser/output_wordcount
>>
>> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
>> localhost/127.0.0.1:8032
>> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to
>> process : 1
>> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
>> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
>> job_1397446243581_0001
>> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
>> application_1397446243581_0001
>> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
>> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
>> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>>
>>
>> Thanks and Regards,
>> Rahul Singh
>>
>
>
Re: job getting hung
Posted by Rahul Singh <sm...@gmail.com>.
thanks for the tip.. looking at the logs i found nodemanager was not able
to comunicate to the server (i assume resourcemanager).
On Mon, Apr 14, 2014 at 11:12 AM, Stanley Shi <ss...@gopivotal.com> wrote:
> do you any node manager running?
>
> Regards,
> *Stanley Shi,*
>
>
>
> On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
>
>> Hi,
>> I am trying to run wordcount example(input file contains just few
>> words) but the job seems to be stuck. How do i debug what went wrong?
>>
>> [hduser@poc-hadoop04 sbin]$ hadoop jar
>> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
>> /user/hduser/input /user/hduser/output_wordcount
>>
>> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
>> localhost/127.0.0.1:8032
>> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to
>> process : 1
>> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
>> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
>> job_1397446243581_0001
>> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
>> application_1397446243581_0001
>> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
>> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
>> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>>
>>
>> Thanks and Regards,
>> Rahul Singh
>>
>
>
Re: job getting hung
Posted by Rahul Singh <sm...@gmail.com>.
thanks for the tip.. looking at the logs i found nodemanager was not able
to comunicate to the server (i assume resourcemanager).
On Mon, Apr 14, 2014 at 11:12 AM, Stanley Shi <ss...@gopivotal.com> wrote:
> do you any node manager running?
>
> Regards,
> *Stanley Shi,*
>
>
>
> On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
>
>> Hi,
>> I am trying to run wordcount example(input file contains just few
>> words) but the job seems to be stuck. How do i debug what went wrong?
>>
>> [hduser@poc-hadoop04 sbin]$ hadoop jar
>> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
>> /user/hduser/input /user/hduser/output_wordcount
>>
>> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
>> localhost/127.0.0.1:8032
>> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to
>> process : 1
>> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
>> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
>> job_1397446243581_0001
>> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
>> application_1397446243581_0001
>> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
>> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
>> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>>
>>
>> Thanks and Regards,
>> Rahul Singh
>>
>
>
Re: job getting hung
Posted by Rahul Singh <sm...@gmail.com>.
thanks for the tip.. looking at the logs i found nodemanager was not able
to comunicate to the server (i assume resourcemanager).
On Mon, Apr 14, 2014 at 11:12 AM, Stanley Shi <ss...@gopivotal.com> wrote:
> do you any node manager running?
>
> Regards,
> *Stanley Shi,*
>
>
>
> On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
>
>> Hi,
>> I am trying to run wordcount example(input file contains just few
>> words) but the job seems to be stuck. How do i debug what went wrong?
>>
>> [hduser@poc-hadoop04 sbin]$ hadoop jar
>> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
>> /user/hduser/input /user/hduser/output_wordcount
>>
>> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
>> localhost/127.0.0.1:8032
>> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to
>> process : 1
>> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
>> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
>> job_1397446243581_0001
>> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
>> application_1397446243581_0001
>> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
>> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
>> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>>
>>
>> Thanks and Regards,
>> Rahul Singh
>>
>
>
Re: job getting hung
Posted by Stanley Shi <ss...@gopivotal.com>.
do you any node manager running?
Regards,
*Stanley Shi,*
On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run wordcount example(input file contains just few words)
> but the job seems to be stuck. How do i debug what went wrong?
>
> [hduser@poc-hadoop04 sbin]$ hadoop jar
> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
> /user/hduser/input /user/hduser/output_wordcount
>
> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
> localhost/127.0.0.1:8032
> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1397446243581_0001
> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
> application_1397446243581_0001
> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>
>
> Thanks and Regards,
> Rahul Singh
>
Re: job getting hung
Posted by Shengjun Xin <sx...@gopivotal.com>.
Check resourcemamager log and nodemanager log
On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run wordcount example(input file contains just few words)
> but the job seems to be stuck. How do i debug what went wrong?
>
> [hduser@poc-hadoop04 sbin]$ hadoop jar
> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
> /user/hduser/input /user/hduser/output_wordcount
>
> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
> localhost/127.0.0.1:8032
> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1397446243581_0001
> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
> application_1397446243581_0001
> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>
>
> Thanks and Regards,
> Rahul Singh
>
--
Regards
Shengjun
Re: job getting hung
Posted by Shengjun Xin <sx...@gopivotal.com>.
Check resourcemamager log and nodemanager log
On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run wordcount example(input file contains just few words)
> but the job seems to be stuck. How do i debug what went wrong?
>
> [hduser@poc-hadoop04 sbin]$ hadoop jar
> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
> /user/hduser/input /user/hduser/output_wordcount
>
> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
> localhost/127.0.0.1:8032
> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1397446243581_0001
> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
> application_1397446243581_0001
> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>
>
> Thanks and Regards,
> Rahul Singh
>
--
Regards
Shengjun
Re: job getting hung
Posted by Stanley Shi <ss...@gopivotal.com>.
do you any node manager running?
Regards,
*Stanley Shi,*
On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run wordcount example(input file contains just few words)
> but the job seems to be stuck. How do i debug what went wrong?
>
> [hduser@poc-hadoop04 sbin]$ hadoop jar
> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
> /user/hduser/input /user/hduser/output_wordcount
>
> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
> localhost/127.0.0.1:8032
> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1397446243581_0001
> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
> application_1397446243581_0001
> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>
>
> Thanks and Regards,
> Rahul Singh
>
Re: job getting hung
Posted by Stanley Shi <ss...@gopivotal.com>.
do you any node manager running?
Regards,
*Stanley Shi,*
On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run wordcount example(input file contains just few words)
> but the job seems to be stuck. How do i debug what went wrong?
>
> [hduser@poc-hadoop04 sbin]$ hadoop jar
> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
> /user/hduser/input /user/hduser/output_wordcount
>
> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
> localhost/127.0.0.1:8032
> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1397446243581_0001
> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
> application_1397446243581_0001
> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>
>
> Thanks and Regards,
> Rahul Singh
>
Re: job getting hung
Posted by Stanley Shi <ss...@gopivotal.com>.
do you any node manager running?
Regards,
*Stanley Shi,*
On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run wordcount example(input file contains just few words)
> but the job seems to be stuck. How do i debug what went wrong?
>
> [hduser@poc-hadoop04 sbin]$ hadoop jar
> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
> /user/hduser/input /user/hduser/output_wordcount
>
> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
> localhost/127.0.0.1:8032
> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1397446243581_0001
> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
> application_1397446243581_0001
> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>
>
> Thanks and Regards,
> Rahul Singh
>
Re: job getting hung
Posted by Shengjun Xin <sx...@gopivotal.com>.
Check resourcemamager log and nodemanager log
On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh <sm...@gmail.com>wrote:
> Hi,
> I am trying to run wordcount example(input file contains just few words)
> but the job seems to be stuck. How do i debug what went wrong?
>
> [hduser@poc-hadoop04 sbin]$ hadoop jar
> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount
> /user/hduser/input /user/hduser/output_wordcount
>
> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at
> localhost/127.0.0.1:8032
> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process
> : 1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1
> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1397446243581_0001
> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application
> application_1397446243581_0001
> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job:
> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/
> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001
>
>
> Thanks and Regards,
> Rahul Singh
>
--
Regards
Shengjun