You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by 間々田 剛史 <ts...@stu.hosei.ac.jp> on 2013/08/06 08:55:27 UTC
Question about Hadoop
Dear Sir
we are students at Hosei University.
we study hadoop now for reserch.
we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
we can access HDFS from master and slaves.
We have some questions.
Master:Hadoop04
Slaves:Hadoop01
Hadoop02
Hadoop03
we run the "wordcount" program on "complete distributed mode" ,but it stops
running.
The following is the response for running the program.
13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process
: 1
13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated.
Instea
d, use mapreduce.job.name
13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is
deprecated.
Instead, use mapreduce.job.reduce.class
13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated.
Inste
ad, use mapreduce.input.fileinputformat.inputdir
13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is deprecated.
Instead, use mapreduce.output.fileoutputformat.outputdir
13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated.
Instead, use mapreduce.job.maps
13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is
deprecated. Instead, use mapreduce.job.output.key.class
13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is
deprecated. Instead, use mapreduce.job.working.dir
13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job:
job_1374652061495_0002
13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application
application_1374652061495_0002 to ResourceManager at Hadoop04/
10.31.185.24:8040
13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job:
http://Hadoop04:
8088/proxy/application_1374652061495_0002/
13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
it stops running at the point.
then,
when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
it shows "The requested application does not appear to be running yet, and
has not set a tracking URL"
I am looking forward to your reply.
Best wishes,
tadayuki,tsuyoshi,and hideki
Re: Question about Hadoop
Posted by yypvsxf19870706 <yy...@gmail.com>.
Hi
You need to check your resourcemanager log and the container log which container allocate by your RM.
�����ҵ� iPhone
�� 2013-8-6��15:30��manish dunani <ma...@gmail.com> ���
> After checking ur error code.
> I think u entered wrong map and reduce class.
>
> can u pls show me code??
> Then i will tell u correctly where u did the mistake..
>
>
>
> On Tue, Aug 6, 2013 at 12:25 PM, �g�����ʷ <ts...@stu.hosei.ac.jp> wrote:
>> Dear Sir
>>
>> we are students at Hosei University.
>> we study hadoop now for reserch.
>>
>> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
>> we can access HDFS from master and slaves.
>> We have some questions.
>> Master:Hadoop04
>> Slaves:Hadoop01
>> Hadoop02
>> Hadoop03
>>
>>
>> we run the "wordcount" program on "complete distributed mode" ,but it stops running.
>> The following is the response for running the program.
>>
>>
>> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process : 1
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated. Instea
>> d, use mapreduce.job.name
>> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is deprecated.
>> Instead, use mapreduce.job.reduce.class
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated. Inste
>> ad, use mapreduce.input.fileinputformat.inputdir
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
>> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1374652061495_0002
>> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application application_1374652061495_0002 to ResourceManager at Hadoop04/10.31.185.24:8040
>> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job: http://Hadoop04:
>> 8088/proxy/application_1374652061495_0002/
>> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>>
>> it stops running at the point.
>> then,
>> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
>> it shows "The requested application does not appear to be running yet, and has not set a tracking URL"
>>
>> I am looking forward to your reply.
>>
>> Best wishes,
>> tadayuki,tsuyoshi,and hideki
>
>
>
> --
> MANISH DUNANI
> -THANX
> +91 9426881954,+91 8460656443
> manishd207@gmail.com
Re: Question about Hadoop
Posted by yypvsxf19870706 <yy...@gmail.com>.
Hi
You need to check your resourcemanager log and the container log which container allocate by your RM.
�����ҵ� iPhone
�� 2013-8-6��15:30��manish dunani <ma...@gmail.com> ���
> After checking ur error code.
> I think u entered wrong map and reduce class.
>
> can u pls show me code??
> Then i will tell u correctly where u did the mistake..
>
>
>
> On Tue, Aug 6, 2013 at 12:25 PM, �g�����ʷ <ts...@stu.hosei.ac.jp> wrote:
>> Dear Sir
>>
>> we are students at Hosei University.
>> we study hadoop now for reserch.
>>
>> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
>> we can access HDFS from master and slaves.
>> We have some questions.
>> Master:Hadoop04
>> Slaves:Hadoop01
>> Hadoop02
>> Hadoop03
>>
>>
>> we run the "wordcount" program on "complete distributed mode" ,but it stops running.
>> The following is the response for running the program.
>>
>>
>> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process : 1
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated. Instea
>> d, use mapreduce.job.name
>> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is deprecated.
>> Instead, use mapreduce.job.reduce.class
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated. Inste
>> ad, use mapreduce.input.fileinputformat.inputdir
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
>> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1374652061495_0002
>> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application application_1374652061495_0002 to ResourceManager at Hadoop04/10.31.185.24:8040
>> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job: http://Hadoop04:
>> 8088/proxy/application_1374652061495_0002/
>> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>>
>> it stops running at the point.
>> then,
>> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
>> it shows "The requested application does not appear to be running yet, and has not set a tracking URL"
>>
>> I am looking forward to your reply.
>>
>> Best wishes,
>> tadayuki,tsuyoshi,and hideki
>
>
>
> --
> MANISH DUNANI
> -THANX
> +91 9426881954,+91 8460656443
> manishd207@gmail.com
Re: Question about Hadoop
Posted by yypvsxf19870706 <yy...@gmail.com>.
Hi
You need to check your resourcemanager log and the container log which container allocate by your RM.
�����ҵ� iPhone
�� 2013-8-6��15:30��manish dunani <ma...@gmail.com> ���
> After checking ur error code.
> I think u entered wrong map and reduce class.
>
> can u pls show me code??
> Then i will tell u correctly where u did the mistake..
>
>
>
> On Tue, Aug 6, 2013 at 12:25 PM, �g�����ʷ <ts...@stu.hosei.ac.jp> wrote:
>> Dear Sir
>>
>> we are students at Hosei University.
>> we study hadoop now for reserch.
>>
>> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
>> we can access HDFS from master and slaves.
>> We have some questions.
>> Master:Hadoop04
>> Slaves:Hadoop01
>> Hadoop02
>> Hadoop03
>>
>>
>> we run the "wordcount" program on "complete distributed mode" ,but it stops running.
>> The following is the response for running the program.
>>
>>
>> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process : 1
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated. Instea
>> d, use mapreduce.job.name
>> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is deprecated.
>> Instead, use mapreduce.job.reduce.class
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated. Inste
>> ad, use mapreduce.input.fileinputformat.inputdir
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
>> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1374652061495_0002
>> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application application_1374652061495_0002 to ResourceManager at Hadoop04/10.31.185.24:8040
>> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job: http://Hadoop04:
>> 8088/proxy/application_1374652061495_0002/
>> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>>
>> it stops running at the point.
>> then,
>> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
>> it shows "The requested application does not appear to be running yet, and has not set a tracking URL"
>>
>> I am looking forward to your reply.
>>
>> Best wishes,
>> tadayuki,tsuyoshi,and hideki
>
>
>
> --
> MANISH DUNANI
> -THANX
> +91 9426881954,+91 8460656443
> manishd207@gmail.com
Re: Question about Hadoop
Posted by yypvsxf19870706 <yy...@gmail.com>.
Hi
You need to check your resourcemanager log and the container log which container allocate by your RM.
�����ҵ� iPhone
�� 2013-8-6��15:30��manish dunani <ma...@gmail.com> ���
> After checking ur error code.
> I think u entered wrong map and reduce class.
>
> can u pls show me code??
> Then i will tell u correctly where u did the mistake..
>
>
>
> On Tue, Aug 6, 2013 at 12:25 PM, �g�����ʷ <ts...@stu.hosei.ac.jp> wrote:
>> Dear Sir
>>
>> we are students at Hosei University.
>> we study hadoop now for reserch.
>>
>> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
>> we can access HDFS from master and slaves.
>> We have some questions.
>> Master:Hadoop04
>> Slaves:Hadoop01
>> Hadoop02
>> Hadoop03
>>
>>
>> we run the "wordcount" program on "complete distributed mode" ,but it stops running.
>> The following is the response for running the program.
>>
>>
>> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process : 1
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated. Instea
>> d, use mapreduce.job.name
>> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is deprecated.
>> Instead, use mapreduce.job.reduce.class
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated. Inste
>> ad, use mapreduce.input.fileinputformat.inputdir
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
>> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
>> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1374652061495_0002
>> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application application_1374652061495_0002 to ResourceManager at Hadoop04/10.31.185.24:8040
>> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job: http://Hadoop04:
>> 8088/proxy/application_1374652061495_0002/
>> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>>
>> it stops running at the point.
>> then,
>> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
>> it shows "The requested application does not appear to be running yet, and has not set a tracking URL"
>>
>> I am looking forward to your reply.
>>
>> Best wishes,
>> tadayuki,tsuyoshi,and hideki
>
>
>
> --
> MANISH DUNANI
> -THANX
> +91 9426881954,+91 8460656443
> manishd207@gmail.com
Re: Question about Hadoop
Posted by manish dunani <ma...@gmail.com>.
After checking ur error code.
I think u entered wrong map and reduce class.
can u pls show me code??
Then i will tell u correctly where u did the mistake..
On Tue, Aug 6, 2013 at 12:25 PM, 間々田 剛史
<ts...@stu.hosei.ac.jp>wrote:
> Dear Sir
>
> we are students at Hosei University.
> we study hadoop now for reserch.
>
> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
> we can access HDFS from master and slaves.
> We have some questions.
> Master:Hadoop04
> Slaves:Hadoop01
> Hadoop02
> Hadoop03
>
>
> we run the "wordcount" program on "complete distributed mode" ,but it
> stops running.
> The following is the response for running the program.
>
>
> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated.
> Instea
> d, use mapreduce.job.name
> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated.
> Instead, use mapreduce.job.reduce.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated.
> Inste
> ad, use mapreduce.input.fileinputformat.inputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated.
> Instead, use mapreduce.job.maps
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1374652061495_0002
> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application
> application_1374652061495_0002 to ResourceManager at Hadoop04/
> 10.31.185.24:8040
> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job:
> http://Hadoop04:
> 8088/proxy/application_1374652061495_0002/
> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>
> it stops running at the point.
> then,
> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
> it shows "The requested application does not appear to be running yet, and
> has not set a tracking URL"
>
> I am looking forward to your reply.
>
> Best wishes,
> tadayuki,tsuyoshi,and hideki
>
--
MANISH DUNANI
-THANX
+91 9426881954,+91 8460656443
manishd207@gmail.com
Re: Question about Hadoop
Posted by manish dunani <ma...@gmail.com>.
After checking ur error code.
I think u entered wrong map and reduce class.
can u pls show me code??
Then i will tell u correctly where u did the mistake..
On Tue, Aug 6, 2013 at 12:25 PM, 間々田 剛史
<ts...@stu.hosei.ac.jp>wrote:
> Dear Sir
>
> we are students at Hosei University.
> we study hadoop now for reserch.
>
> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
> we can access HDFS from master and slaves.
> We have some questions.
> Master:Hadoop04
> Slaves:Hadoop01
> Hadoop02
> Hadoop03
>
>
> we run the "wordcount" program on "complete distributed mode" ,but it
> stops running.
> The following is the response for running the program.
>
>
> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated.
> Instea
> d, use mapreduce.job.name
> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated.
> Instead, use mapreduce.job.reduce.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated.
> Inste
> ad, use mapreduce.input.fileinputformat.inputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated.
> Instead, use mapreduce.job.maps
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1374652061495_0002
> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application
> application_1374652061495_0002 to ResourceManager at Hadoop04/
> 10.31.185.24:8040
> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job:
> http://Hadoop04:
> 8088/proxy/application_1374652061495_0002/
> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>
> it stops running at the point.
> then,
> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
> it shows "The requested application does not appear to be running yet, and
> has not set a tracking URL"
>
> I am looking forward to your reply.
>
> Best wishes,
> tadayuki,tsuyoshi,and hideki
>
--
MANISH DUNANI
-THANX
+91 9426881954,+91 8460656443
manishd207@gmail.com
Re: Question about Hadoop
Posted by manish dunani <ma...@gmail.com>.
After checking ur error code.
I think u entered wrong map and reduce class.
can u pls show me code??
Then i will tell u correctly where u did the mistake..
On Tue, Aug 6, 2013 at 12:25 PM, $B4V!9ED(B $B9d;K(B
<ts...@stu.hosei.ac.jp>wrote:
> Dear Sir
>
> we are students at Hosei University.
> we study hadoop now for reserch.
>
> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
> we can access HDFS from master and slaves.
> We have some questions.
> Master:Hadoop04
> Slaves:Hadoop01
> Hadoop02
> Hadoop03
>
>
> we run the "wordcount" program on "complete distributed mode" ,but it
> stops running.
> The following is the response for running the program.
>
>
> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated.
> Instea
> d, use mapreduce.job.name
> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated.
> Instead, use mapreduce.job.reduce.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated.
> Inste
> ad, use mapreduce.input.fileinputformat.inputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated.
> Instead, use mapreduce.job.maps
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1374652061495_0002
> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application
> application_1374652061495_0002 to ResourceManager at Hadoop04/
> 10.31.185.24:8040
> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job:
> http://Hadoop04:
> 8088/proxy/application_1374652061495_0002/
> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>
> it stops running at the point.
> then,
> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
> it shows "The requested application does not appear to be running yet, and
> has not set a tracking URL"
>
> I am looking forward to your reply.
>
> Best wishes,
> tadayuki,tsuyoshi,and hideki
>
--
MANISH DUNANI
-THANX
+91 9426881954,+91 8460656443
manishd207@gmail.com
Re: Question about Hadoop
Posted by Tatsuo Kawasaki <ta...@cloudera.com>.
Hi Tsuyoshi,
Did you run "wordcount" sample in hadoop-examples.jar?
Can you share the command that you run?
Thanks,
--
Tatsuo
On Tue, Aug 6, 2013 at 3:55 PM, 間々田 剛史
<ts...@stu.hosei.ac.jp>wrote:
> Dear Sir
>
> we are students at Hosei University.
> we study hadoop now for reserch.
>
> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
> we can access HDFS from master and slaves.
> We have some questions.
> Master:Hadoop04
> Slaves:Hadoop01
> Hadoop02
> Hadoop03
>
>
> we run the "wordcount" program on "complete distributed mode" ,but it
> stops running.
> The following is the response for running the program.
>
>
> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated.
> Instea
> d, use mapreduce.job.name
> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated.
> Instead, use mapreduce.job.reduce.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated.
> Inste
> ad, use mapreduce.input.fileinputformat.inputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated.
> Instead, use mapreduce.job.maps
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1374652061495_0002
> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application
> application_1374652061495_0002 to ResourceManager at Hadoop04/
> 10.31.185.24:8040
> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job:
> http://Hadoop04:
> 8088/proxy/application_1374652061495_0002/
> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>
> it stops running at the point.
> then,
> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
> it shows "The requested application does not appear to be running yet, and
> has not set a tracking URL"
>
> I am looking forward to your reply.
>
> Best wishes,
> tadayuki,tsuyoshi,and hideki
>
--
--
Tatsuo Kawasaki
tatsuo@cloudera.com
Re: Question about Hadoop
Posted by manish dunani <ma...@gmail.com>.
After checking ur error code.
I think u entered wrong map and reduce class.
can u pls show me code??
Then i will tell u correctly where u did the mistake..
On Tue, Aug 6, 2013 at 12:25 PM, 間々田 剛史
<ts...@stu.hosei.ac.jp>wrote:
> Dear Sir
>
> we are students at Hosei University.
> we study hadoop now for reserch.
>
> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
> we can access HDFS from master and slaves.
> We have some questions.
> Master:Hadoop04
> Slaves:Hadoop01
> Hadoop02
> Hadoop03
>
>
> we run the "wordcount" program on "complete distributed mode" ,but it
> stops running.
> The following is the response for running the program.
>
>
> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated.
> Instea
> d, use mapreduce.job.name
> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated.
> Instead, use mapreduce.job.reduce.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated.
> Inste
> ad, use mapreduce.input.fileinputformat.inputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated.
> Instead, use mapreduce.job.maps
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1374652061495_0002
> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application
> application_1374652061495_0002 to ResourceManager at Hadoop04/
> 10.31.185.24:8040
> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job:
> http://Hadoop04:
> 8088/proxy/application_1374652061495_0002/
> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>
> it stops running at the point.
> then,
> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
> it shows "The requested application does not appear to be running yet, and
> has not set a tracking URL"
>
> I am looking forward to your reply.
>
> Best wishes,
> tadayuki,tsuyoshi,and hideki
>
--
MANISH DUNANI
-THANX
+91 9426881954,+91 8460656443
manishd207@gmail.com
Re: Question about Hadoop
Posted by Tatsuo Kawasaki <ta...@cloudera.com>.
Hi Tsuyoshi,
Did you run "wordcount" sample in hadoop-examples.jar?
Can you share the command that you run?
Thanks,
--
Tatsuo
On Tue, Aug 6, 2013 at 3:55 PM, 間々田 剛史
<ts...@stu.hosei.ac.jp>wrote:
> Dear Sir
>
> we are students at Hosei University.
> we study hadoop now for reserch.
>
> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
> we can access HDFS from master and slaves.
> We have some questions.
> Master:Hadoop04
> Slaves:Hadoop01
> Hadoop02
> Hadoop03
>
>
> we run the "wordcount" program on "complete distributed mode" ,but it
> stops running.
> The following is the response for running the program.
>
>
> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated.
> Instea
> d, use mapreduce.job.name
> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated.
> Instead, use mapreduce.job.reduce.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated.
> Inste
> ad, use mapreduce.input.fileinputformat.inputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated.
> Instead, use mapreduce.job.maps
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1374652061495_0002
> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application
> application_1374652061495_0002 to ResourceManager at Hadoop04/
> 10.31.185.24:8040
> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job:
> http://Hadoop04:
> 8088/proxy/application_1374652061495_0002/
> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>
> it stops running at the point.
> then,
> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
> it shows "The requested application does not appear to be running yet, and
> has not set a tracking URL"
>
> I am looking forward to your reply.
>
> Best wishes,
> tadayuki,tsuyoshi,and hideki
>
--
--
Tatsuo Kawasaki
tatsuo@cloudera.com
Re: Question about Hadoop
Posted by Tatsuo Kawasaki <ta...@cloudera.com>.
Hi Tsuyoshi,
Did you run "wordcount" sample in hadoop-examples.jar?
Can you share the command that you run?
Thanks,
--
Tatsuo
On Tue, Aug 6, 2013 at 3:55 PM, 間々田 剛史
<ts...@stu.hosei.ac.jp>wrote:
> Dear Sir
>
> we are students at Hosei University.
> we study hadoop now for reserch.
>
> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
> we can access HDFS from master and slaves.
> We have some questions.
> Master:Hadoop04
> Slaves:Hadoop01
> Hadoop02
> Hadoop03
>
>
> we run the "wordcount" program on "complete distributed mode" ,but it
> stops running.
> The following is the response for running the program.
>
>
> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated.
> Instea
> d, use mapreduce.job.name
> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated.
> Instead, use mapreduce.job.reduce.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated.
> Inste
> ad, use mapreduce.input.fileinputformat.inputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated.
> Instead, use mapreduce.job.maps
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1374652061495_0002
> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application
> application_1374652061495_0002 to ResourceManager at Hadoop04/
> 10.31.185.24:8040
> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job:
> http://Hadoop04:
> 8088/proxy/application_1374652061495_0002/
> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>
> it stops running at the point.
> then,
> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
> it shows "The requested application does not appear to be running yet, and
> has not set a tracking URL"
>
> I am looking forward to your reply.
>
> Best wishes,
> tadayuki,tsuyoshi,and hideki
>
--
--
Tatsuo Kawasaki
tatsuo@cloudera.com
Re: Question about Hadoop
Posted by Tatsuo Kawasaki <ta...@cloudera.com>.
Hi Tsuyoshi,
Did you run "wordcount" sample in hadoop-examples.jar?
Can you share the command that you run?
Thanks,
--
Tatsuo
On Tue, Aug 6, 2013 at 3:55 PM, 間々田 剛史
<ts...@stu.hosei.ac.jp>wrote:
> Dear Sir
>
> we are students at Hosei University.
> we study hadoop now for reserch.
>
> we use Hadoop2.0.0-CDH4.2.1 MRv2 and its environment is centOS 6.2.
> we can access HDFS from master and slaves.
> We have some questions.
> Master:Hadoop04
> Slaves:Hadoop01
> Hadoop02
> Hadoop03
>
>
> we run the "wordcount" program on "complete distributed mode" ,but it
> stops running.
> The following is the response for running the program.
>
>
> 13/07/24 16:52:15 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.job.name is deprecated.
> Instea
> d, use mapreduce.job.name
> 13/07/24 16:52:16 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated.
> Instead, use mapreduce.job.reduce.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.input.dir is deprecated.
> Inste
> ad, use mapreduce.input.fileinputformat.inputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.map.tasks is deprecated.
> Instead, use mapreduce.job.maps
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> 13/07/24 16:52:16 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> 13/07/24 16:52:16 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1374652061495_0002
> 13/07/24 16:52:16 INFO client.YarnClientImpl: Submitted application
> application_1374652061495_0002 to ResourceManager at Hadoop04/
> 10.31.185.24:8040
> 13/07/24 16:52:16 INFO mapreduce.Job: The url to track the job:
> http://Hadoop04:
> 8088/proxy/application_1374652061495_0002/
> 13/07/24 16:52:16 INFO mapreduce.Job: Running job: job_1374652061495_0002
>
> it stops running at the point.
> then,
> when we access http://Hadoop04:8088/proxy/application_1374652061495_0002/,
> it shows "The requested application does not appear to be running yet, and
> has not set a tracking URL"
>
> I am looking forward to your reply.
>
> Best wishes,
> tadayuki,tsuyoshi,and hideki
>
--
--
Tatsuo Kawasaki
tatsuo@cloudera.com