You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by gunjan mishra <gu...@gmail.com> on 2013/10/19 20:27:38 UTC
simple word count program remains un assigned...
Hi I am trying to run a simple word count program , like this , job keeps
running but is not being assigned to Mapper and reducers ...
while I checked the status
===============================================================================================
[root@localhost ~]# hadoop jar /usr/lib/hadoop-0.20-
mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar wordcount /usr/read.txt
/usr/output
13/10/19 15:05:02 INFO service.AbstractService:
Service:org.apache.hadoop.yarn.client.YarnClientImpl
is inited.
13/10/19 15:05:02 INFO service.AbstractService:
Service:org.apache.hadoop.yarn.client.YarnClientImpl
is started.
13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to process
: 1
13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
Instead, use mapreduce.job.jar
13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is
deprecated. Instead, use mapreduce.job.output.value.class
13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
deprecated. Instead, use mapreduce.job.combine.class
13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
deprecated. Instead, use mapreduce.job.map.class
13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is deprecated.
Instead, use mapreduce.job.name
13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
deprecated. Instead, use mapreduce.job.reduce.class
13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is deprecated.
Instead, use mapreduce.input.fileinputformat.inputdir
13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is deprecated.
Instead, use mapreduce.output.fileoutputformat.outputdir
13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is deprecated.
Instead, use mapreduce.job.maps
13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
deprecated. Instead, use mapreduce.job.output.key.class
13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
deprecated. Instead, use mapreduce.job.working.dir
13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for job:
job_1382144693199_0005
13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
13/10/19 15:05:04 INFO mapreduce.Job: Running job: job_1382144693199_0005
===============================================================================================
here is my cloudera distribution
Hadoop 2.0.0-cdh4.4.0
Subversion file:///data/1/jenkins/workspace/generic-package-
rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/
hadoop-common-project/hadoop-common -r c0eba6cd38c984557e96a16ccd7356
b7de835e79
Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
>From source with checksum ac7e170aa709b3ace13dc5f775487180
This command was run using /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
and the outcome of jps (from root)
-----------------------------------------
[root@localhost ~]# jps
2202 TaskTracker
4161 Bootstrap
3134 DataNode
3520 Application
3262 NameNode
1879 ThriftServer
1740 Main
3603 RunJar
1606 HMaster
2078 JobTracker
16277 Jps
3624 RunJar
4053 RunJar
4189 Sqoop
3582 Bootstrap
3024 JobHistoryServer
3379 SecondaryNameNode
4732 ResourceManager
------------------------------------------------------
--
Thanks & Regards
Gunjan Mishra
732-200-5839(H)
917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by gunjan mishra <gu...@gmail.com>.
Thanks very much Harsh ,
I am a newbie to this , so I don't know much about MR1 or MR2(YARN) , I
just updated my old cloudera distribution to the latest following
instructions on cloudera website. Thats probably lead me to YARN and I
checked and I don't have MR1 files any more.
So please tell me if I should revert back to MR1 some how or I can continue
with YARN troubleshooting problems.
BTW thanks alot one more time.
Thanks
On Sat, Oct 19, 2013 at 11:26 PM, Harsh J <ha...@cloudera.com> wrote:
> For CDH-specific questions, you can post them onto the Cloudera
> Community forums: http://community.cloudera.com
>
> On Sun, Oct 20, 2013 at 2:45 AM, gunjan mishra <gu...@gmail.com>
> wrote:
> > HItesh ,
> >
> > My apologies , is there a different distribution list. Please can some
> one
> > point me to that.
> >
> > Thanks
> >
> >
> > On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
> >>
> >> Hello Gunjan,
> >>
> >> This mailing list is for Apache Hadoop related questions. Please post
> >> questions for other distributions to the appropriate vendor's mailing
> list.
> >>
> >> thanks
> >> -- Hitesh
> >>
> >> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
> >>
> >> > Hi I am trying to run a simple word count program , like this , job
> >> > keeps running but is not being assigned to Mapper and reducers ...
> >> > while I checked the status
> >> >
> >> >
> >> >
> ===============================================================================================
> >> >
> >> > [root@localhost ~]# hadoop jar
> >> > /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
> >> > wordcount /usr/read.txt /usr/output
> >> > 13/10/19 15:05:02 INFO service.AbstractService:
> >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> >> > 13/10/19 15:05:02 INFO service.AbstractService:
> >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> >> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
> >> > process : 1
> >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
> >> > Instead, use mapreduce.job.jar
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class
> is
> >> > deprecated. Instead, use mapreduce.job.output.value.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
> >> > deprecated. Instead, use mapreduce.job.combine.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
> >> > deprecated. Instead, use mapreduce.job.map.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
> >> > deprecated. Instead, use mapreduce.job.name
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
> >> > deprecated. Instead, use mapreduce.job.reduce.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
> >> > deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
> >> > deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
> >> > deprecated. Instead, use mapreduce.job.maps
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
> >> > deprecated. Instead, use mapreduce.job.output.key.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
> >> > deprecated. Instead, use mapreduce.job.working.dir
> >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
> >> > job: job_1382144693199_0005
> >> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
> >> > application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> >> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
> >> >
> http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> >> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job:
> >> > job_1382144693199_0005
> >> >
> >> >
> >> >
> ===============================================================================================
> >> >
> >> > here is my cloudera distribution
> >> >
> >> >
> >> > Hadoop 2.0.0-cdh4.4.0
> >> > Subversion
> >> >
> file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
> >> > -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> >> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> >> > From source with checksum ac7e170aa709b3ace13dc5f775487180
> >> > This command was run using
> >> > /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
> >> >
> >> >
> >> > and the outcome of jps (from root)
> >> >
> >> > -----------------------------------------
> >> > [root@localhost ~]# jps
> >> > 2202 TaskTracker
> >> > 4161 Bootstrap
> >> > 3134 DataNode
> >> > 3520 Application
> >> > 3262 NameNode
> >> > 1879 ThriftServer
> >> > 1740 Main
> >> > 3603 RunJar
> >> > 1606 HMaster
> >> > 2078 JobTracker
> >> > 16277 Jps
> >> > 3624 RunJar
> >> > 4053 RunJar
> >> > 4189 Sqoop
> >> > 3582 Bootstrap
> >> > 3024 JobHistoryServer
> >> > 3379 SecondaryNameNode
> >> > 4732 ResourceManager
> >> >
> >> > ------------------------------------------------------
> >> > --
> >> > Thanks & Regards
> >> > Gunjan Mishra
> >> > 732-200-5839(H)
> >> > 917-216-9739(C)
> >>
> >
> >
> >
> > --
> > Thanks & Regards
> > Gunjan Mishra
> > 732-200-5839(H)
> > 917-216-9739(C)
>
>
>
> --
> Harsh J
>
--
Thanks & Regards
Gunjan Mishra
732-200-5839(H)
917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by gunjan mishra <gu...@gmail.com>.
Thanks very much Harsh ,
I am a newbie to this , so I don't know much about MR1 or MR2(YARN) , I
just updated my old cloudera distribution to the latest following
instructions on cloudera website. Thats probably lead me to YARN and I
checked and I don't have MR1 files any more.
So please tell me if I should revert back to MR1 some how or I can continue
with YARN troubleshooting problems.
BTW thanks alot one more time.
Thanks
On Sat, Oct 19, 2013 at 11:26 PM, Harsh J <ha...@cloudera.com> wrote:
> For CDH-specific questions, you can post them onto the Cloudera
> Community forums: http://community.cloudera.com
>
> On Sun, Oct 20, 2013 at 2:45 AM, gunjan mishra <gu...@gmail.com>
> wrote:
> > HItesh ,
> >
> > My apologies , is there a different distribution list. Please can some
> one
> > point me to that.
> >
> > Thanks
> >
> >
> > On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
> >>
> >> Hello Gunjan,
> >>
> >> This mailing list is for Apache Hadoop related questions. Please post
> >> questions for other distributions to the appropriate vendor's mailing
> list.
> >>
> >> thanks
> >> -- Hitesh
> >>
> >> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
> >>
> >> > Hi I am trying to run a simple word count program , like this , job
> >> > keeps running but is not being assigned to Mapper and reducers ...
> >> > while I checked the status
> >> >
> >> >
> >> >
> ===============================================================================================
> >> >
> >> > [root@localhost ~]# hadoop jar
> >> > /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
> >> > wordcount /usr/read.txt /usr/output
> >> > 13/10/19 15:05:02 INFO service.AbstractService:
> >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> >> > 13/10/19 15:05:02 INFO service.AbstractService:
> >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> >> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
> >> > process : 1
> >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
> >> > Instead, use mapreduce.job.jar
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class
> is
> >> > deprecated. Instead, use mapreduce.job.output.value.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
> >> > deprecated. Instead, use mapreduce.job.combine.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
> >> > deprecated. Instead, use mapreduce.job.map.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
> >> > deprecated. Instead, use mapreduce.job.name
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
> >> > deprecated. Instead, use mapreduce.job.reduce.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
> >> > deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
> >> > deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
> >> > deprecated. Instead, use mapreduce.job.maps
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
> >> > deprecated. Instead, use mapreduce.job.output.key.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
> >> > deprecated. Instead, use mapreduce.job.working.dir
> >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
> >> > job: job_1382144693199_0005
> >> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
> >> > application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> >> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
> >> >
> http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> >> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job:
> >> > job_1382144693199_0005
> >> >
> >> >
> >> >
> ===============================================================================================
> >> >
> >> > here is my cloudera distribution
> >> >
> >> >
> >> > Hadoop 2.0.0-cdh4.4.0
> >> > Subversion
> >> >
> file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
> >> > -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> >> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> >> > From source with checksum ac7e170aa709b3ace13dc5f775487180
> >> > This command was run using
> >> > /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
> >> >
> >> >
> >> > and the outcome of jps (from root)
> >> >
> >> > -----------------------------------------
> >> > [root@localhost ~]# jps
> >> > 2202 TaskTracker
> >> > 4161 Bootstrap
> >> > 3134 DataNode
> >> > 3520 Application
> >> > 3262 NameNode
> >> > 1879 ThriftServer
> >> > 1740 Main
> >> > 3603 RunJar
> >> > 1606 HMaster
> >> > 2078 JobTracker
> >> > 16277 Jps
> >> > 3624 RunJar
> >> > 4053 RunJar
> >> > 4189 Sqoop
> >> > 3582 Bootstrap
> >> > 3024 JobHistoryServer
> >> > 3379 SecondaryNameNode
> >> > 4732 ResourceManager
> >> >
> >> > ------------------------------------------------------
> >> > --
> >> > Thanks & Regards
> >> > Gunjan Mishra
> >> > 732-200-5839(H)
> >> > 917-216-9739(C)
> >>
> >
> >
> >
> > --
> > Thanks & Regards
> > Gunjan Mishra
> > 732-200-5839(H)
> > 917-216-9739(C)
>
>
>
> --
> Harsh J
>
--
Thanks & Regards
Gunjan Mishra
732-200-5839(H)
917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by gunjan mishra <gu...@gmail.com>.
Thanks very much Harsh ,
I am a newbie to this , so I don't know much about MR1 or MR2(YARN) , I
just updated my old cloudera distribution to the latest following
instructions on cloudera website. Thats probably lead me to YARN and I
checked and I don't have MR1 files any more.
So please tell me if I should revert back to MR1 some how or I can continue
with YARN troubleshooting problems.
BTW thanks alot one more time.
Thanks
On Sat, Oct 19, 2013 at 11:26 PM, Harsh J <ha...@cloudera.com> wrote:
> For CDH-specific questions, you can post them onto the Cloudera
> Community forums: http://community.cloudera.com
>
> On Sun, Oct 20, 2013 at 2:45 AM, gunjan mishra <gu...@gmail.com>
> wrote:
> > HItesh ,
> >
> > My apologies , is there a different distribution list. Please can some
> one
> > point me to that.
> >
> > Thanks
> >
> >
> > On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
> >>
> >> Hello Gunjan,
> >>
> >> This mailing list is for Apache Hadoop related questions. Please post
> >> questions for other distributions to the appropriate vendor's mailing
> list.
> >>
> >> thanks
> >> -- Hitesh
> >>
> >> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
> >>
> >> > Hi I am trying to run a simple word count program , like this , job
> >> > keeps running but is not being assigned to Mapper and reducers ...
> >> > while I checked the status
> >> >
> >> >
> >> >
> ===============================================================================================
> >> >
> >> > [root@localhost ~]# hadoop jar
> >> > /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
> >> > wordcount /usr/read.txt /usr/output
> >> > 13/10/19 15:05:02 INFO service.AbstractService:
> >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> >> > 13/10/19 15:05:02 INFO service.AbstractService:
> >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> >> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
> >> > process : 1
> >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
> >> > Instead, use mapreduce.job.jar
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class
> is
> >> > deprecated. Instead, use mapreduce.job.output.value.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
> >> > deprecated. Instead, use mapreduce.job.combine.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
> >> > deprecated. Instead, use mapreduce.job.map.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
> >> > deprecated. Instead, use mapreduce.job.name
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
> >> > deprecated. Instead, use mapreduce.job.reduce.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
> >> > deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
> >> > deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
> >> > deprecated. Instead, use mapreduce.job.maps
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
> >> > deprecated. Instead, use mapreduce.job.output.key.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
> >> > deprecated. Instead, use mapreduce.job.working.dir
> >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
> >> > job: job_1382144693199_0005
> >> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
> >> > application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> >> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
> >> >
> http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> >> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job:
> >> > job_1382144693199_0005
> >> >
> >> >
> >> >
> ===============================================================================================
> >> >
> >> > here is my cloudera distribution
> >> >
> >> >
> >> > Hadoop 2.0.0-cdh4.4.0
> >> > Subversion
> >> >
> file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
> >> > -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> >> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> >> > From source with checksum ac7e170aa709b3ace13dc5f775487180
> >> > This command was run using
> >> > /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
> >> >
> >> >
> >> > and the outcome of jps (from root)
> >> >
> >> > -----------------------------------------
> >> > [root@localhost ~]# jps
> >> > 2202 TaskTracker
> >> > 4161 Bootstrap
> >> > 3134 DataNode
> >> > 3520 Application
> >> > 3262 NameNode
> >> > 1879 ThriftServer
> >> > 1740 Main
> >> > 3603 RunJar
> >> > 1606 HMaster
> >> > 2078 JobTracker
> >> > 16277 Jps
> >> > 3624 RunJar
> >> > 4053 RunJar
> >> > 4189 Sqoop
> >> > 3582 Bootstrap
> >> > 3024 JobHistoryServer
> >> > 3379 SecondaryNameNode
> >> > 4732 ResourceManager
> >> >
> >> > ------------------------------------------------------
> >> > --
> >> > Thanks & Regards
> >> > Gunjan Mishra
> >> > 732-200-5839(H)
> >> > 917-216-9739(C)
> >>
> >
> >
> >
> > --
> > Thanks & Regards
> > Gunjan Mishra
> > 732-200-5839(H)
> > 917-216-9739(C)
>
>
>
> --
> Harsh J
>
--
Thanks & Regards
Gunjan Mishra
732-200-5839(H)
917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by gunjan mishra <gu...@gmail.com>.
Thanks very much Harsh ,
I am a newbie to this , so I don't know much about MR1 or MR2(YARN) , I
just updated my old cloudera distribution to the latest following
instructions on cloudera website. Thats probably lead me to YARN and I
checked and I don't have MR1 files any more.
So please tell me if I should revert back to MR1 some how or I can continue
with YARN troubleshooting problems.
BTW thanks alot one more time.
Thanks
On Sat, Oct 19, 2013 at 11:26 PM, Harsh J <ha...@cloudera.com> wrote:
> For CDH-specific questions, you can post them onto the Cloudera
> Community forums: http://community.cloudera.com
>
> On Sun, Oct 20, 2013 at 2:45 AM, gunjan mishra <gu...@gmail.com>
> wrote:
> > HItesh ,
> >
> > My apologies , is there a different distribution list. Please can some
> one
> > point me to that.
> >
> > Thanks
> >
> >
> > On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
> >>
> >> Hello Gunjan,
> >>
> >> This mailing list is for Apache Hadoop related questions. Please post
> >> questions for other distributions to the appropriate vendor's mailing
> list.
> >>
> >> thanks
> >> -- Hitesh
> >>
> >> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
> >>
> >> > Hi I am trying to run a simple word count program , like this , job
> >> > keeps running but is not being assigned to Mapper and reducers ...
> >> > while I checked the status
> >> >
> >> >
> >> >
> ===============================================================================================
> >> >
> >> > [root@localhost ~]# hadoop jar
> >> > /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
> >> > wordcount /usr/read.txt /usr/output
> >> > 13/10/19 15:05:02 INFO service.AbstractService:
> >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> >> > 13/10/19 15:05:02 INFO service.AbstractService:
> >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> >> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
> >> > process : 1
> >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
> >> > Instead, use mapreduce.job.jar
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class
> is
> >> > deprecated. Instead, use mapreduce.job.output.value.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
> >> > deprecated. Instead, use mapreduce.job.combine.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
> >> > deprecated. Instead, use mapreduce.job.map.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
> >> > deprecated. Instead, use mapreduce.job.name
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
> >> > deprecated. Instead, use mapreduce.job.reduce.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
> >> > deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
> >> > deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
> >> > deprecated. Instead, use mapreduce.job.maps
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
> >> > deprecated. Instead, use mapreduce.job.output.key.class
> >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
> >> > deprecated. Instead, use mapreduce.job.working.dir
> >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
> >> > job: job_1382144693199_0005
> >> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
> >> > application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> >> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
> >> >
> http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> >> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job:
> >> > job_1382144693199_0005
> >> >
> >> >
> >> >
> ===============================================================================================
> >> >
> >> > here is my cloudera distribution
> >> >
> >> >
> >> > Hadoop 2.0.0-cdh4.4.0
> >> > Subversion
> >> >
> file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
> >> > -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> >> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> >> > From source with checksum ac7e170aa709b3ace13dc5f775487180
> >> > This command was run using
> >> > /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
> >> >
> >> >
> >> > and the outcome of jps (from root)
> >> >
> >> > -----------------------------------------
> >> > [root@localhost ~]# jps
> >> > 2202 TaskTracker
> >> > 4161 Bootstrap
> >> > 3134 DataNode
> >> > 3520 Application
> >> > 3262 NameNode
> >> > 1879 ThriftServer
> >> > 1740 Main
> >> > 3603 RunJar
> >> > 1606 HMaster
> >> > 2078 JobTracker
> >> > 16277 Jps
> >> > 3624 RunJar
> >> > 4053 RunJar
> >> > 4189 Sqoop
> >> > 3582 Bootstrap
> >> > 3024 JobHistoryServer
> >> > 3379 SecondaryNameNode
> >> > 4732 ResourceManager
> >> >
> >> > ------------------------------------------------------
> >> > --
> >> > Thanks & Regards
> >> > Gunjan Mishra
> >> > 732-200-5839(H)
> >> > 917-216-9739(C)
> >>
> >
> >
> >
> > --
> > Thanks & Regards
> > Gunjan Mishra
> > 732-200-5839(H)
> > 917-216-9739(C)
>
>
>
> --
> Harsh J
>
--
Thanks & Regards
Gunjan Mishra
732-200-5839(H)
917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by Harsh J <ha...@cloudera.com>.
For CDH-specific questions, you can post them onto the Cloudera
Community forums: http://community.cloudera.com
On Sun, Oct 20, 2013 at 2:45 AM, gunjan mishra <gu...@gmail.com> wrote:
> HItesh ,
>
> My apologies , is there a different distribution list. Please can some one
> point me to that.
>
> Thanks
>
>
> On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
>>
>> Hello Gunjan,
>>
>> This mailing list is for Apache Hadoop related questions. Please post
>> questions for other distributions to the appropriate vendor's mailing list.
>>
>> thanks
>> -- Hitesh
>>
>> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
>>
>> > Hi I am trying to run a simple word count program , like this , job
>> > keeps running but is not being assigned to Mapper and reducers ...
>> > while I checked the status
>> >
>> >
>> > ===============================================================================================
>> >
>> > [root@localhost ~]# hadoop jar
>> > /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
>> > wordcount /usr/read.txt /usr/output
>> > 13/10/19 15:05:02 INFO service.AbstractService:
>> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
>> > 13/10/19 15:05:02 INFO service.AbstractService:
>> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
>> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
>> > process : 1
>> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
>> > Instead, use mapreduce.job.jar
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is
>> > deprecated. Instead, use mapreduce.job.output.value.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
>> > deprecated. Instead, use mapreduce.job.combine.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
>> > deprecated. Instead, use mapreduce.job.map.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
>> > deprecated. Instead, use mapreduce.job.name
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
>> > deprecated. Instead, use mapreduce.job.reduce.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
>> > deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
>> > deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
>> > deprecated. Instead, use mapreduce.job.maps
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
>> > deprecated. Instead, use mapreduce.job.output.key.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
>> > deprecated. Instead, use mapreduce.job.working.dir
>> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
>> > job: job_1382144693199_0005
>> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
>> > application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
>> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
>> > http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
>> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job:
>> > job_1382144693199_0005
>> >
>> >
>> > ===============================================================================================
>> >
>> > here is my cloudera distribution
>> >
>> >
>> > Hadoop 2.0.0-cdh4.4.0
>> > Subversion
>> > file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
>> > -r c0eba6cd38c984557e96a16ccd7356b7de835e79
>> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
>> > From source with checksum ac7e170aa709b3ace13dc5f775487180
>> > This command was run using
>> > /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
>> >
>> >
>> > and the outcome of jps (from root)
>> >
>> > -----------------------------------------
>> > [root@localhost ~]# jps
>> > 2202 TaskTracker
>> > 4161 Bootstrap
>> > 3134 DataNode
>> > 3520 Application
>> > 3262 NameNode
>> > 1879 ThriftServer
>> > 1740 Main
>> > 3603 RunJar
>> > 1606 HMaster
>> > 2078 JobTracker
>> > 16277 Jps
>> > 3624 RunJar
>> > 4053 RunJar
>> > 4189 Sqoop
>> > 3582 Bootstrap
>> > 3024 JobHistoryServer
>> > 3379 SecondaryNameNode
>> > 4732 ResourceManager
>> >
>> > ------------------------------------------------------
>> > --
>> > Thanks & Regards
>> > Gunjan Mishra
>> > 732-200-5839(H)
>> > 917-216-9739(C)
>>
>
>
>
> --
> Thanks & Regards
> Gunjan Mishra
> 732-200-5839(H)
> 917-216-9739(C)
--
Harsh J
Re: simple word count program remains un assigned...
Posted by Harsh J <ha...@cloudera.com>.
For CDH-specific questions, you can post them onto the Cloudera
Community forums: http://community.cloudera.com
On Sun, Oct 20, 2013 at 2:45 AM, gunjan mishra <gu...@gmail.com> wrote:
> HItesh ,
>
> My apologies , is there a different distribution list. Please can some one
> point me to that.
>
> Thanks
>
>
> On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
>>
>> Hello Gunjan,
>>
>> This mailing list is for Apache Hadoop related questions. Please post
>> questions for other distributions to the appropriate vendor's mailing list.
>>
>> thanks
>> -- Hitesh
>>
>> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
>>
>> > Hi I am trying to run a simple word count program , like this , job
>> > keeps running but is not being assigned to Mapper and reducers ...
>> > while I checked the status
>> >
>> >
>> > ===============================================================================================
>> >
>> > [root@localhost ~]# hadoop jar
>> > /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
>> > wordcount /usr/read.txt /usr/output
>> > 13/10/19 15:05:02 INFO service.AbstractService:
>> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
>> > 13/10/19 15:05:02 INFO service.AbstractService:
>> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
>> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
>> > process : 1
>> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
>> > Instead, use mapreduce.job.jar
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is
>> > deprecated. Instead, use mapreduce.job.output.value.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
>> > deprecated. Instead, use mapreduce.job.combine.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
>> > deprecated. Instead, use mapreduce.job.map.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
>> > deprecated. Instead, use mapreduce.job.name
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
>> > deprecated. Instead, use mapreduce.job.reduce.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
>> > deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
>> > deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
>> > deprecated. Instead, use mapreduce.job.maps
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
>> > deprecated. Instead, use mapreduce.job.output.key.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
>> > deprecated. Instead, use mapreduce.job.working.dir
>> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
>> > job: job_1382144693199_0005
>> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
>> > application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
>> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
>> > http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
>> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job:
>> > job_1382144693199_0005
>> >
>> >
>> > ===============================================================================================
>> >
>> > here is my cloudera distribution
>> >
>> >
>> > Hadoop 2.0.0-cdh4.4.0
>> > Subversion
>> > file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
>> > -r c0eba6cd38c984557e96a16ccd7356b7de835e79
>> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
>> > From source with checksum ac7e170aa709b3ace13dc5f775487180
>> > This command was run using
>> > /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
>> >
>> >
>> > and the outcome of jps (from root)
>> >
>> > -----------------------------------------
>> > [root@localhost ~]# jps
>> > 2202 TaskTracker
>> > 4161 Bootstrap
>> > 3134 DataNode
>> > 3520 Application
>> > 3262 NameNode
>> > 1879 ThriftServer
>> > 1740 Main
>> > 3603 RunJar
>> > 1606 HMaster
>> > 2078 JobTracker
>> > 16277 Jps
>> > 3624 RunJar
>> > 4053 RunJar
>> > 4189 Sqoop
>> > 3582 Bootstrap
>> > 3024 JobHistoryServer
>> > 3379 SecondaryNameNode
>> > 4732 ResourceManager
>> >
>> > ------------------------------------------------------
>> > --
>> > Thanks & Regards
>> > Gunjan Mishra
>> > 732-200-5839(H)
>> > 917-216-9739(C)
>>
>
>
>
> --
> Thanks & Regards
> Gunjan Mishra
> 732-200-5839(H)
> 917-216-9739(C)
--
Harsh J
Re: simple word count program remains un assigned...
Posted by Harsh J <ha...@cloudera.com>.
For CDH-specific questions, you can post them onto the Cloudera
Community forums: http://community.cloudera.com
On Sun, Oct 20, 2013 at 2:45 AM, gunjan mishra <gu...@gmail.com> wrote:
> HItesh ,
>
> My apologies , is there a different distribution list. Please can some one
> point me to that.
>
> Thanks
>
>
> On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
>>
>> Hello Gunjan,
>>
>> This mailing list is for Apache Hadoop related questions. Please post
>> questions for other distributions to the appropriate vendor's mailing list.
>>
>> thanks
>> -- Hitesh
>>
>> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
>>
>> > Hi I am trying to run a simple word count program , like this , job
>> > keeps running but is not being assigned to Mapper and reducers ...
>> > while I checked the status
>> >
>> >
>> > ===============================================================================================
>> >
>> > [root@localhost ~]# hadoop jar
>> > /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
>> > wordcount /usr/read.txt /usr/output
>> > 13/10/19 15:05:02 INFO service.AbstractService:
>> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
>> > 13/10/19 15:05:02 INFO service.AbstractService:
>> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
>> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
>> > process : 1
>> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
>> > Instead, use mapreduce.job.jar
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is
>> > deprecated. Instead, use mapreduce.job.output.value.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
>> > deprecated. Instead, use mapreduce.job.combine.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
>> > deprecated. Instead, use mapreduce.job.map.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
>> > deprecated. Instead, use mapreduce.job.name
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
>> > deprecated. Instead, use mapreduce.job.reduce.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
>> > deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
>> > deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
>> > deprecated. Instead, use mapreduce.job.maps
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
>> > deprecated. Instead, use mapreduce.job.output.key.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
>> > deprecated. Instead, use mapreduce.job.working.dir
>> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
>> > job: job_1382144693199_0005
>> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
>> > application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
>> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
>> > http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
>> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job:
>> > job_1382144693199_0005
>> >
>> >
>> > ===============================================================================================
>> >
>> > here is my cloudera distribution
>> >
>> >
>> > Hadoop 2.0.0-cdh4.4.0
>> > Subversion
>> > file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
>> > -r c0eba6cd38c984557e96a16ccd7356b7de835e79
>> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
>> > From source with checksum ac7e170aa709b3ace13dc5f775487180
>> > This command was run using
>> > /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
>> >
>> >
>> > and the outcome of jps (from root)
>> >
>> > -----------------------------------------
>> > [root@localhost ~]# jps
>> > 2202 TaskTracker
>> > 4161 Bootstrap
>> > 3134 DataNode
>> > 3520 Application
>> > 3262 NameNode
>> > 1879 ThriftServer
>> > 1740 Main
>> > 3603 RunJar
>> > 1606 HMaster
>> > 2078 JobTracker
>> > 16277 Jps
>> > 3624 RunJar
>> > 4053 RunJar
>> > 4189 Sqoop
>> > 3582 Bootstrap
>> > 3024 JobHistoryServer
>> > 3379 SecondaryNameNode
>> > 4732 ResourceManager
>> >
>> > ------------------------------------------------------
>> > --
>> > Thanks & Regards
>> > Gunjan Mishra
>> > 732-200-5839(H)
>> > 917-216-9739(C)
>>
>
>
>
> --
> Thanks & Regards
> Gunjan Mishra
> 732-200-5839(H)
> 917-216-9739(C)
--
Harsh J
Re: simple word count program remains un assigned...
Posted by Harsh J <ha...@cloudera.com>.
For CDH-specific questions, you can post them onto the Cloudera
Community forums: http://community.cloudera.com
On Sun, Oct 20, 2013 at 2:45 AM, gunjan mishra <gu...@gmail.com> wrote:
> HItesh ,
>
> My apologies , is there a different distribution list. Please can some one
> point me to that.
>
> Thanks
>
>
> On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
>>
>> Hello Gunjan,
>>
>> This mailing list is for Apache Hadoop related questions. Please post
>> questions for other distributions to the appropriate vendor's mailing list.
>>
>> thanks
>> -- Hitesh
>>
>> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
>>
>> > Hi I am trying to run a simple word count program , like this , job
>> > keeps running but is not being assigned to Mapper and reducers ...
>> > while I checked the status
>> >
>> >
>> > ===============================================================================================
>> >
>> > [root@localhost ~]# hadoop jar
>> > /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
>> > wordcount /usr/read.txt /usr/output
>> > 13/10/19 15:05:02 INFO service.AbstractService:
>> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
>> > 13/10/19 15:05:02 INFO service.AbstractService:
>> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
>> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
>> > process : 1
>> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
>> > Instead, use mapreduce.job.jar
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is
>> > deprecated. Instead, use mapreduce.job.output.value.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
>> > deprecated. Instead, use mapreduce.job.combine.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
>> > deprecated. Instead, use mapreduce.job.map.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
>> > deprecated. Instead, use mapreduce.job.name
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
>> > deprecated. Instead, use mapreduce.job.reduce.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
>> > deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
>> > deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
>> > deprecated. Instead, use mapreduce.job.maps
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
>> > deprecated. Instead, use mapreduce.job.output.key.class
>> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
>> > deprecated. Instead, use mapreduce.job.working.dir
>> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
>> > job: job_1382144693199_0005
>> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
>> > application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
>> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
>> > http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
>> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job:
>> > job_1382144693199_0005
>> >
>> >
>> > ===============================================================================================
>> >
>> > here is my cloudera distribution
>> >
>> >
>> > Hadoop 2.0.0-cdh4.4.0
>> > Subversion
>> > file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
>> > -r c0eba6cd38c984557e96a16ccd7356b7de835e79
>> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
>> > From source with checksum ac7e170aa709b3ace13dc5f775487180
>> > This command was run using
>> > /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
>> >
>> >
>> > and the outcome of jps (from root)
>> >
>> > -----------------------------------------
>> > [root@localhost ~]# jps
>> > 2202 TaskTracker
>> > 4161 Bootstrap
>> > 3134 DataNode
>> > 3520 Application
>> > 3262 NameNode
>> > 1879 ThriftServer
>> > 1740 Main
>> > 3603 RunJar
>> > 1606 HMaster
>> > 2078 JobTracker
>> > 16277 Jps
>> > 3624 RunJar
>> > 4053 RunJar
>> > 4189 Sqoop
>> > 3582 Bootstrap
>> > 3024 JobHistoryServer
>> > 3379 SecondaryNameNode
>> > 4732 ResourceManager
>> >
>> > ------------------------------------------------------
>> > --
>> > Thanks & Regards
>> > Gunjan Mishra
>> > 732-200-5839(H)
>> > 917-216-9739(C)
>>
>
>
>
> --
> Thanks & Regards
> Gunjan Mishra
> 732-200-5839(H)
> 917-216-9739(C)
--
Harsh J
Re: simple word count program remains un assigned...
Posted by gunjan mishra <gu...@gmail.com>.
HItesh ,
My apologies , is there a different distribution list. Please can some one
point me to that.
Thanks
On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
> Hello Gunjan,
>
> This mailing list is for Apache Hadoop related questions. Please post
> questions for other distributions to the appropriate vendor's mailing list.
>
> thanks
> -- Hitesh
>
> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
>
> > Hi I am trying to run a simple word count program , like this , job
> keeps running but is not being assigned to Mapper and reducers ...
> > while I checked the status
> >
> >
> ===============================================================================================
> >
> > [root@localhost ~]# hadoop jar
> /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
> wordcount /usr/read.txt /usr/output
> > 13/10/19 15:05:02 INFO service.AbstractService:
> Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> > 13/10/19 15:05:02 INFO service.AbstractService:
> Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
> process : 1
> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
> Instead, use mapreduce.job.jar
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is
> deprecated. Instead, use mapreduce.job.output.value.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
> deprecated. Instead, use mapreduce.job.combine.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
> deprecated. Instead, use mapreduce.job.map.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
> deprecated. Instead, use mapreduce.job.name
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated. Instead, use mapreduce.job.reduce.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
> deprecated. Instead, use mapreduce.job.maps
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
> job: job_1382144693199_0005
> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
> application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
> http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job: job_1382144693199_0005
> >
> >
> ===============================================================================================
> >
> > here is my cloudera distribution
> >
> >
> > Hadoop 2.0.0-cdh4.4.0
> > Subversion
> file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
> -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> > From source with checksum ac7e170aa709b3ace13dc5f775487180
> > This command was run using
> /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
> >
> >
> > and the outcome of jps (from root)
> >
> > -----------------------------------------
> > [root@localhost ~]# jps
> > 2202 TaskTracker
> > 4161 Bootstrap
> > 3134 DataNode
> > 3520 Application
> > 3262 NameNode
> > 1879 ThriftServer
> > 1740 Main
> > 3603 RunJar
> > 1606 HMaster
> > 2078 JobTracker
> > 16277 Jps
> > 3624 RunJar
> > 4053 RunJar
> > 4189 Sqoop
> > 3582 Bootstrap
> > 3024 JobHistoryServer
> > 3379 SecondaryNameNode
> > 4732 ResourceManager
> >
> > ------------------------------------------------------
> > --
> > Thanks & Regards
> > Gunjan Mishra
> > 732-200-5839(H)
> > 917-216-9739(C)
>
>
--
Thanks & Regards
Gunjan Mishra
732-200-5839(H)
917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by gunjan mishra <gu...@gmail.com>.
HItesh ,
My apologies , is there a different distribution list. Please can some one
point me to that.
Thanks
On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
> Hello Gunjan,
>
> This mailing list is for Apache Hadoop related questions. Please post
> questions for other distributions to the appropriate vendor's mailing list.
>
> thanks
> -- Hitesh
>
> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
>
> > Hi I am trying to run a simple word count program , like this , job
> keeps running but is not being assigned to Mapper and reducers ...
> > while I checked the status
> >
> >
> ===============================================================================================
> >
> > [root@localhost ~]# hadoop jar
> /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
> wordcount /usr/read.txt /usr/output
> > 13/10/19 15:05:02 INFO service.AbstractService:
> Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> > 13/10/19 15:05:02 INFO service.AbstractService:
> Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
> process : 1
> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
> Instead, use mapreduce.job.jar
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is
> deprecated. Instead, use mapreduce.job.output.value.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
> deprecated. Instead, use mapreduce.job.combine.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
> deprecated. Instead, use mapreduce.job.map.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
> deprecated. Instead, use mapreduce.job.name
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated. Instead, use mapreduce.job.reduce.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
> deprecated. Instead, use mapreduce.job.maps
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
> job: job_1382144693199_0005
> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
> application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
> http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job: job_1382144693199_0005
> >
> >
> ===============================================================================================
> >
> > here is my cloudera distribution
> >
> >
> > Hadoop 2.0.0-cdh4.4.0
> > Subversion
> file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
> -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> > From source with checksum ac7e170aa709b3ace13dc5f775487180
> > This command was run using
> /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
> >
> >
> > and the outcome of jps (from root)
> >
> > -----------------------------------------
> > [root@localhost ~]# jps
> > 2202 TaskTracker
> > 4161 Bootstrap
> > 3134 DataNode
> > 3520 Application
> > 3262 NameNode
> > 1879 ThriftServer
> > 1740 Main
> > 3603 RunJar
> > 1606 HMaster
> > 2078 JobTracker
> > 16277 Jps
> > 3624 RunJar
> > 4053 RunJar
> > 4189 Sqoop
> > 3582 Bootstrap
> > 3024 JobHistoryServer
> > 3379 SecondaryNameNode
> > 4732 ResourceManager
> >
> > ------------------------------------------------------
> > --
> > Thanks & Regards
> > Gunjan Mishra
> > 732-200-5839(H)
> > 917-216-9739(C)
>
>
--
Thanks & Regards
Gunjan Mishra
732-200-5839(H)
917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by gunjan mishra <gu...@gmail.com>.
HItesh ,
My apologies , is there a different distribution list. Please can some one
point me to that.
Thanks
On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
> Hello Gunjan,
>
> This mailing list is for Apache Hadoop related questions. Please post
> questions for other distributions to the appropriate vendor's mailing list.
>
> thanks
> -- Hitesh
>
> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
>
> > Hi I am trying to run a simple word count program , like this , job
> keeps running but is not being assigned to Mapper and reducers ...
> > while I checked the status
> >
> >
> ===============================================================================================
> >
> > [root@localhost ~]# hadoop jar
> /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
> wordcount /usr/read.txt /usr/output
> > 13/10/19 15:05:02 INFO service.AbstractService:
> Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> > 13/10/19 15:05:02 INFO service.AbstractService:
> Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
> process : 1
> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
> Instead, use mapreduce.job.jar
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is
> deprecated. Instead, use mapreduce.job.output.value.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
> deprecated. Instead, use mapreduce.job.combine.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
> deprecated. Instead, use mapreduce.job.map.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
> deprecated. Instead, use mapreduce.job.name
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated. Instead, use mapreduce.job.reduce.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
> deprecated. Instead, use mapreduce.job.maps
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
> job: job_1382144693199_0005
> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
> application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
> http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job: job_1382144693199_0005
> >
> >
> ===============================================================================================
> >
> > here is my cloudera distribution
> >
> >
> > Hadoop 2.0.0-cdh4.4.0
> > Subversion
> file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
> -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> > From source with checksum ac7e170aa709b3ace13dc5f775487180
> > This command was run using
> /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
> >
> >
> > and the outcome of jps (from root)
> >
> > -----------------------------------------
> > [root@localhost ~]# jps
> > 2202 TaskTracker
> > 4161 Bootstrap
> > 3134 DataNode
> > 3520 Application
> > 3262 NameNode
> > 1879 ThriftServer
> > 1740 Main
> > 3603 RunJar
> > 1606 HMaster
> > 2078 JobTracker
> > 16277 Jps
> > 3624 RunJar
> > 4053 RunJar
> > 4189 Sqoop
> > 3582 Bootstrap
> > 3024 JobHistoryServer
> > 3379 SecondaryNameNode
> > 4732 ResourceManager
> >
> > ------------------------------------------------------
> > --
> > Thanks & Regards
> > Gunjan Mishra
> > 732-200-5839(H)
> > 917-216-9739(C)
>
>
--
Thanks & Regards
Gunjan Mishra
732-200-5839(H)
917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by gunjan mishra <gu...@gmail.com>.
HItesh ,
My apologies , is there a different distribution list. Please can some one
point me to that.
Thanks
On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <hi...@apache.org> wrote:
> Hello Gunjan,
>
> This mailing list is for Apache Hadoop related questions. Please post
> questions for other distributions to the appropriate vendor's mailing list.
>
> thanks
> -- Hitesh
>
> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
>
> > Hi I am trying to run a simple word count program , like this , job
> keeps running but is not being assigned to Mapper and reducers ...
> > while I checked the status
> >
> >
> ===============================================================================================
> >
> > [root@localhost ~]# hadoop jar
> /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar
> wordcount /usr/read.txt /usr/output
> > 13/10/19 15:05:02 INFO service.AbstractService:
> Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> > 13/10/19 15:05:02 INFO service.AbstractService:
> Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to
> process : 1
> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated.
> Instead, use mapreduce.job.jar
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is
> deprecated. Instead, use mapreduce.job.output.value.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is
> deprecated. Instead, use mapreduce.job.combine.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is
> deprecated. Instead, use mapreduce.job.map.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is
> deprecated. Instead, use mapreduce.job.name
> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is
> deprecated. Instead, use mapreduce.job.reduce.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is
> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is
> deprecated. Instead, use mapreduce.job.maps
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is
> deprecated. Instead, use mapreduce.job.output.key.class
> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is
> deprecated. Instead, use mapreduce.job.working.dir
> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for
> job: job_1382144693199_0005
> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application
> application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job:
> http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job: job_1382144693199_0005
> >
> >
> ===============================================================================================
> >
> > here is my cloudera distribution
> >
> >
> > Hadoop 2.0.0-cdh4.4.0
> > Subversion
> file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common
> -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> > From source with checksum ac7e170aa709b3ace13dc5f775487180
> > This command was run using
> /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
> >
> >
> > and the outcome of jps (from root)
> >
> > -----------------------------------------
> > [root@localhost ~]# jps
> > 2202 TaskTracker
> > 4161 Bootstrap
> > 3134 DataNode
> > 3520 Application
> > 3262 NameNode
> > 1879 ThriftServer
> > 1740 Main
> > 3603 RunJar
> > 1606 HMaster
> > 2078 JobTracker
> > 16277 Jps
> > 3624 RunJar
> > 4053 RunJar
> > 4189 Sqoop
> > 3582 Bootstrap
> > 3024 JobHistoryServer
> > 3379 SecondaryNameNode
> > 4732 ResourceManager
> >
> > ------------------------------------------------------
> > --
> > Thanks & Regards
> > Gunjan Mishra
> > 732-200-5839(H)
> > 917-216-9739(C)
>
>
--
Thanks & Regards
Gunjan Mishra
732-200-5839(H)
917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by Hitesh Shah <hi...@apache.org>.
Hello Gunjan,
This mailing list is for Apache Hadoop related questions. Please post questions for other distributions to the appropriate vendor's mailing list.
thanks
-- Hitesh
On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
> Hi I am trying to run a simple word count program , like this , job keeps running but is not being assigned to Mapper and reducers ...
> while I checked the status
>
> ===============================================================================================
>
> [root@localhost ~]# hadoop jar /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar wordcount /usr/read.txt /usr/output
> 13/10/19 15:05:02 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> 13/10/19 15:05:02 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to process : 1
> 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is deprecated. Instead, use mapreduce.job.combine.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is deprecated. Instead, use mapreduce.job.name
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
> 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1382144693199_0005
> 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job: http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> 13/10/19 15:05:04 INFO mapreduce.Job: Running job: job_1382144693199_0005
>
> ===============================================================================================
>
> here is my cloudera distribution
>
>
> Hadoop 2.0.0-cdh4.4.0
> Subversion file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> From source with checksum ac7e170aa709b3ace13dc5f775487180
> This command was run using /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
>
>
> and the outcome of jps (from root)
>
> -----------------------------------------
> [root@localhost ~]# jps
> 2202 TaskTracker
> 4161 Bootstrap
> 3134 DataNode
> 3520 Application
> 3262 NameNode
> 1879 ThriftServer
> 1740 Main
> 3603 RunJar
> 1606 HMaster
> 2078 JobTracker
> 16277 Jps
> 3624 RunJar
> 4053 RunJar
> 4189 Sqoop
> 3582 Bootstrap
> 3024 JobHistoryServer
> 3379 SecondaryNameNode
> 4732 ResourceManager
>
> ------------------------------------------------------
> --
> Thanks & Regards
> Gunjan Mishra
> 732-200-5839(H)
> 917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by Hitesh Shah <hi...@apache.org>.
Hello Gunjan,
This mailing list is for Apache Hadoop related questions. Please post questions for other distributions to the appropriate vendor's mailing list.
thanks
-- Hitesh
On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
> Hi I am trying to run a simple word count program , like this , job keeps running but is not being assigned to Mapper and reducers ...
> while I checked the status
>
> ===============================================================================================
>
> [root@localhost ~]# hadoop jar /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar wordcount /usr/read.txt /usr/output
> 13/10/19 15:05:02 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> 13/10/19 15:05:02 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to process : 1
> 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is deprecated. Instead, use mapreduce.job.combine.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is deprecated. Instead, use mapreduce.job.name
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
> 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1382144693199_0005
> 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job: http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> 13/10/19 15:05:04 INFO mapreduce.Job: Running job: job_1382144693199_0005
>
> ===============================================================================================
>
> here is my cloudera distribution
>
>
> Hadoop 2.0.0-cdh4.4.0
> Subversion file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> From source with checksum ac7e170aa709b3ace13dc5f775487180
> This command was run using /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
>
>
> and the outcome of jps (from root)
>
> -----------------------------------------
> [root@localhost ~]# jps
> 2202 TaskTracker
> 4161 Bootstrap
> 3134 DataNode
> 3520 Application
> 3262 NameNode
> 1879 ThriftServer
> 1740 Main
> 3603 RunJar
> 1606 HMaster
> 2078 JobTracker
> 16277 Jps
> 3624 RunJar
> 4053 RunJar
> 4189 Sqoop
> 3582 Bootstrap
> 3024 JobHistoryServer
> 3379 SecondaryNameNode
> 4732 ResourceManager
>
> ------------------------------------------------------
> --
> Thanks & Regards
> Gunjan Mishra
> 732-200-5839(H)
> 917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by Hitesh Shah <hi...@apache.org>.
Hello Gunjan,
This mailing list is for Apache Hadoop related questions. Please post questions for other distributions to the appropriate vendor's mailing list.
thanks
-- Hitesh
On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
> Hi I am trying to run a simple word count program , like this , job keeps running but is not being assigned to Mapper and reducers ...
> while I checked the status
>
> ===============================================================================================
>
> [root@localhost ~]# hadoop jar /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar wordcount /usr/read.txt /usr/output
> 13/10/19 15:05:02 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> 13/10/19 15:05:02 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to process : 1
> 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is deprecated. Instead, use mapreduce.job.combine.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is deprecated. Instead, use mapreduce.job.name
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
> 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1382144693199_0005
> 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job: http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> 13/10/19 15:05:04 INFO mapreduce.Job: Running job: job_1382144693199_0005
>
> ===============================================================================================
>
> here is my cloudera distribution
>
>
> Hadoop 2.0.0-cdh4.4.0
> Subversion file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> From source with checksum ac7e170aa709b3ace13dc5f775487180
> This command was run using /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
>
>
> and the outcome of jps (from root)
>
> -----------------------------------------
> [root@localhost ~]# jps
> 2202 TaskTracker
> 4161 Bootstrap
> 3134 DataNode
> 3520 Application
> 3262 NameNode
> 1879 ThriftServer
> 1740 Main
> 3603 RunJar
> 1606 HMaster
> 2078 JobTracker
> 16277 Jps
> 3624 RunJar
> 4053 RunJar
> 4189 Sqoop
> 3582 Bootstrap
> 3024 JobHistoryServer
> 3379 SecondaryNameNode
> 4732 ResourceManager
>
> ------------------------------------------------------
> --
> Thanks & Regards
> Gunjan Mishra
> 732-200-5839(H)
> 917-216-9739(C)
Re: simple word count program remains un assigned...
Posted by Hitesh Shah <hi...@apache.org>.
Hello Gunjan,
This mailing list is for Apache Hadoop related questions. Please post questions for other distributions to the appropriate vendor's mailing list.
thanks
-- Hitesh
On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote:
> Hi I am trying to run a simple word count program , like this , job keeps running but is not being assigned to Mapper and reducers ...
> while I checked the status
>
> ===============================================================================================
>
> [root@localhost ~]# hadoop jar /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar wordcount /usr/read.txt /usr/output
> 13/10/19 15:05:02 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
> 13/10/19 15:05:02 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
> 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to process : 1
> 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is deprecated. Instead, use mapreduce.job.combine.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is deprecated. Instead, use mapreduce.job.name
> 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
> 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
> 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1382144693199_0005
> 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032
> 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job: http://localhost.localdomain:8088/proxy/application_1382144693199_0005/
> 13/10/19 15:05:04 INFO mapreduce.Job: Running job: job_1382144693199_0005
>
> ===============================================================================================
>
> here is my cloudera distribution
>
>
> Hadoop 2.0.0-cdh4.4.0
> Subversion file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common -r c0eba6cd38c984557e96a16ccd7356b7de835e79
> Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013
> From source with checksum ac7e170aa709b3ace13dc5f775487180
> This command was run using /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar
>
>
> and the outcome of jps (from root)
>
> -----------------------------------------
> [root@localhost ~]# jps
> 2202 TaskTracker
> 4161 Bootstrap
> 3134 DataNode
> 3520 Application
> 3262 NameNode
> 1879 ThriftServer
> 1740 Main
> 3603 RunJar
> 1606 HMaster
> 2078 JobTracker
> 16277 Jps
> 3624 RunJar
> 4053 RunJar
> 4189 Sqoop
> 3582 Bootstrap
> 3024 JobHistoryServer
> 3379 SecondaryNameNode
> 4732 ResourceManager
>
> ------------------------------------------------------
> --
> Thanks & Regards
> Gunjan Mishra
> 732-200-5839(H)
> 917-216-9739(C)