You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jeff Zhang <zj...@gmail.com> on 2010/08/27 03:42:31 UTC
Re: jobtracker.jsp
So what's the log in your client side ?
On Thu, Aug 26, 2010 at 6:23 PM, Venkatesh <vr...@aol.com> wrote:
>
>
>
> I'm running map/reduce jobs from java app (table mapper & reducer) in true distributed
> mode..I don't see anything in jobtracker page..Map/reduce job runs fine..Am I missing some config?
>
> thanks
> venkatesh
>
>
>
--
Best Regards
Jeff Zhang
Re: jobtracker.jsp
Posted by Venkatesh <vr...@aol.com>.
Thanks J-D
I figured I did n't have mapred-site.xml in my WEB-INF/classes directory (classpth)
I copied that from the cluster ..that fixed part of it..Now i don't have zookeper in hadoop-env.sh:HADOOP_CLASSPATH
I distinctly looked at this link a while ago..& it did n't have zookeper listed .(i've everything else i.e hbase-*.)
perhaps i had a old link
can all the config in mapred-site.xml be added to hbase-site.xml?..It kind of works with them being separate..
just wondering..
Have one more question..I also have trouble stopping namenode/datanode/jobtracker..to make this classpath effective
Is there a force shutdown option? (other than kill -9)..?
venkatesh
-----Original Message-----
From: Jean-Daniel Cryans <jd...@apache.org>
To: user@hbase.apache.org
Sent: Fri, Aug 27, 2010 12:10 am
Subject: Re: jobtracker.jsp
HBase needs to know about the job tracker, it could be on the same
machine or distant, and that's taken care by giving HBase mapred's
configurations. Here's the relevant documentation :
http://hbase.apache.org/docs/r0.20.6/api/org/apache/hadoop/hbase/mapreduce/package-summary.html#classpath
J-D
2010/8/26 xiujin yang <xi...@hotmail.com>:
>
> Hi
>
> When I run Hbase performance, I met the same problem.
> When job are run on local, it don't show up on job list.
>
> Best
>
> Xiujin Yang.
>
>> To: user@hbase.apache.org
>> Subject: Re: jobtracker.jsp
>> Date: Thu, 26 Aug 2010 22:30:09 -0400
>> From: vramanathan00@aol.com
>>
>>
>> yeah..log says it's running Locally..i've to figure out why..
>>
>> 2010-08-26 08:49:01,491 INFO Thread-16 org.apache.hadoop.mapred.MapTask -
Starting flush of map output
>> 2010-08-26 08:49:01,578 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner -
Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
>> 2010-08-26 08:49:01,586 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner
-
>> 2010-08-26 08:49:01,587 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner -
Task 'attempt_local_0001_m_000000_0' done.
>> 2010-08-26 08:49:01,613 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner
-
>> 2010-08-26 08:49:01,630 INFO Thread-16 org.apache.hadoop.mapred.Merger -
Merging 1 sorted segments
>> 2010-08-26 08:49:01,640 INFO Thread-16 org.apache.hadoop.mapred.Merger - Down
to the last merge-pass, with 0 segments left of total size: 0 bytes
>> 2010-08-26 08:49:01,640 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner
-
>> 2010-08-26 08:49:01,658 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner -
Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
>> 2010-08-26 08:49:01,659 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner
- reduce > reduce
>> 2010-08-26 08:49:01,660 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner -
Task 'attempt_local_0001_r_000000_0' done.
>>
>>
>>
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: Jeff Zhang <zj...@gmail.com>
>> To: user@hbase.apache.org
>> Sent: Thu, Aug 26, 2010 9:42 pm
>> Subject: Re: jobtracker.jsp
>>
>>
>> So what's the log in your client side ?
>>
>>
>> On Thu, Aug 26, 2010 at 6:23 PM, Venkatesh <vr...@aol.com> wrote:
>> >
>> >
>> >
>> > I'm running map/reduce jobs from java app (table mapper & reducer) in true
>> distributed
>> > mode..I don't see anything in jobtracker page..Map/reduce job runs fine..Am
I
>> missing some config?
>> >
>> > thanks
>> > venkatesh
>> >
>> >
>> >
>>
>>
>>
>> --
>> Best Regards
>>
>> Jeff Zhang
>>
>>
>
Re: jobtracker.jsp
Posted by Jean-Daniel Cryans <jd...@apache.org>.
HBase needs to know about the job tracker, it could be on the same
machine or distant, and that's taken care by giving HBase mapred's
configurations. Here's the relevant documentation :
http://hbase.apache.org/docs/r0.20.6/api/org/apache/hadoop/hbase/mapreduce/package-summary.html#classpath
J-D
2010/8/26 xiujin yang <xi...@hotmail.com>:
>
> Hi
>
> When I run Hbase performance, I met the same problem.
> When job are run on local, it don't show up on job list.
>
> Best
>
> Xiujin Yang.
>
>> To: user@hbase.apache.org
>> Subject: Re: jobtracker.jsp
>> Date: Thu, 26 Aug 2010 22:30:09 -0400
>> From: vramanathan00@aol.com
>>
>>
>> yeah..log says it's running Locally..i've to figure out why..
>>
>> 2010-08-26 08:49:01,491 INFO Thread-16 org.apache.hadoop.mapred.MapTask - Starting flush of map output
>> 2010-08-26 08:49:01,578 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
>> 2010-08-26 08:49:01,586 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner -
>> 2010-08-26 08:49:01,587 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task 'attempt_local_0001_m_000000_0' done.
>> 2010-08-26 08:49:01,613 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner -
>> 2010-08-26 08:49:01,630 INFO Thread-16 org.apache.hadoop.mapred.Merger - Merging 1 sorted segments
>> 2010-08-26 08:49:01,640 INFO Thread-16 org.apache.hadoop.mapred.Merger - Down to the last merge-pass, with 0 segments left of total size: 0 bytes
>> 2010-08-26 08:49:01,640 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner -
>> 2010-08-26 08:49:01,658 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
>> 2010-08-26 08:49:01,659 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner - reduce > reduce
>> 2010-08-26 08:49:01,660 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task 'attempt_local_0001_r_000000_0' done.
>>
>>
>>
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: Jeff Zhang <zj...@gmail.com>
>> To: user@hbase.apache.org
>> Sent: Thu, Aug 26, 2010 9:42 pm
>> Subject: Re: jobtracker.jsp
>>
>>
>> So what's the log in your client side ?
>>
>>
>> On Thu, Aug 26, 2010 at 6:23 PM, Venkatesh <vr...@aol.com> wrote:
>> >
>> >
>> >
>> > I'm running map/reduce jobs from java app (table mapper & reducer) in true
>> distributed
>> > mode..I don't see anything in jobtracker page..Map/reduce job runs fine..Am I
>> missing some config?
>> >
>> > thanks
>> > venkatesh
>> >
>> >
>> >
>>
>>
>>
>> --
>> Best Regards
>>
>> Jeff Zhang
>>
>>
>
RE: jobtracker.jsp
Posted by xiujin yang <xi...@hotmail.com>.
Hi
When I run Hbase performance, I met the same problem.
When job are run on local, it don't show up on job list.
Best
Xiujin Yang.
> To: user@hbase.apache.org
> Subject: Re: jobtracker.jsp
> Date: Thu, 26 Aug 2010 22:30:09 -0400
> From: vramanathan00@aol.com
>
>
> yeah..log says it's running Locally..i've to figure out why..
>
> 2010-08-26 08:49:01,491 INFO Thread-16 org.apache.hadoop.mapred.MapTask - Starting flush of map output
> 2010-08-26 08:49:01,578 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
> 2010-08-26 08:49:01,586 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner -
> 2010-08-26 08:49:01,587 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task 'attempt_local_0001_m_000000_0' done.
> 2010-08-26 08:49:01,613 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner -
> 2010-08-26 08:49:01,630 INFO Thread-16 org.apache.hadoop.mapred.Merger - Merging 1 sorted segments
> 2010-08-26 08:49:01,640 INFO Thread-16 org.apache.hadoop.mapred.Merger - Down to the last merge-pass, with 0 segments left of total size: 0 bytes
> 2010-08-26 08:49:01,640 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner -
> 2010-08-26 08:49:01,658 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
> 2010-08-26 08:49:01,659 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner - reduce > reduce
> 2010-08-26 08:49:01,660 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task 'attempt_local_0001_r_000000_0' done.
>
>
>
>
>
>
>
>
> -----Original Message-----
> From: Jeff Zhang <zj...@gmail.com>
> To: user@hbase.apache.org
> Sent: Thu, Aug 26, 2010 9:42 pm
> Subject: Re: jobtracker.jsp
>
>
> So what's the log in your client side ?
>
>
> On Thu, Aug 26, 2010 at 6:23 PM, Venkatesh <vr...@aol.com> wrote:
> >
> >
> >
> > I'm running map/reduce jobs from java app (table mapper & reducer) in true
> distributed
> > mode..I don't see anything in jobtracker page..Map/reduce job runs fine..Am I
> missing some config?
> >
> > thanks
> > venkatesh
> >
> >
> >
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
>
Re: jobtracker.jsp
Posted by Venkatesh <vr...@aol.com>.
yeah..log says it's running Locally..i've to figure out why..
2010-08-26 08:49:01,491 INFO Thread-16 org.apache.hadoop.mapred.MapTask - Starting flush of map output
2010-08-26 08:49:01,578 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
2010-08-26 08:49:01,586 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner -
2010-08-26 08:49:01,587 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task 'attempt_local_0001_m_000000_0' done.
2010-08-26 08:49:01,613 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner -
2010-08-26 08:49:01,630 INFO Thread-16 org.apache.hadoop.mapred.Merger - Merging 1 sorted segments
2010-08-26 08:49:01,640 INFO Thread-16 org.apache.hadoop.mapred.Merger - Down to the last merge-pass, with 0 segments left of total size: 0 bytes
2010-08-26 08:49:01,640 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner -
2010-08-26 08:49:01,658 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
2010-08-26 08:49:01,659 INFO Thread-16 org.apache.hadoop.mapred.LocalJobRunner - reduce > reduce
2010-08-26 08:49:01,660 INFO Thread-16 org.apache.hadoop.mapred.TaskRunner - Task 'attempt_local_0001_r_000000_0' done.
-----Original Message-----
From: Jeff Zhang <zj...@gmail.com>
To: user@hbase.apache.org
Sent: Thu, Aug 26, 2010 9:42 pm
Subject: Re: jobtracker.jsp
So what's the log in your client side ?
On Thu, Aug 26, 2010 at 6:23 PM, Venkatesh <vr...@aol.com> wrote:
>
>
>
> I'm running map/reduce jobs from java app (table mapper & reducer) in true
distributed
> mode..I don't see anything in jobtracker page..Map/reduce job runs fine..Am I
missing some config?
>
> thanks
> venkatesh
>
>
>
--
Best Regards
Jeff Zhang