You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by "Eason.Lee" <le...@gmail.com> on 2009/09/14 10:11:25 UTC

How to report the status

I am using hadoop Map job to import data into hbase from DB
For there is more than 10M records.It takes more than 10 minutes to finish
one map job.
So I got  "failed to report status for 604 seconds" Error!

I have set in my Map as followed:
cnkiTable.put(put);
 if ((++count % 1000)==0) {
   context.setStatus((count / len) +" done!");
   context.progress();
  }

but it seems no use

do I have to implements my on reporter?

anyone can help me ?

Re: How to report the status

Posted by "Eason.Lee" <le...@gmail.com>.
Seems Context.progress()  work in HBase
>_<
I can see the status updated in the TaskTracker through web
But the JobTracker seems receiving nothing!

2009/9/14 Amogh Vasekar <am...@yahoo-inc.com>

> Hi,
> Ran into a similar issue :
> https://issues.apache.org/jira/browse/HBASE-1791
>
> Not sure if what you are experiencing is similar.
> Context.progress() "should" work. One ugly hack would be to set the timeout
> value to high number. But I would wait for a better answer before doing
> that.
>
> Thanks,
> Amogh
>
> -----Original Message-----
> From: Eason.Lee [mailto:leongfans@gmail.com]
> Sent: Monday, September 14, 2009 1:41 PM
> To: common-user@hadoop.apache.org
> Subject: How to report the status
>
> I am using hadoop Map job to import data into hbase from DB
> For there is more than 10M records.It takes more than 10 minutes to finish
> one map job.
> So I got  "failed to report status for 604 seconds" Error!
>
> I have set in my Map as followed:
> cnkiTable.put(put);
>  if ((++count % 1000)==0) {
>   context.setStatus((count / len) +" done!");
>   context.progress();
>  }
>
> but it seems no use
>
> do I have to implements my on reporter?
>
> anyone can help me ?
>

RE: How to report the status

Posted by Amogh Vasekar <am...@yahoo-inc.com>.
Hi,
Ran into a similar issue : https://issues.apache.org/jira/browse/HBASE-1791

Not sure if what you are experiencing is similar.
Context.progress() "should" work. One ugly hack would be to set the timeout value to high number. But I would wait for a better answer before doing that.

Thanks,
Amogh

-----Original Message-----
From: Eason.Lee [mailto:leongfans@gmail.com] 
Sent: Monday, September 14, 2009 1:41 PM
To: common-user@hadoop.apache.org
Subject: How to report the status

I am using hadoop Map job to import data into hbase from DB
For there is more than 10M records.It takes more than 10 minutes to finish
one map job.
So I got  "failed to report status for 604 seconds" Error!

I have set in my Map as followed:
cnkiTable.put(put);
 if ((++count % 1000)==0) {
   context.setStatus((count / len) +" done!");
   context.progress();
  }

but it seems no use

do I have to implements my on reporter?

anyone can help me ?