You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by "Eason.Lee" <le...@gmail.com> on 2009/09/14 10:11:25 UTC
How to report the status
I am using hadoop Map job to import data into hbase from DB
For there is more than 10M records.It takes more than 10 minutes to finish
one map job.
So I got "failed to report status for 604 seconds" Error!
I have set in my Map as followed:
cnkiTable.put(put);
if ((++count % 1000)==0) {
context.setStatus((count / len) +" done!");
context.progress();
}
but it seems no use
do I have to implements my on reporter?
anyone can help me ?
Re: How to report the status
Posted by "Eason.Lee" <le...@gmail.com>.
Seems Context.progress() work in HBase
>_<
I can see the status updated in the TaskTracker through web
But the JobTracker seems receiving nothing!
2009/9/14 Amogh Vasekar <am...@yahoo-inc.com>
> Hi,
> Ran into a similar issue :
> https://issues.apache.org/jira/browse/HBASE-1791
>
> Not sure if what you are experiencing is similar.
> Context.progress() "should" work. One ugly hack would be to set the timeout
> value to high number. But I would wait for a better answer before doing
> that.
>
> Thanks,
> Amogh
>
> -----Original Message-----
> From: Eason.Lee [mailto:leongfans@gmail.com]
> Sent: Monday, September 14, 2009 1:41 PM
> To: common-user@hadoop.apache.org
> Subject: How to report the status
>
> I am using hadoop Map job to import data into hbase from DB
> For there is more than 10M records.It takes more than 10 minutes to finish
> one map job.
> So I got "failed to report status for 604 seconds" Error!
>
> I have set in my Map as followed:
> cnkiTable.put(put);
> if ((++count % 1000)==0) {
> context.setStatus((count / len) +" done!");
> context.progress();
> }
>
> but it seems no use
>
> do I have to implements my on reporter?
>
> anyone can help me ?
>
RE: How to report the status
Posted by Amogh Vasekar <am...@yahoo-inc.com>.
Hi,
Ran into a similar issue : https://issues.apache.org/jira/browse/HBASE-1791
Not sure if what you are experiencing is similar.
Context.progress() "should" work. One ugly hack would be to set the timeout value to high number. But I would wait for a better answer before doing that.
Thanks,
Amogh
-----Original Message-----
From: Eason.Lee [mailto:leongfans@gmail.com]
Sent: Monday, September 14, 2009 1:41 PM
To: common-user@hadoop.apache.org
Subject: How to report the status
I am using hadoop Map job to import data into hbase from DB
For there is more than 10M records.It takes more than 10 minutes to finish
one map job.
So I got "failed to report status for 604 seconds" Error!
I have set in my Map as followed:
cnkiTable.put(put);
if ((++count % 1000)==0) {
context.setStatus((count / len) +" done!");
context.progress();
}
but it seems no use
do I have to implements my on reporter?
anyone can help me ?