You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Andreas Paepcke <pa...@cs.stanford.edu> on 2011/03/19 00:03:05 UTC

Hadoop Counters Expensive?

I'm writing a load/store pair, and I am considering the use
of two Hadoop counters (via reporter). They would could the number
of records read/written, so that they would be available via
the job WebUI.

Is this an overly expensive proposition?

Thanks,

Andreas

Re: Hadoop Counters Expensive?

Posted by Harsh J <qw...@gmail.com>.
Two additional counters shouldn't be expensive. But do consider if the
already available "map input records" / "(map|reduce) output records"
suit your need for such counters.

On Sat, Mar 19, 2011 at 4:33 AM, Andreas Paepcke
<pa...@cs.stanford.edu> wrote:
> I'm writing a load/store pair, and I am considering the use
> of two Hadoop counters (via reporter). They would could the number
> of records read/written, so that they would be available via
> the job WebUI.
>
> Is this an overly expensive proposition?
>
> Thanks,
>
> Andreas
>



-- 
Harsh J
http://harshj.com