You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Joseph Naegele <jn...@grierforensics.com> on 2016/04/18 15:45:11 UTC

How to monitor mapreduce Reporter at runtime

Hi,

 

Is it possible to monitor the Reporter at runtime, maybe via a Hadoop
option? I'm specifically looking for the Fetcher's Reporter status (pages/s,
bandwidth, etc.). Using Nutch 1.11.

 

Thanks,

Joe


Re: How to monitor mapreduce Reporter at runtime

Posted by Sebastian Nagel <wa...@googlemail.com>.
Hi Joseph,

yes, that's possible, e.g.
  http://localhost:19888/ws/v1/history/mapreduce/jobs/job_1460544333856_0094/counters

Cf.
https://hadoop.apache.org/docs/r2.4.1/hadoop-yarn/hadoop-yarn-site/HistoryServerRest.html#Job_Counters_API

Cheers,
Sebastian

On 04/18/2016 03:45 PM, Joseph Naegele wrote:
> Hi,
> 
>  
> 
> Is it possible to monitor the Reporter at runtime, maybe via a Hadoop
> option? I'm specifically looking for the Fetcher's Reporter status (pages/s,
> bandwidth, etc.). Using Nutch 1.11.
> 
>  
> 
> Thanks,
> 
> Joe
> 
>