You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by arun k <ar...@gmail.com> on 2011/12/14 15:39:33 UTC

Analysing Completed Job info programmatically apart from Jobtracker GUI

Hi Guys !

I want to analyse the completed Job counters like FILE/HDFS BYTES
READ/WRITTEN along with other values like average map/reduce task run time.
I see that Jobtracker GUI has this info but i want to programmatically
retrieve these values instead of manually noting down these values and do
some analysis. Can i do it in a simple/easier way ?
I also see that Cloudera's HUE is good for this but is there anything
equivalent in Hadoop.

Can anyone guide me in this regard ?


Arun

Re: Analysing Completed Job info programmatically apart from Jobtracker GUI

Posted by David Rosenstrauch <da...@darose.net>.

On 12/14/2011 09:39 AM, arun k wrote:
> Hi Guys !
>
> I want to analyse the completed Job counters like FILE/HDFS BYTES
> READ/WRITTEN along with other values like average map/reduce task run time.
> I see that Jobtracker GUI has this info but i want to programmatically
> retrieve these values instead of manually noting down these values and do
> some analysis. Can i do it in a simple/easier way ?
> I also see that Cloudera's HUE is good for this but is there anything
> equivalent in Hadoop.
>
> Can anyone guide me in this regard ?
>
>
> Arun

See:

http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapreduce/Job.html#getCounters%28%29

DR