You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Arun C Murthy <ac...@yahoo-inc.com> on 2009/09/01 08:24:41 UTC

Re: add custom timestamps to the Job log

On Aug 28, 2009, at 7:11 PM, Rares Vernica wrote:

> Hello,
>
> The job log has some very important timestamps that show the start/end
> time of various stages of a task attempt. I was wondering it it is
> possible to add custom timestamps to it.
>

You can add any 'Counters' to your job and they will automatically  
show up in the JobHistory logs...
http://hadoop.apache.org/common/docs/r0.20.0/mapred_tutorial.html#Counters

Arun

> For example, for a reduce task attempt, the job job will contain  
> something like:
>
> ReduceAttempt TASK_TYPE="REDUCE" SHUFFLE_FINISHED="1251226468482"
> SORT_FINISHED="1251226505088" FINISH_TIME="1251226513547"...
>
> Is it possible/easy to add more timestamps, like  
> SOMETHING_FINISHED="..."?
>
> Thanks!
> Rares Vernica