You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Thiago Vieira <tp...@gmail.com> on 2012/09/21 21:50:24 UTC

Re: MAP PHASE,SHUFFLE SORT PHASE AND COPY PHASE , REDUCE PHASE

you can use Apache Rumen(
http://hadoop.apache.org/docs/mapreduce/r0.22.0/rumen.html) for all this
informations.

--
Thiago Vieira

On Tue, Aug 28, 2012 at 4:40 PM, abhiTowson cal
<ab...@gmail.com>wrote:

> hi all,
>
> After completion of the job.
>
> How can we individually calculate total time spent on map
> phase,shuffle sort phase,copy phase and reduce phase.
>
> So that it helps in tuning your job performance.
>
> Regards
> Abhi
>

Re: MAP PHASE,SHUFFLE SORT PHASE AND COPY PHASE , REDUCE PHASE

Posted by Jie Li <ji...@cs.duke.edu>.

Is this view what you want?

http://www.cs.duke.edu/starfish/screenshots/job-analysis-profile-graphs.png

Jie

On Fri, Sep 21, 2012 at 3:50 PM, Thiago Vieira <tp...@gmail.com> wrote:
> you can use Apache Rumen(
> http://hadoop.apache.org/docs/mapreduce/r0.22.0/rumen.html) for all this
> informations.
>
> --
> Thiago Vieira
>
>
> On Tue, Aug 28, 2012 at 4:40 PM, abhiTowson cal
> <ab...@gmail.com>wrote:
>
>> hi all,
>>
>> After completion of the job.
>>
>> How can we individually calculate total time spent on map
>> phase,shuffle sort phase,copy phase and reduce phase.
>>
>> So that it helps in tuning your job performance.
>>
>> Regards
>> Abhi
>>