You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hadoop.apache.org by ch huang <ju...@gmail.com> on 2013/09/05 08:53:27 UTC

how to observe spill operation during shuffle in mapreduce?

hi,all:
       is there any MR spill count metric?

Re: how to observe spill operation during shuffle in mapreduce?

Posted by Ravi Kiran <ra...@gmail.com>.

Hi ,

   You can look at the job metrics from your jobtracker Web UI .  The
"Spilled Record" Counter under the group "Map Reduce Framework" displays
the number of records spilled in both map and reduce tasks.

Regards
Ravi Magham.

On Thu, Sep 5, 2013 at 12:23 PM, ch huang <ju...@gmail.com> wrote:

> hi,all:
>        is there any MR spill count metric?
>

Re: how to observe spill operation during shuffle in mapreduce?

Posted by Ravi Kiran <ra...@gmail.com>.

Hi ,

   You can look at the job metrics from your jobtracker Web UI .  The
"Spilled Record" Counter under the group "Map Reduce Framework" displays
the number of records spilled in both map and reduce tasks.

Regards
Ravi Magham.

On Thu, Sep 5, 2013 at 12:23 PM, ch huang <ju...@gmail.com> wrote:

> hi,all:
>        is there any MR spill count metric?
>

Re: how to observe spill operation during shuffle in mapreduce?

Posted by Ravi Kiran <ra...@gmail.com>.

Hi ,

   You can look at the job metrics from your jobtracker Web UI .  The
"Spilled Record" Counter under the group "Map Reduce Framework" displays
the number of records spilled in both map and reduce tasks.

Regards
Ravi Magham.

On Thu, Sep 5, 2013 at 12:23 PM, ch huang <ju...@gmail.com> wrote:

> hi,all:
>        is there any MR spill count metric?
>

Re: how to observe spill operation during shuffle in mapreduce?

Posted by Ravi Kiran <ra...@gmail.com>.

Hi ,

   You can look at the job metrics from your jobtracker Web UI .  The
"Spilled Record" Counter under the group "Map Reduce Framework" displays
the number of records spilled in both map and reduce tasks.

Regards
Ravi Magham.

On Thu, Sep 5, 2013 at 12:23 PM, ch huang <ju...@gmail.com> wrote:

> hi,all:
>        is there any MR spill count metric?
>