You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by bikash sharma <sh...@gmail.com> on 2011/09/23 20:57:38 UTC

Getting the cpu, memory usage of map/reduce tasks

Hi -- Is it possible to get the cpu and memory usage of individual
map/reduces tasks when any mapreduce job is run.
I came across this jira issue, but was not sure about the exact ways to
access in the current hadoop distriubtion
https://issues.apache.org/jira/browse/MAPREDUCE-220

Any help is highly appreciated.

Thanks,
Bikash

RE: Getting the cpu, memory usage of map/reduce tasks

Posted by Ralf Heyde <ra...@gmx.de>.

Hi Bikash,

every map-/reduce task is - as far as I know - a single jvm instance - you
can configure and/or run with jvm options.
Maybe you can track these jvm's by using some system tools.

Regards,
Ralf

-----Original Message-----
From: bikash sharma [mailto:sharmabiks.07@gmail.com] 
Sent: Freitag, 23. September 2011 20:58
To: common-user@hadoop.apache.org; common-dev@hadoop.apache.org
Subject: Getting the cpu, memory usage of map/reduce tasks

Hi -- Is it possible to get the cpu and memory usage of individual
map/reduces tasks when any mapreduce job is run.
I came across this jira issue, but was not sure about the exact ways to
access in the current hadoop distriubtion
https://issues.apache.org/jira/browse/MAPREDUCE-220

Any help is highly appreciated.

Thanks,
Bikash

Re: Getting the cpu, memory usage of map/reduce tasks

Posted by bikash sharma <sh...@gmail.com>.

Thanks Raif.

On Mon, Sep 26, 2011 at 2:01 PM, Ralf Heyde <ra...@gmx.de> wrote:

> Hi Bikash,
>
> every map-/reduce task is - as far as I know - a single jvm instance - you
> can configure and/or run with jvm options.
> Maybe you can track these jvm's by using some system tools.
>
> Regards,
> Ralf
>
> -----Original Message-----
> From: bikash sharma [mailto:sharmabiks.07@gmail.com]
> Sent: Freitag, 23. September 2011 20:58
> To: common-user@hadoop.apache.org; common-dev@hadoop.apache.org
> Subject: Getting the cpu, memory usage of map/reduce tasks
>
> Hi -- Is it possible to get the cpu and memory usage of individual
> map/reduces tasks when any mapreduce job is run.
> I came across this jira issue, but was not sure about the exact ways to
> access in the current hadoop distriubtion
> https://issues.apache.org/jira/browse/MAPREDUCE-220
>
> Any help is highly appreciated.
>
> Thanks,
> Bikash
>
>