You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "nandan (JIRA)" <ji...@apache.org> on 2011/07/07 18:05:17 UTC

[jira] [Updated] (MAPREDUCE-2653) dynamic map slots (in addition to predifined) on each node which allows to execute cpu intensive jobs along with memory intensive jobs thereby reducing wastage of cpu cycles

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

nandan updated MAPREDUCE-2653:
------------------------------

           Description: I have introduced process monitoring system inside tasktracker, which analyses the cpu and memory utilization of each map task and allows me to increase/decrease maximum number of map slots dynamically on each node. With this I can combine cpu intensive jobs along with memory intensive jobs, thereby reducing the cpu idle time.  (was: I have introduced process monitoring system in hadoop inside tasktracker, which analyses the cpu and memory utilization of each map task and allows me to increase/decrease maximum number of map slots dynamically on each node)
           Environment: linux
     Affects Version/s: 0.20.203.0
                  Tags: dynamic map slots
                Labels: map scheduler tasks  (was: )
    Remaining Estimate: 672h
     Original Estimate: 672h

> dynamic map slots (in addition to predifined) on each node which allows to execute cpu intensive jobs along with memory intensive jobs thereby reducing wastage of cpu cycles
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2653
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2653
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobtracker, tasktracker
>    Affects Versions: 0.20.203.0
>         Environment: linux
>            Reporter: nandan
>              Labels: map, scheduler, tasks
>   Original Estimate: 672h
>  Remaining Estimate: 672h
>
> I have introduced process monitoring system inside tasktracker, which analyses the cpu and memory utilization of each map task and allows me to increase/decrease maximum number of map slots dynamically on each node. With this I can combine cpu intensive jobs along with memory intensive jobs, thereby reducing the cpu idle time.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira