You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Amar Kamat (JIRA)" <ji...@apache.org> on 2011/09/14 15:09:15 UTC
[jira] [Created] (MAPREDUCE-3008) [Gridmix] Improve cumulative CPU
usage emulation for short running tasks
[Gridmix] Improve cumulative CPU usage emulation for short running tasks
------------------------------------------------------------------------
Key: MAPREDUCE-3008
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3008
Project: Hadoop Map/Reduce
Issue Type: Sub-task
Components: contrib/gridmix
Affects Versions: 0.24.0
Reporter: Amar Kamat
Fix For: 0.24.0
CPU emulation in Gridmix fails to meet the expected target if the map has no data to sort/spill/merge. There are 2 major reasons for this:
1. The map task end immediately ends soon after the map task. The map progress is 67% while the map phase ends.
2. Currently, the sort (comparator) doesnt emulate CPU. If the map is short lived, the CPU emulation thread (spawned from the map task in cleanup) doesn't get a chance to emulate.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3008) [Gridmix] Improve cumulative CPU
usage emulation for short running tasks
Posted by "Amar Kamat (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat resolved MAPREDUCE-3008.
-----------------------------------
Resolution: Fixed
Assignee: Amar Kamat
Release Note: Improves cumulative CPU emulation for short running tasks.
Hadoop Flags: Reviewed
I just committed this to trunk! Thanks Ravi for helping with the reviews.
> [Gridmix] Improve cumulative CPU usage emulation for short running tasks
> ------------------------------------------------------------------------
>
> Key: MAPREDUCE-3008
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3008
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: cpu-emulation, gridmix
> Fix For: 0.24.0
>
> Attachments: mapreduce-2591-v1.4.2.patch, mapreduce-2591-v1.7.patch
>
>
> CPU emulation in Gridmix fails to meet the expected target if the map has no data to sort/spill/merge. There are 2 major reasons for this:
> 1. The map task end immediately ends soon after the map task. The map progress is 67% while the map phase ends.
> 2. Currently, the sort (comparator) doesnt emulate CPU. If the map is short lived, the CPU emulation thread (spawned from the map task in cleanup) doesn't get a chance to emulate.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira