You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Scott Chen (JIRA)" <ji...@apache.org> on 2009/11/06 20:46:33 UTC
[jira] Created: (MAPREDUCE-1195) Task resource utilization
reporting for profiling and scheduling
Task resource utilization reporting for profiling and scheduling
----------------------------------------------------------------
Key: MAPREDUCE-1195
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1195
Project: Hadoop Map/Reduce
Issue Type: New Feature
Reporter: Scott Chen
We can make TaskTracker reports its usage on CPU, memory, bandwidth to JobTracker. JobTracker can use the information for scheduling tasks and profiling jobs.
One way to do this is to first make ProcfsProcessTree to collect the utilization information (CPU, mem...) and write the information in TaskTrackerStatus.taskReports and send them with the heartbeats. Then we can aggregate these information in JobInProgress to do job profiling and scheduling.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAPREDUCE-1195) Task resource utilization
reporting for profiling and scheduling
Posted by "Scott Chen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Scott Chen resolved MAPREDUCE-1195.
-----------------------------------
Resolution: Duplicate
It is this same as MAPREDUCE-220. Thanks Aruns for pointing this out.
> Task resource utilization reporting for profiling and scheduling
> ----------------------------------------------------------------
>
> Key: MAPREDUCE-1195
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1195
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Scott Chen
>
> We can make TaskTracker reports its usage on CPU, memory, bandwidth to JobTracker. JobTracker can use the information for scheduling tasks and profiling jobs.
> One way to do this is to first make ProcfsProcessTree to collect the utilization information (CPU, mem...) and write the information in TaskTrackerStatus.taskReports and send them with the heartbeats. Then we can aggregate these information in JobInProgress to do job profiling and scheduling.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.