You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Prabhu Joseph (JIRA)" <ji...@apache.org> on 2017/10/27 12:20:00 UTC

[jira] [Created] (MAPREDUCE-6993) Provide additional aggregated task stats at the Map / Reduce level

Prabhu Joseph created MAPREDUCE-6993:
----------------------------------------

             Summary: Provide additional aggregated task stats at the Map / Reduce level
                 Key: MAPREDUCE-6993
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6993
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 2.7.3
            Reporter: Prabhu Joseph


MapReduce ApplicationMaster can log aggregated tasks stats for Map / Reduce stage like below which will make debugging easier. Similar to what Tez provides TEZ-930

firstTaskStartTime,
firstTasksToStart
lastTaskFinishTime
lastTasksToFinish
minTaskDuration
maxTaskDuration 
avgTaskDuration
numSuccessfulTasks
shortestDurationTasks
longestDurationTasks
numFailedTaskAttempts
numKilledTaskAttempts
numCompletedTasks
numSucceededTasks
numKilledTasks
numFailedTasks



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org