You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Suhas Gogate (JIRA)" <ji...@apache.org> on 2009/05/28 23:05:45 UTC

[jira] Created: (HADOOP-5936) MAP_OUTPUT_BYTES counter is not recorded in Job history log for Map only jobs

MAP_OUTPUT_BYTES counter is not recorded in Job history log for Map only jobs
-----------------------------------------------------------------------------

                 Key: HADOOP-5936
                 URL: https://issues.apache.org/jira/browse/HADOOP-5936
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.20.0
            Reporter: Suhas Gogate


Here is an example Map task entry in job history log, it has MAP_OUTPUT_RECORDS but no MAP_OUTPUT_BYTES

Task TASKID="task_200905250540_0578_m_000000" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1243294056346" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(56630)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(28327)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(MAP_INPUT_RECORDS)(Map input records)(2681)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_INPUT_BYTES)(Map input bytes)(28327)][(MAP_OUTPUT_RECORDS)(Map output records)(2681)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_200905250540_0578_m_000001" TASK_ATTEMPT_ID="attempt_200905250540_0578_m_000001_0" START
_TIME="1243294026959" TRACKER_NAME="tracker_xxx1031\.xxxx\.com:localhost/127\.0\.0\.1:56939" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_200905250540_0578_m_000001" TASK_ATTEMPT_ID="attempt_200905250540_0578_m_000001_0" TASK_STATUS="SUCCESS" FINISH_TIME="1243294041638" HOSTNAME="/xx\.xx\.xx\.xxx/xxx1031\.xxxx\.com" STATE_STRING="Records R/W\=2634/1" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28316)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(28303)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(MAP_INPUT_RECORDS)(Map input records)(2634)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_INPUT_BYTES)(Map input bytes)(28303)][(MAP_OUTPUT_RECORDS)(Map output records)(2634)]}" .


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.