You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Suhas Gogate (JIRA)" <ji...@apache.org> on 2009/05/28 23:05:45 UTC
[jira] Created: (HADOOP-5936) MAP_OUTPUT_BYTES counter is not
recorded in Job history log for Map only jobs
MAP_OUTPUT_BYTES counter is not recorded in Job history log for Map only jobs
-----------------------------------------------------------------------------
Key: HADOOP-5936
URL: https://issues.apache.org/jira/browse/HADOOP-5936
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.20.0
Reporter: Suhas Gogate
Here is an example Map task entry in job history log, it has MAP_OUTPUT_RECORDS but no MAP_OUTPUT_BYTES
Task TASKID="task_200905250540_0578_m_000000" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1243294056346" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(56630)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(28327)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(MAP_INPUT_RECORDS)(Map input records)(2681)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_INPUT_BYTES)(Map input bytes)(28327)][(MAP_OUTPUT_RECORDS)(Map output records)(2681)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_200905250540_0578_m_000001" TASK_ATTEMPT_ID="attempt_200905250540_0578_m_000001_0" START
_TIME="1243294026959" TRACKER_NAME="tracker_xxx1031\.xxxx\.com:localhost/127\.0\.0\.1:56939" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_200905250540_0578_m_000001" TASK_ATTEMPT_ID="attempt_200905250540_0578_m_000001_0" TASK_STATUS="SUCCESS" FINISH_TIME="1243294041638" HOSTNAME="/xx\.xx\.xx\.xxx/xxx1031\.xxxx\.com" STATE_STRING="Records R/W\=2634/1" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28316)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(28303)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(MAP_INPUT_RECORDS)(Map input records)(2634)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_INPUT_BYTES)(Map input bytes)(28303)][(MAP_OUTPUT_RECORDS)(Map output records)(2634)]}" .
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.