You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Harsh J (Resolved) (JIRA)" <ji...@apache.org> on 2011/12/31 10:36:30 UTC
[jira] [Resolved] (MAPREDUCE-37) MAP_OUTPUT_BYTES counter is not
recorded in Job history log for Map only jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-37?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Harsh J resolved MAPREDUCE-37.
------------------------------
Resolution: Not A Problem
It is recorded in current releases.
> MAP_OUTPUT_BYTES counter is not recorded in Job history log for Map only jobs
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-37
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-37
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Suhas Gogate
>
> Here is an example Map task entry in job history log, it has MAP_OUTPUT_RECORDS but no MAP_OUTPUT_BYTES
> Task TASKID="task_200905250540_0578_m_000000" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1243294056346" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(56630)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(28327)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(MAP_INPUT_RECORDS)(Map input records)(2681)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_INPUT_BYTES)(Map input bytes)(28327)][(MAP_OUTPUT_RECORDS)(Map output records)(2681)]}" .
> MapAttempt TASK_TYPE="MAP" TASKID="task_200905250540_0578_m_000001" TASK_ATTEMPT_ID="attempt_200905250540_0578_m_000001_0" START
> _TIME="1243294026959" TRACKER_NAME="tracker_xxx1031\.xxxx\.com:localhost/127\.0\.0\.1:56939" HTTP_PORT="50060" .
> MapAttempt TASK_TYPE="MAP" TASKID="task_200905250540_0578_m_000001" TASK_ATTEMPT_ID="attempt_200905250540_0578_m_000001_0" TASK_STATUS="SUCCESS" FINISH_TIME="1243294041638" HOSTNAME="/xx\.xx\.xx\.xxx/xxx1031\.xxxx\.com" STATE_STRING="Records R/W\=2634/1" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28316)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(28303)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(MAP_INPUT_RECORDS)(Map input records)(2634)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_INPUT_BYTES)(Map input bytes)(28303)][(MAP_OUTPUT_RECORDS)(Map output records)(2634)]}" .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira