[jira] Commented: (MAPREDUCE-2154) Gridmix mapper doesn't emit the correct map output records while comparing with json file.

["Ravi Gummadi (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12924923#action_12924923 ] 

Ravi Gummadi commented on MAPREDUCE-2154:
-----------------------------------------

Since combiner was there in original job, the actual map output records at the end of map task is less than the value shown in the counter "Map output records". See MAPREDUCE-2135 for details of the issue.
You can check the sum of reduceInputRecords of the 3 reduces of original job(=19794) is same as the value in the simulated job and is equal to the sum of map output records of simulated job.

> Gridmix mapper doesn't emit the correct map output records while comparing with json file.
> ------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2154
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2154
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/gridmix
>            Reporter: Vinay Kumar Thota
>            Assignee: Ranjit Mathew
>         Attachments: wordcount.json
>
>
> I ran Gridmix with a trace file and compared the job history information against the trace after completion of job. The map output records in a job history have not matched with the map output records in a trace file.  For reproducing the issue, please download the attached trace file and run the gridmix. Later compare the map output records in a job history with a trace file.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.