You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Eric Badger (JIRA)" <ji...@apache.org> on 2016/10/21 21:04:58 UTC

[jira] [Updated] (TEZ-3486) COMBINE_OUTPUT_RECORDS/COMBINE_INPUT_RECORDS are not correct

     [ https://issues.apache.org/jira/browse/TEZ-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Badger updated TEZ-3486:
-----------------------------
    Attachment: TEZ-3486.001.patch

Attaching a patch that fixes the calculation for COMBINE_INPUT_RECORDS/COMBINE_OUTPUT_RECORDS. Additionally, changed the combiner unit tests to test these counter values. 

[~rohini], can you take a look at the patch? 

> COMBINE_OUTPUT_RECORDS/COMBINE_INPUT_RECORDS are not correct
> ------------------------------------------------------------
>
>                 Key: TEZ-3486
>                 URL: https://issues.apache.org/jira/browse/TEZ-3486
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Eric Badger
>            Assignee: Eric Badger
>         Attachments: TEZ-3486.001.patch
>
>
> They appear to be swapped, though that is not quite the case. You can consistently see {{COMBINE_INPUT_RECORDS}} < {{COMBINE_OUTPUT_RECORDS}}, which shouldn't be possible. 
> This issue relates to TEZ-1344, which was closed due to not being reproducible, but it actually is fairly easily reproducible if you run the same job on Tez and on MR. For whatever reason, I cannot reopen that Jira, so I'm creating this one. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)