You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2014/05/19 20:10:39 UTC

[jira] [Assigned] (TEZ-1128) OnFileUnorderedPartitionedKVOutput does not handle partitioning correctly with the MRPartitioner

     [ https://issues.apache.org/jira/browse/TEZ-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Siddharth Seth reassigned TEZ-1128:
-----------------------------------

    Assignee: Siddharth Seth

> OnFileUnorderedPartitionedKVOutput does not handle partitioning correctly with the MRPartitioner
> ------------------------------------------------------------------------------------------------
>
>                 Key: TEZ-1128
>                 URL: https://issues.apache.org/jira/browse/TEZ-1128
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Siddharth Seth
>
> Two issues:
>    1) It does not set value of TezJobConfig.TEZ_RUNTIME_NUM_EXPECTED_PARTITIONS. So MRPartitioner assumes the number of partitions is 1 and goes with a default partitioner that writes only to last partition. 
>   2) If one of the partitions has empty output (due to issue 1) it gets stuck without fetching input.



--
This message was sent by Atlassian JIRA
(v6.2#6252)