[jira] [Commented] (PIG-3799) TestCustomPartitioner is broken in tez branch

["Rohini Palaniswamy (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-3799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924771#comment-13924771 ] 

Rohini Palaniswamy commented on PIG-3799:
-----------------------------------------

+1

> TestCustomPartitioner is broken in tez branch
> ---------------------------------------------
>
>                 Key: PIG-3799
>                 URL: https://issues.apache.org/jira/browse/PIG-3799
>             Project: Pig
>          Issue Type: Sub-task
>          Components: tez
>    Affects Versions: tez-branch
>            Reporter: Cheolsoo Park
>            Assignee: Cheolsoo Park
>             Fix For: tez-branch
>
>         Attachments: PIG-3799-1.patch
>
>
> This is a regression of PIG-3795. In TezCompiler, visitDistinct() doesn't set the requested parallelism of TezOperator, resulting that only one reducer runs for the following query-
> {code}
> A = LOAD 'table_testCustomPartitionerDistinct' as (a0:int, a1:int);
> B = distinct A PARTITION BY org.apache.pig.test.utils.SimpleCustomPartitioner3 parallel 2;
> {code}
> The test fails because it sees a single output file while it expects two.



--
This message was sent by Atlassian JIRA
(v6.2#6252)