You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Cheolsoo Park (JIRA)" <ji...@apache.org> on 2014/03/06 20:24:47 UTC

[jira] [Created] (PIG-3799) TestCustomPartitioner is broken in tez branch

Cheolsoo Park created PIG-3799:
----------------------------------

             Summary: TestCustomPartitioner is broken in tez branch
                 Key: PIG-3799
                 URL: https://issues.apache.org/jira/browse/PIG-3799
             Project: Pig
          Issue Type: Sub-task
          Components: tez
    Affects Versions: tez-branch
            Reporter: Cheolsoo Park
            Assignee: Cheolsoo Park
             Fix For: tez-branch


This is a regression of PIG-3795. In TezCompiler, visitDistinct() doesn't set the requested parallelism of TezOperator, resulting that only one reducer runs for the following query-
{code}
A = LOAD 'table_testCustomPartitionerDistinct' as (a0:int, a1:int);
B = distinct A PARTITION BY org.apache.pig.test.utils.SimpleCustomPartitioner3 parallel 2;
{code}

The test fails because it sees a single output file while it expects two.



--
This message was sent by Atlassian JIRA
(v6.2#6252)