You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Cheolsoo Park (JIRA)" <ji...@apache.org> on 2014/03/06 20:32:43 UTC
[jira] [Updated] (PIG-3799) TestCustomPartitioner is broken in tez
branch
[ https://issues.apache.org/jira/browse/PIG-3799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheolsoo Park updated PIG-3799:
-------------------------------
Status: Patch Available (was: Open)
> TestCustomPartitioner is broken in tez branch
> ---------------------------------------------
>
> Key: PIG-3799
> URL: https://issues.apache.org/jira/browse/PIG-3799
> Project: Pig
> Issue Type: Sub-task
> Components: tez
> Affects Versions: tez-branch
> Reporter: Cheolsoo Park
> Assignee: Cheolsoo Park
> Fix For: tez-branch
>
> Attachments: PIG-3799-1.patch
>
>
> This is a regression of PIG-3795. In TezCompiler, visitDistinct() doesn't set the requested parallelism of TezOperator, resulting that only one reducer runs for the following query-
> {code}
> A = LOAD 'table_testCustomPartitionerDistinct' as (a0:int, a1:int);
> B = distinct A PARTITION BY org.apache.pig.test.utils.SimpleCustomPartitioner3 parallel 2;
> {code}
> The test fails because it sees a single output file while it expects two.
--
This message was sent by Atlassian JIRA
(v6.2#6252)