You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Cheolsoo Park (JIRA)" <ji...@apache.org> on 2014/03/06 20:24:47 UTC
[jira] [Created] (PIG-3799) TestCustomPartitioner is broken in tez
branch
Cheolsoo Park created PIG-3799:
----------------------------------
Summary: TestCustomPartitioner is broken in tez branch
Key: PIG-3799
URL: https://issues.apache.org/jira/browse/PIG-3799
Project: Pig
Issue Type: Sub-task
Components: tez
Affects Versions: tez-branch
Reporter: Cheolsoo Park
Assignee: Cheolsoo Park
Fix For: tez-branch
This is a regression of PIG-3795. In TezCompiler, visitDistinct() doesn't set the requested parallelism of TezOperator, resulting that only one reducer runs for the following query-
{code}
A = LOAD 'table_testCustomPartitionerDistinct' as (a0:int, a1:int);
B = distinct A PARTITION BY org.apache.pig.test.utils.SimpleCustomPartitioner3 parallel 2;
{code}
The test fails because it sees a single output file while it expects two.
--
This message was sent by Atlassian JIRA
(v6.2#6252)