You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2013/12/23 23:47:50 UTC
[jira] [Created] (PIG-3641) Split "otherwise" producing incorrect
output when combined with ColumnPruning
Koji Noguchi created PIG-3641:
---------------------------------
Summary: Split "otherwise" producing incorrect output when combined with ColumnPruning
Key: PIG-3641
URL: https://issues.apache.org/jira/browse/PIG-3641
Project: Pig
Issue Type: Bug
Affects Versions: 0.11.1, 0.12.0, 0.10.0, 0.13.0
Reporter: Koji Noguchi
Assignee: Koji Noguchi
Our user was observing incorrect outputs depending on if the query had intermediate output or not. Below is a simplified testcase I came up with.
{noformat}
knoguchi pig> cat test.txt
9,1,ignored
9,1,ignored
9,1,ignored
knoguchi pig> cat bz-6590644/test.pig
A = load 'test.txt' using PigStorage(',') as (a1:int, a2:int, a3:chararray);
B = foreach A generate a1,a2;
SPLIT B into C1 if a2 == 1, D1 otherwise;
C2 = foreach C1 generate a2;
store C2 into '/tmp/testC';
store D1 into '/tmp/testD';
knoguchi@nameother-lm pig>
{noformat}
Incorrect output shown below. /tmp/testD should be empty but somehow has data in it.
{noformat}
knoguchi@nameother-lm pig> cat /tmp/testC/part-m-00000
1
1
1
knoguchi pig> cat /tmp/testD/part-m-00000
9 1
9 1
9 1
knoguchi pig>
{noformat}
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)