You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by Daniel Dai <da...@gmail.com> on 2011/01/10 20:47:40 UTC
Review Request: New logical plan: uid conflict in flattened fields
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/269/
-----------------------------------------------------------
Review request for pig and Xuefu Zhang.
Summary
-------
The following script produce wrong result:
a = load '1.txt' as (a0:bag{t:tuple(i0:int, i1:int)});
b = foreach a generate flatten(a0) as (b0, b1), flatten(a0) as (b2, b3);
c = filter b by b0>b2;
dump c;
1.txt:
{(1,2),(2,3)}
Expected result:
(2,3,1,2)
We get nothing.
This addresses bug PIG-1785.
https://issues.apache.org/jira/browse/PIG-1785
Diffs
-----
http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/newplan/logical/rules/DuplicateForEachColumnRewrite.java 1055137
http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/newplan/logical/rules/ImplicitSplitInserter.java 1055137
http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/newplan/optimizer/PlanOptimizer.java 1055137
http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/newplan/optimizer/Rule.java 1055137
http://svn.apache.org/repos/asf/pig/trunk/test/org/apache/pig/test/TestEvalPipeline2.java 1055137
Diff: https://reviews.apache.org/r/269/diff
Testing
-------
Test-patch:
[exec] -1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 3 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] -1 release audit. The applied patch generated 478 release audit warnings (more than the trunk's current 476 warnings).
No new files added. Ignore release audit warnings.
Unit test:
all pass
End-to-end test:
all pass
Thanks,
Daniel