You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2010/07/12 07:14:49 UTC
[jira] Created: (PIG-1493) Column Pruner throw exception
"inconsistent pruning"
Column Pruner throw exception "inconsistent pruning"
----------------------------------------------------
Key: PIG-1493
URL: https://issues.apache.org/jira/browse/PIG-1493
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.7.0
Reporter: Daniel Dai
Assignee: Daniel Dai
Fix For: 0.8.0, 0.7.0
The following script fail:
{code}
a = load '1.txt' as (a0:chararray, a1:chararray, a2);
b = foreach a generate CONCAT(a0,a1) as b0, a0, a2;
c = foreach b generate a0, a2;
dump c;
{code}
Error message:
ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias c
at org.apache.pig.PigServer.openIterator(PigServer.java:698)
at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:595)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:291)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:162)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:138)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
at org.apache.pig.Main.run(Main.java:451)
at org.apache.pig.Main.main(Main.java:103)
Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias c
at org.apache.pig.PigServer.storeEx(PigServer.java:804)
at org.apache.pig.PigServer.store(PigServer.java:760)
at org.apache.pig.PigServer.openIterator(PigServer.java:680)
... 7 more
Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2212: Unable to prune plan
at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:826)
at org.apache.pig.impl.logicalLayer.optimizer.LogicalOptimizer.optimize(LogicalOptimizer.java:240)
at org.apache.pig.PigServer.compileLp(PigServer.java:1180)
at org.apache.pig.PigServer.storeEx(PigServer.java:799)
... 9 more
Caused by: org.apache.pig.impl.plan.VisitorException: ERROR 2188: Cannot prune columns for (Name: b: ForEach 1-50 Operator Key: 1-50)
at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:177)
at org.apache.pig.impl.logicalLayer.ColumnPruner.visit(ColumnPruner.java:202)
at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:132)
at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:47)
at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:69)
at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:821)
... 12 more
Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:148)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1493) Column Pruner throw exception
"inconsistent pruning"
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888063#action_12888063 ]
Hadoop QA commented on PIG-1493:
--------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12449203/PIG-1493-1.patch
against trunk revision 963504.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/367/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/367/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/367/console
This message is automatically generated.
> Column Pruner throw exception "inconsistent pruning"
> ----------------------------------------------------
>
> Key: PIG-1493
> URL: https://issues.apache.org/jira/browse/PIG-1493
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.7.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.7.0, 0.8.0
>
> Attachments: PIG-1493-1.patch
>
>
> The following script fail:
> {code}
> a = load '1.txt' as (a0:chararray, a1:chararray, a2);
> b = foreach a generate CONCAT(a0,a1) as b0, a0, a2;
> c = foreach b generate a0, a2;
> dump c;
> {code}
> Error message:
> ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias c
> at org.apache.pig.PigServer.openIterator(PigServer.java:698)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:595)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:291)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:162)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:138)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
> at org.apache.pig.Main.run(Main.java:451)
> at org.apache.pig.Main.main(Main.java:103)
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias c
> at org.apache.pig.PigServer.storeEx(PigServer.java:804)
> at org.apache.pig.PigServer.store(PigServer.java:760)
> at org.apache.pig.PigServer.openIterator(PigServer.java:680)
> ... 7 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2212: Unable to prune plan
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:826)
> at org.apache.pig.impl.logicalLayer.optimizer.LogicalOptimizer.optimize(LogicalOptimizer.java:240)
> at org.apache.pig.PigServer.compileLp(PigServer.java:1180)
> at org.apache.pig.PigServer.storeEx(PigServer.java:799)
> ... 9 more
> Caused by: org.apache.pig.impl.plan.VisitorException: ERROR 2188: Cannot prune columns for (Name: b: ForEach 1-50 Operator Key: 1-50)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:177)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.visit(ColumnPruner.java:202)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:132)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:47)
> at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:69)
> at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:821)
> ... 12 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:148)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1493) Column Pruner throw exception
"inconsistent pruning"
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888856#action_12888856 ]
Daniel Dai commented on PIG-1493:
---------------------------------
Manually run test successfully.
> Column Pruner throw exception "inconsistent pruning"
> ----------------------------------------------------
>
> Key: PIG-1493
> URL: https://issues.apache.org/jira/browse/PIG-1493
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.7.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.7.0, 0.8.0
>
> Attachments: PIG-1493-1.patch
>
>
> The following script fail:
> {code}
> a = load '1.txt' as (a0:chararray, a1:chararray, a2);
> b = foreach a generate CONCAT(a0,a1) as b0, a0, a2;
> c = foreach b generate a0, a2;
> dump c;
> {code}
> Error message:
> ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias c
> at org.apache.pig.PigServer.openIterator(PigServer.java:698)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:595)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:291)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:162)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:138)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
> at org.apache.pig.Main.run(Main.java:451)
> at org.apache.pig.Main.main(Main.java:103)
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias c
> at org.apache.pig.PigServer.storeEx(PigServer.java:804)
> at org.apache.pig.PigServer.store(PigServer.java:760)
> at org.apache.pig.PigServer.openIterator(PigServer.java:680)
> ... 7 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2212: Unable to prune plan
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:826)
> at org.apache.pig.impl.logicalLayer.optimizer.LogicalOptimizer.optimize(LogicalOptimizer.java:240)
> at org.apache.pig.PigServer.compileLp(PigServer.java:1180)
> at org.apache.pig.PigServer.storeEx(PigServer.java:799)
> ... 9 more
> Caused by: org.apache.pig.impl.plan.VisitorException: ERROR 2188: Cannot prune columns for (Name: b: ForEach 1-50 Operator Key: 1-50)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:177)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.visit(ColumnPruner.java:202)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:132)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:47)
> at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:69)
> at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:821)
> ... 12 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:148)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1493) Column Pruner throw exception
"inconsistent pruning"
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-1493:
----------------------------
Status: Patch Available (was: Open)
> Column Pruner throw exception "inconsistent pruning"
> ----------------------------------------------------
>
> Key: PIG-1493
> URL: https://issues.apache.org/jira/browse/PIG-1493
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.7.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.8.0, 0.7.0
>
> Attachments: PIG-1493-1.patch
>
>
> The following script fail:
> {code}
> a = load '1.txt' as (a0:chararray, a1:chararray, a2);
> b = foreach a generate CONCAT(a0,a1) as b0, a0, a2;
> c = foreach b generate a0, a2;
> dump c;
> {code}
> Error message:
> ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias c
> at org.apache.pig.PigServer.openIterator(PigServer.java:698)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:595)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:291)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:162)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:138)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
> at org.apache.pig.Main.run(Main.java:451)
> at org.apache.pig.Main.main(Main.java:103)
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias c
> at org.apache.pig.PigServer.storeEx(PigServer.java:804)
> at org.apache.pig.PigServer.store(PigServer.java:760)
> at org.apache.pig.PigServer.openIterator(PigServer.java:680)
> ... 7 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2212: Unable to prune plan
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:826)
> at org.apache.pig.impl.logicalLayer.optimizer.LogicalOptimizer.optimize(LogicalOptimizer.java:240)
> at org.apache.pig.PigServer.compileLp(PigServer.java:1180)
> at org.apache.pig.PigServer.storeEx(PigServer.java:799)
> ... 9 more
> Caused by: org.apache.pig.impl.plan.VisitorException: ERROR 2188: Cannot prune columns for (Name: b: ForEach 1-50 Operator Key: 1-50)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:177)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.visit(ColumnPruner.java:202)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:132)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:47)
> at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:69)
> at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:821)
> ... 12 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:148)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1493) Column Pruner throw exception
"inconsistent pruning"
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-1493:
----------------------------
Status: Resolved (was: Patch Available)
Hadoop Flags: [Reviewed]
Resolution: Fixed
Patch committed to both trunk and 0.7 branch.
> Column Pruner throw exception "inconsistent pruning"
> ----------------------------------------------------
>
> Key: PIG-1493
> URL: https://issues.apache.org/jira/browse/PIG-1493
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.7.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.8.0, 0.7.0
>
> Attachments: PIG-1493-1.patch
>
>
> The following script fail:
> {code}
> a = load '1.txt' as (a0:chararray, a1:chararray, a2);
> b = foreach a generate CONCAT(a0,a1) as b0, a0, a2;
> c = foreach b generate a0, a2;
> dump c;
> {code}
> Error message:
> ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias c
> at org.apache.pig.PigServer.openIterator(PigServer.java:698)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:595)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:291)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:162)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:138)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
> at org.apache.pig.Main.run(Main.java:451)
> at org.apache.pig.Main.main(Main.java:103)
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias c
> at org.apache.pig.PigServer.storeEx(PigServer.java:804)
> at org.apache.pig.PigServer.store(PigServer.java:760)
> at org.apache.pig.PigServer.openIterator(PigServer.java:680)
> ... 7 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2212: Unable to prune plan
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:826)
> at org.apache.pig.impl.logicalLayer.optimizer.LogicalOptimizer.optimize(LogicalOptimizer.java:240)
> at org.apache.pig.PigServer.compileLp(PigServer.java:1180)
> at org.apache.pig.PigServer.storeEx(PigServer.java:799)
> ... 9 more
> Caused by: org.apache.pig.impl.plan.VisitorException: ERROR 2188: Cannot prune columns for (Name: b: ForEach 1-50 Operator Key: 1-50)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:177)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.visit(ColumnPruner.java:202)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:132)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:47)
> at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:69)
> at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:821)
> ... 12 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:148)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1493) Column Pruner throw exception
"inconsistent pruning"
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-1493:
----------------------------
Attachment: PIG-1493-1.patch
> Column Pruner throw exception "inconsistent pruning"
> ----------------------------------------------------
>
> Key: PIG-1493
> URL: https://issues.apache.org/jira/browse/PIG-1493
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.7.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.7.0, 0.8.0
>
> Attachments: PIG-1493-1.patch
>
>
> The following script fail:
> {code}
> a = load '1.txt' as (a0:chararray, a1:chararray, a2);
> b = foreach a generate CONCAT(a0,a1) as b0, a0, a2;
> c = foreach b generate a0, a2;
> dump c;
> {code}
> Error message:
> ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias c
> at org.apache.pig.PigServer.openIterator(PigServer.java:698)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:595)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:291)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:162)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:138)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
> at org.apache.pig.Main.run(Main.java:451)
> at org.apache.pig.Main.main(Main.java:103)
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias c
> at org.apache.pig.PigServer.storeEx(PigServer.java:804)
> at org.apache.pig.PigServer.store(PigServer.java:760)
> at org.apache.pig.PigServer.openIterator(PigServer.java:680)
> ... 7 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2212: Unable to prune plan
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:826)
> at org.apache.pig.impl.logicalLayer.optimizer.LogicalOptimizer.optimize(LogicalOptimizer.java:240)
> at org.apache.pig.PigServer.compileLp(PigServer.java:1180)
> at org.apache.pig.PigServer.storeEx(PigServer.java:799)
> ... 9 more
> Caused by: org.apache.pig.impl.plan.VisitorException: ERROR 2188: Cannot prune columns for (Name: b: ForEach 1-50 Operator Key: 1-50)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:177)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.visit(ColumnPruner.java:202)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:132)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:47)
> at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:69)
> at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:821)
> ... 12 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:148)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1493) Column Pruner throw exception
"inconsistent pruning"
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888879#action_12888879 ]
Richard Ding commented on PIG-1493:
-----------------------------------
+1
> Column Pruner throw exception "inconsistent pruning"
> ----------------------------------------------------
>
> Key: PIG-1493
> URL: https://issues.apache.org/jira/browse/PIG-1493
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.7.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.7.0, 0.8.0
>
> Attachments: PIG-1493-1.patch
>
>
> The following script fail:
> {code}
> a = load '1.txt' as (a0:chararray, a1:chararray, a2);
> b = foreach a generate CONCAT(a0,a1) as b0, a0, a2;
> c = foreach b generate a0, a2;
> dump c;
> {code}
> Error message:
> ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias c
> at org.apache.pig.PigServer.openIterator(PigServer.java:698)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:595)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:291)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:162)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:138)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
> at org.apache.pig.Main.run(Main.java:451)
> at org.apache.pig.Main.main(Main.java:103)
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias c
> at org.apache.pig.PigServer.storeEx(PigServer.java:804)
> at org.apache.pig.PigServer.store(PigServer.java:760)
> at org.apache.pig.PigServer.openIterator(PigServer.java:680)
> ... 7 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2212: Unable to prune plan
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:826)
> at org.apache.pig.impl.logicalLayer.optimizer.LogicalOptimizer.optimize(LogicalOptimizer.java:240)
> at org.apache.pig.PigServer.compileLp(PigServer.java:1180)
> at org.apache.pig.PigServer.storeEx(PigServer.java:799)
> ... 9 more
> Caused by: org.apache.pig.impl.plan.VisitorException: ERROR 2188: Cannot prune columns for (Name: b: ForEach 1-50 Operator Key: 1-50)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:177)
> at org.apache.pig.impl.logicalLayer.ColumnPruner.visit(ColumnPruner.java:202)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:132)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:47)
> at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:69)
> at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
> at org.apache.pig.impl.logicalLayer.optimizer.PruneColumns.prune(PruneColumns.java:821)
> ... 12 more
> Caused by: org.apache.pig.impl.plan.optimizer.OptimizerException: ERROR 2185: Column $0 of (Name: b: ForEach 1-50 Operator Key: 1-50) inconsistent pruning
> at org.apache.pig.impl.logicalLayer.ColumnPruner.prune(ColumnPruner.java:148)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.