You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org> on 2008/08/08 14:05:44 UTC
[jira] Created: (PIG-370) dump with split does not work
dump with split does not work
-----------------------------
Key: PIG-370
URL: https://issues.apache.org/jira/browse/PIG-370
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: types_branch
Reporter: Shravan Matthur Narayanamurthy
Assignee: Shravan Matthur Narayanamurthy
Fix For: types_branch
The following script doesn't work:
A = load 'file:/etc/passwd' using PigStorage(':');
split A into A1 if $2<25, A2 if $2>25;
dump A1;
The error dump is:
2008-08-08 17:03:06,888 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOGreaterThan Operator
2008-08-08 17:03:06,889 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOLesserThan Operator
2008-08-08 17:03:06,970 [main] ERROR org.apache.pig.impl.plan.OperatorPlan - Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:158)
at org.apache.pig.PigServer.execute(PigServer.java:519)
at org.apache.pig.PigServer.openIterator(PigServer.java:307)
at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:258)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:175)
at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
at org.apache.pig.Main.main(Main.java:278)
Caused by: org.apache.pig.backend.executionengine.ExecException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
... 8 more
Caused by: org.apache.pig.impl.plan.PlanException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:169)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:81)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:1)
at org.apache.pig.impl.plan.OperatorPlan.addAsLeaf(OperatorPlan.java:395)
at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:142)
... 7 more
2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
The issue is that PigServer.OpenIterator doesn't send the logical plan corresponding to A1 but sends the plan with both splitOutputs. I have a fix for this and will attach it. We have two parallel branches which do nearly the same thing. OpenIterator & Store. However they have individual code paths and we see the same script with a store not raise a plan exception. For now I will just copy some code. But we need to fix this in a better way. Otherwise we will leave some bugs that we fix for store in dump.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-370) dump with split does not work
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12624499#action_12624499 ]
Olga Natkovich commented on PIG-370:
------------------------------------
I verified that with this patch the problem with dump goes away. However, if I try and store A2 into a file, I see the following exception:
08/08/21 15:22:45 ERROR grunt.GruntParser: java.lang.NullPointerException
at org.apache.pig.impl.logicalLayer.LOSplitOutput.getSchema(LOSplitOutput.java:74)
at org.apache.pig.impl.logicalLayer.LOStore.getSchema(LOStore.java:88)
at org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:418)
at org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:60)
at org.apache.pig.PigServer.registerQuery(PigServer.java:252)
at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:422)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:241)
at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
at org.apache.pig.Main.main(Main.java:278)
08/08/21 15:22:45 ERROR grunt.GruntParser:
08/08/21 15:22:45 ERROR grunt.GruntParser: java.lang.NullPointerException
> dump with split does not work
> -----------------------------
>
> Key: PIG-370
> URL: https://issues.apache.org/jira/browse/PIG-370
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: types_branch
> Reporter: Shravan Matthur Narayanamurthy
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: 370.patch
>
>
> The following script doesn't work:
> A = load 'file:/etc/passwd' using PigStorage(':');
> split A into A1 if $2<25, A2 if $2>25;
> dump A1;
> The error dump is:
> 2008-08-08 17:03:06,888 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOGreaterThan Operator
> 2008-08-08 17:03:06,889 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOLesserThan Operator
> 2008-08-08 17:03:06,970 [main] ERROR org.apache.pig.impl.plan.OperatorPlan - Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:158)
> at org.apache.pig.PigServer.execute(PigServer.java:519)
> at org.apache.pig.PigServer.openIterator(PigServer.java:307)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:258)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:175)
> at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
> at org.apache.pig.Main.main(Main.java:278)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> ... 8 more
> Caused by: org.apache.pig.impl.plan.PlanException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:169)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:81)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:1)
> at org.apache.pig.impl.plan.OperatorPlan.addAsLeaf(OperatorPlan.java:395)
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:142)
> ... 7 more
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> The issue is that PigServer.OpenIterator doesn't send the logical plan corresponding to A1 but sends the plan with both splitOutputs. I have a fix for this and will attach it. We have two parallel branches which do nearly the same thing. OpenIterator & Store. However they have individual code paths and we see the same script with a store not raise a plan exception. For now I will just copy some code. But we need to fix this in a better way. Otherwise we will leave some bugs that we fix for store in dump.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-370) dump with split does not work
Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shravan Matthur Narayanamurthy updated PIG-370:
-----------------------------------------------
Attachment: 370-1.patch
Fixed the issue of dump and store not working. Two parts:
1) Fixed the openIterator method to use the store() codepath instead of its own to execute.
2) Because of some debug calls using getSchema method in LOSplitoutput which used an object without checking for null, there was a NPE. Fixed it to return a null schema if there were no predecessors of LOSplitOutput.
Also included is a test case to test the various split + dump + registerQuery(Store) + PigServer.store combinations
> dump with split does not work
> -----------------------------
>
> Key: PIG-370
> URL: https://issues.apache.org/jira/browse/PIG-370
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: types_branch
> Reporter: Shravan Matthur Narayanamurthy
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: 370-1.patch, 370.patch
>
>
> The following script doesn't work:
> A = load 'file:/etc/passwd' using PigStorage(':');
> split A into A1 if $2<25, A2 if $2>25;
> dump A1;
> The error dump is:
> 2008-08-08 17:03:06,888 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOGreaterThan Operator
> 2008-08-08 17:03:06,889 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOLesserThan Operator
> 2008-08-08 17:03:06,970 [main] ERROR org.apache.pig.impl.plan.OperatorPlan - Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:158)
> at org.apache.pig.PigServer.execute(PigServer.java:519)
> at org.apache.pig.PigServer.openIterator(PigServer.java:307)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:258)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:175)
> at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
> at org.apache.pig.Main.main(Main.java:278)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> ... 8 more
> Caused by: org.apache.pig.impl.plan.PlanException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:169)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:81)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:1)
> at org.apache.pig.impl.plan.OperatorPlan.addAsLeaf(OperatorPlan.java:395)
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:142)
> ... 7 more
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> The issue is that PigServer.OpenIterator doesn't send the logical plan corresponding to A1 but sends the plan with both splitOutputs. I have a fix for this and will attach it. We have two parallel branches which do nearly the same thing. OpenIterator & Store. However they have individual code paths and we see the same script with a store not raise a plan exception. For now I will just copy some code. But we need to fix this in a better way. Otherwise we will leave some bugs that we fix for store in dump.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-370) dump with split does not work
Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12625774#action_12625774 ]
Shravan Matthur Narayanamurthy commented on PIG-370:
----------------------------------------------------
Olga, even this one seems to be working for me.
> dump with split does not work
> -----------------------------
>
> Key: PIG-370
> URL: https://issues.apache.org/jira/browse/PIG-370
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: types_branch
> Reporter: Shravan Matthur Narayanamurthy
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: 370-1.patch, 370.patch
>
>
> The following script doesn't work:
> A = load 'file:/etc/passwd' using PigStorage(':');
> split A into A1 if $2<25, A2 if $2>25;
> dump A1;
> The error dump is:
> 2008-08-08 17:03:06,888 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOGreaterThan Operator
> 2008-08-08 17:03:06,889 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOLesserThan Operator
> 2008-08-08 17:03:06,970 [main] ERROR org.apache.pig.impl.plan.OperatorPlan - Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:158)
> at org.apache.pig.PigServer.execute(PigServer.java:519)
> at org.apache.pig.PigServer.openIterator(PigServer.java:307)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:258)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:175)
> at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
> at org.apache.pig.Main.main(Main.java:278)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> ... 8 more
> Caused by: org.apache.pig.impl.plan.PlanException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:169)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:81)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:1)
> at org.apache.pig.impl.plan.OperatorPlan.addAsLeaf(OperatorPlan.java:395)
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:142)
> ... 7 more
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> The issue is that PigServer.OpenIterator doesn't send the logical plan corresponding to A1 but sends the plan with both splitOutputs. I have a fix for this and will attach it. We have two parallel branches which do nearly the same thing. OpenIterator & Store. However they have individual code paths and we see the same script with a store not raise a plan exception. For now I will just copy some code. But we need to fix this in a better way. Otherwise we will leave some bugs that we fix for store in dump.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-370) dump with split does not work
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich updated PIG-370:
-------------------------------
Status: Open (was: Patch Available)
> dump with split does not work
> -----------------------------
>
> Key: PIG-370
> URL: https://issues.apache.org/jira/browse/PIG-370
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: types_branch
> Reporter: Shravan Matthur Narayanamurthy
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: 370-1.patch, 370.patch
>
>
> The following script doesn't work:
> A = load 'file:/etc/passwd' using PigStorage(':');
> split A into A1 if $2<25, A2 if $2>25;
> dump A1;
> The error dump is:
> 2008-08-08 17:03:06,888 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOGreaterThan Operator
> 2008-08-08 17:03:06,889 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOLesserThan Operator
> 2008-08-08 17:03:06,970 [main] ERROR org.apache.pig.impl.plan.OperatorPlan - Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:158)
> at org.apache.pig.PigServer.execute(PigServer.java:519)
> at org.apache.pig.PigServer.openIterator(PigServer.java:307)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:258)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:175)
> at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
> at org.apache.pig.Main.main(Main.java:278)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> ... 8 more
> Caused by: org.apache.pig.impl.plan.PlanException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:169)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:81)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:1)
> at org.apache.pig.impl.plan.OperatorPlan.addAsLeaf(OperatorPlan.java:395)
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:142)
> ... 7 more
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> The issue is that PigServer.OpenIterator doesn't send the logical plan corresponding to A1 but sends the plan with both splitOutputs. I have a fix for this and will attach it. We have two parallel branches which do nearly the same thing. OpenIterator & Store. However they have individual code paths and we see the same script with a store not raise a plan exception. For now I will just copy some code. But we need to fix this in a better way. Otherwise we will leave some bugs that we fix for store in dump.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-370) dump with split does not work
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich updated PIG-370:
-------------------------------
Status: Patch Available (was: Open)
> dump with split does not work
> -----------------------------
>
> Key: PIG-370
> URL: https://issues.apache.org/jira/browse/PIG-370
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: types_branch
> Reporter: Shravan Matthur Narayanamurthy
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: 370.patch
>
>
> The following script doesn't work:
> A = load 'file:/etc/passwd' using PigStorage(':');
> split A into A1 if $2<25, A2 if $2>25;
> dump A1;
> The error dump is:
> 2008-08-08 17:03:06,888 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOGreaterThan Operator
> 2008-08-08 17:03:06,889 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOLesserThan Operator
> 2008-08-08 17:03:06,970 [main] ERROR org.apache.pig.impl.plan.OperatorPlan - Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:158)
> at org.apache.pig.PigServer.execute(PigServer.java:519)
> at org.apache.pig.PigServer.openIterator(PigServer.java:307)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:258)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:175)
> at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
> at org.apache.pig.Main.main(Main.java:278)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> ... 8 more
> Caused by: org.apache.pig.impl.plan.PlanException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:169)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:81)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:1)
> at org.apache.pig.impl.plan.OperatorPlan.addAsLeaf(OperatorPlan.java:395)
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:142)
> ... 7 more
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> The issue is that PigServer.OpenIterator doesn't send the logical plan corresponding to A1 but sends the plan with both splitOutputs. I have a fix for this and will attach it. We have two parallel branches which do nearly the same thing. OpenIterator & Store. However they have individual code paths and we see the same script with a store not raise a plan exception. For now I will just copy some code. But we need to fix this in a better way. Otherwise we will leave some bugs that we fix for store in dump.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-370) dump with split does not work
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12625214#action_12625214 ]
Olga Natkovich commented on PIG-370:
------------------------------------
The end-to-end tests that I tried now passing put one of the unit tests started to fail:
[junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0.006 sec
[junit] Test org.apache.pig.test.TestSplitStore FAILED
> dump with split does not work
> -----------------------------
>
> Key: PIG-370
> URL: https://issues.apache.org/jira/browse/PIG-370
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: types_branch
> Reporter: Shravan Matthur Narayanamurthy
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: 370-1.patch, 370.patch
>
>
> The following script doesn't work:
> A = load 'file:/etc/passwd' using PigStorage(':');
> split A into A1 if $2<25, A2 if $2>25;
> dump A1;
> The error dump is:
> 2008-08-08 17:03:06,888 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOGreaterThan Operator
> 2008-08-08 17:03:06,889 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOLesserThan Operator
> 2008-08-08 17:03:06,970 [main] ERROR org.apache.pig.impl.plan.OperatorPlan - Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:158)
> at org.apache.pig.PigServer.execute(PigServer.java:519)
> at org.apache.pig.PigServer.openIterator(PigServer.java:307)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:258)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:175)
> at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
> at org.apache.pig.Main.main(Main.java:278)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> ... 8 more
> Caused by: org.apache.pig.impl.plan.PlanException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:169)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:81)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:1)
> at org.apache.pig.impl.plan.OperatorPlan.addAsLeaf(OperatorPlan.java:395)
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:142)
> ... 7 more
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> The issue is that PigServer.OpenIterator doesn't send the logical plan corresponding to A1 but sends the plan with both splitOutputs. I have a fix for this and will attach it. We have two parallel branches which do nearly the same thing. OpenIterator & Store. However they have individual code paths and we see the same script with a store not raise a plan exception. For now I will just copy some code. But we need to fix this in a better way. Otherwise we will leave some bugs that we fix for store in dump.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-370) dump with split does not work
Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shravan Matthur Narayanamurthy updated PIG-370:
-----------------------------------------------
Attachment: 370.patch
Please apply this patch after applying patch for PIG-343
> dump with split does not work
> -----------------------------
>
> Key: PIG-370
> URL: https://issues.apache.org/jira/browse/PIG-370
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: types_branch
> Reporter: Shravan Matthur Narayanamurthy
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: 370.patch
>
>
> The following script doesn't work:
> A = load 'file:/etc/passwd' using PigStorage(':');
> split A into A1 if $2<25, A2 if $2>25;
> dump A1;
> The error dump is:
> 2008-08-08 17:03:06,888 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOGreaterThan Operator
> 2008-08-08 17:03:06,889 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOLesserThan Operator
> 2008-08-08 17:03:06,970 [main] ERROR org.apache.pig.impl.plan.OperatorPlan - Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:158)
> at org.apache.pig.PigServer.execute(PigServer.java:519)
> at org.apache.pig.PigServer.openIterator(PigServer.java:307)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:258)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:175)
> at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
> at org.apache.pig.Main.main(Main.java:278)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> ... 8 more
> Caused by: org.apache.pig.impl.plan.PlanException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:169)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:81)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:1)
> at org.apache.pig.impl.plan.OperatorPlan.addAsLeaf(OperatorPlan.java:395)
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:142)
> ... 7 more
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> The issue is that PigServer.OpenIterator doesn't send the logical plan corresponding to A1 but sends the plan with both splitOutputs. I have a fix for this and will attach it. We have two parallel branches which do nearly the same thing. OpenIterator & Store. However they have individual code paths and we see the same script with a store not raise a plan exception. For now I will just copy some code. But we need to fix this in a better way. Otherwise we will leave some bugs that we fix for store in dump.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (PIG-370) dump with split does not work
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich resolved PIG-370.
--------------------------------
Resolution: Fixed
The problem was that the test file was built for new version of junit. Updated the test file and committed the patch.
thanks shravan
> dump with split does not work
> -----------------------------
>
> Key: PIG-370
> URL: https://issues.apache.org/jira/browse/PIG-370
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: types_branch
> Reporter: Shravan Matthur Narayanamurthy
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: 370-1.patch, 370.patch
>
>
> The following script doesn't work:
> A = load 'file:/etc/passwd' using PigStorage(':');
> split A into A1 if $2<25, A2 if $2>25;
> dump A1;
> The error dump is:
> 2008-08-08 17:03:06,888 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOGreaterThan Operator
> 2008-08-08 17:03:06,889 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOLesserThan Operator
> 2008-08-08 17:03:06,970 [main] ERROR org.apache.pig.impl.plan.OperatorPlan - Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:158)
> at org.apache.pig.PigServer.execute(PigServer.java:519)
> at org.apache.pig.PigServer.openIterator(PigServer.java:307)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:258)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:175)
> at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
> at org.apache.pig.Main.main(Main.java:278)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> ... 8 more
> Caused by: org.apache.pig.impl.plan.PlanException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:169)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:81)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:1)
> at org.apache.pig.impl.plan.OperatorPlan.addAsLeaf(OperatorPlan.java:395)
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:142)
> ... 7 more
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> The issue is that PigServer.OpenIterator doesn't send the logical plan corresponding to A1 but sends the plan with both splitOutputs. I have a fix for this and will attach it. We have two parallel branches which do nearly the same thing. OpenIterator & Store. However they have individual code paths and we see the same script with a store not raise a plan exception. For now I will just copy some code. But we need to fix this in a better way. Otherwise we will leave some bugs that we fix for store in dump.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (PIG-370) dump with split does not
work
Posted by "Shravan Matthur Narayanamurthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12625774#action_12625774 ]
shravanmn edited comment on PIG-370 at 8/26/08 8:54 AM:
-----------------------------------------------------------------------------
Olga, even this one seems to be working for me. If it does not work for you could you please attach the log?
was (Author: shravanmn):
Olga, even this one seems to be working for me.
> dump with split does not work
> -----------------------------
>
> Key: PIG-370
> URL: https://issues.apache.org/jira/browse/PIG-370
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: types_branch
> Reporter: Shravan Matthur Narayanamurthy
> Assignee: Shravan Matthur Narayanamurthy
> Fix For: types_branch
>
> Attachments: 370-1.patch, 370.patch
>
>
> The following script doesn't work:
> A = load 'file:/etc/passwd' using PigStorage(':');
> split A into A1 if $2<25, A2 if $2>25;
> dump A1;
> The error dump is:
> 2008-08-08 17:03:06,888 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOGreaterThan Operator
> 2008-08-08 17:03:06,889 [main] WARN org.apache.pig.PigServer - bytearray is implicitly casted to integer under LOLesserThan Operator
> 2008-08-08 17:03:06,970 [main] ERROR org.apache.pig.impl.plan.OperatorPlan - Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:158)
> at org.apache.pig.PigServer.execute(PigServer.java:519)
> at org.apache.pig.PigServer.openIterator(PigServer.java:307)
> at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:258)
> at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:175)
> at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:92)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
> at org.apache.pig.Main.main(Main.java:278)
> Caused by: org.apache.pig.backend.executionengine.ExecException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> ... 8 more
> Caused by: org.apache.pig.impl.plan.PlanException: Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.
> at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:169)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:81)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:1)
> at org.apache.pig.impl.plan.OperatorPlan.addAsLeaf(OperatorPlan.java:395)
> at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:142)
> ... 7 more
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> 2008-08-08 17:03:06,973 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A1 [Attempt to give operator of type org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore multiple inputs. This operator does not support multiple inputs.]
> The issue is that PigServer.OpenIterator doesn't send the logical plan corresponding to A1 but sends the plan with both splitOutputs. I have a fix for this and will attach it. We have two parallel branches which do nearly the same thing. OpenIterator & Store. However they have individual code paths and we see the same script with a store not raise a plan exception. For now I will just copy some code. But we need to fix this in a better way. Otherwise we will leave some bugs that we fix for store in dump.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.