You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Thejas M Nair (JIRA)" <ji...@apache.org> on 2011/03/18 22:29:29 UTC
[jira] Created: (PIG-1919) order-by on bag gives error only at
runtime
order-by on bag gives error only at runtime
-------------------------------------------
Key: PIG-1919
URL: https://issues.apache.org/jira/browse/PIG-1919
Project: Pig
Issue Type: Bug
Reporter: Thejas M Nair
Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Jonathan Coveney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Coveney updated PIG-1919:
----------------------------------
Fix Version/s: (was: 0.10.1)
(was: 0.11)
0.12
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Assignee: Jonathan Coveney
> Fix For: 0.12
>
> Attachments: PIG-1919-0.patch, PIG-1919-1.patch, PIG-1919-1.patch
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486524#comment-13486524 ]
Olga Natkovich commented on PIG-1919:
-------------------------------------
Jonathan, should this be assigned to you? Is this going to be finished for 0.11 or should be moved to 0.12?
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-1919-0.patch, PIG-1919-1.patch, PIG-1919-1.patch
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Jonathan Coveney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Coveney reassigned PIG-1919:
-------------------------------------
Assignee: Jonathan Coveney
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Assignee: Jonathan Coveney
> Fix For: 0.12
>
> Attachments: PIG-1919-0.patch, PIG-1919-1.patch, PIG-1919-1.patch
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Jonathan Coveney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486556#comment-13486556 ]
Jonathan Coveney commented on PIG-1919:
---------------------------------------
Move to 0.12, and yeah, I'll assign it to myself. It could go into 0.11 but it's not that important, really.
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Fix For: 0.12
>
> Attachments: PIG-1919-0.patch, PIG-1919-1.patch, PIG-1919-1.patch
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Jonathan Coveney (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Coveney updated PIG-1919:
----------------------------------
Attachment: PIG-1919-0.patch
Thejas, please find attached a rudimentary stab at this. The approach I took was to check the SortInfo that is generated against the Schema of the Tuple, and to ensure that it isn't a Bag, Tuple, or Map. I throw a FrontendException if that is the case. I can add tests, but first I wanted to see if this was the right approach to take (and if the error I throw is a good one).
Operation "let's get rid of some of these older JIRA's" has commenced.
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-1919-0.patch
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Wojciech Langiewicz (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122640#comment-13122640 ]
Wojciech Langiewicz commented on PIG-1919:
------------------------------------------
Using Pig 0.8.1 (CDH3u1) gives this stacktrace:{code}java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.DataBag
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.processInputBag(POProject.java:482)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:197)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange.getNext(POLocalRearrange.java:330)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:237)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:232)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at org.apache.hadoop.mapred.Child.main(Child.java:264){code}
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich updated PIG-1919:
--------------------------------
Fix Version/s: (was: 0.9.0)
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Fix For: 0.10
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Olga Natkovich (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich updated PIG-1919:
--------------------------------
Fix Version/s: (was: 0.10)
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Jonathan Coveney (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Coveney updated PIG-1919:
----------------------------------
Attachment: PIG-1919-1.patch
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-1919-0.patch, PIG-1919-1.patch, PIG-1919-1.patch
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008637#comment-13008637 ]
Thejas M Nair commented on PIG-1919:
------------------------------------
{code}
grunt> l = load 't.txt' as (a,b,c);
grunt> g = group l by a;
grunt> describe g;
g: {group: bytearray,l: {(a: bytearray,b: bytearray,c: bytearray)}}
grunt> o = order g by $1; -- this should have given an error message
grunt> dump o;
...
...
2011-03-18 14:26:23,903 [Thread-29] WARN org.apache.hadoop.mapred.LocalJobRunner - job_local_0002
java.lang.ClassCastException: org.apache.pig.data.DataByteArray cannot be cast to org.apache.pig.data.DataBag
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.processInputBag(POProject.java:487)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:202)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:317)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange.getNext(POLocalRearrange.java:325)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:261)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:256)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:58)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
{code}
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Fix For: 0.9.0
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich updated PIG-1919:
--------------------------------
Fix Version/s: 0.10
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Fix For: 0.10
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thejas M Nair updated PIG-1919:
-------------------------------
Affects Version/s: 0.9.0
0.8.0
Fix Version/s: 0.9.0
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Fix For: 0.9.0
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Jonathan Coveney (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Coveney updated PIG-1919:
----------------------------------
Fix Version/s: 0.10.1
0.11
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Fix For: 0.11, 0.10.1
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-1919) order-by on bag gives error only at
runtime
Posted by "Jonathan Coveney (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Coveney updated PIG-1919:
----------------------------------
Attachment: PIG-1919-1.patch
minor fix to make tests pass. one downside of this is that describe doesnt fail, only dump or store
> order-by on bag gives error only at runtime
> -------------------------------------------
>
> Key: PIG-1919
> URL: https://issues.apache.org/jira/browse/PIG-1919
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Thejas M Nair
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-1919-0.patch, PIG-1919-1.patch, PIG-1919-1.patch
>
>
> Order-by on a bag or tuple should give error at query compile time, instead of giving an error at runtime.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira