You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Brian Tan (JIRA)" <ji...@apache.org> on 2012/05/23 01:22:41 UTC
[jira] [Created] (PIG-2717) Tuple field mangled during flattening
Brian Tan created PIG-2717:
------------------------------
Summary: Tuple field mangled during flattening
Key: PIG-2717
URL: https://issues.apache.org/jira/browse/PIG-2717
Project: Pig
Issue Type: Bug
Affects Versions: 0.10.0, 0.9.2
Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
Reporter: Brian Tan
1.txt:
1, 2, 3
4, 5, 6
7, 8, 9
a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
b = foreach a generate TOTUPLE(x, y) as t, z;
c = group b by t;
d = foreach c generate flatten(b);
e = foreach d generate t;
Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
However, when dumping d the output is
(1,3)
(4,6)
(7,9)
Describing e shows the schema as e: {b::t: (x: int,y: int)}
However, when dumping I got the following error:
java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2717) Tuple field mangled during flattening
Posted by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284244#comment-13284244 ]
Dmitriy V. Ryaboy commented on PIG-2717:
----------------------------------------
+1
> Tuple field mangled during flattening
> -------------------------------------
>
> Key: PIG-2717
> URL: https://issues.apache.org/jira/browse/PIG-2717
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.2, 0.10.0
> Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
> Reporter: Brian Tan
> Assignee: Daniel Dai
> Priority: Critical
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2717-1.patch
>
>
> 1.txt:
> 1, 2, 3
> 4, 5, 6
> 7, 8, 9
> a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
> b = foreach a generate TOTUPLE(x, y) as t, z;
> c = group b by t;
> d = foreach c generate flatten(b);
> e = foreach d generate t;
> Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
> However, when dumping d the output is
> (1,3)
> (4,6)
> (7,9)
> Describing e shows the schema as e: {b::t: (x: int,y: int)}
> However, when dumping I got the following error:
> java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2717) Tuple field mangled during flattening
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-2717:
----------------------------
Attachment: PIG-2717-1.patch
> Tuple field mangled during flattening
> -------------------------------------
>
> Key: PIG-2717
> URL: https://issues.apache.org/jira/browse/PIG-2717
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.2, 0.10.0
> Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
> Reporter: Brian Tan
> Assignee: Daniel Dai
> Priority: Critical
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2717-1.patch
>
>
> 1.txt:
> 1, 2, 3
> 4, 5, 6
> 7, 8, 9
> a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
> b = foreach a generate TOTUPLE(x, y) as t, z;
> c = group b by t;
> d = foreach c generate flatten(b);
> e = foreach d generate t;
> Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
> However, when dumping d the output is
> (1,3)
> (4,6)
> (7,9)
> Describing e shows the schema as e: {b::t: (x: int,y: int)}
> However, when dumping I got the following error:
> java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2717) Tuple field mangled during flattening
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-2717:
----------------------------
Priority: Critical (was: Major)
Fix Version/s: 0.10.1
0.11
Assignee: Daniel Dai
This seems to be a bug in POPackageAnnotator. I will submit a patch shortly.
> Tuple field mangled during flattening
> -------------------------------------
>
> Key: PIG-2717
> URL: https://issues.apache.org/jira/browse/PIG-2717
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.2, 0.10.0
> Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
> Reporter: Brian Tan
> Assignee: Daniel Dai
> Priority: Critical
> Fix For: 0.11, 0.10.1
>
>
> 1.txt:
> 1, 2, 3
> 4, 5, 6
> 7, 8, 9
> a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
> b = foreach a generate TOTUPLE(x, y) as t, z;
> c = group b by t;
> d = foreach c generate flatten(b);
> e = foreach d generate t;
> Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
> However, when dumping d the output is
> (1,3)
> (4,6)
> (7,9)
> Describing e shows the schema as e: {b::t: (x: int,y: int)}
> However, when dumping I got the following error:
> java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2717) Tuple field mangled during flattening
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-2717:
----------------------------
Attachment: PIG-2717-2.patch
Fix a unit test failure.
> Tuple field mangled during flattening
> -------------------------------------
>
> Key: PIG-2717
> URL: https://issues.apache.org/jira/browse/PIG-2717
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.2, 0.10.0
> Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
> Reporter: Brian Tan
> Assignee: Daniel Dai
> Priority: Critical
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2717-1.patch, PIG-2717-2.patch
>
>
> 1.txt:
> 1, 2, 3
> 4, 5, 6
> 7, 8, 9
> a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
> b = foreach a generate TOTUPLE(x, y) as t, z;
> c = group b by t;
> d = foreach c generate flatten(b);
> e = foreach d generate t;
> Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
> However, when dumping d the output is
> (1,3)
> (4,6)
> (7,9)
> Describing e shows the schema as e: {b::t: (x: int,y: int)}
> However, when dumping I got the following error:
> java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (PIG-2717) Tuple field mangled during flattening
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai resolved PIG-2717.
-----------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Patch committed to 0.10/trunk.
> Tuple field mangled during flattening
> -------------------------------------
>
> Key: PIG-2717
> URL: https://issues.apache.org/jira/browse/PIG-2717
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.2, 0.10.0
> Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
> Reporter: Brian Tan
> Assignee: Daniel Dai
> Priority: Critical
> Fix For: 0.11, 0.10.1
>
> Attachments: PIG-2717-1.patch, PIG-2717-2.patch
>
>
> 1.txt:
> 1, 2, 3
> 4, 5, 6
> 7, 8, 9
> a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
> b = foreach a generate TOTUPLE(x, y) as t, z;
> c = group b by t;
> d = foreach c generate flatten(b);
> e = foreach d generate t;
> Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
> However, when dumping d the output is
> (1,3)
> (4,6)
> (7,9)
> Describing e shows the schema as e: {b::t: (x: int,y: int)}
> However, when dumping I got the following error:
> java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira