You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Brian Tan (JIRA)" <ji...@apache.org> on 2012/05/23 01:22:41 UTC

[jira] [Created] (PIG-2717) Tuple field mangled during flattening

Brian Tan created PIG-2717:
------------------------------

             Summary: Tuple field mangled during flattening
                 Key: PIG-2717
                 URL: https://issues.apache.org/jira/browse/PIG-2717
             Project: Pig
          Issue Type: Bug
    Affects Versions: 0.10.0, 0.9.2
         Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
            Reporter: Brian Tan


1.txt:
1, 2, 3
4, 5, 6
7, 8, 9

a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
b = foreach a generate TOTUPLE(x, y) as t, z;
c = group b by t;
d = foreach c generate flatten(b);
e = foreach d generate t;

Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
However, when dumping d the output is
(1,3)
(4,6)
(7,9)

Describing e shows the schema as e: {b::t: (x: int,y: int)}
However, when dumping I got the following error:
java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (PIG-2717) Tuple field mangled during flattening

Posted by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13284244#comment-13284244 ] 

Dmitriy V. Ryaboy commented on PIG-2717:
----------------------------------------

+1
                
> Tuple field mangled during flattening
> -------------------------------------
>
>                 Key: PIG-2717
>                 URL: https://issues.apache.org/jira/browse/PIG-2717
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.2, 0.10.0
>         Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
>            Reporter: Brian Tan
>            Assignee: Daniel Dai
>            Priority: Critical
>             Fix For: 0.11, 0.10.1
>
>         Attachments: PIG-2717-1.patch
>
>
> 1.txt:
> 1, 2, 3
> 4, 5, 6
> 7, 8, 9
> a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
> b = foreach a generate TOTUPLE(x, y) as t, z;
> c = group b by t;
> d = foreach c generate flatten(b);
> e = foreach d generate t;
> Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
> However, when dumping d the output is
> (1,3)
> (4,6)
> (7,9)
> Describing e shows the schema as e: {b::t: (x: int,y: int)}
> However, when dumping I got the following error:
> java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (PIG-2717) Tuple field mangled during flattening

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-2717:
----------------------------

    Attachment: PIG-2717-1.patch
    
> Tuple field mangled during flattening
> -------------------------------------
>
>                 Key: PIG-2717
>                 URL: https://issues.apache.org/jira/browse/PIG-2717
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.2, 0.10.0
>         Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
>            Reporter: Brian Tan
>            Assignee: Daniel Dai
>            Priority: Critical
>             Fix For: 0.11, 0.10.1
>
>         Attachments: PIG-2717-1.patch
>
>
> 1.txt:
> 1, 2, 3
> 4, 5, 6
> 7, 8, 9
> a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
> b = foreach a generate TOTUPLE(x, y) as t, z;
> c = group b by t;
> d = foreach c generate flatten(b);
> e = foreach d generate t;
> Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
> However, when dumping d the output is
> (1,3)
> (4,6)
> (7,9)
> Describing e shows the schema as e: {b::t: (x: int,y: int)}
> However, when dumping I got the following error:
> java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (PIG-2717) Tuple field mangled during flattening

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-2717:
----------------------------

         Priority: Critical  (was: Major)
    Fix Version/s: 0.10.1
                   0.11
         Assignee: Daniel Dai

This seems to be a bug in POPackageAnnotator. I will submit a patch shortly.
                
> Tuple field mangled during flattening
> -------------------------------------
>
>                 Key: PIG-2717
>                 URL: https://issues.apache.org/jira/browse/PIG-2717
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.2, 0.10.0
>         Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
>            Reporter: Brian Tan
>            Assignee: Daniel Dai
>            Priority: Critical
>             Fix For: 0.11, 0.10.1
>
>
> 1.txt:
> 1, 2, 3
> 4, 5, 6
> 7, 8, 9
> a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
> b = foreach a generate TOTUPLE(x, y) as t, z;
> c = group b by t;
> d = foreach c generate flatten(b);
> e = foreach d generate t;
> Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
> However, when dumping d the output is
> (1,3)
> (4,6)
> (7,9)
> Describing e shows the schema as e: {b::t: (x: int,y: int)}
> However, when dumping I got the following error:
> java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (PIG-2717) Tuple field mangled during flattening

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-2717:
----------------------------

    Attachment: PIG-2717-2.patch

Fix a unit test failure.
                
> Tuple field mangled during flattening
> -------------------------------------
>
>                 Key: PIG-2717
>                 URL: https://issues.apache.org/jira/browse/PIG-2717
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.2, 0.10.0
>         Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
>            Reporter: Brian Tan
>            Assignee: Daniel Dai
>            Priority: Critical
>             Fix For: 0.11, 0.10.1
>
>         Attachments: PIG-2717-1.patch, PIG-2717-2.patch
>
>
> 1.txt:
> 1, 2, 3
> 4, 5, 6
> 7, 8, 9
> a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
> b = foreach a generate TOTUPLE(x, y) as t, z;
> c = group b by t;
> d = foreach c generate flatten(b);
> e = foreach d generate t;
> Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
> However, when dumping d the output is
> (1,3)
> (4,6)
> (7,9)
> Describing e shows the schema as e: {b::t: (x: int,y: int)}
> However, when dumping I got the following error:
> java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (PIG-2717) Tuple field mangled during flattening

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai resolved PIG-2717.
-----------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed

Patch committed to 0.10/trunk.
                
> Tuple field mangled during flattening
> -------------------------------------
>
>                 Key: PIG-2717
>                 URL: https://issues.apache.org/jira/browse/PIG-2717
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.2, 0.10.0
>         Environment: RHEL5 (Linux 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:54 EDT 2009 i686 i686 i386 GNU/Linux)
>            Reporter: Brian Tan
>            Assignee: Daniel Dai
>            Priority: Critical
>             Fix For: 0.11, 0.10.1
>
>         Attachments: PIG-2717-1.patch, PIG-2717-2.patch
>
>
> 1.txt:
> 1, 2, 3
> 4, 5, 6
> 7, 8, 9
> a = load '1.txt' using PigStorage(',') as (x:int, y:int, z:int);
> b = foreach a generate TOTUPLE(x, y) as t, z;
> c = group b by t;
> d = foreach c generate flatten(b);
> e = foreach d generate t;
> Describing d shows the schema as d: {b::t: (x: int,y: int),b::z: int}
> However, when dumping d the output is
> (1,3)
> (4,6)
> (7,9)
> Describing e shows the schema as e: {b::t: (x: int,y: int)}
> However, when dumping I got the following error:
> java.lang.ClassCastException: java.lang.Integer cannot be cast to org.apache.pig.data.Tuple

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira