You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Thejas M Nair (JIRA)" <ji...@apache.org> on 2009/12/04 22:51:20 UTC

[jira] Created: (PIG-1128) column pruning causing failure when foreach has user-specified schema

column pruning causing failure when foreach has user-specified schema
---------------------------------------------------------------------

                 Key: PIG-1128
                 URL: https://issues.apache.org/jira/browse/PIG-1128
             Project: Pig
          Issue Type: Bug
    Affects Versions: 0.6.0, 0.7.0
            Reporter: Thejas M Nair


Issue is seen in 0.6.0 and trunk.

grunt> l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);                                   
grunt> f1 = foreach l generate c1 as c1 : chararray, c2 as c2 : int, 'CA' as state : chararray;
grunt> f2 = foreach f1 generate c1 as c1 : chararray;                                          
grunt> explain f2;
2009-12-04 13:11:19,010 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c2: int


( it does not matter if the new schema has new/different column name - )
grunt>l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);
grunt>f1 = foreach l generate c1 as c11 : chararray, c2 as c22 : int, 'CA' as state : chararray;
grunt>f2 = foreach f1 generate c11 as c111 : chararray;
grunt> explain f2;
2009-12-04 13:13:01,462 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c22: int


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1128) column pruning causing failure when foreach has user-specified schema

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787140#action_12787140 ] 

Daniel Dai commented on PIG-1128:
---------------------------------

Core tests failures are due to port conflict. Run unit tests manually and all passed.

> column pruning causing failure when foreach has user-specified schema
> ---------------------------------------------------------------------
>
>                 Key: PIG-1128
>                 URL: https://issues.apache.org/jira/browse/PIG-1128
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Thejas M Nair
>            Assignee: Daniel Dai
>             Fix For: 0.6.0
>
>         Attachments: PIG-1128-1.patch
>
>
> Issue is seen in 0.6.0 and trunk.
> grunt> l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);                                   
> grunt> f1 = foreach l generate c1 as c1 : chararray, c2 as c2 : int, 'CA' as state : chararray;
> grunt> f2 = foreach f1 generate c1 as c1 : chararray;                                          
> grunt> explain f2;
> 2009-12-04 13:11:19,010 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c2: int
> ( it does not matter if the new schema has new/different column name - )
> grunt>l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);
> grunt>f1 = foreach l generate c1 as c11 : chararray, c2 as c22 : int, 'CA' as state : chararray;
> grunt>f2 = foreach f1 generate c11 as c111 : chararray;
> grunt> explain f2;
> 2009-12-04 13:13:01,462 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c22: int

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (PIG-1128) column pruning causing failure when foreach has user-specified schema

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai reassigned PIG-1128:
-------------------------------

    Assignee: Daniel Dai

> column pruning causing failure when foreach has user-specified schema
> ---------------------------------------------------------------------
>
>                 Key: PIG-1128
>                 URL: https://issues.apache.org/jira/browse/PIG-1128
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Thejas M Nair
>            Assignee: Daniel Dai
>             Fix For: 0.6.0
>
>
> Issue is seen in 0.6.0 and trunk.
> grunt> l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);                                   
> grunt> f1 = foreach l generate c1 as c1 : chararray, c2 as c2 : int, 'CA' as state : chararray;
> grunt> f2 = foreach f1 generate c1 as c1 : chararray;                                          
> grunt> explain f2;
> 2009-12-04 13:11:19,010 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c2: int
> ( it does not matter if the new schema has new/different column name - )
> grunt>l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);
> grunt>f1 = foreach l generate c1 as c11 : chararray, c2 as c22 : int, 'CA' as state : chararray;
> grunt>f2 = foreach f1 generate c11 as c111 : chararray;
> grunt> explain f2;
> 2009-12-04 13:13:01,462 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c22: int

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1128) column pruning causing failure when foreach has user-specified schema

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-1128:
----------------------------

    Status: Patch Available  (was: Open)

> column pruning causing failure when foreach has user-specified schema
> ---------------------------------------------------------------------
>
>                 Key: PIG-1128
>                 URL: https://issues.apache.org/jira/browse/PIG-1128
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Thejas M Nair
>            Assignee: Daniel Dai
>             Fix For: 0.6.0
>
>         Attachments: PIG-1128-1.patch
>
>
> Issue is seen in 0.6.0 and trunk.
> grunt> l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);                                   
> grunt> f1 = foreach l generate c1 as c1 : chararray, c2 as c2 : int, 'CA' as state : chararray;
> grunt> f2 = foreach f1 generate c1 as c1 : chararray;                                          
> grunt> explain f2;
> 2009-12-04 13:11:19,010 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c2: int
> ( it does not matter if the new schema has new/different column name - )
> grunt>l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);
> grunt>f1 = foreach l generate c1 as c11 : chararray, c2 as c22 : int, 'CA' as state : chararray;
> grunt>f2 = foreach f1 generate c11 as c111 : chararray;
> grunt> explain f2;
> 2009-12-04 13:13:01,462 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c22: int

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1128) column pruning causing failure when foreach has user-specified schema

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-1128:
----------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Committed to both trunk and branch 0.6.

> column pruning causing failure when foreach has user-specified schema
> ---------------------------------------------------------------------
>
>                 Key: PIG-1128
>                 URL: https://issues.apache.org/jira/browse/PIG-1128
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Thejas M Nair
>            Assignee: Daniel Dai
>             Fix For: 0.6.0
>
>         Attachments: PIG-1128-1.patch
>
>
> Issue is seen in 0.6.0 and trunk.
> grunt> l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);                                   
> grunt> f1 = foreach l generate c1 as c1 : chararray, c2 as c2 : int, 'CA' as state : chararray;
> grunt> f2 = foreach f1 generate c1 as c1 : chararray;                                          
> grunt> explain f2;
> 2009-12-04 13:11:19,010 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c2: int
> ( it does not matter if the new schema has new/different column name - )
> grunt>l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);
> grunt>f1 = foreach l generate c1 as c11 : chararray, c2 as c22 : int, 'CA' as state : chararray;
> grunt>f2 = foreach f1 generate c11 as c111 : chararray;
> grunt> explain f2;
> 2009-12-04 13:13:01,462 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c22: int

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1128) column pruning causing failure when foreach has user-specified schema

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich updated PIG-1128:
--------------------------------

    Fix Version/s: 0.6.0

> column pruning causing failure when foreach has user-specified schema
> ---------------------------------------------------------------------
>
>                 Key: PIG-1128
>                 URL: https://issues.apache.org/jira/browse/PIG-1128
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Thejas M Nair
>             Fix For: 0.6.0
>
>
> Issue is seen in 0.6.0 and trunk.
> grunt> l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);                                   
> grunt> f1 = foreach l generate c1 as c1 : chararray, c2 as c2 : int, 'CA' as state : chararray;
> grunt> f2 = foreach f1 generate c1 as c1 : chararray;                                          
> grunt> explain f2;
> 2009-12-04 13:11:19,010 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c2: int
> ( it does not matter if the new schema has new/different column name - )
> grunt>l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);
> grunt>f1 = foreach l generate c1 as c11 : chararray, c2 as c22 : int, 'CA' as state : chararray;
> grunt>f2 = foreach f1 generate c11 as c111 : chararray;
> grunt> explain f2;
> 2009-12-04 13:13:01,462 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c22: int

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1128) column pruning causing failure when foreach has user-specified schema

Posted by "Pradeep Kamath (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787131#action_12787131 ] 

Pradeep Kamath commented on PIG-1128:
-------------------------------------

reviewed - +1

> column pruning causing failure when foreach has user-specified schema
> ---------------------------------------------------------------------
>
>                 Key: PIG-1128
>                 URL: https://issues.apache.org/jira/browse/PIG-1128
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Thejas M Nair
>            Assignee: Daniel Dai
>             Fix For: 0.6.0
>
>         Attachments: PIG-1128-1.patch
>
>
> Issue is seen in 0.6.0 and trunk.
> grunt> l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);                                   
> grunt> f1 = foreach l generate c1 as c1 : chararray, c2 as c2 : int, 'CA' as state : chararray;
> grunt> f2 = foreach f1 generate c1 as c1 : chararray;                                          
> grunt> explain f2;
> 2009-12-04 13:11:19,010 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c2: int
> ( it does not matter if the new schema has new/different column name - )
> grunt>l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);
> grunt>f1 = foreach l generate c1 as c11 : chararray, c2 as c22 : int, 'CA' as state : chararray;
> grunt>f2 = foreach f1 generate c11 as c111 : chararray;
> grunt> explain f2;
> 2009-12-04 13:13:01,462 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c22: int

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1128) column pruning causing failure when foreach has user-specified schema

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-1128:
----------------------------

    Attachment: PIG-1128-1.patch

> column pruning causing failure when foreach has user-specified schema
> ---------------------------------------------------------------------
>
>                 Key: PIG-1128
>                 URL: https://issues.apache.org/jira/browse/PIG-1128
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Thejas M Nair
>            Assignee: Daniel Dai
>             Fix For: 0.6.0
>
>         Attachments: PIG-1128-1.patch
>
>
> Issue is seen in 0.6.0 and trunk.
> grunt> l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);                                   
> grunt> f1 = foreach l generate c1 as c1 : chararray, c2 as c2 : int, 'CA' as state : chararray;
> grunt> f2 = foreach f1 generate c1 as c1 : chararray;                                          
> grunt> explain f2;
> 2009-12-04 13:11:19,010 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c2: int
> ( it does not matter if the new schema has new/different column name - )
> grunt>l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);
> grunt>f1 = foreach l generate c1 as c11 : chararray, c2 as c22 : int, 'CA' as state : chararray;
> grunt>f2 = foreach f1 generate c11 as c111 : chararray;
> grunt> explain f2;
> 2009-12-04 13:13:01,462 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c22: int

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1128) column pruning causing failure when foreach has user-specified schema

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786565#action_12786565 ] 

Hadoop QA commented on PIG-1128:
--------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12427028/PIG-1128-1.patch
  against trunk revision 887401.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/99/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/99/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/99/console

This message is automatically generated.

> column pruning causing failure when foreach has user-specified schema
> ---------------------------------------------------------------------
>
>                 Key: PIG-1128
>                 URL: https://issues.apache.org/jira/browse/PIG-1128
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Thejas M Nair
>            Assignee: Daniel Dai
>             Fix For: 0.6.0
>
>         Attachments: PIG-1128-1.patch
>
>
> Issue is seen in 0.6.0 and trunk.
> grunt> l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);                                   
> grunt> f1 = foreach l generate c1 as c1 : chararray, c2 as c2 : int, 'CA' as state : chararray;
> grunt> f2 = foreach f1 generate c1 as c1 : chararray;                                          
> grunt> explain f2;
> 2009-12-04 13:11:19,010 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c2: int
> ( it does not matter if the new schema has new/different column name - )
> grunt>l = load 'dummy.txt' as ( c1 : chararray,  c2 : int);
> grunt>f1 = foreach l generate c1 as c11 : chararray, c2 as c22 : int, 'CA' as state : chararray;
> grunt>f2 = foreach f1 generate c11 as c111 : chararray;
> grunt> explain f2;
> 2009-12-04 13:13:01,462 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1022: Type mismatch merging schema prefix. Field Schema: chararray. Other Field Schema: c22: int

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.