You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Bill Graham (JIRA)" <ji...@apache.org> on 2012/05/05 01:57:48 UTC
[jira] [Commented] (PIG-2683) Schema propogation not working
correctly after join
[ https://issues.apache.org/jira/browse/PIG-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268812#comment-13268812 ]
Bill Graham commented on PIG-2683:
----------------------------------
Actually, Pig 0.4.0 had the bug in your example. Since the schema isn't defined for A it is in fact unknown. Therefore describing F as shown above for 0.4.0 is wrong. Relation A could have multiple bytearrays (or not), but it's described as just one. Pig 0.7.0 fixed this to say unknown when the schema is really in fact unknown.
Pig 0.7.0 is pretty old. You should consider upgrading to Pig 0.10.
> Schema propogation not working correctly after join
> ---------------------------------------------------
>
> Key: PIG-2683
> URL: https://issues.apache.org/jira/browse/PIG-2683
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: Tushar Agrawal
>
> The schema propagation is not working correctly in Pig 0.7.0. This was working in 0.4.0.
> Following was the output with Pig 0.4.0 -
> grunt> A = LOAD '/tmp/part-r-00000' USING PigStorage('\t');
> grunt> B = FOREACH A GENERATE $0 as f1, $1 as f2;
> grunt> describe B;
> B: {f1: bytearray,f2: bytearray}
> grunt> F = JOIN B by (f1), A by ($0);
> grunt> describe F;
> F: {B::f1: bytearray,B::f2: bytearray,bytearray}
> Following is the output with Pig 0.7.0 -
> grunt> A = LOAD '/tmp/part-r-00000' USING PigStorage('\t');
> grunt> B = FOREACH A GENERATE $0 as f1, $1 as f2;
> grunt> describe B;
> B: {f1: bytearray,f2: bytearray}
> grunt> F = JOIN B by (f1), A by ($0);
> grunt> describe F;
> Schema for F unknown.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira