You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Peter Arthur Ciccolo (JIRA)" <ji...@apache.org> on 2009/03/10 02:22:51 UTC

[jira] Updated: (PIG-698) Simple join fails on records not loaded with schema

     [ https://issues.apache.org/jira/browse/PIG-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Peter Arthur Ciccolo updated PIG-698:
-------------------------------------

    Description: 
Joins can fail with an out-of-bounds access to fields that are not referenced in the script when records without schema (including all variable-length records) are involved.
Example by Ben Reed:
i1:
1       c       D       E
1       a       B

i2:
0
0       Q
1       x       z
1       a       b       c


i1 = load 'i1';                                                                                                                                                                        
i2 = load 'i2';                                                                                                                                                                        
j = join i1 by $0, i2 by $0;                                                                                                                                                           
dump j

  was:
Joins can fail with an out-of-bounds access to fields that are not referenced in the script when variable-length
records are involved.
Example by Ben Reed:
i1:
1       c       D       E
1       a       B

i2:
0
0       Q
1       x       z
1       a       b       c


i1 = load 'i1';                                                                                                                                                                        
i2 = load 'i2';                                                                                                                                                                        
j = join i1 by $0, i2 by $0;                                                                                                                                                           
dump j

        Summary: Simple join fails on records not loaded with schema  (was: Simple join fails on variable-length records)

> Simple join fails on records not loaded with schema
> ---------------------------------------------------
>
>                 Key: PIG-698
>                 URL: https://issues.apache.org/jira/browse/PIG-698
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>         Environment: Yahoo! clusters.
>            Reporter: Peter Arthur Ciccolo
>
> Joins can fail with an out-of-bounds access to fields that are not referenced in the script when records without schema (including all variable-length records) are involved.
> Example by Ben Reed:
> i1:
> 1       c       D       E
> 1       a       B
> i2:
> 0
> 0       Q
> 1       x       z
> 1       a       b       c
> i1 = load 'i1';                                                                                                                                                                        
> i2 = load 'i2';                                                                                                                                                                        
> j = join i1 by $0, i2 by $0;                                                                                                                                                           
> dump j

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.