You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Chao Wang (JIRA)" <ji...@apache.org> on 2010/04/07 18:51:33 UTC

[jira] Commented: (PIG-1351) [Zebra] No type check when we write to the basic table

    [ https://issues.apache.org/jira/browse/PIG-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854595#action_12854595 ] 

Chao Wang commented on PIG-1351:
--------------------------------

1) We follow Java's type compatibility rule as follows:
For int type column, we allow int data instances.
For long type column, we allow int and long data instances.
For float type column, we allow int, long and float data instances.
For double type column, we allow int, long, float and double data instances.

2) Also, due to the limitation that Pig only supports BYTES for map value type, we do not check inside of a map if it's BYTES type, else we do check.

> [Zebra] No type check when we write to the basic table
> ------------------------------------------------------
>
>                 Key: PIG-1351
>                 URL: https://issues.apache.org/jira/browse/PIG-1351
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.6.0, 0.7.0, 0.8.0
>            Reporter: Chao Wang
>            Assignee: Chao Wang
>             Fix For: 0.8.0
>
>         Attachments: PIG-1351.patch
>
>
> In Zebra, we do not have any type check when writing to a basic table. 
> Say, we have a schema: "f1:int, f2:string",
> however we can write a tuple ("abc", 123) without any problem, which is definitely not desirable.
> To overcome this problem, we decide to perform certain amount of type checking in Zebra - We check the first row only for each writer.
> This only serves as a sanity check purpose in cases where users screw up specifying the output schema. We do NOT perform a rigorous type checking for all rows for apparently performance concerns.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.