You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Thejas M Nair (JIRA)" <ji...@apache.org> on 2011/02/09 19:17:57 UTC

[jira] Updated: (PIG-1847) implement typechecking and lineage tracking on new logical plan

     [ https://issues.apache.org/jira/browse/PIG-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thejas M Nair updated PIG-1847:
-------------------------------

    Attachment: PIG-1847.1.patch

Some test cases have not been migrated in this patch, that will be part of other patches in this jira.
There describe output has changed for the test case TestPigServer.testDescribeForeachNoSchema, that will be fixed as part of another patch.

This patch also brings some changes to pig's behavior to make it more consistent -
If the load function associated with a bytearray column that needs to be cast is not found, now it will result in a warning and not an error. Previously, in some cases this would result in an error at compile time, while in other cases it would result in a warning.


> implement typechecking and lineage tracking on new logical plan
> ---------------------------------------------------------------
>
>                 Key: PIG-1847
>                 URL: https://issues.apache.org/jira/browse/PIG-1847
>             Project: Pig
>          Issue Type: Task
>    Affects Versions: 0.8.0
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>             Fix For: 0.9.0
>
>         Attachments: PIG-1847.1.patch
>
>
> In 0.8, TypeCheckingVisitor works on the old logical plan, before it is translated to new logical plan. The TypeCheckingVisitor checks the types in expressions, adds casts and tracks lineage for identifying which load function's LoadCaster interface is to be used to convert bytearrays into other types. 
> As the old logical plan is going away in 0.9,  this functionality needs to be added for new plan.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira