You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2013/10/31 18:29:17 UTC
[jira] [Updated] (PIG-3545) Seperate validation rules from
optimizer
[ https://issues.apache.org/jira/browse/PIG-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-3545:
----------------------------
Attachment: PIG-3545-1.patch
> Seperate validation rules from optimizer
> ----------------------------------------
>
> Key: PIG-3545
> URL: https://issues.apache.org/jira/browse/PIG-3545
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.13.0
>
> Attachments: PIG-3545-1.patch
>
>
> A continuation of PIG-3492. We realize separate validation rules (such as DuplicateForEachColumnRewriteVisitor, ImplicitSplitInsertVisitor) from optimizer would make code clear. The reason is:
> 1. validation rule only need to run once
> 2. In contrast to optimization rule, validation rule works on an inconsistent plan, and should be careful about precondition. Also some global operation such as resetSchema is not possible on inconsistent plan
> 3. Some operations should work with unoptimized but validated plan, such as describe
> Also want to address PIG-3508 in the cleanup. We should call LogicalPlan.optimize explicitly rather than rely on HExecutionEngine.compile to do the logical plan optimization.
--
This message was sent by Atlassian JIRA
(v6.1#6144)