[jira] [Created] (PIG-3545) Seperate validation rules from optimizer

["Daniel Dai (JIRA)" <ji...@apache.org>]

Daniel Dai created PIG-3545:
-------------------------------

             Summary: Seperate validation rules from optimizer
                 Key: PIG-3545
                 URL: https://issues.apache.org/jira/browse/PIG-3545
             Project: Pig
          Issue Type: Bug
          Components: impl
            Reporter: Daniel Dai
            Assignee: Daniel Dai
             Fix For: 0.13.0


A continuation of PIG-3492. We realize separate validation rules (such as DuplicateForEachColumnRewriteVisitor, ImplicitSplitInsertVisitor) from optimizer would make code clear. The reason is:
1. validation rule only need to run once
2. In contrast to optimization rule, validation rule works on an inconsistent plan, and should be careful about precondition. Also some global operation such as resetSchema is not possible on inconsistent plan
3. Some operations should work with unoptimized but validated plan, such as describe

Also want to address PIG-3508 in the cleanup. We should call LogicalPlan.optimize explicitly rather than rely on HExecutionEngine.compile to do the logical plan optimization.



--
This message was sent by Atlassian JIRA
(v6.1#6144)