You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Jesus Camacho Rodriguez (JIRA)" <ji...@apache.org> on 2017/06/09 11:35:18 UTC

[jira] [Created] (HIVE-16867) Extend shared scan optimizer to reuse computation from other operators

Jesus Camacho Rodriguez created HIVE-16867:
----------------------------------------------

             Summary: Extend shared scan optimizer to reuse computation from other operators
                 Key: HIVE-16867
                 URL: https://issues.apache.org/jira/browse/HIVE-16867
             Project: Hive
          Issue Type: Improvement
          Components: Physical Optimizer
    Affects Versions: 3.0.0
            Reporter: Jesus Camacho Rodriguez
            Assignee: Jesus Camacho Rodriguez


Follow-up of the work in HIVE-16602.

HIVE-16602 introduced an optimization that identifies scans on input tables that can be merged so the data is read only once.
This extension to that rule allows to reuse the computation that is done in the work containing those scans. In particular, we traverse both parts of the plan upstream and reuse the operators if possible.
Currently, the optimizer will not go beyond the output edge(s) of that work. Follow-up extensions might remove this limitation.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)