You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Steve Yeom (JIRA)" <ji...@apache.org> on 2017/12/04 22:22:00 UTC

[jira] [Created] (HIVE-18215) Possible code optimization exists for "INSERT OVERWITE on MM table. SELECT FROM (SELECT .. UNION ALL SELECT ..)

Steve Yeom created HIVE-18215:
---------------------------------

             Summary: Possible code optimization exists for "INSERT OVERWITE on MM table. SELECT FROM (SELECT .. UNION ALL SELECT ..)
                 Key: HIVE-18215
                 URL: https://issues.apache.org/jira/browse/HIVE-18215
             Project: Hive
          Issue Type: Bug
          Components: HiveServer2
    Affects Versions: 3.0.0
            Reporter: Steve Yeom
            Priority: Minor
             Fix For: 3.0.0


removeTempOrDuplicateFiles(.) has an opportunity for performance code optimization for the 
test case of "INSERT OVERWITE on MM table. SELECT FROM (SELECT .. UNION ALL SELECT ..)" from dp_counter_mm.q.

This is MM table specific and we can avoid calling fs.exists() by creating a specific mmDirectories
list for the current SELECT statement (out of two SELECTs in our test case from 
the dp_counter_mm.q) from the IOW union all query.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)