You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2017/04/24 18:05:04 UTC

[jira] [Created] (HIVE-16520) Cache hive metadata in metastore

Daniel Dai created HIVE-16520:
---------------------------------

             Summary: Cache hive metadata in metastore
                 Key: HIVE-16520
                 URL: https://issues.apache.org/jira/browse/HIVE-16520
             Project: Hive
          Issue Type: New Feature
          Components: Metastore
            Reporter: Daniel Dai
            Assignee: Daniel Dai


During Hive 2 benchmark, we find Hive metastore operation take a lot of time and thus slow down Hive compilation. In some extreme case, it takes much longer than the actual query run time. Especially, we find the latency of cloud db is very high and 90% of total query runtime is waiting for metastore SQL database operations. Based on this observation, the metastore operation performance will be greatly enhanced if we have a memory structure which cache the database query result.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)