You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Craig Condit (JIRA)" <ji...@apache.org> on 2019/04/18 16:40:00 UTC

[jira] [Created] (HIVE-21631) Enhance metastore API to allow bulk-loading materialized views

Craig Condit created HIVE-21631:
-----------------------------------

             Summary: Enhance metastore API to allow bulk-loading materialized views
                 Key: HIVE-21631
                 URL: https://issues.apache.org/jira/browse/HIVE-21631
             Project: Hive
          Issue Type: Improvement
          Components: Materialized views, Metastore
    Affects Versions: 3.1.1, 3.2.0
            Reporter: Craig Condit


Currently, every query in HS2 results in a metastore call per database to retrieve all materialized views. This causes severe performance degradation on multi-tenant clusters with thousands of databases (very similar to how the old get_function() metastore call didn't scale).

We should add a metastore call which can retrieve all materialized view definitions at once (for all DBs) so that we don't have to make thousands of metastore calls per query.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)