[jira] [Updated] (HIVE-18347) Allow dynamic lookup of Hive Metastores via Consul

["Szehon Ho (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-18347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Szehon Ho updated HIVE-18347:
-----------------------------
    Attachment: HIVE-18347.1.patch

This patch allows a plugable Hive Metastore URI Resolver hook that is called to resolve Metastore URI's from HiveMetastoreClient, and implements one that we use in production.  This connects to our Marathon-based Consul service for lookup of a particular Consul-registered service, and will read a consul-based scheme for hive.metastore.uris.

One can imagine other schemes, like for example Zookeeper-based Metastore registration, those could also be implemented via this plugin.

> Allow dynamic lookup of Hive Metastores via Consul
> --------------------------------------------------
>
>                 Key: HIVE-18347
>                 URL: https://issues.apache.org/jira/browse/HIVE-18347
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Szehon Ho
>            Assignee: Szehon Ho
>         Attachments: HIVE-18347.1.patch
>
>
> In our organization, we have deployed HiveMetastore and HiveServer2 on Mesos as dynamic services for scalability and flexibility.
> In this architecture, we would like to allow HiveServer2 to dynamically load balance between Metastores (which may be scaled up and down or to different nodes) for different requests.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)