You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Csaba Ringhofer (Jira)" <ji...@apache.org> on 2020/10/07 19:57:00 UTC
[jira] [Resolved] (IMPALA-10172) Support Hive metastore managed
locations for databases
[ https://issues.apache.org/jira/browse/IMPALA-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Csaba Ringhofer resolved IMPALA-10172.
--------------------------------------
Fix Version/s: Impala 4.0
Resolution: Implemented
> Support Hive metastore managed locations for databases
> ------------------------------------------------------
>
> Key: IMPALA-10172
> URL: https://issues.apache.org/jira/browse/IMPALA-10172
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Tristan Stevens
> Assignee: Csaba Ringhofer
> Priority: Major
> Fix For: Impala 4.0
>
>
> In Hive 3 a database can have both managed and (unmanaged) locations.
> Hive DDL syntax is as follows:
> {noformat}
> CREATE (DATABASE|SCHEMA) [IF NOT EXISTS] database_name
> [COMMENT database_comment]
> [LOCATION hdfs_path]
> [MANAGEDLOCATION hdfs_path]
> [WITH DBPROPERTIES (property_name=property_value, ...)];
> ALTER (DATABASE|SCHEMA) database_name SET MANAGEDLOCATION hdfs_path;
> {noformat}
> Right now, Impala does not appear to support this syntax.
> Also the {{DESCRIBE FORMATTED}} and {{DESCRIBE EXTENDED}} statements should display both the {{LOCATION}} and {{MANAGEDLOCATION}}.
> Example:
> {noformat}
> impala-shell -i host-2.user1-c5.my.example.com -d default -k --ssl --ca_cert=/opt/cloudera/security/pki/chain.pem
> Starting Impala Shell using Kerberos authentication
> Using service name 'impala'
> SSL is enabled
> Opened TCP connection to host-2.user1-c5.my.example.com:21000
> Connected to host-2.user1-c5.my.example.com:21000
> Server version: impalad version 3.4.0-SNAPSHOT RELEASE (build 25402784335c39cc24076d71dab7a3ccbd562094)
> Query: use `default`
> ***********************************************************************************
> Welcome to the Impala shell.
> (Impala Shell v3.4.0-SNAPSHOT (2540278) built on Wed Aug 5 11:07:32 UTC 2020)
> To see a summary of a query's progress that updates in real-time, run 'set
> LIVE_PROGRESS=1;'.
> ***********************************************************************************
> Query: use `default`
> [host-2.user1-c5.my.example.com:21000] default> create database dbnew4 LOCATION 'hdfs://host-1.user1-c5.my.example.com:8020/data/dbnewnew/external' MANAGEDLOCATION 'hdfs://host-1.user1-c5.my.example.com:8020/data/dbnewnew/managed';
> Query: create database dbnew4 LOCATION 'hdfs://host-1.user1-c5.my.example.com:8020/data/dbnewnew/external' MANAGEDLOCATION 'hdfs://host-1.user1-c5.my.example.com:8020/data/dbnewnew/managed'
> ERROR: ParseException: Syntax error in line 1:
> ...0/data/dbnewnew/external' MANAGEDLOCATION 'hdfs://ccyc...
> ^
> Encountered: IDENTIFIER
> Expected: AS, CACHED, PARTITION, TBLPROPERTIES, UNCACHED
> CAUSED BY: Exception: Syntax error
> [host-2.user1-c5.my.example.com:21000] default> alter database dbnewnew SET MANAGEDLOCATION='hdfs://host-1.user1-c5.my.example.com:8020/data/dbnewnew/managed';
> Query: alter database dbnewnew SET MANAGEDLOCATION='hdfs://host-1.user1-c5.my.example.com:8020/data/dbnewnew/managed'
> ERROR: ParseException: Syntax error in line 1:
> ...newnew SET MANAGEDLOCATION='hdfs://host-1.user1-...
> ^
> Encountered: =
> Expected: ROLE, IDENTIFIER
> CAUSED BY: Exception: Syntax error
> [host-2.user1-c5.my.example.com:21000] default> describe database formatted db_cust_loc3 ;
> Query: describe database formatted db_cust_loc3
> +--------------+-------------------------------------------------------------------+---------+
> | name | location | comment |
> +--------------+-------------------------------------------------------------------+---------+
> | db_cust_loc3 | hdfs://host-1.user1-c5.my.example.com:8020/data/db_cust_loc3 | |
> | Owner: | | |
> | | admin | USER |
> +--------------+-------------------------------------------------------------------+---------+
> Fetched 3 row(s) in 0.03s
> [host-2.user1-c5.my.example.com:21000] default> describe database extended db_cust_loc3 ;
> Query: describe database extended db_cust_loc3
> +--------------+-------------------------------------------------------------------+---------+
> | name | location | comment |
> +--------------+-------------------------------------------------------------------+---------+
> | db_cust_loc3 | hdfs://host-1.user1-c5.my.example.com:8020/data/db_cust_loc3 | |
> | Owner: | | |
> | | admin | USER |
> +--------------+-------------------------------------------------------------------+---------+
> Fetched 3 row(s) in 0.01s
> [host-2.user1-c5.my.example.com:21000] default>
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org