[jira] [Created] (SPARK-50461) Add support for location for managed tables on database

["Madhukar (Jira)" <ji...@apache.org>]

Madhukar created SPARK-50461:
--------------------------------

             Summary: Add support for location for managed tables on database
                 Key: SPARK-50461
                 URL: https://issues.apache.org/jira/browse/SPARK-50461
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 4.0.0
            Reporter: Madhukar


Consider the changes done under HIVE-22995, for HMS4 support. 

Wiki - [https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-ManagedandExternalTables] 

Behaviour change - With HIVE4 , MANAGEDLOCATION has been introduced with database. And LOCATION now refers to the path of external table.

 

So, when a database is created using sparkSQL, it dont have managed location reference and all the tables created inside it is of external table type. Impacts functionality like TRUNC, .....

 

Reference logs - 

metastore.MetastoreDefaultTransformer (MetastoreDefaultTransformer.java:transformDatabase(811)) - Starting translation for transformDatabase for processor null with null on database truncate_insert_overwrite locationUri=hdfs://madzilla/warehouse/tablespace/managed/hive/truncate_insert_overwrite.db *managedLocationUri=null*

Results in external table type.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org