[jira] [Comment Edited] (HIVE-21663) Hive Metastore Translation Layer

["Naveen Gangam (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17297663#comment-17297663 ] 

Naveen Gangam edited comment on HIVE-21663 at 3/8/21, 7:27 PM:
---------------------------------------------------------------

Adding ReviewBoard link

From the commentary on the ReviewBoard, pasting the usage of this enhancement.

{noformat}
This proposed fix adds support for a new schematool task "mergeCatalog".
This option, without any name conflicts in Database names will merge the databases between 2 catalog. For example "schematool -dbType mysql -mergeCatalog spark -toCatalog hive" will merge the databases in the catalog named "spark" into a catalog named "hive" (which is the default catalog for hiveserver.
It does so by manipulating the HMS metadata directly by changing the 
1) All tables in the source catalog to "EXTERNAL" tables in the destination catalog. These tables will become purgable when they are dropped (aka behave like non-ACID managed tables)
2) Changes the catalog name on the DB from source CTLG to destination CTLG.


{noformat}



was (Author: ngangam):
Adding ReviewBoard link

From the commentary on the ReviewBoard, pasting the usage of this enhancement.
This proposed fix adds support for a new schematool task "mergeCatalog".
This option, without any name conflicts in Database names will merge the databases between 2 catalog. For example "schematool -dbType mysql -mergeCatalog spark -toCatalog hive" will merge the databases in the catalog named "spark" into a catalog named "hive" (which is the default catalog for hiveserver.
It does so by manipulating the HMS metadata directly by changing the 
1) All tables in the source catalog to "EXTERNAL" tables in the destination catalog. These tables will become purgable when they are dropped (aka behave like non-ACID managed tables)
2) Changes the catalog name on the DB from source CTLG to destination CTLG.



> Hive Metastore Translation Layer
> --------------------------------
>
>                 Key: HIVE-21663
>                 URL: https://issues.apache.org/jira/browse/HIVE-21663
>             Project: Hive
>          Issue Type: New Feature
>          Components: Standalone Metastore
>            Reporter: Naveen Gangam
>            Assignee: Naveen Gangam
>            Priority: Major
>             Fix For: 4.0.0
>
>         Attachments: HIVE-21663.3.patch, HIVE-21663.4.patch, HIVE-21663.5.patch, HIVE-21663.6.patch, HIVE-21663.7.patch, HIVE-21663.8.patch
>
>
> This task is for the implementation of the default provider for translation, that is extensible if needed for a custom translator. Please refer the spec for additional details on the translation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)