You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Sankar Hariappan (JIRA)" <ji...@apache.org> on 2018/12/10 05:41:00 UTC

[jira] [Updated] (HIVE-20968) Support conversion of managed to external where location set by user.

     [ https://issues.apache.org/jira/browse/HIVE-20968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sankar Hariappan updated HIVE-20968:
------------------------------------
    Description: 
As per migration rule, if a location is outside the default managed table directory and the location is not owned by "hive" user, then it should be converted to external table after upgrade.
So, the same rule is applicable for Hive replication where the data of source managed table is residing outside the default warehouse directory and is not owned by "hive" user.
During this conversion, the path should be preserved in target as well so that failover works seamlessly.

  was:
Hive2 supports replication of managed tables. But in Hive3, some of these managed tables are converted to ACID or MM tables. Also, some of them are converted to external tables based on below rules. 
 # Avro format with external schema, Storage handlers, List bucketed tabled are converted to external tables.
 # Location not owned by "hive" user are converted to external table.
 # Hive owned ORC format are converted to full ACID transactional table.
 # Hive owned Non-ORC format are converted to MM transactional table.

REPL LOAD should apply these rules during bootstrap and convert the tables accordingly.


> Support conversion of managed to external where location set by user.
> ---------------------------------------------------------------------
>
>                 Key: HIVE-20968
>                 URL: https://issues.apache.org/jira/browse/HIVE-20968
>             Project: Hive
>          Issue Type: Sub-task
>          Components: repl
>    Affects Versions: 4.0.0
>            Reporter: mahesh kumar behera
>            Assignee: Sankar Hariappan
>            Priority: Major
>              Labels: DR
>
> As per migration rule, if a location is outside the default managed table directory and the location is not owned by "hive" user, then it should be converted to external table after upgrade.
> So, the same rule is applicable for Hive replication where the data of source managed table is residing outside the default warehouse directory and is not owned by "hive" user.
> During this conversion, the path should be preserved in target as well so that failover works seamlessly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)