You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Sankar Hariappan (JIRA)" <ji...@apache.org> on 2018/12/04 07:14:00 UTC
[jira] [Updated] (HIVE-20966) Support incremental replication to a
target cluster with hive.strict.managed.tables enabled.
[ https://issues.apache.org/jira/browse/HIVE-20966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sankar Hariappan updated HIVE-20966:
------------------------------------
Description:
*Requirements:*
Hive2 supports replication of managed tables. But in Hive3, some of these managed tables are converted to ACID or MM tables. Also, some of them are converted to external tables based on below rules.
- Avro format with external schema, Storage handlers, List bucketed tabled are converted to external tables.
- Location not owned by "hive" user are converted to external table.
- Hive owned ORC format are converted to full ACID transactional table.
- Hive owned Non-ORC format are converted to MM transactional table.
REPL LOAD should apply these rules during bootstrap and incremental phases and convert the tables accordingly.
was:
*Requirements:*
- Support Hive incremental replication with Hive2 as master and Hive3 as slave where hive.strict.managed.tables is enabled.
- The non-ACID managed tables from Hive2 should be converted to appropriate ACID or MM tables or to an external table based on Hive3 table type rules.
> Support incremental replication to a target cluster with hive.strict.managed.tables enabled.
> --------------------------------------------------------------------------------------------
>
> Key: HIVE-20966
> URL: https://issues.apache.org/jira/browse/HIVE-20966
> Project: Hive
> Issue Type: Sub-task
> Components: repl
> Affects Versions: 4.0.0
> Reporter: mahesh kumar behera
> Assignee: mahesh kumar behera
> Priority: Major
> Labels: DR
>
> *Requirements:*
> Hive2 supports replication of managed tables. But in Hive3, some of these managed tables are converted to ACID or MM tables. Also, some of them are converted to external tables based on below rules.
> - Avro format with external schema, Storage handlers, List bucketed tabled are converted to external tables.
> - Location not owned by "hive" user are converted to external table.
> - Hive owned ORC format are converted to full ACID transactional table.
> - Hive owned Non-ORC format are converted to MM transactional table.
> REPL LOAD should apply these rules during bootstrap and incremental phases and convert the tables accordingly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)