You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Sankar Hariappan (JIRA)" <ji...@apache.org> on 2018/04/05 13:23:00 UTC
[jira] [Updated] (HIVE-18988) Support bootstrap replication of ACID
tables
[ https://issues.apache.org/jira/browse/HIVE-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sankar Hariappan updated HIVE-18988:
------------------------------------
Description:
Bootstrapping of ACID tables, need special handling to replicate a stable state of data.
- If ACID feature enables, then perform bootstrap dump for ACID tables with in read txn.
-> Dump table/partition metadata.
-> Get the list of valid data files for a table using same logic as read txn do.
-> Dump latest ValidWriteIdList as per current read txn.
- Find the valid last replication state such that it points to event ID of open_txn event of oldest on-going txn.
was:
Bootstrapping of ACID tables, need special handling to replicate a stable state of data.
- If ACID feature enables, then perform bootstrap dump for ACID tables with in read txn.
-> Dump table/partition metadata.
-> Get the list of valid data files for a table using same logic as read txn do.
-> Dump latest valid table Write ID as per current read txn.
- Find the valid last replication state such that it points to event ID of open_txn event of oldest on-going txn.
> Support bootstrap replication of ACID tables
> --------------------------------------------
>
> Key: HIVE-18988
> URL: https://issues.apache.org/jira/browse/HIVE-18988
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
> Affects Versions: 3.0.0
> Reporter: Sankar Hariappan
> Assignee: Sankar Hariappan
> Priority: Major
> Labels: ACID, DR, replication
> Fix For: 3.0.0
>
>
> Bootstrapping of ACID tables, need special handling to replicate a stable state of data.
> - If ACID feature enables, then perform bootstrap dump for ACID tables with in read txn.
> -> Dump table/partition metadata.
> -> Get the list of valid data files for a table using same logic as read txn do.
> -> Dump latest ValidWriteIdList as per current read txn.
> - Find the valid last replication state such that it points to event ID of open_txn event of oldest on-going txn.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)