You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sankar Hariappan (JIRA)" <ji...@apache.org> on 2017/06/29 11:11:00 UTC
[jira] [Created] (HIVE-16990) REPL LOAD should update last repl ID
only after successful copy of data files.
Sankar Hariappan created HIVE-16990:
---------------------------------------
Summary: REPL LOAD should update last repl ID only after successful copy of data files.
Key: HIVE-16990
URL: https://issues.apache.org/jira/browse/HIVE-16990
Project: Hive
Issue Type: Sub-task
Components: Hive, repl
Affects Versions: 2.1.0
Reporter: Sankar Hariappan
Assignee: Sankar Hariappan
Fix For: 3.0.0
For REPL LOAD operations that includes both metadata and data changes should follow the below rule.
1. Copy the metadata excluding the last repl ID.
2. Copy the data files
3. If Step 1 and 2 are successful, then update the last repl ID of the object.
This rule will allow the the failed events to be re-applied by REPL LOAD and ensures no data loss due to failures.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)