You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sankar Hariappan (JIRA)" <ji...@apache.org> on 2017/06/29 11:11:00 UTC

[jira] [Created] (HIVE-16990) REPL LOAD should update last repl ID only after successful copy of data files.

Sankar Hariappan created HIVE-16990:
---------------------------------------

             Summary: REPL LOAD should update last repl ID only after successful copy of data files.
                 Key: HIVE-16990
                 URL: https://issues.apache.org/jira/browse/HIVE-16990
             Project: Hive
          Issue Type: Sub-task
          Components: Hive, repl
    Affects Versions: 2.1.0
            Reporter: Sankar Hariappan
            Assignee: Sankar Hariappan
             Fix For: 3.0.0


For REPL LOAD operations that includes both metadata and data changes should follow the below rule.
1. Copy the metadata excluding the last repl ID.
2. Copy the data files
3. If Step 1 and 2 are successful, then update the last repl ID of the object.
This rule will allow the the failed events to be re-applied by REPL LOAD and ensures no data loss due to failures.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)