You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Eugene Koifman (JIRA)" <ji...@apache.org> on 2018/06/01 04:25:00 UTC
[jira] [Commented] (HIVE-19598) Add Acid V1 to V2 upgrade module
[ https://issues.apache.org/jira/browse/HIVE-19598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16497541#comment-16497541 ]
Eugene Koifman commented on HIVE-19598:
---------------------------------------
[~vgarg], HIVE-19598.01-branch-3.patch is attached and sanity checked
> Add Acid V1 to V2 upgrade module
> --------------------------------
>
> Key: HIVE-19598
> URL: https://issues.apache.org/jira/browse/HIVE-19598
> Project: Hive
> Issue Type: Sub-task
> Components: Transactions
> Affects Versions: 3.0.0
> Reporter: Eugene Koifman
> Assignee: Eugene Koifman
> Priority: Critical
> Fix For: 4.0.0
>
> Attachments: HIVE-19598.01-branch-3.patch, HIVE-19598.02.patch, HIVE-19598.05.patch, HIVE-19598.06.patch
>
>
> The on-disk layout for full acid (transactional) tables has changed 3.0.
> Any transactional table that has any update/delete events in any deltas that have not been Major compacted, must go through a Major compaction before upgrading to 3.0. No more update/delete/merge should be run after/during major compaction.
> Not doing so will result in data corruption/loss.
>
> Need to create a utility tool to help with this process. HIVE-19233 started this but it needs more work.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)