You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Ben Johnson (JIRA)" <ji...@apache.org> on 2017/05/17 03:52:04 UTC

[jira] [Commented] (HIVE-2777) ability to add and drop partitions atomically

    [ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013475#comment-16013475 ] 

Ben Johnson commented on HIVE-2777:
-----------------------------------

Apologies for digging up an old issue, but was this ever resolved? [~aniket486] did you find a work around for this? We're also storing data on S3 and need a way to atomically merge data. Hive's CONCATENATE feature is not sufficient as it introduces a brief period where data just disappears and the reappears. I'd love to hear solutions to this if anyone has them. Thanks!

> ability to add and drop partitions atomically
> ---------------------------------------------
>
>                 Key: HIVE-2777
>                 URL: https://issues.apache.org/jira/browse/HIVE-2777
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>    Affects Versions: 0.13.0
>            Reporter: Aniket Mokashi
>            Assignee: Aniket Mokashi
>         Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2777.D2271.1.patch, hive-2777-updated.patch
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)