You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Aniket Mokashi (Created) (JIRA)" <ji...@apache.org> on 2012/02/05 04:35:05 UTC
[jira] [Created] (HIVE-2777) ability to add and drop partitions
atomically
ability to add and drop partitions atomically
---------------------------------------------
Key: HIVE-2777
URL: https://issues.apache.org/jira/browse/HIVE-2777
Project: Hive
Issue Type: New Feature
Components: Metastore
Reporter: Aniket Mokashi
Fix For: 0.9.0
Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Aniket Mokashi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203913#comment-13203913 ]
Aniket Mokashi commented on HIVE-2777:
--------------------------------------
I am adding deleteData option there, deletion of data itself cannot be made atomic. But, its good to have as part of the api. deleteData=true attempts to delete the data.
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Fix For: 0.9.0
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan updated HIVE-2777:
-----------------------------------
Fix Version/s: (was: 0.9.0)
Unlinking from 0.9
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Attachments: HIVE-2777.D2271.1.patch
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Aniket Mokashi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420102#comment-13420102 ]
Aniket Mokashi commented on HIVE-2777:
--------------------------------------
Thanks Namit. We are using S3 as our storage, which doesnt support move operation. Hence, to replace n number of partitions with one, we need to support that only through metadata api. In following api, for the given db and tbl_name, addParts partition list will be added to metastore and dropParts partitions will be deleted, atomically. Hence, users querying of one level up of partition hierarchy would not know that the partitions were replaced with data with a better representation (merged into bigger files, sorted etc.)
add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
Any downsides of this approach?
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Attachments: HIVE-2777.D2271.1.patch
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Ashutosh Chauhan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203896#comment-13203896 ]
Ashutosh Chauhan commented on HIVE-2777:
----------------------------------------
So, this api is purely metadata and data won't be touched at all? Data is managed separately in such cases. I think if thats the case, this new api should have an additional parameter bool moveData, which for now works as you described for moveData = false and throws exception for moveData = true.
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Fix For: 0.9.0
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Aniket Mokashi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419639#comment-13419639 ]
Aniket Mokashi commented on HIVE-2777:
--------------------------------------
Can someone take a look at this?
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Attachments: HIVE-2777.D2271.1.patch
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420012#comment-13420012 ]
Namit Jain commented on HIVE-2777:
----------------------------------
add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
What are the exact semantics of the above API ?
Can you give an example of what you are trying to do ?
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Attachments: HIVE-2777.D2271.1.patch
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Aniket Mokashi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262282#comment-13262282 ]
Aniket Mokashi commented on HIVE-2777:
--------------------------------------
Hi Ashutosh,
Let me know if the patch is missing something. I will work on fixing those problems. It would be good api to have.
Thanks,
Aniket
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Attachments: HIVE-2777.D2271.1.patch
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Phabricator (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2777:
------------------------------
Attachment: HIVE-2777.D2271.1.patch
aniket486 requested code review of "HIVE-2777 [jira] ability to add and drop partitions atomically".
Reviewers: JIRA
https://issues.apache.org/jira/browse/HIVE-2777
ability to add and drop partitions atomically
Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
This jira covers changes required for metastore and thrift.
TEST PLAN
EMPTY
REVISION DETAIL
https://reviews.facebook.net/D2271
AFFECTED FILES
metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java
metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java
metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java
metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java
metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py
metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore-remote
metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.h
metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore_server.skeleton.cpp
metastore/src/gen/thrift/gen-rb/thrift_hive_metastore.rb
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java
metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php
metastore/if/hive_metastore.thrift
MANAGE HERALD DIFFERENTIAL RULES
https://reviews.facebook.net/herald/view/differential/
WHY DID I GET THIS EMAIL?
https://reviews.facebook.net/herald/transcript/5037/
Tip: use the X-Herald-Rules header to filter Herald messages in your client.
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Fix For: 0.9.0
>
> Attachments: HIVE-2777.D2271.1.patch
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Ashutosh Chauhan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13200672#comment-13200672 ]
Ashutosh Chauhan commented on HIVE-2777:
----------------------------------------
Dupe of HIVE-2224 ?
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Fix For: 0.9.0
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Carl Steinbach (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach reassigned HIVE-2777:
------------------------------------
Assignee: Aniket Mokashi
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Fix For: 0.9.0
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Ashutosh Chauhan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13200673#comment-13200673 ]
Ashutosh Chauhan commented on HIVE-2777:
----------------------------------------
Oh, looks like you want more than HIVE-2224. You are passing in both addParts as well as dropParts in one call.
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Fix For: 0.9.0
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Aniket Mokashi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201963#comment-13201963 ]
Aniket Mokashi commented on HIVE-2777:
--------------------------------------
Yes, our goal is to merge multiple small files (partitions) into big ones. But, we would like users to see the data as soon as it comes to warehouse. Also, one limitation is we run from S3, that doesn't allow a move operation. So, with that we have come up with an idea to transparently create a new location for merged data and atomically drop and add partitions to point to it.
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Fix For: 0.9.0
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Aniket Mokashi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13200674#comment-13200674 ]
Aniket Mokashi commented on HIVE-2777:
--------------------------------------
Yes. Basically, I would like to support merge of partitions.
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Fix For: 0.9.0
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Aniket Mokashi (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aniket Mokashi updated HIVE-2777:
---------------------------------
Status: Patch Available (was: Open)
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Fix For: 0.9.0
>
> Attachments: HIVE-2777.D2271.1.patch
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2777) ability to add and drop partitions
atomically
Posted by "Alan Gates (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201946#comment-13201946 ]
Alan Gates commented on HIVE-2777:
----------------------------------
Is the goal here to reduce the number of partitions that Hive has or the number of files in HDFS? If the goal is to reduce the number of files then you might consider using har to pack the files into one and then change the location value in the partitions.
> ability to add and drop partitions atomically
> ---------------------------------------------
>
> Key: HIVE-2777
> URL: https://issues.apache.org/jira/browse/HIVE-2777
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
> Reporter: Aniket Mokashi
> Fix For: 0.9.0
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change partitions atomically without breaking the running jobs. It allows admin to merge several partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name, List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira