You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2014/02/04 02:23:08 UTC

[jira] [Commented] (HIVE-6256) add batch dropping of partitions to Hive metastore (as well as to dropTable)

    [ https://issues.apache.org/jira/browse/HIVE-6256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890245#comment-13890245 ] 

Sergey Shelukhin commented on HIVE-6256:
----------------------------------------

Oh. this patch incorporates heavily changed HIVE-6342. The approach used is sending expressions to metastore. Unfortunately, to populate results if semantic analyzer (which seems to be of dubious value) we still need to fetch partitions from client also.
Also, JDO requires fetching objects to delete them, which is sad... we may need to do followup patch to do direct SQL deletes, but that may not be safe wrt other code going thru DN.

> add batch dropping of partitions to Hive metastore (as well as to dropTable)
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-6256
>                 URL: https://issues.apache.org/jira/browse/HIVE-6256
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>            Priority: Minor
>         Attachments: HIVE-6256.nogen.patch, HIVE-6256.patch
>
>
> Metastore drop partitions call drops one partition; when many are being dropped this can be slow. Partitions could be dropped in batch instead, if multiple are dropped via one command. Drop table can also use that.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)