You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Mithun Radhakrishnan (JIRA)" <ji...@apache.org> on 2015/02/12 21:44:13 UTC

[jira] [Updated] (HIVE-9674) *DropPartitionEvent should handle partition-sets.

     [ https://issues.apache.org/jira/browse/HIVE-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mithun Radhakrishnan updated HIVE-9674:
---------------------------------------
    Description: 
Dropping a set of N partitions from a table currently results in N DropPartitionEvents (and N PreDropPartitionEvents) being fired serially. This is wasteful, especially so for large N. It also makes it impossible to even try to run authorization-checks on all partitions in a batch.

Taking the cue from HIVE-9609, we should compose an {{Iterable<Partition>}} in the event, and expose them via an {{Iterator}}.

  was:
Dropping a set of N partitions from a table currently results in N DropPartitionEvents (and N PreDropPartitionEvents) being fired serially. This is wasteful, especially so for large N. It also makes it impossible to even try to run authorization-checks on all partitions in a batch.

Taking the cue from HIVE-9603, we should compose an {{Iterable<Partition>}} in the event, and expose them via an {{Iterator}}.


> *DropPartitionEvent should handle partition-sets.
> -------------------------------------------------
>
>                 Key: HIVE-9674
>                 URL: https://issues.apache.org/jira/browse/HIVE-9674
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.14.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>
> Dropping a set of N partitions from a table currently results in N DropPartitionEvents (and N PreDropPartitionEvents) being fired serially. This is wasteful, especially so for large N. It also makes it impossible to even try to run authorization-checks on all partitions in a batch.
> Taking the cue from HIVE-9609, we should compose an {{Iterable<Partition>}} in the event, and expose them via an {{Iterator}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)