You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Mithun Radhakrishnan (JIRA)" <ji...@apache.org> on 2014/02/25 09:58:21 UTC

[jira] [Updated] (HIVE-3938) Hive MetaStore should send a single AddPartitionEvent for atomically added partition-set.

     [ https://issues.apache.org/jira/browse/HIVE-3938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mithun Radhakrishnan updated HIVE-3938:
---------------------------------------

    Attachment: HIVE-3938.trunk.2.patch

I've rebased this patch for the latest trunk (0.13-ish).

I've had to remove the support for multi-table add-partitions, because the metastore now seems to check that all partitions in add_partitions_core() actually belong to the same table.

I've modified the TestNotificationListener accordingly.

> Hive MetaStore should send a single AddPartitionEvent for atomically added partition-set.
> -----------------------------------------------------------------------------------------
>
>                 Key: HIVE-3938
>                 URL: https://issues.apache.org/jira/browse/HIVE-3938
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.10.0, 0.11.0, 0.12.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>         Attachments: HIVE-3938.trunk.2.patch, Hive-3938-Support_for_Multi-table-insert.patch
>
>
> HiveMetaStore::add_partitions() currently adds all partitions specified in one call using a single meta-store transaction. This acts correctly. However, there's one AddPartitionEvent created per partition specified.
> Ideally, the set of partitions added atomically can be communicated using a single AddPartitionEvent, such that they are consumed together.
> I'll post a patch that does this.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)