[jira] [Commented] (HIVE-27746) Hive Metastore should send single AlterPartitionEvent with list of partitions

["Quanlong Huang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-27746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17776049#comment-17776049 ] 

Quanlong Huang commented on HIVE-27746:
---------------------------------------

Another benifit of this is that partition events on different tables won't interleave. So event consumers like Impala can handle such batch events more efficiently (IMPALA-12463).

It'd be nice if we can do the same for partition level insert events.

> Hive Metastore should send single AlterPartitionEvent with list of partitions
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-27746
>                 URL: https://issues.apache.org/jira/browse/HIVE-27746
>             Project: Hive
>          Issue Type: Improvement
>          Components: Standalone Metastore
>            Reporter: Naveen Gangam
>            Assignee: Zhihua Deng
>            Priority: Major
>
> In HIVE-3938, work was done to send single AddPartitionEvent for APIs that add partitions in bulk. Similarly, we have alter_partitions APIs that alter partitions in bulk via a single HMS call. For such events, we should also send a single AlterPartitionEvent with a list of partitions in it.
> This would be way more efficient than having to send and process them individually.
> This fix will be incompatible with the older clients that expect single partition.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)