[jira] [Commented] (HIVE-25205) Reduce overhead of adding write notification log during batch loading of partition..

["Naveen Gangam (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-25205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718289#comment-17718289 ] 

Naveen Gangam commented on HIVE-25205:
--------------------------------------

Merged via https://github.com/apache/hive/pull/2357

> Reduce overhead of adding write notification log during batch loading of partition..
> ------------------------------------------------------------------------------------
>
>                 Key: HIVE-25205
>                 URL: https://issues.apache.org/jira/browse/HIVE-25205
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Hive, HiveServer2
>            Reporter: mahesh kumar behera
>            Assignee: mahesh kumar behera
>            Priority: Major
>              Labels: performance
>
> During batch loading of partition the write notification logs are added for each partition added. This is causing delay in execution as the call to HMS is done for each partition. This can be optimised by adding a new API in HMS to send a batch of partition and then this batch can be added together to the backend database. Once we have a batch of notification log, at HMS side, code can be optimised to add the logs using single call to backend RDBMS. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)