You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/08/10 07:07:00 UTC

[jira] [Updated] (HIVE-25414) Optimise Hive::addWriteNotificationLog: Reduce FS call per notification

     [ https://issues.apache.org/jira/browse/HIVE-25414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated HIVE-25414:
----------------------------------
    Labels: pull-request-available  (was: )

> Optimise Hive::addWriteNotificationLog: Reduce FS call per notification
> -----------------------------------------------------------------------
>
>                 Key: HIVE-25414
>                 URL: https://issues.apache.org/jira/browse/HIVE-25414
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Rajesh Balamohan
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> AddWriteNotification is slow due to FS interactions (i.e to get the set of insert file information). This can be avoided as FileStatus can be passed instead of Path from parent methods.
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L3572] 
> [https://github.com/apache/hive/blob/96b39cd5190f0cfadb677e3f3b7ead1d663921b2/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L3620]
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)