You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Rajesh Balamohan (Jira)" <ji...@apache.org> on 2020/01/21 03:17:00 UTC
[jira] [Updated] (HIVE-22752) HiveMetastore addWriteNotificationLog
should be invoked only when listeners are enabled
[ https://issues.apache.org/jira/browse/HIVE-22752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajesh Balamohan updated HIVE-22752:
------------------------------------
Description:
[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L8109]
Even though listeners are turned off, it gets executed and causes load on the system. This should be guarded by listener checks.
{noformat}
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1589)
at org.apache.hadoop.fs.FileSystem.isDirectory(FileSystem.java:1700)
at org.apache.hadoop.hive.ql.metadata.Hive.addInsertFileInformation(Hive.java:3185)
at org.apache.hadoop.hive.ql.metadata.Hive.addWriteNotificationLog(Hive.java:3138)
at org.apache.hadoop.hive.ql.metadata.Hive.addWriteNotificationLog(Hive.java:3123)
at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:2238){noformat}
was:
[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L8109]
Even though listeners are turned off, it gets executed and causes load on the system. This should be guarded by listener checks.
> HiveMetastore addWriteNotificationLog should be invoked only when listeners are enabled
> ---------------------------------------------------------------------------------------
>
> Key: HIVE-22752
> URL: https://issues.apache.org/jira/browse/HIVE-22752
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
> Reporter: Rajesh Balamohan
> Priority: Minor
>
> [https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L8109]
>
> Even though listeners are turned off, it gets executed and causes load on the system. This should be guarded by listener checks.
>
> {noformat}
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1589)
> at org.apache.hadoop.fs.FileSystem.isDirectory(FileSystem.java:1700)
> at org.apache.hadoop.hive.ql.metadata.Hive.addInsertFileInformation(Hive.java:3185)
> at org.apache.hadoop.hive.ql.metadata.Hive.addWriteNotificationLog(Hive.java:3138)
> at org.apache.hadoop.hive.ql.metadata.Hive.addWriteNotificationLog(Hive.java:3123)
> at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:2238){noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)