You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sindhu Subhas (Jira)" <ji...@apache.org> on 2022/06/16 16:07:00 UTC
[jira] [Created] (HIVE-26337) Duplicate and single event log under NOTIFICATION_LOG for drop-partition unlike add-partition event which overloads the metadata table
Sindhu Subhas created HIVE-26337:
------------------------------------
Summary: Duplicate and single event log under NOTIFICATION_LOG for drop-partition unlike add-partition event which overloads the metadata table
Key: HIVE-26337
URL: https://issues.apache.org/jira/browse/HIVE-26337
Project: Hive
Issue Type: Bug
Components: Hive
Affects Versions: 3.1.0
Environment: HDInsight 4.1.8
Hive 3.1.2
Reporter: Sindhu Subhas
Multiple events are generated for each drop partition under NOTIFICATION_LOG whereas a single event is generated for add_partition during msck sync partitions as part of partition management discovery.
Say, Hive is to add 5 new partitions and remove 100 partitions into SQL server, one event is generated for 1 add_partition event entry whereas 100 drop_partitions events are generated under NOTIFICATION_LOG. This results in overloading of the table and also indexes associated with the table.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)