You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sindhu Subhas (Jira)" <ji...@apache.org> on 2022/06/16 16:07:00 UTC

[jira] [Created] (HIVE-26337) Duplicate and single event log under NOTIFICATION_LOG for drop-partition unlike add-partition event which overloads the metadata table

Sindhu Subhas created HIVE-26337:
------------------------------------

             Summary: Duplicate and single event log under NOTIFICATION_LOG for drop-partition unlike add-partition event which overloads the metadata table
                 Key: HIVE-26337
                 URL: https://issues.apache.org/jira/browse/HIVE-26337
             Project: Hive
          Issue Type: Bug
          Components: Hive
    Affects Versions: 3.1.0
         Environment: HDInsight 4.1.8

Hive 3.1.2
            Reporter: Sindhu Subhas


Multiple events are generated for each drop partition under NOTIFICATION_LOG whereas a single event is generated for add_partition during msck sync partitions as part of partition management discovery.

Say, Hive is to add 5 new partitions and remove 100 partitions into SQL server, one event is generated for 1 add_partition event entry whereas 100 drop_partitions events are generated under NOTIFICATION_LOG. This results in overloading of the table and also indexes associated with the table.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)