You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Zsolt Miskolczi (Jira)" <ji...@apache.org> on 2023/06/15 13:21:00 UTC

[jira] [Created] (HIVE-27444) Limit items processed by Initiator/Cleaner

Zsolt Miskolczi created HIVE-27444:
--------------------------------------

             Summary: Limit items processed by Initiator/Cleaner
                 Key: HIVE-27444
                 URL: https://issues.apache.org/jira/browse/HIVE-27444
             Project: Hive
          Issue Type: Improvement
          Components: Hive
            Reporter: Zsolt Miskolczi


The list of potential compaction items processed by Initiator is currently unlimited, and this may result in very long Initator loops. To avoid this, the potential compaction items returned by
{code:java}
org.apache.hadoop.hive.metastore.txn.CompactionTxnHandler#findPotentialCompactions(int, long, long){code}
 

should be limited.

The same limit needs to be added to cleaner:

 
{code:java}
org.apache.hadoop.hive.metastore.txn.CompactionTxnHandler#findReadyToClean
org.apache.hadoop.hive.metastore.txn.CompactionTxnHandler#findReadyToCleanAborts
{code}
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)