You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "László Végh (Jira)" <ji...@apache.org> on 2022/05/13 10:45:00 UTC

[jira] [Resolved] (HIVE-26059) Eventually clean compactions in "refused" state from compaction history

     [ https://issues.apache.org/jira/browse/HIVE-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

László Végh resolved HIVE-26059.
--------------------------------
    Resolution: Fixed

> Eventually clean compactions in "refused" state from compaction history
> -----------------------------------------------------------------------
>
>                 Key: HIVE-26059
>                 URL: https://issues.apache.org/jira/browse/HIVE-26059
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>            Reporter: László Végh
>            Assignee: László Végh
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Compactions in states succeeded, failed, and did not initiate have a retention threshold (example: metastore.compactor.history.retention.succeeded) and are purged from COMPLETED_COMPACTIONS if the number of compactions in this state per partition/unpartitioned table passes the threshold. This keeps the size of COMPLETED_COMPACTIONS in check.
> We should also purge refused compactions from COMPLETED_COMPACTIONS.
> See:
> CompactionTxnHandler#purgeCompactionHistory
> ! Also: REFUSED_RESPONSE should be added to org.apache.hadoop.hive.metastore.txn.TxnStore#COMPACTION_STATES so that metrics will be collected about it.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)