You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Peter Varga (Jira)" <ji...@apache.org> on 2021/03/23 07:08:00 UTC

[jira] [Assigned] (HIVE-24824) Define metrics for compaction observability

     [ https://issues.apache.org/jira/browse/HIVE-24824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Peter Varga reassigned HIVE-24824:
----------------------------------

    Assignee: Denys Kuzmenko  (was: Peter Varga)

> Define metrics for compaction observability
> -------------------------------------------
>
>                 Key: HIVE-24824
>                 URL: https://issues.apache.org/jira/browse/HIVE-24824
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Peter Varga
>            Assignee: Denys Kuzmenko
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Many times if there are failures in the Compaction background processes (Initiator, Worker, Cleaner) it is hard notice the problem until it causes serious performance degradation.
> We should create new JMX metrics, that would make it easier to monitor the compaction health. Examples are:
>  * number of failed / initiated compaction
>  * number of aborted txns, oldest aborted txns
>  * tables with disabled compactions and writes
>  * Initiator and Cleaner cycle runtime
>  * Size of ACID metadata tables that should have ~ constant rows (txn_to_writeId, completed_txns)
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)