You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Peter Varga (Jira)" <ji...@apache.org> on 2021/03/23 07:08:00 UTC
[jira] [Assigned] (HIVE-24824) Define metrics for compaction
observability
[ https://issues.apache.org/jira/browse/HIVE-24824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Varga reassigned HIVE-24824:
----------------------------------
Assignee: Denys Kuzmenko (was: Peter Varga)
> Define metrics for compaction observability
> -------------------------------------------
>
> Key: HIVE-24824
> URL: https://issues.apache.org/jira/browse/HIVE-24824
> Project: Hive
> Issue Type: Improvement
> Reporter: Peter Varga
> Assignee: Denys Kuzmenko
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Many times if there are failures in the Compaction background processes (Initiator, Worker, Cleaner) it is hard notice the problem until it causes serious performance degradation.
> We should create new JMX metrics, that would make it easier to monitor the compaction health. Examples are:
> * number of failed / initiated compaction
> * number of aborted txns, oldest aborted txns
> * tables with disabled compactions and writes
> * Initiator and Cleaner cycle runtime
> * Size of ACID metadata tables that should have ~ constant rows (txn_to_writeId, completed_txns)
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)