[jira] [Work logged] (HIVE-25022) Metric about incomplete compactions

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-25022?focusedWorklogId=583551&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-583551 ]

ASF GitHub Bot logged work on HIVE-25022:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 15/Apr/21 16:04
            Start Date: 15/Apr/21 16:04
    Worklog Time Spent: 10m 
      Work Description: klcopp opened a new pull request #2184:
URL: https://github.com/apache/hive/pull/2184


   ### What changes were proposed in this pull request?
   See https://issues.apache.org/jira/browse/HIVE-25022
   
   ### How was this patch tested?
   Unit tests
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 583551)
    Remaining Estimate: 0h
            Time Spent: 10m

> Metric about incomplete compactions
> -----------------------------------
>
>                 Key: HIVE-25022
>                 URL: https://issues.apache.org/jira/browse/HIVE-25022
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Karen Coppage
>            Assignee: Karen Coppage
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> "Compactions in a state" metrics (for example compaction_num_working) count the sum of tables/partitions where the last compaction is in that state.
> I propose introducing a new metric about incomplete compactions: i.e. the number of tables/partitions where the last finished compaction* is unsuccessful (failed or "did not initiate"), or where major compaction was unsuccessful then minor compaction succeeded (compaction is not "complete" since major compaction has not succeeded in the time since it should have run).
> Example:
> {code:java}
> These compactions ran on a partition:
> major succeeded
> major working
> major failed
> major initiated
> major working
> major failed
> major initiated
> major working
> The "compactions in a state" metrics will consider the state of this table: working.
> The "incomplete compactions" metric will consider this: incomplete, since there have been failed compactions since the last succeeded compaction.
> {code}
> Another example:
> {code:java}
> These compactions ran on a partition:
> major succeeded
> major failed
> minor failed
> minor succeeded
> The "compactions in a state" metrics will consider the state of this table: succeeded.
> The "incomplete compactions" metric will consider this: incomplete, since there hasn't been a major succeeded since major failed.{code}
> Last example:
> {code:java}
> These compactions ran on a partition:
> major succeeded
> minor did not initiate
> The "compactions in a state" metrics will consider the state of this table: did not initiate.
> The "incomplete compactions" metric will consider this: incomplete, since the last compaction was "did not initiate"{code}
> *finished compaction: state in (succeeded, failed, attempted/did not initiate)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)