You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Andrew Kyle Purtell (Jira)" <ji...@apache.org> on 2021/08/11 18:05:00 UTC

[jira] [Assigned] (HBASE-25828) CompactionProgress WARNS: "totalCompactingKVs=N less than currentCompactedKVs=M"

     [ https://issues.apache.org/jira/browse/HBASE-25828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Kyle Purtell reassigned HBASE-25828:
-------------------------------------------

    Assignee: Andrew Kyle Purtell

> CompactionProgress WARNS: "totalCompactingKVs=N less than currentCompactedKVs=M"
> --------------------------------------------------------------------------------
>
>                 Key: HBASE-25828
>                 URL: https://issues.apache.org/jira/browse/HBASE-25828
>             Project: HBase
>          Issue Type: Bug
>          Components: Compaction, Operability, regionserver
>    Affects Versions: 2.4.3
>            Reporter: Andrew Kyle Purtell
>            Assignee: Andrew Kyle Purtell
>            Priority: Minor
>             Fix For: 2.5.0, 3.0.0-alpha-2, 2.4.6
>
>
> Similar to HBASE-25642, but compaction progress warnings.
> Lots of warnings like:
> {noformat}
> 2021-04-30 00:55:15,436 WARN  [regionserver/ip-172-31-63-65:8120] 
> compactions.CompactionProgress: totalCompactingKVs=15589 less than currentCompactedKVs=21411
> {noformat}
> {noformat}
> 2021-04-30 00:55:15,437 WARN  [regionserver/ip-172-31-63-65:8120] 
> compactions.CompactionProgress: totalCompactingKVs=21916 less than currentCompactedKVs=33328
> {noformat}
> {noformat}
> 2021-04-30 00:55:15,438 WARN  [regionserver/ip-172-31-63-65:8120]
> compactions.CompactionProgress: totalCompactingKVs=89731 less than currentCompactedKVs=92808
> {noformat}
> A couple of issues:
> - Is there a way to make CompactionProgress more reliable? I seem to recall this is the second or third time around the block on this.
> - This is annoying because compaction progress isn't always accurate, but this information is not used to determine anything significant, so WARN level is a bit much. (Or, if this is a real correctness problem, see point above.)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)