You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2014/12/04 02:33:13 UTC

[jira] [Commented] (HBASE-11979) Compaction progress reporting is wrong

    [ https://issues.apache.org/jira/browse/HBASE-11979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233777#comment-14233777 ] 

Andrew Purtell commented on HBASE-11979:
----------------------------------------

[~esteban], for the short term we could simply disable where we report compaction progress in logs and on the UI, but keep the metrics even if broken because someone might be using them - until estimation is improved. That wouldn't be necessary if a better fix is at hand, but if not, let's do something smaller and resolve this.

> Compaction progress reporting is wrong
> --------------------------------------
>
>                 Key: HBASE-11979
>                 URL: https://issues.apache.org/jira/browse/HBASE-11979
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Esteban Gutierrez
>            Priority: Minor
>             Fix For: 1.0.0, 2.0.0, 0.98.9
>
>
> This is a long standing problem and previously could be observed in regionserver metrics, but, we recently added logging for long running compactions, and this has exposed the issue in a new way, e.g.
> {noformat}
> 2014-09-15 14:20:59,450 DEBUG [regionserver8120-largeCompactions-1410813534627]
> compactions.Compactor: Compaction progress: 22683625/6808179 (333.18%), rate=162.08 kB/sec
> {noformat}
> The 'rate' reported in such logging is consistent and what we were really after, but the progress indication is clearly broken and should be fixed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)