You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2013/05/31 01:23:20 UTC

[jira] [Created] (HBASE-8665) bad compaction priority behavior in queue can cause store to be blocked

Sergey Shelukhin created HBASE-8665:
---------------------------------------

             Summary: bad compaction priority behavior in queue can cause store to be blocked
                 Key: HBASE-8665
                 URL: https://issues.apache.org/jira/browse/HBASE-8665
             Project: HBase
          Issue Type: Bug
            Reporter: Sergey Shelukhin


Note that this can be solved by bumping up the number of compaction threads but still it seems like this priority "inversion" should be dealt with.
There's a store with 1 big file and 3 flushes (1 2 3 4) sitting around and minding its own business when it decides to compact. Compaction (2 3 4) is created and put in queue, it's low priority, so it doesn't get out of the queue for some time - other stores are compacting. Meanwhile more files are flushed and at (1 2 3 4 5 6 7) it decides to compact (5 6 7). This compaction now has higher priority than the first one. After that if the load is high it enters vicious cycle of compacting and compacting files as they arrive, with store being blocked on and off, with the (2 3 4) compaction staying in queue for up to ~20 minutes (that I've seen).

I wonder why we do thing thing where we queue compaction and compact separately. Perhaps we should take snapshot of all store priorities, then do select in order and execute the first compaction we find. This will need starvation safeguard too but should probably be better.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira