You are viewing a plain text version of this content. The canonical link for it is here.

Posted to notifications@accumulo.apache.org by "Shawn Walker (JIRA)" <ji...@apache.org> on 2016/04/12 21:43:25 UTC

[jira] [Created] (ACCUMULO-4187) Rate limiting of major compactions

Shawn Walker created ACCUMULO-4187:
--------------------------------------

             Summary: Rate limiting of major compactions
                 Key: ACCUMULO-4187
                 URL: https://issues.apache.org/jira/browse/ACCUMULO-4187
             Project: Accumulo
          Issue Type: Improvement
          Components: core, tserver
    Affects Versions: 1.8.0
            Reporter: Shawn Walker
            Priority: Minor


In discussing [ACCUMULO-4166] with Keith Turner, we decided that the underlying issue is that major compactions can overwhelm a tablet server, rendering it nearly unresponsive.

To address this, we should take a cue from Apache Cassandra and restrict how quickly we perform major compactions.  Rate limiting reads and writes involved in major compactions will directly affect the IO load caused by major compactions, and should also indirectly affect the CPU load.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)