You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Divyesh Chandra (Jira)" <ji...@apache.org> on 2021/03/25 11:08:00 UTC

[jira] [Commented] (HBASE-25633) When unconfigured, PressureAwareCompactionThroughputController should sniff NIC speed and use appropriate settings

    [ https://issues.apache.org/jira/browse/HBASE-25633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308591#comment-17308591 ] 

Divyesh Chandra commented on HBASE-25633:
-----------------------------------------

Hi Nick, Id like to work on this. Assigning it to myself.

> When unconfigured, PressureAwareCompactionThroughputController should sniff NIC speed and use appropriate settings
> ------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-25633
>                 URL: https://issues.apache.org/jira/browse/HBASE-25633
>             Project: HBase
>          Issue Type: Improvement
>          Components: Compaction
>            Reporter: Nick Dimiduk
>            Priority: Major
>
> After upgrading a cluster to 2.3, we noticed that compactions were taking much longer. We tracked this down to the PressureAwareCompactionThroughputController, which became default as part of our upgrade. Our default configuration settings set the lower bound: 50MB/s, upper bound: 100MB/s. These settings make sense if you have a 1gbit NIC (~120 MB/s). For a 10gbit NIC, they’re quite inadequate.
> Suggestion: instead of using fixed values as the default for these configurations, we should sniff the NIC speed and configure for an optimal value according to available bandwidth.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)