You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Sebastien Barnoud (JIRA)" <ji...@apache.org> on 2019/06/26 13:21:00 UTC

[jira] [Created] (HBASE-22634) Improve performance of BufferedMutator

Sebastien Barnoud created HBASE-22634:
-----------------------------------------

             Summary: Improve performance of BufferedMutator
                 Key: HBASE-22634
                 URL: https://issues.apache.org/jira/browse/HBASE-22634
             Project: HBase
          Issue Type: Improvement
          Components: Client
    Affects Versions: 2.1.5
         Environment: HDP 2.6.5

Linux RedHat
            Reporter: Sebastien Barnoud


The default ThreadPoolExecutor uses a default size of 1 (property hbase.htable.threads.max). When using a size > 1, we still encountered poor performance and exception while submitting to pool (pool exceed its capacity).

This patch propose a fix on different issues encountered when the pool size is > 1:
 * thread safety issue
 * concurrent cleanup by Netty and the "legacy" code
 * errors in the backpressure
 * Netty memory leak

And propose a BufferedMutatorThreadPoolExecutor which:
 * uses hbase.client.max.total.tasks as the default size (instead of 1)
 * some usefull metrics

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)