You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "ramkrishna.s.vasudevan (JIRA)" <ji...@apache.org> on 2016/11/24 11:21:58 UTC
[jira] [Updated] (HBASE-17048) Introduce a helper class to calcuate
suitable ByteBuf size when allocating send buffer in
FanOutOneBlockAsyncDFSOutputHelper
[ https://issues.apache.org/jira/browse/HBASE-17048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ramkrishna.s.vasudevan updated HBASE-17048:
-------------------------------------------
Attachment: HBASE-17048.patch
A simple way to increase/decrease the byte buffer size in steps of 1KB. Default it will be 64KB.
With WALPE I am able to see atleast 1500 ops/sec more with this patch. I repeated this over 10 times and then posting the avg here.
Without patch
~24500ops/sec
With patch
~26000 ops/sec
How ever with PE am not seeing significant changes.
Am not sure if there is way to impl in such a way that the buffer allocation itself happens via AdaptiveRecvByteBufAllocator so that allow the RecvByteBufAllocator to take care of the new allocations. Because in the ByteBuf eventloop life cycle where does the RecvByteBufAllocator gets called am not aware of it.
> Introduce a helper class to calcuate suitable ByteBuf size when allocating send buffer in FanOutOneBlockAsyncDFSOutputHelper
> ----------------------------------------------------------------------------------------------------------------------------
>
> Key: HBASE-17048
> URL: https://issues.apache.org/jira/browse/HBASE-17048
> Project: HBase
> Issue Type: Sub-task
> Components: wal
> Affects Versions: 2.0.0
> Reporter: Duo Zhang
> Assignee: ramkrishna.s.vasudevan
> Fix For: 2.0.0
>
> Attachments: HBASE-17048.patch
>
>
> As [~ram_krish] mentioned in HBASE-17021
> https://issues.apache.org/jira/browse/HBASE-17021?focusedCommentId=15646938&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15646938
> The default ByteBuf size is 256B which is too small.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)