You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Gali Sheffi (JIRA)" <ji...@apache.org> on 2018/02/01 15:41:00 UTC

[jira] [Commented] (HBASE-19506) Support variable sized chunks from ChunkCreator

    [ https://issues.apache.org/jira/browse/HBASE-19506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348767#comment-16348767 ] 

Gali Sheffi commented on HBASE-19506:
-------------------------------------

Hi everyone,

I uploaded the new patch to the Review Board. The ChunkCreator is going to have two pools: one for regular chunks and another for small chunks. When flattening, the index chunk size will be chosen according to the number of cells.

Please take a look and review.

Thanks!

> Support variable sized chunks from ChunkCreator
> -----------------------------------------------
>
>                 Key: HBASE-19506
>                 URL: https://issues.apache.org/jira/browse/HBASE-19506
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Anastasia Braginsky
>            Priority: Major
>         Attachments: HBASE-19506-V01.patch
>
>
> When CellChunkMap is created it allocates a special index chunk (or chunks) where array of cell-representations is stored. When the number of cell-representations is small, it is preferable to allocate a chunk smaller than a default value which is 2MB.
> On the other hand, those "non-standard size" chunks can not be used in pool. On-demand allocations in off-heap are costly. So this JIRA is about to investigate the trade of between memory usage and the final performance. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)