[jira] [Commented] (HBASE-21874) Bucket cache on Persistent memory

["Vladimir Rodionov (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-21874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766551#comment-16766551 ] 

Vladimir Rodionov commented on HBASE-21874:
-------------------------------------------

With 512GB NVDIMMs and 12 - 16 modules per server we are getting up to 6-8TB of non-volatile memory with DRAM -like access and latency (350ns). We can fit all the data into this - not only bucket cache :). Expensive though.

> Bucket cache on Persistent memory
> ---------------------------------
>
>                 Key: HBASE-21874
>                 URL: https://issues.apache.org/jira/browse/HBASE-21874
>             Project: HBase
>          Issue Type: New Feature
>          Components: BucketCache
>    Affects Versions: 3.0.0
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: Vladimir Rodionov
>            Priority: Major
>             Fix For: 3.0.0
>
>         Attachments: HBASE-21874.patch
>
>
> Non volatile persistent memory devices are byte addressable like DRAM (for eg. Intel DCPMM). Bucket cache implementation can take advantage of this new memory type and can make use of the existing offheap data structures to serve data directly from this memory area without having to bring the data to onheap.
> The patch is a new IOEngine implementation that works with the persistent memory.
> Note : Here we don't make use of the persistence nature of the device and just make use of the big memory it provides.
> Performance numbers to follow. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)