You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Feilong He (JIRA)" <ji...@apache.org> on 2019/08/02 03:50:00 UTC
[jira] [Comment Edited] (HDFS-13762) Support non-volatile storage
class memory(SCM) in HDFS cache directives
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898508#comment-16898508 ]
Feilong He edited comment on HDFS-13762 at 8/2/19 3:49 AM:
-----------------------------------------------------------
Thanks [~jojochuang] for your attention on this Jira. Before closing it, we will post a refreshed formal performance report for this feature. Currently, half of the test work has been done.
was (Author: philohe):
Thanks [~jojochuang] for your attention on this Jira. Before closing it, we will post a formal performance report for this feature. Currently, half of the test work has been done.
> Support non-volatile storage class memory(SCM) in HDFS cache directives
> -----------------------------------------------------------------------
>
> Key: HDFS-13762
> URL: https://issues.apache.org/jira/browse/HDFS-13762
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: caching, datanode
> Reporter: Sammi Chen
> Assignee: Feilong He
> Priority: Major
> Attachments: HDFS-13762.000.patch, HDFS-13762.001.patch, HDFS-13762.002.patch, HDFS-13762.003.patch, HDFS-13762.004.patch, HDFS-13762.005.patch, HDFS-13762.006.patch, HDFS-13762.007.patch, HDFS-13762.008.patch, SCMCacheDesign-2018-11-08.pdf, SCMCacheDesign-2019-07-12.pdf, SCMCacheDesign-2019-07-16.pdf, SCMCacheDesign-2019-3-26.pdf, SCMCacheTestPlan-2019-3-27.pdf, SCMCacheTestPlan.pdf, SCM_Cache_Perf_Results-v1.pdf
>
>
> No-volatile storage class memory is a type of memory that can keep the data content after power failure or between the power cycle. Non-volatile storage class memory device usually has near access speed as memory DIMM while has lower cost than memory. So today It is usually used as a supplement to memory to hold long tern persistent data, such as data in cache.
> Currently in HDFS, we have OS page cache backed read only cache and RAMDISK based lazy write cache. Non-volatile memory suits for both these functions.
> This Jira aims to enable storage class memory first in read cache. Although storage class memory has non-volatile characteristics, to keep the same behavior as current read only cache, we don't use its persistent characteristics currently.
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org