You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Wei Zhou (JIRA)" <ji...@apache.org> on 2017/02/15 02:00:45 UTC
[jira] [Comment Edited] (HDFS-7343) HDFS smart storage management
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15867046#comment-15867046 ]
Wei Zhou edited comment on HDFS-7343 at 2/15/17 1:59 AM:
---------------------------------------------------------
After discussed with [~andrew.wang] and [~drankye], in order to make the design doc more friendly to read and maintain, I'll divide the previous doc into two: one focus on high-level discussion and the other one focus on phase 1 design. Phase 1 targets at three scenarios:
* Cache hot data
* Move hot data to faster storage
* Archive cold data
Based on these cases, enough details will be provided to answer Andrew's great questions. Thanks!
was (Author: zhouwei):
After discussed with [~andrew.wang] and [~drankye], in order to make the design doc more friendly to read and maintain, I'll divide the previous doc into two: one focus on high-level design and the other one focus on phase 1. Phase 1 targets at three scenarios:
* Cache hot data
* Move hot data to faster storage
* Archive cold data
Based on these cases, enough details will be provided to answer Andrew's great questions. Thanks!
> HDFS smart storage management
> -----------------------------
>
> Key: HDFS-7343
> URL: https://issues.apache.org/jira/browse/HDFS-7343
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Kai Zheng
> Assignee: Wei Zhou
> Attachments: HDFS-Smart-Storage-Management.pdf, HDFS-Smart-Storage-Management-update.pdf, move.jpg
>
>
> As discussed in HDFS-7285, it would be better to have a comprehensive and flexible storage policy engine considering file attributes, metadata, data temperature, storage type, EC codec, available hardware capabilities, user/application preference and etc.
> Modified the title for re-purpose.
> We'd extend this effort some bit and aim to work on a comprehensive solution to provide smart storage management service in order for convenient, intelligent and effective utilizing of erasure coding or replicas, HDFS cache facility, HSM offering, and all kinds of tools (balancer, mover, disk balancer and so on) in a large cluster.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org