You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Xiaoqiao He (Jira)" <ji...@apache.org> on 2021/05/07 12:53:00 UTC

[jira] [Resolved] (HDFS-16009) HDFS tiered storage support

     [ https://issues.apache.org/jira/browse/HDFS-16009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xiaoqiao He resolved HDFS-16009.
--------------------------------
    Resolution: Duplicate

Close this issue based on above comments. Please feel free to reopen it if need to improve it. Thanks [~LeonG] and [~jianghuazhu].

> HDFS tiered storage support
> ---------------------------
>
>                 Key: HDFS-16009
>                 URL: https://issues.apache.org/jira/browse/HDFS-16009
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: JiangHua Zhu
>            Priority: Major
>
> HDFS currently stores data blocks on different data nodes. These data nodes are random within the scope of the network topology (local rack/different racks/node group).
> When the NameNode allocates DataNodes to the Block, it is randomly selected, that is, each DataNode is selected equally.
> We should make a hierarchical strategy. For example, DataNode1, DataNode2, and DataNode3 are the same level, and DataNode4 and DataNode5 are the same level. Because the hardware between DataNodes may be different, in this case, it is necessary for us to do tiered storage, so that DataNodes with poor hardware can store up to 50%, and 40% or even lower. This is conducive to cluster maintenance and stability.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org