You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org> on 2013/09/18 17:13:55 UTC
[jira] [Resolved] (HDFS-4990) Block placement for storage types
[ https://issues.apache.org/jira/browse/HDFS-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE resolved HDFS-4990.
------------------------------------------
Resolution: Fixed
Fix Version/s: Heterogeneous Storage (HDFS-2832)
Hadoop Flags: Reviewed
Thanks Arpit and Junping for reviewing the patches.
I have committed this.
> Block placement for storage types
> ---------------------------------
>
> Key: HDFS-4990
> URL: https://issues.apache.org/jira/browse/HDFS-4990
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: namenode
> Reporter: Suresh Srinivas
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: Heterogeneous Storage (HDFS-2832)
>
> Attachments: h4990_20130909.patch, h4990_20130916.patch, h4990_20130917b.patch, h4990_20130917c.patch, h4990_20130917.patch, h4990_20130918b.patch, h4990_20130918.patch
>
>
> Currently block location for writes are made based on:
> # Datanode load (number of transceivers)
> # Space left on datanode
> # Topology
> With storage abstraction, namenode must choose a storage instead of a datanode for block placement. It also needs to consider storage type, load on the storage etc.
> As an additional benefit, currently HDFS support heterogeneous nodes (nodes with different number of spindles etc.) poorly. This work should help solve that issue as well.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira