You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Junping Du (JIRA)" <ji...@apache.org> on 2012/09/16 21:07:07 UTC
[jira] [Created] (HDFS-3941) Backport HDFS-3498 and HDFS3601:
update replica placement policy for new added "NodeGroup" layer topology
Junping Du created HDFS-3941:
--------------------------------
Summary: Backport HDFS-3498 and HDFS3601: update replica placement policy for new added "NodeGroup" layer topology
Key: HDFS-3941
URL: https://issues.apache.org/jira/browse/HDFS-3941
Project: Hadoop HDFS
Issue Type: New Feature
Components: name-node
Affects Versions: 1.0.0
Reporter: Junping Du
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-3941) Backport HDFS-3498 and HDFS3601:
update replica placement policy for new added "NodeGroup" layer topology
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE resolved HDFS-3941.
------------------------------------------
Resolution: Fixed
Fix Version/s: 1-win
1.2.0
I have committed it. Thanks, Junping and Jing!
> Backport HDFS-3498 and HDFS3601: update replica placement policy for new added "NodeGroup" layer topology
> ---------------------------------------------------------------------------------------------------------
>
> Key: HDFS-3941
> URL: https://issues.apache.org/jira/browse/HDFS-3941
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: name-node
> Affects Versions: 1.0.0
> Reporter: Junping Du
> Assignee: Junping Du
> Fix For: 1.2.0, 1-win
>
> Attachments: HDFS-3941.002.patch, HDFS-3941.003.patch, HDFS-3941.004.patch, HDFS-3941.005.patch, HDFS-3941.patch
>
>
> With enabling additional layer of "NodeGroup", the replica placement policy used in BlockPlacementPolicyWithNodeGroup is updated to following rules:
> 0. No more than one replica is placed within a NodeGroup (*)
> 1. First replica on the local node.
> 2. Second and third replicas are within the same rack but remote rack with 1st replica.
> 3. Other replicas on random nodes with restriction that no more than two replicas are placed in the same rack, if there is enough racks.
> Also, this patch abstract Replica Removal Policy from FSNameSystem to BlockPlacementPolicy and update removal policy slightly to remove duplicated replica within the same NodeGroup first when over-replicated happens.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira