You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org> on 2011/02/01 00:41:29 UTC

[jira] Created: (HDFS-1606) Provide a stronger data guarantee in the write pipeline

Provide a stronger data guarantee in the write pipeline
-------------------------------------------------------

                 Key: HDFS-1606
                 URL: https://issues.apache.org/jira/browse/HDFS-1606
             Project: Hadoop HDFS
          Issue Type: New Feature
          Components: data-node, hdfs client
            Reporter: Tsz Wo (Nicholas), SZE


In the current design, if there is a datanode/network failures in the write pipeline, DFSClient will try to remove the failed datanode from the pipeline and then continue writing with the remaining datanodes.  As a result, the number of datanodes in the pipeline is decreased.  Unfortunately, it is possible that DFSClient may incorrectly remove a healthy datanode but leave the failed datanode in the pipeline because failure detection may not be accurate under erroneous conditions.

We propose to add a new mechanism for adding new datanodes to the pipeline in order to provide a stronger data guarantee.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira