You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "dragon (JIRA)" <ji...@apache.org> on 2016/03/15 09:16:35 UTC
[jira] [Created] (HDFS-10054) CLONE - Avoid assigning a leading
streamer in StripedDataStreamer to tolerate datanode failure
dragon created HDFS-10054:
-----------------------------
Summary: CLONE - Avoid assigning a leading streamer in StripedDataStreamer to tolerate datanode failure
Key: HDFS-10054
URL: https://issues.apache.org/jira/browse/HDFS-10054
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: dragon
Assignee: Tsz Wo Nicholas Sze
Fix For: HDFS-7285
StripedDataStreamer javadoc is shown below.
{code}
* The StripedDataStreamer class is used by {@link DFSStripedOutputStream}.
* There are two kinds of StripedDataStreamer, leading streamer and ordinary
* stream. Leading streamer requests a block group from NameNode, unwraps
* it to located blocks and transfers each located block to its corresponding
* ordinary streamer via a blocking queue.
{code}
Leading streamer is the streamer with index 0. When the datanode of the leading streamer fails, the other steamers cannot continue since no one will request a block group from NameNode anymore.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)