You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "dark_num (Jira)" <ji...@apache.org> on 2020/09/01 12:04:00 UTC

[jira] [Created] (HDFS-15552) Let DeadNode Detector also work for EC cases

dark_num created HDFS-15552:
-------------------------------

             Summary: Let DeadNode Detector also work for EC cases
                 Key: HDFS-15552
                 URL: https://issues.apache.org/jira/browse/HDFS-15552
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: dfsclient, ec
    Affects Versions: 3.3.0
            Reporter: dark_num
             Fix For: 3.4.0


Currently, the EC stream (`DFSStripedInputStream`) is not handled properly while exception occurs.

For example, while reading EC-blocks, if the client timed out when connecting to the DataNode, it will throws `SocketTimeoutException` , then add current DN to localDeadNode.

However, the local dead nodes will not be removed until the stream is closed, which will cause *missing block IOException* to be thrown in the use scenario of Hbase.

So we need to use detector to deal with dead nodes under EC to avoid reading failures.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org