You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Janus Chow (Jira)" <ji...@apache.org> on 2021/11/22 14:48:00 UTC

[jira] [Created] (HDFS-16348) Mark slownode as badnode to recover pipeline

Janus Chow created HDFS-16348:
---------------------------------

             Summary: Mark slownode as badnode to recover pipeline
                 Key: HDFS-16348
                 URL: https://issues.apache.org/jira/browse/HDFS-16348
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Janus Chow
            Assignee: Janus Chow


In HDFS-16320, the DataNode can retrieve the SLOW status from each NameNode. 

This ticket is to send this information back to Clients who are writing blocks. If a Clients noticed the pipeline is build on a slownode, he/she can choose to mark the slownode as a badnode to exclude the node or rebuild a pipeline.

In order to avoid the false positives, we added a config of "threshold", only clients continuously receives slownode reply from the same node will the node be marked as SLOW.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org