[jira] [Created] (HDFS-14988) HDFS should avoid read/write data from slow disks.

["yimeng (Jira)" <ji...@apache.org>]

yimeng created HDFS-14988:
-----------------------------

             Summary: HDFS should avoid read/write data from slow disks.
                 Key: HDFS-14988
                 URL: https://issues.apache.org/jira/browse/HDFS-14988
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: block placement, datanode
    Affects Versions: 3.2.1, 3.1.1
            Reporter: yimeng


Slow disk causes real-time service(such as HBase ) become slowdown.

The slow disk detection is added to the HDFS-11461, but only the slow disk is recorded in the Metric. I hope to further handle the detected slow disk. In my view, the slow disk can be added to the read data policy. If the block is on the slow disk of the DataNode, the block of other DataNodes is selected. For write data, slow disks can be added to the data write policy. We can remove the slow disk from all disks and then select a disk to write data based on dfs.datanode.fsdataset.volume.choosing.policy.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org