You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2026/06/19 16:47:00 UTC
[jira] [Updated] (HDFS-17936) Detect slow disks separately by storage type
[ https://issues.apache.org/jira/browse/HDFS-17936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated HDFS-17936:
----------------------------------
Labels: pull-request-available (was: )
> Detect slow disks separately by storage type
> --------------------------------------------
>
> Key: HDFS-17936
> URL: https://issues.apache.org/jira/browse/HDFS-17936
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 3.6.0
> Reporter: caozhiqiang
> Assignee: caozhiqiang
> Priority: Major
> Labels: pull-request-available
>
> The current slow disk detection does not differentiate between storage types. When a DataNode has 1 SSD and 10 HDDs with dfs.datanode.max.slowdisks.to.exclude=2 and
> dfs.datanode.min.outlier.detection.disks=5, if the SSD is under heavy read/write load, the single SSD may be identified as a slow disk. Client tasks writing SSD data to that DataNode will then fail to select a volume and report: No more available volumes.
> {code:java}
> public V chooseVolume(List<V> volumes, long replicaSize, String storageId)
> throws IOException {
> if (volumes.size() < 1) {
> throw new DiskOutOfSpaceException("No more available volumes");
> }
> ...
> } {code}
> Therefore, slow disk detection should be performed separately for each storage type. If the number of disks of a given storage type is less than dfs.datanode.min.outlier.detection.disks, detection for that storage type is skipped entirely.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org