You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "ZanderXu (Jira)" <ji...@apache.org> on 2022/10/06 01:38:00 UTC

[jira] [Resolved] (HDFS-16596) Improve the processing capability of FsDatasetAsyncDiskService

     [ https://issues.apache.org/jira/browse/HDFS-16596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ZanderXu resolved HDFS-16596.
-----------------------------
    Resolution: Duplicate

> Improve the processing capability of FsDatasetAsyncDiskService
> --------------------------------------------------------------
>
>                 Key: HDFS-16596
>                 URL: https://issues.apache.org/jira/browse/HDFS-16596
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: ZanderXu
>            Assignee: ZanderXu
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> In our production environment, when DN needs to delete a large number blocks, we find that many deletion tasks are backlogged in the queue of threadPoolExecutor in FsDatasetAsyncDiskService. We can't improve its throughput because the number of core threads is hard coded.
> So DN needs to support the number of core threads of FsDatasetAsyncDiskService can be configured.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org