[jira] (HDFS-16500) Make asynchronous blocks deletion lock and unlock durtion threshold configurable

["Hui Fei (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDFS-16500 ]


    Hui Fei deleted comment on HDFS-16500:
    --------------------------------

was (Author: ferhui):
We met one problem when we used this feature.
It created and deleted files frequently in data lake scenario. Async deleting is slower than it enqueues, so the number of pending blocks is growing.
Hope this message can help users who enable this feature.

> Make asynchronous blocks deletion lock and unlock durtion threshold configurable 
> ---------------------------------------------------------------------------------
>
>                 Key: HDFS-16500
>                 URL: https://issues.apache.org/jira/browse/HDFS-16500
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: namanode
>            Reporter: Chengwei Wang
>            Assignee: Chengwei Wang
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> I have backport the nice feature HDFS-16043 to our internal branch, it works well in our testing cluster.
> I think it's better to make the fields *_deleteBlockLockTimeMs_* and *_deleteBlockUnlockIntervalTimeMs_* configurable, so that we can control the lock and unlock duration.
> {code:java}
> private final long deleteBlockLockTimeMs = 500;
> private final long deleteBlockUnlockIntervalTimeMs = 100;{code}
> And we should set the default value smaller to avoid blocking other requests long time when deleting some  large directories.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org