You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Jie Yao (Jira)" <ji...@apache.org> on 2022/10/27 12:04:00 UTC
[jira] [Resolved] (HDDS-7328) Improve Deletion of FSO Paths
[ https://issues.apache.org/jira/browse/HDDS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jie Yao resolved HDDS-7328.
---------------------------
Resolution: Fixed
> Improve Deletion of FSO Paths
> -----------------------------
>
> Key: HDDS-7328
> URL: https://issues.apache.org/jira/browse/HDDS-7328
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Xu Shao Hong
> Assignee: Xu Shao Hong
> Priority: Major
> Labels: pull-request-available
>
> Currently, the deleting speed of paths in the FSO bucket is too slow.
> Every time the DirectoryDeletingService executes(every 1m by default), it chooses only one path from DeletedDirectroyTable and tries adding its sub-files and sub-dirs into the PurgeDirectories Request. The real deletion happens in OMKeyDeleteResponseWithFSO, which moved all sub-dirs into DeletedDirectroyTable. Then these sub-dirs will be chosen by the future execution of DirectoryDeletingService.
> In the real production environment, such deletion speed is not applicable. There could be lots of dirs deleted without sub-dirs or sub-files. The dir deletion speed would lag behind the dir creation speed.
> I propose to optimize the logic of the DirectoryDeletingService, we could consume all the quota (ozone.path.deleting.limit.per.task) to delete paths as much as possible. The good news is the PB is already designed to do so, we could add more PurgePathRequest in one PurgeDirectoriesRequest.
> -----------------------------------
> This should be compatible with HDDS-5048.
> This aims to improve the efficiency of the deletion if not enough sub-files or sub-dirs are chosen.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org