You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Aryan Gupta (Jira)" <ji...@apache.org> on 2026/06/09 07:22:00 UTC

[jira] [Resolved] (HDDS-11510) All deletion services should support multiple threads

     [ https://issues.apache.org/jira/browse/HDDS-11510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aryan Gupta resolved HDDS-11510.
--------------------------------
    Resolution: Workaround

> All deletion services should support multiple threads
> -----------------------------------------------------
>
>                 Key: HDDS-11510
>                 URL: https://issues.apache.org/jira/browse/HDDS-11510
>             Project: Apache Ozone
>          Issue Type: Sub-task
>          Components: OM, SCM
>            Reporter: Ethan Rose
>            Assignee: Aryan Gupta
>            Priority: Major
>
> When a large amount of data is deleted, we may see slow progress to clear it out due to the large backlog of pending deletes, even if all deletion services are running for their full intervals and collecting their maximum number of entries. In order to speed up deletion further, more threads will need to be configured. However, the deletion algorithms in OM and SCM currently only support single threaded implementations. The algorithms for these jobs need to be updates to partition the pending delete key space to support any number of deletion threads working over it.
> This Jira is relevant for the following components and these may be done in separate subtasks:
> * OM open key cleanup
> * OM key delete
> * OM directory delete
> * SCM block delete
> Datanode block deletion already supports a configurable thread pool that divides work by container.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org