You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Xiaoyu Yao (Jira)" <ji...@apache.org> on 2020/06/23 21:23:00 UTC
[jira] [Resolved] (HDDS-3286) BasicOzoneFileSystem support
batchDelete
[ https://issues.apache.org/jira/browse/HDDS-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiaoyu Yao resolved HDDS-3286.
------------------------------
Fix Version/s: 0.6.0
Resolution: Fixed
Thanks [~micahzhao] for the contribution and all for the reviews. I've merged the PR to master.
> BasicOzoneFileSystem support batchDelete
> -----------------------------------------
>
> Key: HDDS-3286
> URL: https://issues.apache.org/jira/browse/HDDS-3286
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
> Components: Ozone Filesystem
> Reporter: mingchao zhao
> Assignee: mingchao zhao
> Priority: Major
> Labels: Triaged, pull-request-available
> Fix For: 0.6.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Currently delete file is to get all the keys in the directory, and then delete one by one. And the same with rename. This makes for poor performance.
> By tested the deletion path with 100,000 files, which took 3718.70 sec. And rename it took 7327.936.
> HDDS-2939 can able to optimize this part, but at present the hdds-2939 is slow and still a long way to go. So we optimized the batch operation based on the current interface. We were able to get better performance with this PR before the hdds-2939 came in.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org