You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2023/03/24 14:50:00 UTC

[jira] [Created] (HADOOP-18679) Add API for bulk/paged object deletion

Steve Loughran created HADOOP-18679:
---------------------------------------

             Summary: Add API for bulk/paged object deletion
                 Key: HADOOP-18679
                 URL: https://issues.apache.org/jira/browse/HADOOP-18679
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
    Affects Versions: 3.3.5
            Reporter: Steve Loughran


iceberg and hbase could benefit from being able to give a list of individual files to delete -files which may be scattered round the bucket for better read peformance. 

Add some new optional interface for an object store which allows a caller to submit a list of paths to files to delete, where
the expectation is
* if a path is a file: delete
* if a path is a dir, outcome undefined
For s3 that'd let us build these into DeleteRequest objects, and submit, without any probes first.




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org