You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Chao Sun (Jira)" <ji...@apache.org> on 2024/11/02 00:50:00 UTC

[jira] [Created] (HADOOP-19323) ABFS: Add a new API in AzureBlobFileSystem to allow listing with startFrom

Chao Sun created HADOOP-19323:
---------------------------------

             Summary: ABFS: Add a new API in AzureBlobFileSystem to allow listing with startFrom
                 Key: HADOOP-19323
                 URL: https://issues.apache.org/jira/browse/HADOOP-19323
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Chao Sun


Currently the API to list from a certain starting point is hidden inside {{{}AzureBlobFileSystemStore{}}}, and is hard to access. It'd be better to surface this up to places like {{AzureBlobFileSystem}} to make it easier to use. 

 

The API is useful in scenarios such as Delta Lake where transaction logs are always indexed sequentially. With this API, the listing in Delta no longer needs to listing the whole {{_delta_log}} directory but only a small subset.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org