You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2024/11/07 02:25:00 UTC

[jira] [Commented] (HADOOP-19323) ABFS: Add a new API in AzureBlobFileSystem to allow listing with startFrom

    [ https://issues.apache.org/jira/browse/HADOOP-19323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17896140#comment-17896140 ] 

ASF GitHub Bot commented on HADOOP-19323:
-----------------------------------------

sunchao opened a new pull request, #7150:
URL: https://github.com/apache/hadoop/pull/7150

   <!--
     Thanks for sending a pull request!
       1. If this is your first time, please read our contributor guidelines: https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
       2. Make sure your PR title starts with JIRA issue id, e.g., 'HADOOP-17799. Your PR title ...'.
   -->
   
   ### Description of PR
   
   
   ### How was this patch tested?
   
   
   ### For code changes:
   
   - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
   - [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files?
   
   




> ABFS: Add a new API in AzureBlobFileSystem to allow listing with startFrom
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-19323
>                 URL: https://issues.apache.org/jira/browse/HADOOP-19323
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Chao Sun
>            Priority: Major
>
> Currently the API to list from a certain starting point is hidden inside {{{}AzureBlobFileSystemStore{}}}, and is hard to access. It'd be better to surface this up to places like {{AzureBlobFileSystem}} to make it easier to use. 
>  
> The API is useful in scenarios such as Delta Lake where transaction logs are always indexed sequentially. With this API, the listing in Delta no longer needs to listing the whole {{_delta_log}} directory but only a small subset.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org