Re: [PR] Use reconstructed ListBlobs marker to provide list offset support in `MicrosoftAzure` store [arrow-rs]

["alexwilcoxson-rel (via GitHub)" <gi...@apache.org>]

alexwilcoxson-rel commented on PR #6174:
URL: https://github.com/apache/arrow-rs/pull/6174#issuecomment-2436322754

   Latest update. I have tested list with a startFrom parameter against a private preview storage account Microsoft provided us. However it won't be generally available until sometime next year.
   
   In the mean time they once again directed us towards what [hadoop is doing](https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java#L1260-L1267)
   
   This workaround only works against the **dfs**.core.windows.net and associated endpoints.
   
   I tested it against a patched version of OpenDAL's azdls (which has an impl of ObjectStore trait) with success: https://github.com/apache/opendal/pull/5242


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org