You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "felipecrv (via GitHub)" <gi...@apache.org> on 2024/03/07 17:56:52 UTC
[I] [C++][FS][Azure] Produce better error message when Move is attempted on flat-namespace accounts [arrow]
felipecrv opened a new issue, #40405:
URL: https://github.com/apache/arrow/issues/40405
### Describe the enhancement requested
Azure Blobs Storage doesn't support renaming of blobs (without downloading and re-uploading the Blob) and offers even less support for atomic rename of multiple blobs.
Users are advised to enable Hierarchical Namespace support [1] if they intend to perform `Move` operations. `AzureFileSystem` will automatically detect HNS is enabled and use the Azure Data Lake File System Gen 2 APIs [1] and perform `Move` operations through that. Then even directories can be moved (something that even the Arrow `S3FileSystem` doesn't support at the moment).
Before giving up, I started the work in [2]. If anyone wants to implement just blob Move or directory Move, I recommend cloning the branch and continuing the work from there.
[1] https://learn.microsoft.com/en-gb/azure/storage/blobs/data-lake-storage-namespace
[2] #40025
### Component(s)
C++
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++][FS][Azure] Produce better error message when Move is attempted on flat-namespace accounts [arrow]
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on issue #40405:
URL: https://github.com/apache/arrow/issues/40405#issuecomment-1984943351
Issue resolved by pull request 40406
https://github.com/apache/arrow/pull/40406
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++][FS][Azure] Produce better error message when Move is attempted on flat-namespace accounts [arrow]
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou closed issue #40405: [C++][FS][Azure] Produce better error message when Move is attempted on flat-namespace accounts
URL: https://github.com/apache/arrow/issues/40405
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org