You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "francesco086 (via GitHub)" <gi...@apache.org> on 2024/09/27 05:28:50 UTC
[I] Object Store: Azure access using DefaultAzureCredential possible? [arrow-rs]
francesco086 opened a new issue, #6470:
URL: https://github.com/apache/arrow-rs/issues/6470
**Which part is this question about**
[object_store](https://docs.rs/object_store/latest/object_store/index.html)::[azure](https://docs.rs/object_store/latest/object_store/azure/index.html)::[AzureConfigKey](https://docs.rs/object_store/latest/object_store/azure/enum.AzureConfigKey.html#)
**Describe your question**
Coming from systems that use [adlfs](https://github.com/fsspec/adlfs), it has always been possible to use "Auto credential solving using Azure's DefaultAzureCredential()", by setting in the storage options `anon=False`.
I could not find an equivalent in AzureConfigKey. Is there a way to achieve the same?
**Additional context**
I am trying to use polars and raised this question in polars already: https://github.com/pola-rs/polars/issues/18931.
Notice that [a workaround](https://learn.microsoft.com/en-us/azure/storage/blobs/storage-blob-user-delegation-sas-create-python?tabs=container) has been suggested, but it's quite cumbersome, so I am checking if there is a simpler way that perhaps I could not see.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Object Store: Azure access using DefaultAzureCredential possible? [arrow-rs]
Posted by "francesco086 (via GitHub)" <gi...@apache.org>.
francesco086 closed issue #6470: Object Store: Azure access using DefaultAzureCredential possible?
URL: https://github.com/apache/arrow-rs/issues/6470
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Object Store: Azure access using DefaultAzureCredential possible? [arrow-rs]
Posted by "francesco086 (via GitHub)" <gi...@apache.org>.
francesco086 commented on issue #6470:
URL: https://github.com/apache/arrow-rs/issues/6470#issuecomment-2379830952
That works in the `az login` scenario from my laptop, thanks @tustvold !
So, basically what is missing is support for [`DefaultAzureCredential`](https://learn.microsoft.com/en-us/dotnet/api/azure.identity.defaultazurecredential?view=azure-dotnet), that would automatically resolve between the two (and more).
Do you know if there is a deep reason for this, or it could make sense to raise a feature request to add support for this very handy option?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Object Store: Azure access using DefaultAzureCredential possible? [arrow-rs]
Posted by "francesco086 (via GitHub)" <gi...@apache.org>.
francesco086 commented on issue #6470:
URL: https://github.com/apache/arrow-rs/issues/6470#issuecomment-2380394964
Thanks for the explanation!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Object Store: Azure access using DefaultAzureCredential possible? [arrow-rs]
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #6470:
URL: https://github.com/apache/arrow-rs/issues/6470#issuecomment-2379842532
DefaultAzureCredential is a feature of the .NET SDK, trying to mirror all the authentication options the various cloud providers have in their various SDKs is out of scope for this crate.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Object Store: Azure access using DefaultAzureCredential possible? [arrow-rs]
Posted by "francesco086 (via GitHub)" <gi...@apache.org>.
francesco086 commented on issue #6470:
URL: https://github.com/apache/arrow-rs/issues/6470#issuecomment-2379485539
Thanks for your answer @tustvold !
Right, I just checked and on an Azure VM it works as you described.
But what about my local machine where I did a simple `az login`? Is there a way to make it source the credentials from the azure account I am logged in with in my session?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Object Store: Azure access using DefaultAzureCredential possible? [arrow-rs]
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #6470:
URL: https://github.com/apache/arrow-rs/issues/6470#issuecomment-2379489057
Perhaps https://docs.rs/object_store/latest/object_store/azure/struct.MicrosoftAzureBuilder.html#method.with_use_azure_cli ?
https://docs.rs/object_store/latest/object_store/azure/enum.AzureConfigKey.html#variant.UseAzureCli
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Object Store: Azure access using DefaultAzureCredential possible? [arrow-rs]
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #6470:
URL: https://github.com/apache/arrow-rs/issues/6470#issuecomment-2378620821
I'm not familiar with that terminology, but if you don't provide credentials it will try to source them from IMDS. In an azure environment it should just work
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org