You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "zadeluca (via GitHub)" <gi...@apache.org> on 2024/11/20 04:16:47 UTC

[I] object_store Azure Government using OAuth [arrow-rs]

zadeluca opened a new issue, #6759:
URL: https://github.com/apache/arrow-rs/issues/6759

   **Which part is this question about**
   object_store Azure
   
   **Describe your question**
   I have reviewed this issue https://github.com/apache/arrow-rs/issues/4853 which also pertains to using Azure Government. That example uses shared key authentication. For OAuth (`ClientSecretOAuthProvider`), I believe it is also necessary to set `authority_host` to `authority_hosts::AZURE_GOVERNMENT` in order for the `token_url` to be correct.
   
   Without this setting, I am currently getting this error `"AADSTS900382: Confidential Client is not supported in Cross Cloud request.` I understand it is possible to override using `MicrosoftAzureBuilder::with_authority_host()`, however I am using [delta-rs](https://github.com/delta-io/delta-rs) which requires that all configuration is provided though `storage_options` with keys defined in [AzureConfigKey](https://docs.rs/object_store/latest/object_store/azure/enum.AzureConfigKey.html). This currently does not allow setting `AuthorityHost`.
   
   Does that sound correct? If so, is it possible to expose `AuthorityHost` through `AzureConfigKey`?
   
   **Additional context**
   I have only tried in Python using delta-rs. I am going to attempt to use arrow-rs directly in order to verify that setting `AuthorityHost` does indeed resolve the error mentioned above. I am a Rust beginner so it may take some effort.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] object_store Azure Government using OAuth [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #6759:
URL: https://github.com/apache/arrow-rs/issues/6759#issuecomment-2741680635

   Migrating from arrow-rs issue [#6759](https://github.com/apache/arrow-rs/issues/6759)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] object_store Azure Government using OAuth [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #6759:
URL: https://github.com/apache/arrow-rs/issues/6759#issuecomment-2549318954

   `label_issue.py` automatically added labels {'object-store'} from #6773


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] object_store Azure Government using OAuth [arrow-rs]

Posted by "zadeluca (via GitHub)" <gi...@apache.org>.
zadeluca commented on issue #6759:
URL: https://github.com/apache/arrow-rs/issues/6759#issuecomment-2492169443

   I have confirmed that including both of these:
   
   ```
               .with_authority_host("https://login.microsoftonline.us")
               .with_endpoint("https://<ACCOUNT>.blob.core.usgovcloudapi.net".to_string())
   ```
   
   on the builder allows OAuth to succeed. I will try to submit a PR to add `AuthorityHost` to `AzureConfigKey`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] object_store Azure Government using OAuth [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #6759: object_store Azure Government using OAuth
URL: https://github.com/apache/arrow-rs/issues/6759


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] object_store Azure Government using OAuth [arrow-rs]

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #6759:
URL: https://github.com/apache/arrow-rs/issues/6759#issuecomment-2489695101

   I'm not very familiar with Azure's government offering, but we should expose the option as a config key if it isn't


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org