You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Will Jones (Jira)" <ji...@apache.org> on 2022/10/05 21:52:00 UTC

[jira] [Commented] (ARROW-14342) [Python] Add support for the SSO credential provider

    [ https://issues.apache.org/jira/browse/ARROW-14342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17613238#comment-17613238 ] 

Will Jones commented on ARROW-14342:
------------------------------------

In the meantime, you can work around this by using boto3 to resolve the SSO credentials:

{code:Python}
from boto3 import Session

session = Session()
credentials = session.get_credentials()
s3 = S3FileSystem(
    access_key=current_credentials.access_key,
    secret_key=current_credentials.secret_key,
    session_token=current_credentials.token,
)
{code}

> [Python] Add support for the SSO credential provider
> ----------------------------------------------------
>
>                 Key: ARROW-14342
>                 URL: https://issues.apache.org/jira/browse/ARROW-14342
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Python
>    Affects Versions: 3.0.0, 5.0.0
>            Reporter: Björn Boschman
>            Priority: Major
>             Fix For: 11.0.0
>
>
> Not sure about other languages
>  see also: [https://github.com/boto/botocore/pull/2070]
> {code:java}
> from pyarrow.fs import S3FileSystem 
> bucket = 'some-bucket-with-read-access' 
> key = 'some-existing-key' 
> s3 = S3FileSystem() 
> s3.open_input_file(f'{bucket}/{key}'){code}
>  
>  results in
>  
> {code:java}
> Traceback (most recent call last):
>   File "test.py", line 7, in <module>
>     s3.open_input_file(f'{bucket}/{key}')
>   File "pyarrow/_fs.pyx", line 587, in pyarrow._fs.FileSystem.open_input_file
>   File "pyarrow/error.pxi", line 143, in pyarrow.lib.pyarrow_internal_check_status
>   File "pyarrow/error.pxi", line 114, in pyarrow.lib.check_status
> OSError: When reading information for key 'some-existing-key' in bucket 'some-bucket-with-read-access': AWS Error [code 15]: No response body.
> {code}
>  
> without sso creds supported - shouldn't it raise some kind of AccessDenied Exception?
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)