Re: [I] [Python] pyarrow: using role_arn with S3FileSystem results in Anonymous user error [arrow]

["lauragalera (via GitHub)" <gi...@apache.org>]

lauragalera commented on issue #38421:
URL: https://github.com/apache/arrow/issues/38421#issuecomment-2057096794

   I am facing not the exact but a similar error using pyarrow version 10.0.0 for a glue job.
   
   After calling `S3FileSystem` with an arn_role and using it to read a table, I get an access error
   
   `df = pq.read_table('key', columns = ["_id","preferences"], schema = custom_schema,filesystem=s3).to_pandas()`
   
   `OSError: When getting information for key 'X' in bucket 'X': AWS Error ACCESS_DENIED during HeadObject operation: No response body.`
   
   I thought it could be due to role policies but the role has enough permission on the S3 bucket and the trust-relationship looks fine.
   
   I have come with a workaround using `boto3.client()`, but I'd like to know what is causing the access denied.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org