You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "kevinjqliu (via GitHub)" <gi...@apache.org> on 2023/05/03 16:19:52 UTC

[GitHub] [arrow] kevinjqliu opened a new issue, #35409: Document `pyarrow.fs.S3FileSystem` behavior in EC2

kevinjqliu opened a new issue, #35409:
URL: https://github.com/apache/arrow/issues/35409

   ### Describe the enhancement requested
   
   ### Context
   While working with both `s3fs` and `pyarrow`, I noticed the difference in documentation regarding establishing AWS credentials. 
   
   `s3fs` documentation explicitly mentions this scenario for using EC2
   ```
   Boto will try the following methods, in order:
   ...
   * for nodes on EC2, the IAM metadata provider
   ```
   `pyarrow` documentation does not mention this behavior.
   
   After digging into `pyarrow` code and the C++ implementation, I was able to find that `pyarrow` will use IAM metadata provide in EC2 to establish credentials. 
   
   Here's the PR to explain in depth and the associated change to the `pyarrow.fs.S3FileSystem` documentation:
   
   * MINOR: [S3FileSystem] Clarify S3FileSystem Credentials chain for EC2 #35312
   
   
   ### Component(s)
   
   Documentation


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] kou closed issue #35409: [Docs] Document `S3FileSystem` behavior in EC2

Posted by "kou (via GitHub)" <gi...@apache.org>.

kou closed issue #35409: [Docs] Document `S3FileSystem` behavior in EC2 
URL: https://github.com/apache/arrow/issues/35409


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] kevinjqliu commented on issue #35409: [Docs] Document `S3FileSystem` behavior in EC2

Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.

kevinjqliu commented on issue #35409:
URL: https://github.com/apache/arrow/issues/35409#issuecomment-1657242695

   @kou hello, can I get some eyes on the PR?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org