You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "westonpace (via GitHub)" <gi...@apache.org> on 2023/05/15 19:10:32 UTC

[GitHub] [arrow] westonpace commented on issue #35575: [Python] Cannot call pyarrow.fs.initialize_s3

westonpace commented on issue #35575:
URL: https://github.com/apache/arrow/issues/35575#issuecomment-1548419134

   Yes, I noticed this myself when testing some changes.  Unfortunately, if we just remove the call from the `pyarrow.fs` import then I think it will break some people.  Perhaps we should just do better documentation around the `pyarrow._s3fs` workaround?
   
   However, if the goal is to actually defer S3 initialization until S3 is used then I don't think this helps.
   
   Ideally, we could move the ensure initialized function inside of the `S3FileSystem` constructor but then this wouldn't catch cases where we use S3 indirectly (e.g. from an S3 URI).
   
   We could push the auto-initialization into C++ I suppose.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org