You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/06/16 11:08:03 UTC
[GitHub] [arrow] szdrasiak opened a new issue #7443: module 'pyarrow.fs' has no attribute 'S3FileSystem'
szdrasiak opened a new issue #7443:
URL: https://github.com/apache/arrow/issues/7443
pyarrow version = 0.17.1
**I have latest version installed but I cant import `S3FileSystem` from `pyarrow.fs` module.**
I'm trying read parquet file from S3 using `read_table` with argument `use_legacy_dataset=False` to filter data without partitions, I tried to use file system from `s3fs` package but I'm getting ```filesystem` argument must be a FileSystem instance or a valid file system URI```. I tried pass full s3 url as source without `filesystem` parameter but I'm getting `Got S3 URI but Arrow compiled without S3 support`
Why I'm missing `S3FileSystem` and is my approach to filter data on reading good?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] wesm commented on issue #7443: module 'pyarrow.fs' has no attribute 'S3FileSystem'
Posted by GitBox <gi...@apache.org>.
wesm commented on issue #7443:
URL: https://github.com/apache/arrow/issues/7443#issuecomment-656159164
See https://github.com/apache/arrow/commit/d04f54bcf6e70f3b0a46fb36f68d461ef71f764c.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] wesm closed issue #7443: module 'pyarrow.fs' has no attribute 'S3FileSystem'
Posted by GitBox <gi...@apache.org>.
wesm closed issue #7443:
URL: https://github.com/apache/arrow/issues/7443
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kkozmic commented on issue #7443: module 'pyarrow.fs' has no attribute 'S3FileSystem'
Posted by GitBox <gi...@apache.org>.
kkozmic commented on issue #7443:
URL: https://github.com/apache/arrow/issues/7443#issuecomment-655897659
> S3FileSystem is not yet available in the wheel packages from PyPI
Is addressing that on the roadmap? Using Conda isn't a viable option for me, so that issue is a bit of a blocker
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] wesm commented on issue #7443: module 'pyarrow.fs' has no attribute 'S3FileSystem'
Posted by GitBox <gi...@apache.org>.
wesm commented on issue #7443:
URL: https://github.com/apache/arrow/issues/7443#issuecomment-644741874
S3FileSystem is not yet available in the wheel packages from PyPI. Use conda-forge to install instead. If you run into an issue other than this please open a JIRA issue
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org