You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2017/07/13 14:47:00 UTC
[jira] [Commented] (ARROW-1213) [Python] Enable s3fs to be used
with ParquetDataset and reader/writer functions
[ https://issues.apache.org/jira/browse/ARROW-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16085788#comment-16085788 ]
Wes McKinney commented on ARROW-1213:
-------------------------------------
I just revised the description to use this issue for the s3fs interface. I will take a look when I can (maybe get this into the 0.5.0 release); since I'm already familiar with this code it may not take much time to implement.
> [Python] Enable s3fs to be used with ParquetDataset and reader/writer functions
> -------------------------------------------------------------------------------
>
> Key: ARROW-1213
> URL: https://issues.apache.org/jira/browse/ARROW-1213
> Project: Apache Arrow
> Issue Type: Improvement
> Reporter: Yacko
> Priority: Minor
> Fix For: 0.5.0
>
>
> Pyarrow dataset function can't read from s3 using s3fs as the filesystem. Is there a way we can add the support for read from s3 based on partitioned files ?
> I am trying to address the problem mentioned in the stackoverflow link :
> https://stackoverflow.com/questions/45082832/how-to-read-partitioned-parquet-files-from-s3-using-pyarrow-in-python
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)