You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Rok Mihevc (Jira)" <ji...@apache.org> on 2023/01/11 07:14:03 UTC

[jira] [Updated] (ARROW-1213) [Python] Enable s3fs to be used with ParquetDataset and reader/writer functions

     [ https://issues.apache.org/jira/browse/ARROW-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rok Mihevc updated ARROW-1213:
------------------------------
    External issue URL: https://github.com/apache/arrow/issues/17002

> [Python] Enable s3fs to be used with ParquetDataset and reader/writer functions
> -------------------------------------------------------------------------------
>
>                 Key: ARROW-1213
>                 URL: https://issues.apache.org/jira/browse/ARROW-1213
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Python
>            Reporter: Yacko
>            Assignee: Wes McKinney
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 0.6.0
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Pyarrow dataset function can't read from s3 using s3fs as the filesystem. Is  there a way we can add the support for read from s3 based on partitioned files ?
> I am trying to address the problem mentioned in the stackoverflow link :
> https://stackoverflow.com/questions/45082832/how-to-read-partitioned-parquet-files-from-s3-using-pyarrow-in-python



--
This message was sent by Atlassian Jira
(v8.20.10#820010)