You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Nicola Crane (Jira)" <ji...@apache.org> on 2022/10/27 20:25:00 UTC

[jira] [Updated] (ARROW-16620) [R] open_dataset fails to open single compressed csv

     [ https://issues.apache.org/jira/browse/ARROW-16620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nicola Crane updated ARROW-16620:
---------------------------------
    Priority: Critical  (was: Major)

> [R] open_dataset fails to open single compressed csv
> ----------------------------------------------------
>
>                 Key: ARROW-16620
>                 URL: https://issues.apache.org/jira/browse/ARROW-16620
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: R
>            Reporter: Carl Boettiger
>            Priority: Critical
>
>  
> The following fails:
> {code:java}
> bucket <- s3_bucket("targets/aquatics", endpoint_override="data.ecoforecast.org")
> x <- open_dataset(bucket$path("aquatics-targets.csv.gz"), format="csv") {code}
> This is surprising since pointing to an individual parquet file path is fine:
> {code:java}
> bucket <- s3_bucket("scores/parquet/aquatics/2022", endpoint_override="data.ecoforecast.org")
> x <- open_dataset(bucket$path("aquatics-2022-05-18-climatology.parquet")) {code}
> Maybe related to discussion in https://issues.apache.org/jira/browse/ARROW-15060 or maybe not?  In this context I'm thinking only about read.  The above examples use public buckets so should be reproducible with no credentials.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)