You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/10/05 22:42:00 UTC

[jira] [Updated] (ARROW-9870) [R] Friendly interface for filesystems (S3)

     [ https://issues.apache.org/jira/browse/ARROW-9870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated ARROW-9870:
----------------------------------
    Labels: pull-request-available  (was: )

> [R] Friendly interface for filesystems (S3)
> -------------------------------------------
>
>                 Key: ARROW-9870
>                 URL: https://issues.apache.org/jira/browse/ARROW-9870
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: R
>            Reporter: Neal Richardson
>            Assignee: Neal Richardson
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 2.0.0
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> The Filesystem methods don't provide a human-friendly interface for basic operations like ls, mkdir, etc. Since we provide access to S3 and potentially other cloud storage, it would be nice to have simple methods for exploring it.
> Additional ideas:
> * S3Bucket class/constructor: it's basically a SubTreeFileSystem containing S3FS and a path, except that we can auto-detect a bucket's region.
> * Add a class like the FileLocator C++ struct list(fs, path). _also_ kinda like a SubTreeFileSystem, but with different methods and intents. Aside from use in ls/mkdir/cp, it could be used in file reader/writers instead of having an extra {{filesystem}} argument added everywhere, e.g. {{fs$path("path/to/file")}}. See https://github.com/apache/arrow/pull/8197#discussion_r494325934



--
This message was sent by Atlassian Jira
(v8.3.4#803005)