[jira] [Created] (ARROW-17120) copy_files() does not take paths to specific files

["Carl Boettiger (Jira)" <ji...@apache.org>]

Carl Boettiger created ARROW-17120:
--------------------------------------

             Summary: copy_files() does not take paths to specific files
                 Key: ARROW-17120
                 URL: https://issues.apache.org/jira/browse/ARROW-17120
             Project: Apache Arrow
          Issue Type: Improvement
          Components: R
            Reporter: Carl Boettiger


`copy_files()` is a pretty handy function for working between local and remote interfaces, particularly for any file type arrow doesn't handle (arvo, ncdf, h5, etc etc).  

Unfortunately, it seems to work only from directory-to-directory, at least in the direction of copying S3 -> local file system.  e.g. this reprex:


{code:java}
library(arrow)
local_dir <- tempfile()
fs::dir_delete(local_dir)
fs::dir_create(local_dir) # create dir if it doesn't exist
l3 <- SubTreeFileSystem$create(local_dir)
l3$ls() #empty

s3 <- s3_bucket("neon4cast-targets/aquatics", endpoint_override = "data.ecoforecast.org", anonymous=TRUE)
s3$ls() #not empty, good

copy_files(s3$path("aquatics-targets.csv.gz"), l3$path("aquatics-targets.csv.gz"))
l3$ls() # darn, nothing!

copy_files(s3$path("aquatics-targets.csv.gz"), l3)
l3$ls() # darn, nothing!

copy_files(s3, l3)
l3$ls()  # Finally! only this works
{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)