[jira] [Commented] (ARROW-16421) [R] Permission error on Windows when deleting file previously accessed with open_dataset

["Miles Granger (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580774#comment-17580774 ] 

Miles Granger commented on ARROW-16421:
---------------------------------------

That's right, couldn't see that any files were left open when using those methods. Doing a loop and watching `lsof` I can spot the file being opened and closed immediately during `ds.dataset(...).read()`, and assigning to a variable also will not leave the file open from what I could see.

> [R] Permission error on Windows when deleting file previously accessed with open_dataset
> ----------------------------------------------------------------------------------------
>
>                 Key: ARROW-16421
>                 URL: https://issues.apache.org/jira/browse/ARROW-16421
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: R
>    Affects Versions: 7.0.0
>            Reporter: Will Jones
>            Assignee: Will Jones
>            Priority: Major
>
> On Windows this fails:
> {code:R}
> library(arrow)
> write_dataset(iris, "test_dataset")
> # Original example was with DuckDB, but that's not necessarily the issue
> # con <- open_dataset("test_dataset") |> to_duckdb()
> con <- open_dataset("test_dataset")$NewScan()$Finish()$ToRecordBatchReader()
> file.remove("test_dataset/part-0.parquet")
> #> Warning in file.remove("test_dataset/part-0.parquet"): cannot remove file
> #> 'test_dataset/part-0.parquet', reason 'Permission denied'
> #> [1] FALSE
> {code}
> But on MacOS it does not:
> {code:r}
> library(arrow)
> write_dataset(iris, "test_dataset")
> # Original example was with DuckDB, but that's not necessarily the issue
> # con <- open_dataset("test_dataset") |> to_duckdb()
> con <- open_dataset("test_dataset")$NewScan()$Finish()$ToRecordBatchReader()
> file.remove("test_dataset/part-0.parquet")
> #> [1] TRUE
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)