You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Will Jones (Jira)" <ji...@apache.org> on 2022/04/29 18:38:00 UTC
[jira] [Updated] (ARROW-16421) [R] Permission error on Windows when deleting file in dataset

     [ https://issues.apache.org/jira/browse/ARROW-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Will Jones updated ARROW-16421:
-------------------------------
    Description: 
On Windows this fails:
{code:R}
library(arrow)

write_dataset(iris, "test_dataset")

# Original example was with DuckDB, but that's not necessarily the issue
# con <- open_dataset("test_dataset") |> to_duckdb()
con <- open_dataset("test_dataset")$NewScan()$Finish()$ToRecordBatchReader()

file.remove("test_dataset/part-0.parquet")
#> Warning in file.remove("test_dataset/part-0.parquet"): cannot remove file
#> 'test_dataset/part-0.parquet', reason 'Permission denied'
#> [1] FALSE
{code}
But on MacOS it does not:
{code:r}
library(arrow)

write_dataset(iris, "test_dataset")

# Original example was with DuckDB, but that's not necessarily the issue
# con <- open_dataset("test_dataset") |> to_duckdb()
con <- open_dataset("test_dataset")$NewScan()$Finish()$ToRecordBatchReader()

file.remove("test_dataset/part-0.parquet")
#> [1] TRUE
{code}

  was:
On Windows this fails: 
{code:r}
library(arrow)

write_dataset(iris, "test_dataset")

con <- open_dataset("test_dataset") |> to_duckdb()

file.remove("test_dataset/part-0.parquet")
#> Warning in file.remove("test_dataset/part-0.parquet"): cannot remove file
#> 'test_dataset/part-0.parquet', reason 'Permission denied'
#> [1] FALSE
{code}

But on MacOS it does not:

{code:R}
library(arrow)

write_dataset(iris, "test_dataset")

con <- open_dataset("test_dataset") |> to_duckdb()

file.remove("test_dataset/part-0.parquet")
#> [1] TRUE
{code}


> [R] Permission error on Windows when deleting file in dataset
> -------------------------------------------------------------
>
>                 Key: ARROW-16421
>                 URL: https://issues.apache.org/jira/browse/ARROW-16421
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: R
>    Affects Versions: 7.0.0
>            Reporter: Will Jones
>            Assignee: Will Jones
>            Priority: Major
>
> On Windows this fails:
> {code:R}
> library(arrow)
> write_dataset(iris, "test_dataset")
> # Original example was with DuckDB, but that's not necessarily the issue
> # con <- open_dataset("test_dataset") |> to_duckdb()
> con <- open_dataset("test_dataset")$NewScan()$Finish()$ToRecordBatchReader()
> file.remove("test_dataset/part-0.parquet")
> #> Warning in file.remove("test_dataset/part-0.parquet"): cannot remove file
> #> 'test_dataset/part-0.parquet', reason 'Permission denied'
> #> [1] FALSE
> {code}
> But on MacOS it does not:
> {code:r}
> library(arrow)
> write_dataset(iris, "test_dataset")
> # Original example was with DuckDB, but that's not necessarily the issue
> # con <- open_dataset("test_dataset") |> to_duckdb()
> con <- open_dataset("test_dataset")$NewScan()$Finish()$ToRecordBatchReader()
> file.remove("test_dataset/part-0.parquet")
> #> [1] TRUE
> {code}



--
This message was sent by Atlassian Jira
(v8.20.7#820007)