You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Miles McBain (Jira)" <ji...@apache.org> on 2021/11/30 02:13:00 UTC

[jira] [Created] (ARROW-14919) [R] write_parquet() drops attributes for grouped dataframes

Miles McBain created ARROW-14919:
------------------------------------

             Summary: [R] write_parquet() drops attributes for grouped dataframes
                 Key: ARROW-14919
                 URL: https://issues.apache.org/jira/browse/ARROW-14919
             Project: Apache Arrow
          Issue Type: Improvement
          Components: R
    Affects Versions: 6.0.1
         Environment: Linux
            Reporter: Miles McBain


Reprex:
{code:r}
library(dplyr)
#>
#> Attaching package: 'dplyr'
#> The following objects are masked from 'package:stats':
#>
#>     filter, lag
#> The following objects are masked from 'package:base':
#>
#>     intersect, setdiff, setequal, union
library(purrr)
library(arrow)
#>
#> Attaching package: 'arrow'
#> The following object is masked from 'package:utils':
#>
#>     timestamp
attr(mtcars, "etag") <- "test"
mtcars_grouped <-
  mtcars |>
  group_by("cyl")write_parquet(mtcars, "mtcars.parquet")
read_parquet("mtcars.parquet") |>
  attributes() |>
  pluck("etag")
#> [1] "test"write_parquet(mtcars_grouped, "mtcars_grouped.parquet")
read_parquet("mtcars_grouped.parquet") |>
  attributes() |>
  pluck("etag")
#> NULLunlink("mtcars_grouped.parquet")
unlink("mtcars.parquet") {code}
<sup>Created on 2021-11-30 by the [reprex package]([https://reprex.tidyverse.org|https://reprex.tidyverse.org/]) (v2.0.1)</sup>

Attributes are preserved for ungrouped data but unexpectedly dropped for grouped data. May affect other read/write formats.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)