You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Miles McBain (Jira)" <ji...@apache.org> on 2021/11/30 02:13:00 UTC
[jira] [Created] (ARROW-14919) [R] write_parquet() drops attributes for grouped dataframes
Miles McBain created ARROW-14919:
------------------------------------
Summary: [R] write_parquet() drops attributes for grouped dataframes
Key: ARROW-14919
URL: https://issues.apache.org/jira/browse/ARROW-14919
Project: Apache Arrow
Issue Type: Improvement
Components: R
Affects Versions: 6.0.1
Environment: Linux
Reporter: Miles McBain
Reprex:
{code:r}
library(dplyr)
#>
#> Attaching package: 'dplyr'
#> The following objects are masked from 'package:stats':
#>
#> filter, lag
#> The following objects are masked from 'package:base':
#>
#> intersect, setdiff, setequal, union
library(purrr)
library(arrow)
#>
#> Attaching package: 'arrow'
#> The following object is masked from 'package:utils':
#>
#> timestamp
attr(mtcars, "etag") <- "test"
mtcars_grouped <-
mtcars |>
group_by("cyl")write_parquet(mtcars, "mtcars.parquet")
read_parquet("mtcars.parquet") |>
attributes() |>
pluck("etag")
#> [1] "test"write_parquet(mtcars_grouped, "mtcars_grouped.parquet")
read_parquet("mtcars_grouped.parquet") |>
attributes() |>
pluck("etag")
#> NULLunlink("mtcars_grouped.parquet")
unlink("mtcars.parquet") {code}
<sup>Created on 2021-11-30 by the [reprex package]([https://reprex.tidyverse.org|https://reprex.tidyverse.org/]) (v2.0.1)</sup>
Attributes are preserved for ungrouped data but unexpectedly dropped for grouped data. May affect other read/write formats.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)