[jira] [Created] (ARROW-16768) Factor variables in R with missing values cause an error for write_parquet

["Kieran Martin (Jira)" <ji...@apache.org>]

Kieran Martin created ARROW-16768:
-------------------------------------

             Summary: Factor variables in R with missing values cause an error for write_parquet
                 Key: ARROW-16768
                 URL: https://issues.apache.org/jira/browse/ARROW-16768
             Project: Apache Arrow
          Issue Type: Bug
          Components: R
    Affects Versions: 7.0.0
            Reporter: Kieran Martin


If you try to write a data frame with a factor with a missing value to parquet, you get the error: "Error: Invalid: Cannot insert dictionary values containing nulls". 

This seems likely due to how the metadata for factors is currently captured in parquet files. Reprex follows:

 

library(arrow)

bad_data <- data.frame(A = factor(1, 2, NA))

write_parquet(bad_data, tempfile())

 

 



--
This message was sent by Atlassian Jira
(v8.20.7#820007)