[jira] [Commented] (ARROW-7825) Have arrow::read_parquet respect options(stringsAsFactors = FALSE)

["Neal Richardson (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17033792#comment-17033792 ] 

Neal Richardson commented on ARROW-7825:
----------------------------------------

I'm not sure this is valid. {{iris$Species}} already is factor, so that's preserved when you write to Parquet or Feather, but when you write to a CSV, that is lost. So {{stringsAsFactors}} is irrelevant because it's not a string in the file, unlike in a CSV. 

> Have arrow::read_parquet respect options(stringsAsFactors = FALSE)
> ------------------------------------------------------------------
>
>                 Key: ARROW-7825
>                 URL: https://issues.apache.org/jira/browse/ARROW-7825
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: R
>    Affects Versions: 0.16.0
>         Environment: Linux 64-bit 5.4.15
>            Reporter: Keith Hughitt
>            Priority: Major
>              Labels: R, parquet
>
> Same issue as reported for feather::read_feather (https://issues.apache.org/jira/browse/ARROW-7823);
>  
> For the R arrow package, the "read_parquet()" function currently does not respect "options(stringsAsFactors = FALSE)", leading to unexpected/inconsistent behavior.
>  
> *Example:*
>  
>  
> {code:java}
> library(arrow)
> library(readr)
> options(stringsAsFactors = FALSE)
> write_tsv(head(iris), 'test.tsv')
> write_parquet(head(iris), 'test.parquet')
> head(read.delim('test.tsv', sep='\t')$Species)
> # [1] "setosa" "setosa" "setosa" "setosa" "setosa" "setosa"
> head(read_tsv('test.tsv', col_types = cols())$Species)
> # [1] "setosa" "setosa" "setosa" "setosa" "setosa" "setosa"
> head(read_parquet('test.parquet')$Species)
> # [1] setosa setosa setosa setosa setosa setosa
> # Levels: setosa versicolor virginica
> {code}
>  
>  
> *Versions:*
> - R 3.6.2
> - arrow_0.15.1.9000



--
This message was sent by Atlassian Jira
(v8.3.4#803005)