You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Lucas Mation (Jira)" <ji...@apache.org> on 2022/11/03 16:17:00 UTC
[jira] [Created] (ARROW-18241) as.integer can't handdle empty character cels (ex c(''))
Lucas Mation created ARROW-18241:
------------------------------------
Summary: as.integer can't handdle empty character cels (ex c(''))
Key: ARROW-18241
URL: https://issues.apache.org/jira/browse/ARROW-18241
Project: Apache Arrow
Issue Type: Bug
Reporter: Lucas Mation
I am importing a dataset with arrow, and then converting variable types. But I got an error message because the `arrow` implementation of `as.integer` can't handle empty strings (which is legal in base R). Is this a bug?
```
#In R
'' %>% as.integer()
[1] NA
#in arrow
q <- data.table(x=c('','1','2'))
q %>% write_dataset(paste0(p2,'/q'))
q2 <- paste0(p2,'/q') %>% open_dataset %>% mutate(x=as.integer(x)) %>% collect
Error in `collect()`:
! Invalid: Failed to parse string: '' as a scalar of type int32
Run `rlang::last_error()` to see where the error occurred.
```
--
This message was sent by Atlassian Jira
(v8.20.10#820010)