You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "alearrigo (via GitHub)" <gi...@apache.org> on 2023/07/13 11:54:22 UTC
[GitHub] [arrow] alearrigo opened a new issue, #36660: [R] count() and tally() don't work with open_dataset()
alearrigo opened a new issue, #36660:
URL: https://github.com/apache/arrow/issues/36660
### Describe the bug, including details regarding any error messages, version, and platform.
As described in the object, that's what happen when I try to use count() or tally() on a parquet file with open_dataset():
Reprex:
```
library(dplyr)
library(arrow)
write_parquet(mtcars, "~/Desktop/mtcars.parquet")
open_dataset("~/Desktop/mtcars.parquet") %>%
tally(mpg)
```
That's the error:
````
> open_dataset("~/Desktop/mtcars.parquet") %>%
+ count(mpg)
Error in `dplyr::tally()`:
! `name` must be a valid name, not `NULL`.
Run `rlang::last_trace()` to see where the error occurred.
> rlang::last_trace()
<error/mpg>
Error in `dplyr::tally()`:
! `name` must be a valid name, not `NULL`.
---
Backtrace:
▆
1. ├─open_dataset("~/Desktop/mtcars.parquet") %>% count(mpg)
2. ├─dplyr::count(., mpg)
3. └─arrow:::count.Dataset(., mpg)
4. ├─dplyr::tally(...)
5. └─arrow:::tally.arrow_dplyr_query(name = name)
Run rlang::last_trace(drop = FALSE) to see 3 hidden frames.
> rlang::last_trace(drop = FALSE)
<error/mpg>
Error in `dplyr::tally()`:
! `name` must be a valid name, not `NULL`.
---
Backtrace:
▆
1. ├─open_dataset("~/Desktop/mtcars.parquet") %>% count(mpg)
2. ├─dplyr::count(., mpg)
3. └─arrow:::count.Dataset(., mpg)
4. ├─dplyr::tally(...)
5. └─arrow:::tally.arrow_dplyr_query(name = name)
6. └─dplyr:::check_name(name, dplyr::group_vars(x))
7. └─dplyr:::stop_input_type(...)
8. └─rlang::abort(message, ..., call = call, arg = arg)
````
Session info:
```
─ Session info ───────────────────────────────────────────────────────────────────────────────────────────────────────────
setting value
version R version 4.2.2 (2022-10-31)
os macOS Ventura 13.4.1
system aarch64, darwin20
ui RStudio
language (EN)
collate en_US.UTF-8
ctype en_US.UTF-8
tz Europe/Rome
date 2023-07-13
rstudio 2023.06.0+421 Mountain Hydrangea (desktop)
pandoc NA
─ Packages ───────────────────────────────────────────────────────────────────────────────────────────────────────────────
package * version date (UTC) lib source
arrow * 10.0.1 2022-12-06 [1] CRAN (R 4.2.0)
assertthat 0.2.1 2019-03-21 [1] CRAN (R 4.2.0)
bit 4.0.5 2022-11-15 [1] CRAN (R 4.2.0)
bit64 4.0.5 2020-08-30 [1] CRAN (R 4.2.0)
cli 3.6.1 2023-03-23 [1] CRAN (R 4.2.0)
crayon 1.5.2 2022-09-29 [1] CRAN (R 4.2.0)
dplyr * 1.1.2 2023-04-20 [1] CRAN (R 4.2.0)
fansi 1.0.4 2023-01-22 [1] CRAN (R 4.2.0)
generics 0.1.3 2022-07-05 [1] CRAN (R 4.2.0)
glue 1.6.2 2022-02-24 [1] CRAN (R 4.2.0)
lifecycle 1.0.3 2022-10-07 [1] CRAN (R 4.2.0)
magrittr 2.0.3 2022-03-30 [1] CRAN (R 4.2.0)
pillar 1.9.0 2023-03-22 [1] CRAN (R 4.2.0)
pkgconfig 2.0.3 2019-09-22 [1] CRAN (R 4.2.0)
purrr 1.0.1 2023-01-10 [1] CRAN (R 4.2.0)
R6 2.5.1 2021-08-19 [1] CRAN (R 4.2.0)
rlang 1.1.1 2023-04-28 [1] CRAN (R 4.2.0)
rstudioapi 0.14 2022-08-22 [1] CRAN (R 4.2.0)
sessioninfo 1.2.2 2021-12-06 [1] CRAN (R 4.2.0)
tibble 3.2.1 2023-03-20 [1] CRAN (R 4.2.0)
tidyselect 1.2.0 2022-10-10 [1] CRAN (R 4.2.0)
utf8 1.2.3 2023-01-31 [1] CRAN (R 4.2.0)
vctrs 0.6.3 2023-06-14 [1] CRAN (R 4.2.0)
[1] /Library/Frameworks/R.framework/Versions/4.2-arm64/Resources/library
```
### Component(s)
R
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] thisisnic commented on issue #36660: [R] count() and tally() don't work with open_dataset()
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #36660:
URL: https://github.com/apache/arrow/issues/36660#issuecomment-1634120653
Sorry, this one completely slipped the net; apologies for the lack of reply, and thanks for following up.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] alearrigo commented on issue #36660: [R] count() and tally() don't work with open_dataset()
Posted by "alearrigo (via GitHub)" <gi...@apache.org>.
alearrigo commented on issue #36660:
URL: https://github.com/apache/arrow/issues/36660#issuecomment-1634119414
I updated to the last release of the arrow library and the problem is now fixed.
I'm closing the issue, sorry!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] alearrigo closed issue #36660: [R] count() and tally() don't work with open_dataset()
Posted by "alearrigo (via GitHub)" <gi...@apache.org>.
alearrigo closed issue #36660: [R] count() and tally() don't work with open_dataset()
URL: https://github.com/apache/arrow/issues/36660
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org