You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Dragoș Moldovan-Grünfeld (Jira)" <ji...@apache.org> on 2022/01/26 11:00:01 UTC
[jira] [Updated] (ARROW-15460) [R] Add as.data.frame.Dataset method
[ https://issues.apache.org/jira/browse/ARROW-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dragoș Moldovan-Grünfeld updated ARROW-15460:
---------------------------------------------
Description:
Started with a question from Jim Hester on Twitter:
bq. Is there a way to take an arrow::Dataset and collect all the data into a data.frame without using `dplyr::collect()`?
bq. I have a code path I just want to return a regular data.frame, but I don't really want to add a soft dplyr dependency just for this.
Twitter thread: https://twitter.com/jimhester_/status/1484624519612579841
This might also be useful for pillar/tibble. Maybe add a {{max_memory_argument}} to avoid allocating to much memory. (see suggestion from Kirill Müller)
was:
Started with a question from Jim Hester on Twitter:
bq. Is there a way to take an arrow::Dataset and collect all the data into a data.frame without using `dplyr::collect()`?
bq. I have a code path I just want to return a regular data.frame, but I don't really want to add a soft dplyr dependency just for this.
Twitter thread: https://twitter.com/jimhester_/status/1484624519612579841?s=21
This might also be useful for pillar/tibble. Maybe add a {{max_memory_argument}} to avoid allocating to much memory. (see suggestion from Kirill Müller)
> [R] Add as.data.frame.Dataset method
> ------------------------------------
>
> Key: ARROW-15460
> URL: https://issues.apache.org/jira/browse/ARROW-15460
> Project: Apache Arrow
> Issue Type: New Feature
> Components: R
> Reporter: Dragoș Moldovan-Grünfeld
> Priority: Major
>
> Started with a question from Jim Hester on Twitter:
> bq. Is there a way to take an arrow::Dataset and collect all the data into a data.frame without using `dplyr::collect()`?
> bq. I have a code path I just want to return a regular data.frame, but I don't really want to add a soft dplyr dependency just for this.
> Twitter thread: https://twitter.com/jimhester_/status/1484624519612579841
> This might also be useful for pillar/tibble. Maybe add a {{max_memory_argument}} to avoid allocating to much memory. (see suggestion from Kirill Müller)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)