You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Dragoș Moldovan-Grünfeld (Jira)" <ji...@apache.org> on 2022/01/26 11:00:01 UTC

[jira] [Updated] (ARROW-15460) [R] Add as.data.frame.Dataset method

     [ https://issues.apache.org/jira/browse/ARROW-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dragoș Moldovan-Grünfeld updated ARROW-15460:
---------------------------------------------
    Description: 
Started with a question from Jim Hester on Twitter:

bq. Is there a way to take an arrow::Dataset and collect all the data into a data.frame without using `dplyr::collect()`?

bq. I have a code path I just want to return a regular data.frame, but I don't really want to add a soft dplyr dependency just for this.

Twitter thread: https://twitter.com/jimhester_/status/1484624519612579841

This might also be useful for pillar/tibble. Maybe add a {{max_memory_argument}} to avoid allocating to much memory. (see suggestion from Kirill Müller)

  was:
Started with a question from Jim Hester on Twitter:

bq. Is there a way to take an arrow::Dataset and collect all the data into a data.frame without using `dplyr::collect()`?

bq. I have a code path I just want to return a regular data.frame, but I don't really want to add a soft dplyr dependency just for this.

Twitter thread: https://twitter.com/jimhester_/status/1484624519612579841?s=21

This might also be useful for pillar/tibble. Maybe add a {{max_memory_argument}} to avoid allocating to much memory. (see suggestion from Kirill Müller)


> [R] Add as.data.frame.Dataset method
> ------------------------------------
>
>                 Key: ARROW-15460
>                 URL: https://issues.apache.org/jira/browse/ARROW-15460
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: R
>            Reporter: Dragoș Moldovan-Grünfeld
>            Priority: Major
>
> Started with a question from Jim Hester on Twitter:
> bq. Is there a way to take an arrow::Dataset and collect all the data into a data.frame without using `dplyr::collect()`?
> bq. I have a code path I just want to return a regular data.frame, but I don't really want to add a soft dplyr dependency just for this.
> Twitter thread: https://twitter.com/jimhester_/status/1484624519612579841
> This might also be useful for pillar/tibble. Maybe add a {{max_memory_argument}} to avoid allocating to much memory. (see suggestion from Kirill Müller)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)