[jira] [Comment Edited] (ARROW-14740) [Python] duckdb helper functions

["Joris Van den Bossche (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445716#comment-17445716 ] 

Joris Van den Bossche edited comment on ARROW-14740 at 11/18/21, 8:02 AM:
--------------------------------------------------------------------------

Looking at the R code you linked to now, I see that also for R you are indeed calling the register method of the R duckdb package itself: https://github.com/apache/arrow/blob/641554b0bcce587549bfcfd0cde3cb4bc23054aa/r/R/duckdb.R#L55-L75

But in R you have some additional logic to eg add the group variables, which is something that doesn't exist in Python. So in Python it  might simpler and boil down to:

{code:python}
def to_duckdb(table, con, table_name):
    con.register_arrow(table_name, table)
{code}

EDIT: I see the R version also provides defaults for {{con}} and {{table_name}}.

The {{auto_disconnect}} logic you have in R, is that something relevant for Python as well?



was (Author: jorisvandenbossche):
Looking at the R code you linked to now, I see that also for R you are indeed calling the register method of the R duckdb package itself: https://github.com/apache/arrow/blob/641554b0bcce587549bfcfd0cde3cb4bc23054aa/r/R/duckdb.R#L55-L75

But in R you have some additional logic to eg add the group variables, which is something that doesn't exist in Python. So in Python it  might simpler and boil down to:

{code:python}
def to_duckdb(table, con, table_name):
    con.register_arrow(table_name, table)
{code}

The {{auto_disconnect}} logic you have in R, is that something relevant for Python as well?


> [Python] duckdb helper functions
> --------------------------------
>
>                 Key: ARROW-14740
>                 URL: https://issues.apache.org/jira/browse/ARROW-14740
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Python
>            Reporter: Jonathan Keane
>            Priority: Major
>
> In the R package, [we have an integration with DuckDB|https://github.com/apache/arrow/blob/master/r/R/duckdb.R] that uses the C-Data and C-Stream interface, we include a handful of helper functions that handle the conversion for end users (including setting up the DuckDB connection, registering the arrow data, etc.)
> Should we also have some helper functions in pyarrow?



--
This message was sent by Atlassian Jira
(v8.20.1#820001)