[jira] [Commented] (ARROW-16211) [C++][Python] Unregister compute functions

["Weston Pace (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-16211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525485#comment-17525485 ] 

Weston Pace commented on ARROW-16211:
-------------------------------------

Another task we should tackle as part of this PR that came up during the discussion of ARROW-15639: https://github.com/apache/arrow/pull/12590#discussion_r854069757

If python is finalized then any python UDFs that have been registered will be invalid.  We should consider adding an atexit hook to pyarrow which unregisters all python UDFs.

This is something of a corner case, as finalization usually happens at process exit, but in some cases users may have multiple python interpreters or be restarting the python interpreter.

> [C++][Python] Unregister compute functions
> ------------------------------------------
>
>                 Key: ARROW-16211
>                 URL: https://issues.apache.org/jira/browse/ARROW-16211
>             Project: Apache Arrow
>          Issue Type: Sub-task
>          Components: C++, Python
>            Reporter: Vibhatha Lakmal Abeykoon
>            Assignee: Vibhatha Lakmal Abeykoon
>            Priority: Major
>
> In general, when using UDFs, the user defines a function expecting a particular outcome. When building the program, there needs to be a way to update existing function kernels if it expands beyond what is planned before. In such situations, there should be a way to remove the existing definition and add a new definition. To enable this, the unregister functionality has to be included. 



--
This message was sent by Atlassian Jira
(v8.20.7#820007)