You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2020/12/02 08:54:00 UTC

[jira] [Commented] (ARROW-10784) [Python] Loading pyarrow.compute isn't thread safe

    [ https://issues.apache.org/jira/browse/ARROW-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17242178#comment-17242178 ] 

Antoine Pitrou commented on ARROW-10784:
----------------------------------------

I don't understand how this can happen, and I'm not unable to reproduce. Do you saw this in the wild? Do you have more precise symptoms? (a traceback perhaps?)

> [Python] Loading pyarrow.compute isn't thread safe
> --------------------------------------------------
>
>                 Key: ARROW-10784
>                 URL: https://issues.apache.org/jira/browse/ARROW-10784
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Python
>    Affects Versions: 2.0.0
>            Reporter: Micah Kornfield
>            Priority: Major
>
> When using Arrow in a multithreaded environment it is possible to trigger an initialization race on the pyarrow.compute module when calling Array.flatten.
>  
> Flatten calls _pc() which imports pyarrow compute but if two threads call flatten at the same time is possible that the global initialization of functions from the registry will be incomplete and therefore cause an AttributeError.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)