You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2021/10/26 12:07:00 UTC

[jira] [Created] (ARROW-14470) [Python] Expose the use_threads option in Feather read functions

Joris Van den Bossche created ARROW-14470:
---------------------------------------------

             Summary: [Python] Expose the use_threads option in Feather read functions
                 Key: ARROW-14470
                 URL: https://issues.apache.org/jira/browse/ARROW-14470
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Python
            Reporter: Joris Van den Bossche


On the C++ side, the Feather V2 Reader wraps the IPC RecordBatchFileReader, which accepts IpcReadOptions which can control the use of threads (and the default memory pool and some other options). 

On the Python (cython) side, those options are not passed through. As a consequence the {{use_threads}} keyword only disables multithreading in the conversion from arrow table to pandas DataFrame, and not the actual reading. As a follow-up on ARROW-13317, we can actually make this keyword control both.p



--
This message was sent by Atlassian Jira
(v8.3.4#803005)