You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2021/10/26 12:07:00 UTC
[jira] [Created] (ARROW-14470) [Python] Expose the use_threads
option in Feather read functions
Joris Van den Bossche created ARROW-14470:
---------------------------------------------
Summary: [Python] Expose the use_threads option in Feather read functions
Key: ARROW-14470
URL: https://issues.apache.org/jira/browse/ARROW-14470
Project: Apache Arrow
Issue Type: Improvement
Components: Python
Reporter: Joris Van den Bossche
On the C++ side, the Feather V2 Reader wraps the IPC RecordBatchFileReader, which accepts IpcReadOptions which can control the use of threads (and the default memory pool and some other options).
On the Python (cython) side, those options are not passed through. As a consequence the {{use_threads}} keyword only disables multithreading in the conversion from arrow table to pandas DataFrame, and not the actual reading. As a follow-up on ARROW-13317, we can actually make this keyword control both.p
--
This message was sent by Atlassian Jira
(v8.3.4#803005)