You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Arun Joseph (Jira)" <ji...@apache.org> on 2021/07/12 20:21:00 UTC
[jira] [Created] (ARROW-13317) [Python] Improve documentation on
what 'use_threads' does in 'read_feather'
Arun Joseph created ARROW-13317:
-----------------------------------
Summary: [Python] Improve documentation on what 'use_threads' does in 'read_feather'
Key: ARROW-13317
URL: https://issues.apache.org/jira/browse/ARROW-13317
Project: Apache Arrow
Issue Type: Improvement
Components: Python
Affects Versions: 4.0.1
Reporter: Arun Joseph
The current documentation for [read_feather|https://arrow.apache.org/docs/python/generated/pyarrow.feather.read_feather.html] states the following:
*use_threads* (_bool__,_ _default True_) – Whether to parallelize reading using multiple threads.
if the underlying file uses compression, then multiple threads will still be spawned. The verbiage of the `use_threads` is ambiguous that the restriction on multiple threads is only for the conversion from pyarrow to the pandas dataframe vs the reading/decompression of the file itself which might spawn additional threads.
[set_cpu_count|http://arrow.apache.org/docs/python/generated/pyarrow.set_cpu_count.html#pyarrow.set_cpu_count] might good to mention as well
--
This message was sent by Atlassian Jira
(v8.3.4#803005)