You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Arun Joseph (Jira)" <ji...@apache.org> on 2021/07/12 20:21:00 UTC

[jira] [Created] (ARROW-13317) [Python] Improve documentation on what 'use_threads' does in 'read_feather'

Arun Joseph created ARROW-13317:
-----------------------------------

             Summary: [Python] Improve documentation on what 'use_threads' does in 'read_feather'
                 Key: ARROW-13317
                 URL: https://issues.apache.org/jira/browse/ARROW-13317
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Python
    Affects Versions: 4.0.1
            Reporter: Arun Joseph


The current documentation for [read_feather|https://arrow.apache.org/docs/python/generated/pyarrow.feather.read_feather.html] states the following:

*use_threads* (_bool__,_ _default True_) – Whether to parallelize reading using multiple threads.

if the underlying file uses compression, then multiple threads will still be spawned. The verbiage of the `use_threads` is ambiguous that the restriction on multiple threads is only for the conversion from pyarrow to the pandas dataframe vs the reading/decompression of the file itself which might spawn additional threads.

[set_cpu_count|http://arrow.apache.org/docs/python/generated/pyarrow.set_cpu_count.html#pyarrow.set_cpu_count] might good to mention as well



--
This message was sent by Atlassian Jira
(v8.3.4#803005)