You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Duncan (Jira)" <ji...@apache.org> on 2022/07/12 16:03:00 UTC

[jira] [Created] (ARROW-17057) [Python] S3FileSystem has no parameter for retry strategy

Duncan created ARROW-17057:
------------------------------

             Summary: [Python] S3FileSystem has no parameter for retry strategy
                 Key: ARROW-17057
                 URL: https://issues.apache.org/jira/browse/ARROW-17057
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 8.0.0, 7.0.0, 6.0.1
            Reporter: Duncan


The Python wrapper for S3Fs does not accept a {{retry_strategy}} parameter, but the underlying C++ implementation supports it.

 

Python wrapper's constructor arguments:
[https://github.com/apache/arrow/blob/master/python/pyarrow/_s3fs.pyx#L181]
 
C++ base: [https://github.com/apache/arrow/blob/master/cpp/src/arrow/filesystem/s3fs.cc#L729]
 
The result is that Python users of S3Fs always default to the legacy retry strategy, which is very limited.
 
Suggested fix is to allow the Python wrapper to specify a retry strategy to be passed through to the wrapped C++ implementation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)