[jira] [Commented] (ARROW-17057) [Python] S3FileSystem has no parameter for retry strategy

["Kouhei Sutou (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-17057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566011#comment-17566011 ] 

Kouhei Sutou commented on ARROW-17057:
--------------------------------------

Do you want to open a pull request with the suggested fix?

> [Python] S3FileSystem has no parameter for retry strategy
> ---------------------------------------------------------
>
>                 Key: ARROW-17057
>                 URL: https://issues.apache.org/jira/browse/ARROW-17057
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Python
>    Affects Versions: 6.0.1, 7.0.0, 8.0.0
>            Reporter: Duncan
>            Priority: Major
>
> The Python wrapper for S3Fs does not accept a {{retry_strategy}} parameter, but the underlying C++ implementation supports it.
>  
> Python wrapper's constructor arguments:
> [https://github.com/apache/arrow/blob/master/python/pyarrow/_s3fs.pyx#L181]
>  
> C++ base: [https://github.com/apache/arrow/blob/master/cpp/src/arrow/filesystem/s3fs.cc#L729]
>  
> The result is that Python users of S3Fs always default to the legacy retry strategy, which is very limited.
>  
> Suggested fix is to allow the Python wrapper to specify a retry strategy to be passed through to the wrapped C++ implementation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)