[jira] [Commented] (ARROW-17020) [Python][R] GcsFilesystem can appear to hang for non permanent errors

["Will Jones (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-17020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564387#comment-17564387 ] 

Will Jones commented on ARROW-17020:
------------------------------------

FYI [~coryan]

> [Python][R] GcsFilesystem can appear to hang for non permanent errors
> ---------------------------------------------------------------------
>
>                 Key: ARROW-17020
>                 URL: https://issues.apache.org/jira/browse/ARROW-17020
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Python, R
>    Affects Versions: 8.0.0
>            Reporter: Will Jones
>            Priority: Major
>
> GcsFileSystem will attempt to retry if it gets a non-permanent error (such as couldn't connect to server). That's fine, except: (1) the sleep call used by the retry doesn't seem to check for interrupts and (2) the default retry timeout is 15 minutes!
> The following snippets will hang for 15 minutes if you run them and wait about 5 seconds before trying to do a keyboard interrupt (CTRL+C):
> {code:bash}
> Rscript -e 'library(arrow); fs <- GcsFileSystem$create(endpoint_override="localhost:1234", anonymous=TRUE); fs$CreateDir("x")'
> python -c 'from pyarrow.fs import GcsFileSystem; fs = GcsFileSystem(endpoint_override="localhost:1234", anonymous=True); fs.create_dir("x")'
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)