[jira] [Created] (ARROW-17020) [Python][R] GcsFilesystem can appear to hang for non permanent errors

["Will Jones (Jira)" <ji...@apache.org>]

Will Jones created ARROW-17020:
----------------------------------

             Summary: [Python][R] GcsFilesystem can appear to hang for non permanent errors
                 Key: ARROW-17020
                 URL: https://issues.apache.org/jira/browse/ARROW-17020
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python, R
    Affects Versions: 8.0.0
            Reporter: Will Jones


GcsFileSystem will attempt to retry if it gets a non-permanent error (such as couldn't connect to server). That's fine, except: (1) the sleep call used by the retry doesn't seem to check for interrupts and (2) the default retry timeout is 15 minutes!

The following snippets will hang for 15 minutes if you run them and wait about 5 seconds before trying to do a keyboard interrupt (CTRL+C):

{code:bash}
Rscript -e 'library(arrow); fs <- GcsFileSystem$create(endpoint_override="localhost:1234", anonymous=TRUE); fs$CreateDir("x")'

python -c 'from pyarrow.fs import GcsFileSystem; fs = GcsFileSystem(endpoint_override="localhost:1234", anonymous=True); fs.create_dir("x")'
{code}


 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)