[jira] [Created] (ARROW-17064) Python hangs when use pyarrow.fs.copy_files is used with "used_threads=True"

["Alejandro Marco Ramos (Jira)" <ji...@apache.org>]

Alejandro Marco Ramos created ARROW-17064:
---------------------------------------------

             Summary: Python hangs when use pyarrow.fs.copy_files is used with "used_threads=True"
                 Key: ARROW-17064
                 URL: https://issues.apache.org/jira/browse/ARROW-17064
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 8.0.0
            Reporter: Alejandro Marco Ramos


When try to copy a local path to s3 remote filesystem using `pyarrow.fs.copy_files` and using default parameter `use_threads=True`, the system hangs. If use "use_threads=False` the operation must complete ok (but more slow).

 

My code is:
{code:java}
>>> import pyarrow as pa
>>> s3fs=pa.fs.S3FileSystem(endpoint_override="http://xxxxxx")
>>> pa.fs.copy_files("tests/data/payments", "bucket/payments", destination_filesystem=s3fs)
... (don't return){code}
If check remote s3, all files appear, but the function don't return



--
This message was sent by Atlassian Jira
(v8.20.10#820010)