You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Marius van Niekerk (Jira)" <ji...@apache.org> on 2020/10/30 18:07:00 UTC

[jira] [Created] (ARROW-10433) [Python] pyarrow doesn't work with s3fs>=0.5

Marius van Niekerk created ARROW-10433:
------------------------------------------

             Summary: [Python] pyarrow doesn't work with s3fs>=0.5
                 Key: ARROW-10433
                 URL: https://issues.apache.org/jira/browse/ARROW-10433
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
            Reporter: Marius van Niekerk


s3fs has moved to using asyncio underneath. 

Unfortunately pyarrow relies on internal private methods

as see https://github.com/apache/arrow/blob/apache-arrow-2.0.0/python/pyarrow/filesystem.py

```
for key in list(self.fs._ls(path, refresh=refresh)):
```

this _ls has been changed to be an asynchronous coroutine

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)