You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2018/11/13 14:42:00 UTC

[jira] [Created] (ARROW-3777) [Python] Implement a mock "high latency" filesystem

Wes McKinney created ARROW-3777:
-----------------------------------

             Summary: [Python] Implement a mock "high latency" filesystem
                 Key: ARROW-3777
                 URL: https://issues.apache.org/jira/browse/ARROW-3777
             Project: Apache Arrow
          Issue Type: New Feature
          Components: Python
            Reporter: Wes McKinney


Some of our tools don't perform well out of the box for filesystems with high latency reads, like cloud blob stores. In such cases, it may be better to use buffered reads with a larger read ahead window. Having a mock filesystem to introduce latency into reads will help with testing / developing APIs for this



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)