You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/02/08 03:05:00 UTC

[jira] [Updated] (ARROW-3777) [Python] Implement a mock "high latency" filesystem

     [ https://issues.apache.org/jira/browse/ARROW-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wes McKinney updated ARROW-3777:
--------------------------------
    Fix Version/s: 0.14.0

> [Python] Implement a mock "high latency" filesystem
> ---------------------------------------------------
>
>                 Key: ARROW-3777
>                 URL: https://issues.apache.org/jira/browse/ARROW-3777
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Python
>            Reporter: Wes McKinney
>            Priority: Major
>              Labels: parquet
>             Fix For: 0.14.0
>
>
> Some of our tools don't perform well out of the box for filesystems with high latency reads, like cloud blob stores. In such cases, it may be better to use buffered reads with a larger read ahead window. Having a mock filesystem to introduce latency into reads will help with testing / developing APIs for this



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)