[jira] [Comment Edited] (ARROW-8307) [Python] Expose use_memory_map option in pyarrow.feather APIs

["Wes McKinney (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17073146#comment-17073146 ] 

Wes McKinney edited comment on ARROW-8307 at 4/1/20, 7:52 PM:
--------------------------------------------------------------

It's somewhat unrelated to the name of the parameter, but I'm a bit opposed to globally setting whether to memory map when opening a file at the filesystem level. This would be better handled through a separate filesystem API that allows mapped memory to be requested (and this will either use mmap for local or pull the entire file into memory for remote filesystems). And possibly an attribute of filesystems to indicate whether or not they support zero-copy mapped memory


was (Author: wesmckinn):
It's somewhat unrelated to the name of the parameter, but I'm a bit opposed to globally setting whether to memory map at the filesystem level. This would be better handled through a separate filesystem API that allows mapped memory to be requested (and this will either use mmap for local or pull the entire file into memory for remote filesystems). And possibly an attribute of filesystems to indicate whether or not they support zero-copy mapped memory

> [Python] Expose use_memory_map option in pyarrow.feather APIs
> -------------------------------------------------------------
>
>                 Key: ARROW-8307
>                 URL: https://issues.apache.org/jira/browse/ARROW-8307
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Python
>            Reporter: Wes McKinney
>            Assignee: Wes McKinney
>            Priority: Major
>             Fix For: 0.17.0
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)