[jira] [Commented] (ARROW-3406) [C++] Create a caching memory pool implementation

["Wes McKinney (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-3406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16635865#comment-16635865 ] 

Wes McKinney commented on ARROW-3406:
-------------------------------------

Not really related, but on the subject of other kinds of allocators wanted to make you aware of the chunked allocator that's used (I think) in the Parquet encoding routines https://github.com/apache/parquet-cpp/blob/master/src/parquet/util/memory.h#L100

> [C++] Create a caching memory pool implementation
> -------------------------------------------------
>
>                 Key: ARROW-3406
>                 URL: https://issues.apache.org/jira/browse/ARROW-3406
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>    Affects Versions: 0.11.0
>            Reporter: Antoine Pitrou
>            Priority: Major
>
> A caching memory pool implementation would be able to recycle freed memory blocks instead of returning them to the system immediately. Two different policies may be chosen:
> * either an unbounded cache
> * or a size-limited cache, perhaps with some kind of LRU mechanism
> Such a feature might help e.g. for CSV parsing, when reading and parsing data into temporary memory buffers.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)