[jira] [Commented] (MNEMONIC-2) Apache Arrow Integration, Phase 1

["Anoop Sam John (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MNEMONIC-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229650#comment-15229650 ] 

Anoop Sam John commented on MNEMONIC-2:
---------------------------------------

So as part of this work, Mnemonics will provide more data structures (Like the netty ByteBuff(s)) ?  Any new Allocator impls also?

Arrow can later integrate Mnemonics and use the new data structures.

> Apache Arrow Integration, Phase 1
> ---------------------------------
>
>                 Key: MNEMONIC-2
>                 URL: https://issues.apache.org/jira/browse/MNEMONIC-2
>             Project: Mnemonic
>          Issue Type: Improvement
>            Reporter: Wang, Gang
>            Assignee: Wang, Gang
>              Labels: features
>
> The Apache Incubator Mnemonic provides a extendable mechanism for managing hybrid memory-like resources & their customized allocation services. 
> Apache Arrow is powering columnar In-memory analytics. Theoretical, Apache Arrow is able to take advantages of Mnemonic and put its columnar dataset on various underlying memory-like devices e.g. SSD, NVMe, Off-heap. 
> In this way, Apache Arrow could manage more columnar data for its applications and even customize its own allocation services according to their special data layouts for better performance as well as improve the generality and leverage Mnemonic coming new features if desired.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)