[jira] [Resolved] (ASTERIXDB-1339) Have a dynamically allocate memory management for in-memory components

["Michael Blow (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ASTERIXDB-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Blow resolved ASTERIXDB-1339.
-------------------------------------
    Resolution: Duplicate

> Have a dynamically allocate memory management for in-memory components
> ----------------------------------------------------------------------
>
>                 Key: ASTERIXDB-1339
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1339
>             Project: Apache AsterixDB
>          Issue Type: Improvement
>          Components: Storage
>            Reporter: Jianfeng Jia
>            Assignee: Michael Blow
>
> Each dataset has a fixed budget no matter how small/big it is. Then the number of datasets can be loaded at the same time is also fixed by $number = storage.memorycomponent.globalbudget/storage.memorycomponent.numpages.
> Is it possible that all those datasets share a global budget in a multi-tenant way? The ideal case is there is only one dynamically memory allocation manager with one global upper-bound, and all datasets can share the space without an extra bound per dataset. 
> From Yingyi:
> In the current implementation, we pre-allocate all in-memory pages
> upfront:
> https://github.com/apache/incubator-asterixdb-hyracks/blob/master/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/VirtualBufferCache.java#L247
> I think we should fix it to dynamically allocate memory when needed.  (Disk
> buffer cache already does that.)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)