You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Matthias Boehm (JIRA)" <ji...@apache.org> on 2016/09/28 22:01:21 UTC

[jira] [Updated] (SYSTEMML-968) Missing bufferpool eviction of frames

     [ https://issues.apache.org/jira/browse/SYSTEMML-968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matthias Boehm updated SYSTEMML-968:
------------------------------------
    Description: 
Frames have been integrated into the buffer pool. However, the implementation of getInMemorySize and getExactSerializedSize always returns 1 which means that frame are effectively never evicted. This is problematic as it leads to out-of-memory errors. 

This task tracks the proper full integration of frames into the buffer pool which entails (1) an implementation of size estimation methods, and (2) the fix of the input/output code path in order to prevent the usage of FastBufferDataInputStream and FastBufferedDataOutputStream for frames because these streams do not implement readUTF/writeUTF.

> Missing bufferpool eviction of frames
> -------------------------------------
>
>                 Key: SYSTEMML-968
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-968
>             Project: SystemML
>          Issue Type: Bug
>    Affects Versions: SystemML 0.11
>            Reporter: Matthias Boehm
>            Priority: Blocker
>
> Frames have been integrated into the buffer pool. However, the implementation of getInMemorySize and getExactSerializedSize always returns 1 which means that frame are effectively never evicted. This is problematic as it leads to out-of-memory errors. 
> This task tracks the proper full integration of frames into the buffer pool which entails (1) an implementation of size estimation methods, and (2) the fix of the input/output code path in order to prevent the usage of FastBufferDataInputStream and FastBufferedDataOutputStream for frames because these streams do not implement readUTF/writeUTF.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)