[jira] [Created] (SYSTEMML-2234) Memory leak buffer pool due to missing variable cleanup

["Matthias Boehm (JIRA)" <ji...@apache.org>]

Matthias Boehm created SYSTEMML-2234:
----------------------------------------

             Summary: Memory leak buffer pool due to missing variable cleanup
                 Key: SYSTEMML-2234
                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2234
             Project: SystemML
          Issue Type: Task
            Reporter: Matthias Boehm


There are scenarios where variables are not properly cleaned up before assigning new matrices to logical variable names. This missing cleanup leads to a memory leak in the buffer pool, which in turn leads to unnecessary evictions and missing cleanup of FS and HDFS files.

After a closer investigation, this issue occurs for special cases of function calls that have a peculiar control flow structure that prevents rmvar instructions for certain intermediates and thus requires cleanup of these intermediates after the function call. Furthermore, a similar issue occurs for loops with dedicated update-in place variables. 




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)