You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@systemml.apache.org by "Matthias Boehm (JIRA)" <ji...@apache.org> on 2016/06/03 17:47:59 UTC

[jira] [Resolved] (SYSTEMML-747) Wrong in-memory csv reblock decision w/ unknowns

     [ https://issues.apache.org/jira/browse/SYSTEMML-747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matthias Boehm resolved SYSTEMML-747.
-------------------------------------
       Resolution: Fixed
    Fix Version/s: SystemML 0.11

> Wrong in-memory csv reblock decision w/ unknowns
> ------------------------------------------------
>
>                 Key: SYSTEMML-747
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-747
>             Project: SystemML
>          Issue Type: Bug
>          Components: Runtime
>    Affects Versions: SystemML 0.10
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>             Fix For: SystemML 0.11
>
>
> The decision on cp in-memory reblock for text input matrices is made based on the estimated size in memory. For csv reblock, we support persistent reads with unknown dimension sizes. In scenarios with unknown dimensions the memory estimate is always negative, resulting always in in-memory reblocks which either take very long or even run out of memory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)