[jira] [Closed] (SYSTEMML-383) Compiler integration sparse matrix blocks

["Matthias Boehm (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SYSTEMML-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matthias Boehm closed SYSTEMML-383.
-----------------------------------

> Compiler integration sparse matrix blocks
> -----------------------------------------
>
>                 Key: SYSTEMML-383
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-383
>             Project: SystemML
>          Issue Type: Task
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>             Fix For: SystemML 0.11
>
>
> Finally, we have to integrate the different types of sparse matrix blocks into our compiler. First, this requires a type-specific computation of memory estimates. Second, we need to define when and how the compiler/runtime decides for a certain sparse matrix format. Since CSR is memory-efficient and allows fast operations at the cost of slow incremental construction and updates, we intend to initially integrate a switch from MCSR to CSR into our checkpoint instructions (potentially with an extension for CP). This will already achieve the major benefits we expect for the Spark backend.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)