[jira] [Commented] (SPARK-3418) [MLlib] Additional BLAS and Local Sparse Matrix support

["Apache Spark (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123634#comment-14123634 ] 

Apache Spark commented on SPARK-3418:
-------------------------------------

User 'brkyvz' has created a pull request for this issue:
https://github.com/apache/spark/pull/2294

> [MLlib] Additional BLAS and Local Sparse Matrix support
> -------------------------------------------------------
>
>                 Key: SPARK-3418
>                 URL: https://issues.apache.org/jira/browse/SPARK-3418
>             Project: Spark
>          Issue Type: New Feature
>          Components: MLlib
>            Reporter: Burak Yavuz
>
> Currently MLlib doesn't have Level-2 and Level-3 BLAS support. For Multi-Model training, adding support for Level-3 BLAS functions is vital.
> In addition, as most real data is sparse, support for Local Sparse Matrices will also be added, as supporting sparse matrices will save a lot of memory and will lead to better performance. The ability to left multiply a dense matrix with a sparse matrix, i.e. `C := alpha * A * B + beta * C` where `A` is a sparse matrix will also be added. However, `B` and `C` will remain as Dense Matrices for now.
> I will post performance comparisons with other libraries that support sparse matrices such as Breeze and Matrix-toolkits-JAVA (MTJ) in the comments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org