You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Joseph K. Bradley (JIRA)" <ji...@apache.org> on 2016/01/05 23:36:40 UTC

[jira] [Closed] (SPARK-10906) More efficient SparseMatrix.equals

     [ https://issues.apache.org/jira/browse/SPARK-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joseph K. Bradley closed SPARK-10906.
-------------------------------------
          Resolution: Won't Fix
    Target Version/s:   (was: )

We'll fix this in Breeze, rather than in MLlib.

> More efficient SparseMatrix.equals
> ----------------------------------
>
>                 Key: SPARK-10906
>                 URL: https://issues.apache.org/jira/browse/SPARK-10906
>             Project: Spark
>          Issue Type: Improvement
>          Components: MLlib
>            Reporter: Joseph K. Bradley
>            Priority: Minor
>
> SparseMatrix.equals currently uses toBreeze and then calls Breeze's equals method.  However, it looks like Breeze's equals is inefficient: [https://github.com/scalanlp/breeze/blob/1130e0de31948d19225179d8500a8d2d1cc337d0/math/src/main/scala/breeze/linalg/Matrix.scala#L132]
> Breeze iterates over all values, including implicit zeros.  We could make this more efficient.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org