You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yanbo Liang (JIRA)" <ji...@apache.org> on 2016/09/09 15:45:20 UTC

[jira] [Commented] (SPARK-17471) Add compressed method for Matrix class

    [ https://issues.apache.org/jira/browse/SPARK-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15477376#comment-15477376 ] 

Yanbo Liang commented on SPARK-17471:
-------------------------------------

[~sethah] I think this task is duplicated with SPARK-17137 which will add compressed support for multinomial logistic regression coefficients. I'm working on that one and have some {{Matrix}} compression performance test result. I will post them here for discussion as soon as possible. Thanks!

> Add compressed method for Matrix class
> --------------------------------------
>
>                 Key: SPARK-17471
>                 URL: https://issues.apache.org/jira/browse/SPARK-17471
>             Project: Spark
>          Issue Type: New Feature
>          Components: ML
>            Reporter: Seth Hendrickson
>
> Vectors in Spark have a {{compressed}} method which selects either sparse or dense representation by minimizing storage requirements. Matrices should also have this method, which is now explicitly needed in {{LogisticRegression}} since we have implemented multiclass regression.
> The compressed method should also give the option to store row major or column major, and if nothing is specified should select the lower storage representation (for sparse).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org