You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yanbo Liang (JIRA)" <ji...@apache.org> on 2016/08/19 03:43:20 UTC

[jira] [Commented] (SPARK-17137) Add compressed support for multinomial logistic regression coefficients

    [ https://issues.apache.org/jira/browse/SPARK-17137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15427563#comment-15427563 ] 

Yanbo Liang commented on SPARK-17137:
-------------------------------------

I think we should provide transparent interface to users rather than exposing a param to control whether output dense/sparse coefficients. Spark MLlib {{Vector.compressed}} returns a vector in either dense or sparse format, whichever uses less storage. I would like to do the performance tests for this issue. Thanks!

> Add compressed support for multinomial logistic regression coefficients
> -----------------------------------------------------------------------
>
>                 Key: SPARK-17137
>                 URL: https://issues.apache.org/jira/browse/SPARK-17137
>             Project: Spark
>          Issue Type: Sub-task
>          Components: ML
>            Reporter: Seth Hendrickson
>            Priority: Minor
>
> For sparse coefficients in MLOR, such as when high L1 regularization, it may be more efficient to store coefficients in compressed format. We can add this option to MLOR and perhaps to do some performance tests to verify improvements.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org