You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Seth Hendrickson (JIRA)" <ji...@apache.org> on 2016/08/16 17:49:21 UTC

[jira] [Commented] (SPARK-17090) Make tree aggregation level in linear/logistic regression configurable

    [ https://issues.apache.org/jira/browse/SPARK-17090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15423151#comment-15423151 ] 

Seth Hendrickson commented on SPARK-17090:
------------------------------------------

cc [~dbtsai]

> Make tree aggregation level in linear/logistic regression configurable
> ----------------------------------------------------------------------
>
>                 Key: SPARK-17090
>                 URL: https://issues.apache.org/jira/browse/SPARK-17090
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML
>            Reporter: Seth Hendrickson
>            Priority: Minor
>
> Linear/logistic regression use treeAggregate with default aggregation depth for collecting coefficient gradient updates to the driver. For high dimensional problems, this can case OOM error on the driver. We should make it configurable, perhaps via an expert param, so that users can avoid this problem if their data has many features.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org