You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Seth Hendrickson (JIRA)" <ji...@apache.org> on 2016/08/16 17:48:20 UTC

[jira] [Created] (SPARK-17090) Make tree aggregation level in linear/logistic regression configurable

Seth Hendrickson created SPARK-17090:
----------------------------------------

             Summary: Make tree aggregation level in linear/logistic regression configurable
                 Key: SPARK-17090
                 URL: https://issues.apache.org/jira/browse/SPARK-17090
             Project: Spark
          Issue Type: Improvement
          Components: ML
            Reporter: Seth Hendrickson
            Priority: Minor


Linear/logistic regression use treeAggregate with default aggregation depth for collecting coefficient gradient updates to the driver. For high dimensional problems, this can case OOM error on the driver. We should make it configurable, perhaps via an expert param, so that users can avoid this problem if their data has many features.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org