You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "DB Tsai (JIRA)" <ji...@apache.org> on 2016/09/21 07:29:20 UTC
[jira] [Commented] (SPARK-17134) Use level 2 BLAS operations in
LogisticAggregator
[ https://issues.apache.org/jira/browse/SPARK-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15509053#comment-15509053 ]
DB Tsai commented on SPARK-17134:
---------------------------------
I'm benchmarking MLOR with 22533 of classes, and dense feature of 100. The number of instances are 200M. On a cluster with 1k executors, it takes 2.5 hours for one iteration. Will be great that we can do some performance investigation to see if we can push the performance further. Thanks.
> Use level 2 BLAS operations in LogisticAggregator
> -------------------------------------------------
>
> Key: SPARK-17134
> URL: https://issues.apache.org/jira/browse/SPARK-17134
> Project: Spark
> Issue Type: Sub-task
> Components: ML
> Reporter: Seth Hendrickson
>
> Multinomial logistic regression uses LogisticAggregator class for gradient updates. We should look into refactoring MLOR to use level 2 BLAS operations for the updates. Performance testing should be done to show improvements.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org