You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/11/14 15:26:00 UTC
[jira] [Resolved] (SPARK-25868) One part of Spark MLlib Kmean Logic
Performance problem
[ https://issues.apache.org/jira/browse/SPARK-25868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-25868.
-------------------------------
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22893
[https://github.com/apache/spark/pull/22893]
> One part of Spark MLlib Kmean Logic Performance problem
> -------------------------------------------------------
>
> Key: SPARK-25868
> URL: https://issues.apache.org/jira/browse/SPARK-25868
> Project: Spark
> Issue Type: Improvement
> Components: MLlib
> Affects Versions: 2.3.2
> Reporter: Liang Li
> Assignee: Liang Li
> Priority: Minor
> Fix For: 3.0.0
>
>
> In function fastSquaredDistance, there is a low performance logic:
> the sqDist = Vectors.sqdist(v1, v2) is better than sqDist = sumSquaredNorm - 2.0 * dot(v1, v2) in calculation performance
> So get rid of the low performance login in function fastSquaredDistance.
> More test(End-to-End, function) situation can be found in https://github.com/apache/spark/pull/22893
> Already update a patch #22893 for merge
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org