You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2015/03/05 10:06:39 UTC

[jira] [Comment Edited] (SPARK-6142) 10-12% Performance regression with "finalize"

    [ https://issues.apache.org/jira/browse/SPARK-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14348444#comment-14348444 ] 

Shixiong Zhu edited comment on SPARK-6142 at 3/5/15 9:05 AM:
-------------------------------------------------------------

[~nravi] I tested in our environment, and didn't find any performance lost with `finalize`. Did 10-12% performance regression always happen?


was (Author: zsxwing):
@nishkamravi2 I tested in our environment, and didn't find any performance lost with `finalize`. Did 10-12% performance regression always happen?

> 10-12% Performance regression with "finalize"
> ---------------------------------------------
>
>                 Key: SPARK-6142
>                 URL: https://issues.apache.org/jira/browse/SPARK-6142
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 1.3.0
>            Reporter: Nishkam Ravi
>
> 10-12% performance regression in PageRank (and potentially other workloads) caused due to the use of finalize in ExternalAppendOnlyMap. Introduced by a commit on Feb 19th. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org