You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/12/07 01:59:00 UTC
[jira] [Resolved] (SPARK-26289) cleanup enablePerfMetrics parameter
from BytesToBytesMap
[ https://issues.apache.org/jira/browse/SPARK-26289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan resolved SPARK-26289.
---------------------------------
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23244
[https://github.com/apache/spark/pull/23244]
> cleanup enablePerfMetrics parameter from BytesToBytesMap
> --------------------------------------------------------
>
> Key: SPARK-26289
> URL: https://issues.apache.org/jira/browse/SPARK-26289
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core, SQL
> Affects Versions: 2.5.0
> Reporter: caoxuewen
> Assignee: caoxuewen
> Priority: Major
> Fix For: 3.0.0
>
>
> enablePerfMetrics was originally designed in BytesToBytesMap to control getNumHashCollisions getTimeSpentResizingNs getAverageProbesPerLookup.
> However, as the Spark version gradual progress. This parameter is only used for getAverageProbesPerLookup and always given to true when using BytesToBytesMap. it is also dangerous to determine whether getAverageProbesPerLookup opens and throws an IllegalStateException exception. So this pr will be remove enablePerfMetrics parameter from BytesToBytesMap. thanks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org