[jira] [Commented] (SPARK-26289) cleanup enablePerfMetrics parameter from BytesToBytesMap

["Apache Spark (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-26289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16711112#comment-16711112 ] 

Apache Spark commented on SPARK-26289:
--------------------------------------

User 'heary-cao' has created a pull request for this issue:
https://github.com/apache/spark/pull/23244

> cleanup enablePerfMetrics parameter from BytesToBytesMap
> --------------------------------------------------------
>
>                 Key: SPARK-26289
>                 URL: https://issues.apache.org/jira/browse/SPARK-26289
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core, SQL
>    Affects Versions: 2.5.0
>            Reporter: caoxuewen
>            Priority: Major
>
> enablePerfMetrics was originally designed in BytesToBytesMap to control getNumHashCollisions getTimeSpentResizingNs getAverageProbesPerLookup.
> However, as the Spark version gradual progress. This parameter is only used for getAverageProbesPerLookup and always given to true when using BytesToBytesMap. it is also dangerous to determine whether getAverageProbesPerLookup opens and throws an IllegalStateException exception. So this pr will be remove enablePerfMetrics parameter from BytesToBytesMap. thanks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org