You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/02/07 21:48:00 UTC
[jira] [Resolved] (SPARK-23349) Duplicate and redundant type
determination for ShuffleManager Object
[ https://issues.apache.org/jira/browse/SPARK-23349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-23349.
-------------------------------
Resolution: Won't Fix
Fix Version/s: (was: 2.2.1)
> Duplicate and redundant type determination for ShuffleManager Object
> --------------------------------------------------------------------
>
> Key: SPARK-23349
> URL: https://issues.apache.org/jira/browse/SPARK-23349
> Project: Spark
> Issue Type: Improvement
> Components: Shuffle, SQL
> Affects Versions: 2.2.1
> Reporter: Phoenix_Daddy
> Priority: Minor
>
> org.apache.spark.sql.execution.exchange.ShuffleExchange
> In the "needtocopyobjectsbeforguffle()" function，there is a nested "if or else" branch .
> The <sortBasedShufffleOn> condition in the first layer "if" has the same value as the <bypassIsSupported> condition in the second layer "if", that is, <bypassIsSupported> must be true when <sortBasedShufffleOn> is true.
> In addition, the <byPassMergeThreshold> condition will be used in the second layer "if" and should not be calculated until needed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org