You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yuming Wang (JIRA)" <ji...@apache.org> on 2019/03/18 09:53:01 UTC
[jira] [Commented] (SPARK-27186) Optimize SortShuffleWriter writing
process
[ https://issues.apache.org/jira/browse/SPARK-27186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794881#comment-16794881 ]
Yuming Wang commented on SPARK-27186:
-------------------------------------
Please avoid to set {{Fix Version/s}} which is usually reserved for committers.
> Optimize SortShuffleWriter writing process
> ------------------------------------------
>
> Key: SPARK-27186
> URL: https://issues.apache.org/jira/browse/SPARK-27186
> Project: Spark
> Issue Type: Improvement
> Components: Shuffle
> Affects Versions: 3.0.0
> Reporter: wangjiaochun
> Priority: Minor
> Fix For: 3.0.0
>
>
> If the SortShuffleWriter.write method records is empty, it should be return directly and no need to keep running，refer to the process of BypassMergeSortShuffleWriter.write. Here are the benefits of create Instance ExternalSorter and tmp file.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org