You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "wangjiaochun (JIRA)" <ji...@apache.org> on 2019/03/18 09:18:00 UTC

[jira] [Created] (SPARK-27186) Optimize SortShuffleWriter writing process

wangjiaochun created SPARK-27186:
------------------------------------

             Summary: Optimize SortShuffleWriter writing process
                 Key: SPARK-27186
                 URL: https://issues.apache.org/jira/browse/SPARK-27186
             Project: Spark
          Issue Type: Improvement
          Components: Shuffle
    Affects Versions: 3.0.0
            Reporter: wangjiaochun
             Fix For: 3.0.0


If the SortShuffleWriter.write method records is empty, it should be return directly and no need to keep running，refer to the process of BypassMergeSortShuffleWriter.write. Here are the benefits of create Instance ExternalSorter and tmp file. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org