You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Min Shen (Jira)" <ji...@apache.org> on 2020/09/17 17:25:00 UTC

[jira] [Created] (SPARK-32917) Add support for executors to push shuffle blocks after successful map task completion

Min Shen created SPARK-32917:
--------------------------------

             Summary: Add support for executors to push shuffle blocks after successful map task completion
                 Key: SPARK-32917
                 URL: https://issues.apache.org/jira/browse/SPARK-32917
             Project: Spark
          Issue Type: Sub-task
          Components: Shuffle, Spark Core
    Affects Versions: 3.1.0
            Reporter: Min Shen


This is the shuffle write path for push-based shuffle, where the executors would leverage the RPC protocol to push shuffle blocks to remote shuffle services.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org