You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by do...@apache.org on 2020/06/22 02:48:45 UTC

[spark] branch master updated (9f8e15b -> aa4c100)

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 9f8e15b  [SPARK-32034][SQL] Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown
     add aa4c100  [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

No new revisions were added by this update.

Summary of changes:
 .../spark/shuffle/api/ShuffleMapOutputWriter.java  | 12 +++-
 .../api/metadata/MapOutputCommitMessage.java       | 64 ++++++++++++++++++++++
 .../api/metadata/MapOutputMetadata.java}           | 15 ++---
 .../shuffle/sort/BypassMergeSortShuffleWriter.java |  4 +-
 .../spark/shuffle/sort/UnsafeShuffleWriter.java    |  4 +-
 .../sort/io/LocalDiskShuffleMapOutputWriter.java   |  5 +-
 .../spark/shuffle/sort/SortShuffleWriter.scala     |  2 +-
 .../io/LocalDiskShuffleMapOutputWriterSuite.scala  |  2 +-
 8 files changed, 90 insertions(+), 18 deletions(-)
 create mode 100644 core/src/main/java/org/apache/spark/shuffle/api/metadata/MapOutputCommitMessage.java
 copy core/src/main/java/org/apache/spark/{api/java/function/ForeachFunction.java => shuffle/api/metadata/MapOutputMetadata.java} (71%)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org