You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by ya...@apache.org on 2020/06/19 23:22:06 UTC

[spark] branch master updated (a9247c3 -> 7b86838)

This is an automated email from the ASF dual-hosted git repository.

yamamuro pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from a9247c3  [SPARK-32033][SS][DSTEAMS] Use new poll API in Kafka connector executor side to avoid infinite wait
     add 7b86838  [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

No new revisions were added by this update.

Summary of changes:
 .../org/apache/spark/sql/internal/SQLConf.scala    |  20 +++
 .../spark/sql/execution/DataSourceScanExec.scala   |  29 ++-
 .../spark/sql/execution/QueryExecution.scala       |   2 +
 .../bucketing/CoalesceBucketsInSortMergeJoin.scala | 132 ++++++++++++++
 .../execution/datasources/FileSourceStrategy.scala |   1 +
 .../org/apache/spark/sql/DataFrameJoinSuite.scala  |   2 +-
 .../scala/org/apache/spark/sql/ExplainSuite.scala  |  17 ++
 .../scala/org/apache/spark/sql/SubquerySuite.scala |   2 +-
 .../CoalesceBucketsInSortMergeJoinSuite.scala      | 194 +++++++++++++++++++++
 .../spark/sql/sources/BucketedReadSuite.scala      | 137 ++++++++++++++-
 10 files changed, 523 insertions(+), 13 deletions(-)
 create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/bucketing/CoalesceBucketsInSortMergeJoin.scala
 create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/bucketing/CoalesceBucketsInSortMergeJoinSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org