You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2019/11/21 16:20:22 UTC
[spark] branch master updated (cdcd43c -> 54c5087)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from cdcd43c [SPARK-29977][SQL] Remove newMutableProjection/newOrdering/newNaturalAscendingOrdering from SparkPlan
add 54c5087 [SPARK-29248][SQL] provider number of partitions when creating v2 data writer factory
No new revisions were added by this update.
Summary of changes:
.../spark/sql/kafka010/KafkaBatchWrite.scala | 4 +--
.../spark/sql/kafka010/KafkaStreamingWrite.scala | 5 ++--
.../spark/sql/connector/write/BatchWrite.java | 8 +++---
.../sql/connector/write/DataWriterFactory.java | 5 ++--
...upportsTruncate.java => PhysicalWriteInfo.java} | 17 +++++++------
.../streaming/StreamingDataWriterFactory.java | 5 ++--
.../connector/write/streaming/StreamingWrite.java | 9 ++++---
.../connector/write/PhysicalWriteInfoImpl.scala | 5 ++--
.../apache/spark/sql/connector/InMemoryTable.scala | 2 +-
.../datasources/noop/NoopDataSource.scala | 9 ++++---
.../execution/datasources/v2/FileBatchWrite.scala | 4 +--
.../datasources/v2/WriteToDataSourceV2Exec.scala | 29 ++++++++++++----------
.../WriteToContinuousDataSourceExec.scala | 7 ++++--
.../execution/streaming/sources/ConsoleWrite.scala | 5 ++--
.../streaming/sources/ForeachWriterTable.scala | 5 ++--
.../streaming/sources/MicroBatchWrite.scala | 6 ++---
.../sql/execution/streaming/sources/memory.scala | 4 +--
.../sql/connector/SimpleWritableDataSource.scala | 2 +-
.../sources/StreamingDataSourceV2Suite.scala | 5 ++--
19 files changed, 77 insertions(+), 59 deletions(-)
copy sql/catalyst/src/main/java/org/apache/spark/sql/connector/write/{SupportsTruncate.java => PhysicalWriteInfo.java} (66%)
copy core/src/main/resources/org/apache/spark/ui/static/initialize-tooltips.js => sql/catalyst/src/main/scala/org/apache/spark/sql/connector/write/PhysicalWriteInfoImpl.scala (85%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org