You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2020/01/06 15:54:51 UTC
[spark] branch master updated (3eade74 -> 604d679)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 3eade74 [SPARK-29800][SQL] Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf
add 604d679 [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/sql/v2/avro/AvroTable.scala | 6 ++--
.../spark/sql/v2/avro/AvroWriteBuilder.scala | 8 ++---
.../spark/sql/kafka010/KafkaSourceProvider.scala | 12 +++-----
.../spark/sql/connector/catalog/StagedTable.java | 10 +++----
.../sql/connector/catalog/StagingTableCatalog.java | 8 ++---
.../spark/sql/connector/catalog/SupportsWrite.java | 8 ++---
...hysicalWriteInfo.java => LogicalWriteInfo.java} | 25 ++++++++++++----
.../spark/sql/connector/write/WriteBuilder.java | 23 ---------------
...teInfoImpl.scala => LogicalWriteInfoImpl.scala} | 8 ++++-
.../apache/spark/sql/connector/InMemoryTable.scala | 4 +--
.../connector/StagingInMemoryTableCatalog.scala | 6 ++--
.../datasources/noop/NoopDataSource.scala | 4 +--
.../datasources/v2/FileWriteBuilder.scala | 22 ++++----------
.../datasources/v2/V1FallbackWriters.scala | 11 ++++---
.../datasources/v2/WriteToDataSourceV2Exec.scala | 34 +++++++++++++---------
.../execution/datasources/v2/csv/CSVTable.scala | 6 ++--
.../datasources/v2/csv/CSVWriteBuilder.scala | 8 ++---
.../execution/datasources/v2/json/JsonTable.scala | 6 ++--
.../datasources/v2/json/JsonWriteBuilder.scala | 8 ++---
.../execution/datasources/v2/orc/OrcTable.scala | 6 ++--
.../datasources/v2/orc/OrcWriteBuilder.scala | 8 ++---
.../datasources/v2/parquet/ParquetTable.scala | 6 ++--
.../v2/parquet/ParquetWriteBuilder.scala | 9 +++---
.../execution/datasources/v2/text/TextTable.scala | 6 ++--
.../datasources/v2/text/TextWriteBuilder.scala | 8 ++---
.../sql/execution/streaming/StreamExecution.scala | 10 ++++---
.../spark/sql/execution/streaming/console.scala | 13 +++------
.../streaming/sources/ForeachWriterTable.scala | 12 ++------
.../sql/execution/streaming/sources/memory.scala | 12 ++------
.../connector/FileDataSourceV2FallBackSuite.scala | 4 +--
.../sql/connector/SimpleWritableDataSource.scala | 14 ++++-----
.../spark/sql/connector/V1WriteFallbackSuite.scala | 14 +++++----
.../execution/datasources/v2/FileTableSuite.scala | 4 +--
.../sources/StreamingDataSourceV2Suite.scala | 4 +--
34 files changed, 161 insertions(+), 186 deletions(-)
copy sql/catalyst/src/main/java/org/apache/spark/sql/connector/write/{PhysicalWriteInfo.java => LogicalWriteInfo.java} (56%)
copy sql/catalyst/src/main/scala/org/apache/spark/sql/connector/write/{PhysicalWriteInfoImpl.scala => LogicalWriteInfoImpl.scala} (76%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org