You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2020/01/06 15:54:51 UTC

[spark] branch master updated (3eade74 -> 604d679)

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 3eade74  [SPARK-29800][SQL] Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize perf
     add 604d679  [SPARK-30226][SQL] Remove withXXX functions in WriteBuilder

No new revisions were added by this update.

Summary of changes:
 .../org/apache/spark/sql/v2/avro/AvroTable.scala   |  6 ++--
 .../spark/sql/v2/avro/AvroWriteBuilder.scala       |  8 ++---
 .../spark/sql/kafka010/KafkaSourceProvider.scala   | 12 +++-----
 .../spark/sql/connector/catalog/StagedTable.java   | 10 +++----
 .../sql/connector/catalog/StagingTableCatalog.java |  8 ++---
 .../spark/sql/connector/catalog/SupportsWrite.java |  8 ++---
 ...hysicalWriteInfo.java => LogicalWriteInfo.java} | 25 ++++++++++++----
 .../spark/sql/connector/write/WriteBuilder.java    | 23 ---------------
 ...teInfoImpl.scala => LogicalWriteInfoImpl.scala} |  8 ++++-
 .../apache/spark/sql/connector/InMemoryTable.scala |  4 +--
 .../connector/StagingInMemoryTableCatalog.scala    |  6 ++--
 .../datasources/noop/NoopDataSource.scala          |  4 +--
 .../datasources/v2/FileWriteBuilder.scala          | 22 ++++----------
 .../datasources/v2/V1FallbackWriters.scala         | 11 ++++---
 .../datasources/v2/WriteToDataSourceV2Exec.scala   | 34 +++++++++++++---------
 .../execution/datasources/v2/csv/CSVTable.scala    |  6 ++--
 .../datasources/v2/csv/CSVWriteBuilder.scala       |  8 ++---
 .../execution/datasources/v2/json/JsonTable.scala  |  6 ++--
 .../datasources/v2/json/JsonWriteBuilder.scala     |  8 ++---
 .../execution/datasources/v2/orc/OrcTable.scala    |  6 ++--
 .../datasources/v2/orc/OrcWriteBuilder.scala       |  8 ++---
 .../datasources/v2/parquet/ParquetTable.scala      |  6 ++--
 .../v2/parquet/ParquetWriteBuilder.scala           |  9 +++---
 .../execution/datasources/v2/text/TextTable.scala  |  6 ++--
 .../datasources/v2/text/TextWriteBuilder.scala     |  8 ++---
 .../sql/execution/streaming/StreamExecution.scala  | 10 ++++---
 .../spark/sql/execution/streaming/console.scala    | 13 +++------
 .../streaming/sources/ForeachWriterTable.scala     | 12 ++------
 .../sql/execution/streaming/sources/memory.scala   | 12 ++------
 .../connector/FileDataSourceV2FallBackSuite.scala  |  4 +--
 .../sql/connector/SimpleWritableDataSource.scala   | 14 ++++-----
 .../spark/sql/connector/V1WriteFallbackSuite.scala | 14 +++++----
 .../execution/datasources/v2/FileTableSuite.scala  |  4 +--
 .../sources/StreamingDataSourceV2Suite.scala       |  4 +--
 34 files changed, 161 insertions(+), 186 deletions(-)
 copy sql/catalyst/src/main/java/org/apache/spark/sql/connector/write/{PhysicalWriteInfo.java => LogicalWriteInfo.java} (56%)
 copy sql/catalyst/src/main/scala/org/apache/spark/sql/connector/write/{PhysicalWriteInfoImpl.scala => LogicalWriteInfoImpl.scala} (76%)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org