You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2020/12/22 08:28:46 UTC

[spark] branch master updated (1dd63dc -> 2562183)

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 1dd63dc  [SPARK-33860][SQL] Make CatalystTypeConverters.convertToCatalyst match special Array value
     add 2562183  [SPARK-33808][SQL] DataSource V2: Build logical writes in the optimizer

No new revisions were added by this update.

Summary of changes:
 project/MimaExcludes.scala                         |  2 +
 .../sql/connector/catalog/TableCapability.java     |  2 +-
 .../sql/catalyst/plans/logical/v2Commands.scala    | 10 ++-
 .../apache/spark/sql/connector/write/V1Write.java} | 22 ++---
 .../spark/sql/connector/write/V1WriteBuilder.java  | 45 ----------
 .../spark/sql/execution/SparkOptimizer.scala       |  7 +-
 .../datasources/v2/DataSourceV2Strategy.scala      | 56 +++++++------
 .../datasources/v2/TableCapabilityCheck.scala      |  6 +-
 .../datasources/v2/V1FallbackWriters.scala         | 66 +++------------
 .../sql/execution/datasources/v2/V2Writes.scala    | 95 ++++++++++++++++++++++
 .../datasources/v2/WriteToDataSourceV2Exec.scala   | 72 +++++-----------
 .../datasources/v2/jdbc/JDBCWriteBuilder.scala     |  6 +-
 .../spark/sql/connector/V1WriteFallbackSuite.scala | 12 +--
 .../execution/command/PlanResolutionSuite.scala    |  2 +-
 14 files changed, 199 insertions(+), 204 deletions(-)
 copy sql/{catalyst/src/main/java/org/apache/spark/sql/connector/write/SupportsTruncate.java => core/src/main/java/org/apache/spark/sql/connector/write/V1Write.java} (64%)
 delete mode 100644 sql/core/src/main/java/org/apache/spark/sql/connector/write/V1WriteBuilder.java
 create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V2Writes.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org