You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2020/01/17 04:42:13 UTC

[spark] branch master updated (4398dfa -> 0bd7a3d)

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 4398dfa  [SPARK-29188][PYTHON][FOLLOW-UP] Explicitly disable Arrow execution for the test of toPandas empty types
     add 0bd7a3d  [SPARK-29572][SQL] add v1 read fallback API in DS v2

No new revisions were added by this update.

Summary of changes:
 .../spark/sql/connector/InMemoryTableCatalog.scala |   4 +-
 .../apache/spark/sql/connector/read/V1Scan.java}   |  26 +--
 .../spark/sql/connector/write/V1WriteBuilder.java} |  19 +-
 .../apache/spark/sql/execution/SparkPlanner.scala  |   5 +-
 .../spark/sql/execution/SparkStrategies.scala      |   2 +-
 .../execution/datasources/DataSourceStrategy.scala |  26 ++-
 .../datasources/v2/DataSourceV2Strategy.scala      |  59 ++++--
 .../execution/datasources/v2/PushDownUtils.scala   |  10 +-
 .../datasources/v2/V2ScanRelationPushDown.scala    |  21 ++-
 .../execution/streaming/IncrementalExecution.scala |   2 +-
 .../sql/internal/BaseSessionStateBuilder.scala     |   2 +-
 .../spark/sql/connector/V1ReadFallbackSuite.scala  | 199 +++++++++++++++++++++
 .../spark/sql/hive/HiveSessionStateBuilder.scala   |   2 +-
 13 files changed, 313 insertions(+), 64 deletions(-)
 copy sql/{catalyst/src/main/java/org/apache/spark/sql/connector/read/SupportsReportStatistics.java => core/src/main/java/org/apache/spark/sql/connector/read/V1Scan.java} (55%)
 rename sql/core/src/main/{scala/org/apache/spark/sql/connector/write/V1WriteBuilder.scala => java/org/apache/spark/sql/connector/write/V1WriteBuilder.java} (73%)
 create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/connector/V1ReadFallbackSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org