You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2020/01/17 04:42:13 UTC
[spark] branch master updated (4398dfa -> 0bd7a3d)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 4398dfa [SPARK-29188][PYTHON][FOLLOW-UP] Explicitly disable Arrow execution for the test of toPandas empty types
add 0bd7a3d [SPARK-29572][SQL] add v1 read fallback API in DS v2
No new revisions were added by this update.
Summary of changes:
.../spark/sql/connector/InMemoryTableCatalog.scala | 4 +-
.../apache/spark/sql/connector/read/V1Scan.java} | 26 +--
.../spark/sql/connector/write/V1WriteBuilder.java} | 19 +-
.../apache/spark/sql/execution/SparkPlanner.scala | 5 +-
.../spark/sql/execution/SparkStrategies.scala | 2 +-
.../execution/datasources/DataSourceStrategy.scala | 26 ++-
.../datasources/v2/DataSourceV2Strategy.scala | 59 ++++--
.../execution/datasources/v2/PushDownUtils.scala | 10 +-
.../datasources/v2/V2ScanRelationPushDown.scala | 21 ++-
.../execution/streaming/IncrementalExecution.scala | 2 +-
.../sql/internal/BaseSessionStateBuilder.scala | 2 +-
.../spark/sql/connector/V1ReadFallbackSuite.scala | 199 +++++++++++++++++++++
.../spark/sql/hive/HiveSessionStateBuilder.scala | 2 +-
13 files changed, 313 insertions(+), 64 deletions(-)
copy sql/{catalyst/src/main/java/org/apache/spark/sql/connector/read/SupportsReportStatistics.java => core/src/main/java/org/apache/spark/sql/connector/read/V1Scan.java} (55%)
rename sql/core/src/main/{scala/org/apache/spark/sql/connector/write/V1WriteBuilder.scala => java/org/apache/spark/sql/connector/write/V1WriteBuilder.java} (73%)
create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/connector/V1ReadFallbackSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org