You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2020/01/31 05:39:07 UTC
[spark] branch master updated (ca3a64b -> 9f42be2)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from ca3a64b [SPARK-30481][CORE][FOLLOWUP] Execute log compaction only when merge application listing is successful
add 9f42be2 [SPARK-29665][SQL] refine the TableProvider interface
No new revisions were added by this update.
Summary of changes:
.../spark/sql/kafka010/KafkaSourceProvider.scala | 3 +-
.../spark/sql/connector/catalog/TableProvider.java | 57 ++++++++++++++++------
.../sql/connector/catalog/CatalogV2Implicits.scala | 5 +-
.../internal/connector/SimpleTableProvider.scala | 50 +++++++++++++++++++
.../org/apache/spark/sql/DataFrameReader.scala | 6 +--
.../org/apache/spark/sql/DataFrameWriter.scala | 23 +++++++--
.../datasources/noop/NoopDataSource.scala | 5 +-
.../datasources/v2/DataSourceV2Utils.scala | 28 ++++++++++-
.../datasources/v2/FileDataSourceV2.scala | 42 +++++++++++++++-
.../sql/execution/datasources/v2/FileTable.scala | 2 +-
.../spark/sql/execution/streaming/console.scala | 5 +-
.../spark/sql/execution/streaming/memory.scala | 5 +-
.../streaming/sources/RateStreamProvider.scala | 5 +-
.../sources/TextSocketSourceProvider.scala | 5 +-
.../spark/sql/streaming/DataStreamReader.scala | 10 ++--
.../spark/sql/streaming/DataStreamWriter.scala | 10 ++--
.../sql/connector/JavaAdvancedDataSourceV2.java | 6 +--
.../sql/connector/JavaColumnarDataSourceV2.java | 4 +-
.../connector/JavaPartitionAwareDataSource.java | 4 +-
.../connector/JavaReportStatisticsDataSource.java | 4 +-
.../connector/JavaSchemaRequiredDataSource.java | 21 +++++---
.../spark/sql/connector/JavaSimpleBatchTable.java | 3 +-
.../sql/connector/JavaSimpleDataSourceV2.java | 4 +-
.../spark/sql/connector/JavaSimpleScanBuilder.java | 3 +-
.../DataSourceV2DataFrameSessionCatalogSuite.scala | 8 +--
.../spark/sql/connector/DataSourceV2SQLSuite.scala | 3 +-
.../spark/sql/connector/DataSourceV2Suite.scala | 48 +++++++++++++-----
.../sql/connector/SimpleWritableDataSource.scala | 5 +-
.../connector/SupportsCatalogOptionsSuite.scala | 4 +-
.../sql/connector/TableCapabilityCheckSuite.scala | 8 +--
.../spark/sql/connector/V1ReadFallbackSuite.scala | 3 +-
.../spark/sql/connector/V1WriteFallbackSuite.scala | 5 +-
.../execution/command/PlanResolutionSuite.scala | 4 +-
.../streaming/sources/TextSocketStreamSuite.scala | 3 +-
.../sources/StreamingDataSourceV2Suite.scala | 19 ++++----
.../sql/streaming/util/BlockOnStopSource.scala | 5 +-
36 files changed, 308 insertions(+), 117 deletions(-)
create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/internal/connector/SimpleTableProvider.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org