You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2021/05/13 17:24:02 UTC
[spark] branch master updated (c2e15cc -> 6aa2594)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from c2e15cc [SPARK-35062][SQL] Group exception messages in sql/streaming
add 6aa2594 [SPARK-35366][SQL] Avoid using deprecated `buildForBatch` and `buildForStreaming`
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/sql/v2/avro/AvroTable.scala | 6 ++-
.../{AvroWriteBuilder.scala => AvroWrite.scala} | 7 ++--
.../spark/sql/kafka010/KafkaSourceProvider.scala | 13 +-----
.../org/apache/spark/sql/kafka010/KafkaWrite.scala | 32 ++++++++------
.../datasources/noop/NoopDataSource.scala | 10 +++--
.../v2/{FileWriteBuilder.scala => FileWrite.scala} | 17 ++++----
.../execution/datasources/v2/csv/CSVTable.scala | 6 ++-
.../csv/{CSVWriteBuilder.scala => CSVWrite.scala} | 7 ++--
.../execution/datasources/v2/json/JsonTable.scala | 6 ++-
.../{JsonWriteBuilder.scala => JsonWrite.scala} | 7 ++--
.../execution/datasources/v2/orc/OrcTable.scala | 6 ++-
.../orc/{OrcWriteBuilder.scala => OrcWrite.scala} | 7 ++--
.../datasources/v2/parquet/ParquetTable.scala | 6 ++-
...arquetWriteBuilder.scala => ParquetWrite.scala} | 7 ++--
.../execution/datasources/v2/text/TextTable.scala | 6 ++-
.../{TextWriteBuilder.scala => TextWrite.scala} | 7 ++--
.../spark/sql/execution/streaming/console.scala | 12 ++++--
...soleWrite.scala => ConsoleStreamingWrite.scala} | 0
.../streaming/sources/ForeachWriterTable.scala | 49 +++++++++++++---------
.../sql/execution/streaming/sources/memory.scala | 12 ++++--
.../sql/connector/SimpleWritableDataSource.scala | 22 ++++++----
.../sources/StreamingDataSourceV2Suite.scala | 13 ++++--
22 files changed, 150 insertions(+), 108 deletions(-)
rename external/avro/src/main/scala/org/apache/spark/sql/v2/avro/{AvroWriteBuilder.scala => AvroWrite.scala} (88%)
copy sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/WriteToContinuousDataSource.scala => external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaWrite.scala (58%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/{FileWriteBuilder.scala => FileWrite.scala} (95%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/csv/{CSVWriteBuilder.scala => CSVWrite.scala} (92%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/json/{JsonWriteBuilder.scala => JsonWrite.scala} (92%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/orc/{OrcWriteBuilder.scala => OrcWrite.scala} (93%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/parquet/{ParquetWriteBuilder.scala => ParquetWrite.scala} (95%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/text/{TextWriteBuilder.scala => TextWrite.scala} (92%)
rename sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/{ConsoleWrite.scala => ConsoleStreamingWrite.scala} (100%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org