You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by we...@apache.org on 2020/08/19 16:30:29 UTC

[spark] branch master updated (3d1dce7 -> 278d0dd)

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 3d1dce7  [SPARK-32621][SQL] 'path' option can cause issues while inferring schema in CSV/JSON datasources
     add 278d0dd  [SPARK-28863][SQL] Introduce AlreadyPlanned to prevent reanalysis of V1FallbackWriters

No new revisions were added by this update.

Summary of changes:
 .../spark/sql/execution/AlreadyPlanned.scala       | 61 +++++++++++++++++
 .../spark/sql/execution/SparkStrategies.scala      |  1 +
 .../datasources/v2/DataSourceV2Strategy.scala      | 10 ++-
 .../datasources/v2/V1FallbackWriters.scala         | 22 +++---
 .../datasources/v2/WriteToDataSourceV2Exec.scala   |  4 --
 .../spark/sql/connector/V1WriteFallbackSuite.scala | 42 ++++++++++++
 .../spark/sql/execution/AlreadyPlannedSuite.scala  | 80 ++++++++++++++++++++++
 7 files changed, 196 insertions(+), 24 deletions(-)
 create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/AlreadyPlanned.scala
 create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/AlreadyPlannedSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org