You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by we...@apache.org on 2020/01/09 13:55:34 UTC

[spark] branch master updated (dcdc9a8 -> 94fc0e3)

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from dcdc9a8  [SPARK-28198][PYTHON][FOLLOW-UP] Run the tests of MAP ITER UDF in Jenkins
     add 94fc0e3  [SPARK-30428][SQL] File source V2: support partition pruning

No new revisions were added by this update.

Summary of changes:
 .../org/apache/spark/sql/v2/avro/AvroScan.scala    | 42 +++++++-----
 .../org/apache/spark/sql/avro/AvroSuite.scala      | 74 +++++++++++++++++++++-
 .../spark/sql/execution/SparkOptimizer.scala       |  2 +-
 .../datasources/PruneFileSourcePartitions.scala    | 71 ++++++++++++++++-----
 .../sql/execution/datasources/v2/FileScan.scala    | 48 +++++++++++---
 .../datasources/v2/TextBasedFileScan.scala         |  6 +-
 .../sql/execution/datasources/v2/csv/CSVScan.scala | 20 ++++--
 .../execution/datasources/v2/json/JsonScan.scala   | 20 ++++--
 .../sql/execution/datasources/v2/orc/OrcScan.scala | 16 +++--
 .../datasources/v2/parquet/ParquetScan.scala       | 15 +++--
 .../execution/datasources/v2/text/TextScan.scala   | 19 +++++-
 .../spark/sql/FileBasedDataSourceSuite.scala       | 48 +++++++++++++-
 .../sql/execution/datasources/orc/OrcTest.scala    | 10 +--
 .../execution/datasources/orc/OrcFilterSuite.scala |  9 ++-
 .../execution/datasources/orc/OrcFilterSuite.scala |  9 ++-
 15 files changed, 323 insertions(+), 86 deletions(-)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org