[spark] branch master updated (d7f4b2a -> d338af3)

[ka...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

kabhwan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from d7f4b2a  [SPARK-28704][SQL][TEST] Add back Skiped HiveExternalCatalogVersionsSuite in HiveSparkSubmitSuite at JDK9+
     add d338af3  [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

No new revisions were added by this update.

Summary of changes:
 docs/sql-data-sources-generic-options.md           |  37 +++
 .../examples/sql/JavaSQLDataSourceExample.java     |  16 ++
 examples/src/main/python/sql/datasource.py         |  20 ++
 examples/src/main/r/RSparkSQLExample.R             |   8 +
 .../spark/examples/sql/SQLDataSourceExample.scala  |  21 ++
 python/pyspark/sql/readwriter.py                   |  81 +++++-
 .../org/apache/spark/sql/DataFrameReader.scala     |  30 ++
 .../datasources/PartitioningAwareFileIndex.scala   |  13 +-
 .../sql/execution/datasources/pathFilters.scala    | 161 +++++++++++
 .../execution/streaming/FileStreamOptions.scala    |  11 +
 .../spark/sql/FileBasedDataSourceSuite.scala       |  32 ---
 .../datasources/PathFilterStrategySuite.scala      |  54 ++++
 .../execution/datasources/PathFilterSuite.scala    | 307 +++++++++++++++++++++
 .../sql/streaming/FileStreamSourceSuite.scala      |  44 ++-
 14 files changed, 787 insertions(+), 48 deletions(-)
 create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/pathFilters.scala
 create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterStrategySuite.scala
 create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/PathFilterSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org