[spark] branch master updated (6fd3138 -> bb295d8)

[we...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 6fd3138  [SPARK-30667][CORE] Change BarrierTaskContext allGather method return type
     add bb295d8  [SPARK-31159][SQL] Rebase date/timestamp from/to Julian calendar in parquet

No new revisions were added by this update.

Summary of changes:
 .../spark/sql/catalyst/util/DateTimeUtils.scala    | 106 ++++++++++++++++++++-
 .../org/apache/spark/sql/internal/SQLConf.scala    |  16 ++++
 .../sql/catalyst/util/DateTimeUtilsSuite.scala     |  60 ++++++++++++
 .../parquet/VectorizedColumnReader.java            |  44 ++++++++-
 .../datasources/parquet/ParquetRowConverter.scala  |  49 ++++++++--
 .../datasources/parquet/ParquetWriteSupport.scala  |  19 ++++
 .../test-data/before_1582_date_v2_4.snappy.parquet | Bin 0 -> 398 bytes
 ...before_1582_timestamp_int96_v2_4.snappy.parquet | Bin 0 -> 494 bytes
 ...efore_1582_timestamp_micros_v2_4.snappy.parquet | Bin 0 -> 436 bytes
 ...efore_1582_timestamp_millis_v2_4.snappy.parquet | Bin 0 -> 436 bytes
 .../datasources/parquet/ParquetIOSuite.scala       |  66 +++++++++++++
 11 files changed, 343 insertions(+), 17 deletions(-)
 create mode 100644 sql/core/src/test/resources/test-data/before_1582_date_v2_4.snappy.parquet
 create mode 100644 sql/core/src/test/resources/test-data/before_1582_timestamp_int96_v2_4.snappy.parquet
 create mode 100644 sql/core/src/test/resources/test-data/before_1582_timestamp_micros_v2_4.snappy.parquet
 create mode 100644 sql/core/src/test/resources/test-data/before_1582_timestamp_millis_v2_4.snappy.parquet


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org