You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2020/04/21 15:29:36 UTC
[spark] branch master updated (55b026a -> a5ebbac)
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 55b026a [SPARK-31504][SQL] Formatted Explain should have determined order of Output fields
add a5ebbac [SPARK-31361][SQL] Rebase datetime in parquet/avro according to file metadata
No new revisions were added by this update.
Summary of changes:
.../apache/spark/sql/avro/AvroDeserializer.scala | 12 ++-
.../org/apache/spark/sql/avro/AvroFileFormat.scala | 11 ++-
.../apache/spark/sql/avro/AvroOutputWriter.scala | 17 +++-
.../org/apache/spark/sql/avro/AvroSerializer.scala | 14 ++-
.../sql/v2/avro/AvroPartitionReaderFactory.scala | 10 +-
.../sql/avro/AvroCatalystDataConversionSuite.scala | 2 +-
.../org/apache/spark/sql/avro/AvroSuite.scala | 103 ++++++++++++++++-----
.../parquet/VectorizedColumnReader.java | 6 +-
.../parquet/VectorizedParquetRecordReader.java | 18 +++-
.../execution/datasources/DataSourceUtils.scala | 17 ++++
.../datasources/parquet/ParquetFileFormat.scala | 13 ++-
.../datasources/parquet/ParquetReadSupport.scala | 15 +--
.../parquet/ParquetRecordMaterializer.scala | 10 +-
.../datasources/parquet/ParquetRowConverter.scala | 10 +-
.../datasources/parquet/ParquetWriteSupport.scala | 6 +-
.../v2/parquet/ParquetPartitionReaderFactory.scala | 26 ++++--
.../main/scala/org/apache/spark/sql/package.scala | 6 ++
.../benchmark/DataSourceReadBenchmark.scala | 6 +-
.../datasources/parquet/ParquetEncodingSuite.scala | 6 +-
.../datasources/parquet/ParquetIOSuite.scala | 89 ++++++++++++++----
.../datasources/parquet/ParquetTest.scala | 7 +-
21 files changed, 299 insertions(+), 105 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org