You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ge...@apache.org on 2020/07/29 17:41:30 UTC
[spark] branch master updated (40e6a5b -> d897825d)
This is an automated email from the ASF dual-hosted git repository.
gengliang pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 40e6a5b [SPARK-32449][ML][PYSPARK] Add summary to MultilayerPerceptronClassificationModel
add d897825d [SPARK-32346][SQL] Support filters pushdown in Avro datasource
No new revisions were added by this update.
Summary of changes:
.../benchmarks/AvroReadBenchmark-jdk11-results.txt | 72 ++++++++++++----------
.../avro/benchmarks/AvroReadBenchmark-results.txt | 72 ++++++++++++----------
.../apache/spark/sql/avro/AvroDataToCatalyst.scala | 5 +-
.../apache/spark/sql/avro/AvroDeserializer.scala | 40 +++++++-----
.../org/apache/spark/sql/avro/AvroFileFormat.scala | 44 +++++--------
.../org/apache/spark/sql/avro/AvroUtils.scala | 36 ++++++++++-
.../sql/v2/avro/AvroPartitionReaderFactory.scala | 48 ++++++---------
.../org/apache/spark/sql/v2/avro/AvroScan.scala | 24 ++++++--
.../apache/spark/sql/v2/avro/AvroScanBuilder.scala | 27 +++++++-
.../sql/avro/AvroCatalystDataConversionSuite.scala | 71 +++++++++++++++++----
.../org/apache/spark/sql/avro/AvroSuite.scala | 34 +++++++++-
.../execution/benchmark/AvroReadBenchmark.scala | 64 ++++++++++++++++++-
.../{csv/CSVFilters.scala => OrderedFilters.scala} | 68 ++++++++++----------
.../spark/sql/catalyst/csv/UnivocityParser.scala | 9 ++-
.../org/apache/spark/sql/internal/SQLConf.scala | 8 +++
...iltersSuite.scala => OrderedFiltersSuite.scala} | 7 +--
16 files changed, 430 insertions(+), 199 deletions(-)
rename sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/{csv/CSVFilters.scala => OrderedFilters.scala} (60%)
rename sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/{csv/CSVFiltersSuite.scala => OrderedFiltersSuite.scala} (83%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org