You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by db...@apache.org on 2021/06/11 05:40:27 UTC

[spark] branch master updated (463daab -> e9ccf4a)

This is an automated email from the ASF dual-hosted git repository.

dbtsai pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 463daab  [SPARK-34512][BUILD][SQL] Upgrade built-in Hive to 2.3.9
     add e9ccf4a  [SPARK-35640][SQL] Refactor Parquet vectorized reader to remove duplicated code paths

No new revisions were added by this update.

Summary of changes:
 .../datasources/parquet/ParquetVectorUpdater.java  |   86 ++
 .../parquet/ParquetVectorUpdaterFactory.java       | 1005 ++++++++++++++++++++
 .../parquet/VectorizedColumnReader.java            |  597 +-----------
 .../parquet/VectorizedRleValuesReader.java         |  433 +--------
 .../datasources/parquet/ParquetIOSuite.scala       |   22 +
 5 files changed, 1144 insertions(+), 999 deletions(-)
 create mode 100644 sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/ParquetVectorUpdater.java
 create mode 100644 sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/ParquetVectorUpdaterFactory.java

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org