You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2021/10/02 06:36:38 UTC
[spark] branch master updated (25db6b4 -> 14d4cee)
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 25db6b4 [MINOR][DOCS] Typo fix in cloud-integration.md
add 14d4cee [SPARK-36891][SQL] Refactor SpecificParquetRecordReaderBase and add more coverage on vectorized Parquet decoding
No new revisions were added by this update.
Summary of changes:
pom.xml | 21 +
sql/core/pom.xml | 18 +
.../parquet/SpecificParquetRecordReaderBase.java | 72 +++-
.../parquet/VectorizedParquetRecordReader.java | 15 +-
.../apache/parquet/column/page/TestDataPage.java | 28 +-
.../parquet/ParquetVectorizedSuite.scala | 426 +++++++++++++++++++++
6 files changed, 555 insertions(+), 25 deletions(-)
copy core/src/main/java/org/apache/spark/util/ParentClassLoader.java => sql/core/src/test/java/test/org/apache/parquet/column/page/TestDataPage.java (54%)
create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetVectorizedSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org