You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by yi...@apache.org on 2024/09/05 01:01:30 UTC
(hudi) branch master updated (5a30d5b8af3 -> 0ed4e11a87b)
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 5a30d5b8af3 [HUDI-8112] Improve HoodieActiveTimeline#revertCompleteToInflight parameter check (#11815)
add 0ed4e11a87b [HUDI-5807] Read partition values from file and create infra to support reading only a subset of columns (#11770)
No new revisions were added by this update.
Summary of changes:
.../hudi/HoodieHadoopFsRelationFactory.scala | 36 +-
...odieFileGroupReaderBasedParquetFileFormat.scala | 128 +++-
.../spark/sql/vectorized/ColumnarBatchUtils.java | 54 ++
.../apache/hudi/functional/TestCOWDataSource.scala | 22 +-
.../apache/hudi/functional/TestMORDataSource.scala | 10 +-
.../TestSparkSqlWithCustomKeyGenerator.scala | 654 +++++++++++----------
.../TestSparkSqlWithTimestampKeyGenerator.scala | 3 +-
.../HoodieSpark2PartitionedFileUtils.scala | 5 +-
.../HoodieSpark33PartitionedFileUtils.scala | 5 +-
9 files changed, 551 insertions(+), 366 deletions(-)
create mode 100644 hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/vectorized/ColumnarBatchUtils.java