You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@paimon.apache.org by lz...@apache.org on 2025/08/04 07:12:59 UTC

(paimon) branch master updated (a2b23dcf08 -> 52838bdb8c)

This is an automated email from the ASF dual-hosted git repository.

lzljs3620320 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/paimon.git


    from a2b23dcf08 [core][spark] Support UPDATE for row lineage (#6014)
     add 52838bdb8c [variant][spark] Add support for read and write shredding (#5905)

No new revisions were added by this update.

Summary of changes:
 .../paimon/data/variant/GenericVariantBuilder.java |   2 +-
 .../paimon/data/variant/PaimonShreddingUtils.java  |  24 +++
 .../paimon/format/parquet/ParquetOptions.java      |  17 +-
 .../format/parquet/ParquetReaderFactory.java       |  21 +--
 .../format/parquet/ParquetSchemaConverter.java     |   3 +-
 .../apache/paimon/format/parquet/VariantUtils.java | 104 ++++++++++++
 .../format/parquet/reader/ParquetColumnVector.java |  30 +++-
 ...SplitReaderUtil.java => ParquetReaderUtil.java} | 182 ++++-----------------
 .../paimon/format/parquet/type/ParquetField.java   |  22 +++
 .../format/parquet/type/ParquetGroupField.java     |  13 +-
 .../parquet/writer/ParquetRowDataBuilder.java      |  15 +-
 .../parquet/writer/ParquetRowDataWriter.java       |  39 ++++-
 .../reader/ParquetRowDataBuilderForTest.java       |   3 +-
 .../apache/paimon/spark/sql/VariantTestBase.scala  |  41 +++++
 14 files changed, 338 insertions(+), 178 deletions(-)
 copy paimon-core/src/main/java/org/apache/paimon/table/FormatTableOptions.java => paimon-format/src/main/java/org/apache/paimon/format/parquet/ParquetOptions.java (68%)
 create mode 100644 paimon-format/src/main/java/org/apache/paimon/format/parquet/VariantUtils.java
 rename paimon-format/src/main/java/org/apache/paimon/format/parquet/reader/{ParquetSplitReaderUtil.java => ParquetReaderUtil.java} (66%)