You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "codecov-commenter (via GitHub)" <gi...@apache.org> on 2026/03/19 02:48:00 UTC

Re: [PR] feat(vector): Support writing VECTOR to parquet and avro formats using Spark [hudi]

codecov-commenter commented on PR #18328:
URL: https://github.com/apache/hudi/pull/18328#issuecomment-4087292336

   ## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18328?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
   :x: Patch coverage is `1.63043%` with `181 lines` in your changes missing coverage. Please review.
   :white_check_mark: Project coverage is 48.19%. Comparing base ([`14a549f`](https://app.codecov.io/gh/apache/hudi/commit/14a549f45c2ca713369177b6e8cc9c9d094c915e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`106fb29`](https://app.codecov.io/gh/apache/hudi/commit/106fb29fab335f616c82195e610a1c6db50bbe19?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
   :warning: Report is 3 commits behind head on master.
   
   | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18328?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
   |---|---|---|
   | [.../apache/hudi/io/storage/VectorConversionUtils.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-client%2Fhudi-spark-client%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fio%2Fstorage%2FVectorConversionUtils.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vc3RvcmFnZS9WZWN0b3JDb252ZXJzaW9uVXRpbHMuamF2YQ==) | 0.00% | [54 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...i/io/storage/row/HoodieRowParquetWriteSupport.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-client%2Fhudi-spark-client%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fio%2Fstorage%2Frow%2FHoodieRowParquetWriteSupport.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vc3RvcmFnZS9yb3cvSG9vZGllUm93UGFycXVldFdyaXRlU3VwcG9ydC5qYXZh) | 0.00% | [30 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...hudi/SparkFileFormatInternalRowReaderContext.scala](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-client%2Fhudi-spark-client%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fhudi%2FSparkFileFormatInternalRowReaderContext.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9odWRpL1NwYXJrRmlsZUZvcm1hdEludGVybmFsUm93UmVhZGVyQ29udGV4dC5zY2FsYQ==) | 0.00% | [25 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...in/java/org/apache/hudi/internal/schema/Types.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Finternal%2Fschema%2FTypes.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW50ZXJuYWwvc2NoZW1hL1R5cGVzLmphdmE=) | 0.00% | [22 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...ache/hudi/io/storage/HoodieSparkParquetReader.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-client%2Fhudi-spark-client%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fio%2Fstorage%2FHoodieSparkParquetReader.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vc3RvcmFnZS9Ib29kaWVTcGFya1BhcnF1ZXRSZWFkZXIuamF2YQ==) | 0.00% | [15 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...ommon/schema/HoodieSchemaCompatibilityChecker.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fschema%2FHoodieSchemaCompatibilityChecker.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3NjaGVtYS9Ib29kaWVTY2hlbWFDb21wYXRpYmlsaXR5Q2hlY2tlci5qYXZh) | 0.00% | [13 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...ternal/schema/convert/InternalSchemaConverter.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Finternal%2Fschema%2Fconvert%2FInternalSchemaConverter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW50ZXJuYWwvc2NoZW1hL2NvbnZlcnQvSW50ZXJuYWxTY2hlbWFDb252ZXJ0ZXIuamF2YQ==) | 0.00% | [9 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...hema/HoodieSchemaComparatorForSchemaEvolution.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fschema%2FHoodieSchemaComparatorForSchemaEvolution.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3NjaGVtYS9Ib29kaWVTY2hlbWFDb21wYXJhdG9yRm9yU2NoZW1hRXZvbHV0aW9uLmphdmE=) | 0.00% | [6 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...quet/avro/AvroSchemaConverterWithTimestampNTZ.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-hadoop-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fparquet%2Favro%2FAvroSchemaConverterWithTimestampNTZ.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1oYWRvb3AtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9wYXJxdWV0L2F2cm8vQXZyb1NjaGVtYUNvbnZlcnRlcldpdGhUaW1lc3RhbXBOVFouamF2YQ==) | 0.00% | [5 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [.../apache/hudi/metadata/HoodieTableMetadataUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieTableMetadataUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvbWV0YWRhdGEvSG9vZGllVGFibGVNZXRhZGF0YVV0aWwuamF2YQ==) | 33.33% | [1 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   > :exclamation:  There is a different number of reports uploaded between BASE (14a549f) and HEAD (106fb29). Click for more details.
   > 
   > <details><summary>HEAD has 28 uploads less than BASE</summary>
   >
   >| Flag | BASE (14a549f) | HEAD (106fb29) |
   >|------|------|------|
   >|hadoop-mr-java-client|1|0|
   >|spark-scala-tests|10|0|
   >|spark-java-tests|15|0|
   >|common-and-other-modules|1|0|
   >|utilities|1|0|
   ></details>
   
   <details><summary>Additional details and impacted files</summary>
   
   
   
   ```diff
   @@              Coverage Diff              @@
   ##             master   #18328       +/-   ##
   =============================================
   - Coverage     68.48%   48.19%   -20.30%     
   + Complexity    27362    10564    -16798     
   =============================================
     Files          2420     1373     -1047     
     Lines        132127    68962    -63165     
     Branches      15909     7751     -8158     
   =============================================
   - Hits          90491    33234    -57257     
   + Misses        34627    32762     -1865     
   + Partials       7009     2966     -4043     
   ```
   
   | [Flag](https://app.codecov.io/gh/apache/hudi/pull/18328/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
   |---|---|---|
   | [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18328/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
   | [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18328/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
   | [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18328/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.19% <1.63%> (-0.15%)` | :arrow_down: |
   | [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18328/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
   | [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18328/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
   | [utilities](https://app.codecov.io/gh/apache/hudi/pull/18328/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
   
   Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
   
   | [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18328?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
   |---|---|---|
   | [...ain/java/org/apache/hudi/internal/schema/Type.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Finternal%2Fschema%2FType.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW50ZXJuYWwvc2NoZW1hL1R5cGUuamF2YQ==) | `57.37% <100.00%> (-22.63%)` | :arrow_down: |
   | [.../apache/hudi/metadata/HoodieTableMetadataUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieTableMetadataUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvbWV0YWRhdGEvSG9vZGllVGFibGVNZXRhZGF0YVV0aWwuamF2YQ==) | `48.04% <33.33%> (-34.30%)` | :arrow_down: |
   | [...quet/avro/AvroSchemaConverterWithTimestampNTZ.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-hadoop-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fparquet%2Favro%2FAvroSchemaConverterWithTimestampNTZ.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1oYWRvb3AtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9wYXJxdWV0L2F2cm8vQXZyb1NjaGVtYUNvbnZlcnRlcldpdGhUaW1lc3RhbXBOVFouamF2YQ==) | `73.40% <0.00%> (-2.17%)` | :arrow_down: |
   | [...hema/HoodieSchemaComparatorForSchemaEvolution.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fschema%2FHoodieSchemaComparatorForSchemaEvolution.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3NjaGVtYS9Ib29kaWVTY2hlbWFDb21wYXJhdG9yRm9yU2NoZW1hRXZvbHV0aW9uLmphdmE=) | `21.34% <0.00%> (-67.81%)` | :arrow_down: |
   | [...ternal/schema/convert/InternalSchemaConverter.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Finternal%2Fschema%2Fconvert%2FInternalSchemaConverter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW50ZXJuYWwvc2NoZW1hL2NvbnZlcnQvSW50ZXJuYWxTY2hlbWFDb252ZXJ0ZXIuamF2YQ==) | `0.00% <0.00%> (-88.79%)` | :arrow_down: |
   | [...ommon/schema/HoodieSchemaCompatibilityChecker.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fschema%2FHoodieSchemaCompatibilityChecker.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL3NjaGVtYS9Ib29kaWVTY2hlbWFDb21wYXRpYmlsaXR5Q2hlY2tlci5qYXZh) | `21.54% <0.00%> (-42.84%)` | :arrow_down: |
   | [...ache/hudi/io/storage/HoodieSparkParquetReader.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-client%2Fhudi-spark-client%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fio%2Fstorage%2FHoodieSparkParquetReader.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vc3RvcmFnZS9Ib29kaWVTcGFya1BhcnF1ZXRSZWFkZXIuamF2YQ==) | `0.00% <0.00%> (-86.42%)` | :arrow_down: |
   | [...in/java/org/apache/hudi/internal/schema/Types.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Finternal%2Fschema%2FTypes.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW50ZXJuYWwvc2NoZW1hL1R5cGVzLmphdmE=) | `13.95% <0.00%> (-64.55%)` | :arrow_down: |
   | [...hudi/SparkFileFormatInternalRowReaderContext.scala](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-client%2Fhudi-spark-client%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fhudi%2FSparkFileFormatInternalRowReaderContext.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9odWRpL1NwYXJrRmlsZUZvcm1hdEludGVybmFsUm93UmVhZGVyQ29udGV4dC5zY2FsYQ==) | `3.67% <0.00%> (-75.97%)` | :arrow_down: |
   | [...i/io/storage/row/HoodieRowParquetWriteSupport.java](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree&filepath=hudi-client%2Fhudi-spark-client%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fio%2Fstorage%2Frow%2FHoodieRowParquetWriteSupport.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vc3RvcmFnZS9yb3cvSG9vZGllUm93UGFycXVldFdyaXRlU3VwcG9ydC5qYXZh) | `0.00% <0.00%> (-76.30%)` | :arrow_down: |
   | ... and [1 more](https://app.codecov.io/gh/apache/hudi/pull/18328?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | |
   
   ... and [1884 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18328/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
   </details>
   <details><summary> :rocket: New features to boost your workflow: </summary>
   
   - :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org