You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/03/28 20:50:00 UTC

[jira] [Updated] (HUDI-3731) Failure to merging Column Stats Records

     [ https://issues.apache.org/jira/browse/HUDI-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Kudinkin updated HUDI-3731:
----------------------------------
    Sprint: Hudi-Sprint-Mar-21

> Failure to merging Column Stats Records 
> ----------------------------------------
>
>                 Key: HUDI-3731
>                 URL: https://issues.apache.org/jira/browse/HUDI-3731
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Alexey Kudinkin
>            Assignee: Alexey Kudinkin
>            Priority: Blocker
>             Fix For: 0.11.0
>
>
> Occurs, due to `columnName` record not being present in the merged record
> {code:java}
> Caused by: Path in schema: --> columnName
>     at org.apache.avro.generic.GenericData.getDefaultValue(GenericData.java:1175)
>     at org.apache.avro.data.RecordBuilderBase.defaultValue(RecordBuilderBase.java:138)
>     at org.apache.hudi.avro.model.HoodieMetadataColumnStats$Builder.build(HoodieMetadataColumnStats.java:876)
>     at org.apache.hudi.metadata.HoodieTableMetadataUtil.mergeColumnStats(HoodieTableMetadataUtil.java:931)
>     at org.apache.hudi.metadata.HoodieMetadataPayload.combineColumnStatsMetadata(HoodieMetadataPayload.java:326)
>     at org.apache.hudi.metadata.HoodieMetadataPayload.preCombine(HoodieMetadataPayload.java:310)
>     at org.apache.hudi.metadata.HoodieMetadataPayload.preCombine(HoodieMetadataPayload.java:88)
>     at org.apache.hudi.common.table.log.HoodieMergedLogRecordScanner.processNextRecord(HoodieMergedLogRecordScanner.java:142)
>     at org.apache.hudi.metadata.HoodieMetadataMergedLogRecordReader.processNextRecord(HoodieMetadataMergedLogRecordReader.java:78)
>     at org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.processDataBlock(AbstractHoodieLogRecordReader.java:366)
>     at org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.processQueuedBlocksForInstant(AbstractHoodieLogRecordReader.java:430)
>     at org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.scan(AbstractHoodieLogRecordReader.java:327) {code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)