You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Y Ethan Guo (Jira)" <ji...@apache.org> on 2024/10/30 01:12:00 UTC

[jira] [Updated] (HUDI-8322) Operation metadata field is not implemented for spark records

     [ https://issues.apache.org/jira/browse/HUDI-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Y Ethan Guo updated HUDI-8322:
------------------------------
    Fix Version/s: 1.1.0

> Operation metadata field is not implemented for spark records
> -------------------------------------------------------------
>
>                 Key: HUDI-8322
>                 URL: https://issues.apache.org/jira/browse/HUDI-8322
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: spark, writer-core
>            Reporter: Jonathan Vexler
>            Priority: Major
>             Fix For: 1.1.0
>
>
> If you enable the operation field using the config HoodieWriteConfig.ALLOW_OPERATION_METADATA_FIELD and you write with spark records, it will lead to data corruption (or maybe write failure, can't remember) because HoodieInternalRow does not support the field, so the indexes are incorrect when it writes the record.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)