You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Jonathan Vexler (Jira)" <ji...@apache.org> on 2023/09/18 16:28:00 UTC

[jira] [Created] (HUDI-6873) Clustering MOR with OOB schema evolution results in data loss

Jonathan Vexler created HUDI-6873:
-------------------------------------

             Summary: Clustering MOR with OOB schema evolution results in data loss
                 Key: HUDI-6873
                 URL: https://issues.apache.org/jira/browse/HUDI-6873
             Project: Apache Hudi
          Issue Type: Bug
          Components: deltastreamer, spark
            Reporter: Jonathan Vexler
            Assignee: Jonathan Vexler


If new columns are added using OOB schema evolution on an MOR table and then clustering is performed, the field will be null for all records after clustering. This has only been tested with deltastreamer, but may also affect other write sources as well.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)