You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2021/10/22 03:02:00 UTC

[jira] [Created] (HUDI-2598) Resign record payload class to decouple HoodieRecordPayload from Avro

Ethan Guo created HUDI-2598:
-------------------------------

             Summary: Resign record payload class to decouple HoodieRecordPayload from Avro
                 Key: HUDI-2598
                 URL: https://issues.apache.org/jira/browse/HUDI-2598
             Project: Apache Hudi
          Issue Type: Sub-task
          Components: Code Cleanup
            Reporter: Ethan Guo
            Assignee: Ethan Guo
             Fix For: 0.10.0


We need to redesign the HoodieRecordPayload interface, which should not depend on avro, to pave the road for Spark Row writer work. Ideally, the new abstraction should have the individual implementation of avro-based record and spark-based Row, and the abstraction itself has more high-level operations like preCombine, getValue, etc., which are not tied to IndexedRecord. This should also make the write client easier to extend for Spark Dataset of Rows.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)