You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Frank Wong (Jira)" <ji...@apache.org> on 2022/10/05 14:47:00 UTC

[jira] [Closed] (HUDI-2598) Redesign record payload class to decouple HoodieRecordPayload from Avro

     [ https://issues.apache.org/jira/browse/HUDI-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Frank Wong closed HUDI-2598.
----------------------------
    Resolution: Fixed

> Redesign record payload class to decouple HoodieRecordPayload from Avro
> -----------------------------------------------------------------------
>
>                 Key: HUDI-2598
>                 URL: https://issues.apache.org/jira/browse/HUDI-2598
>             Project: Apache Hudi
>          Issue Type: Task
>          Components: code-quality
>            Reporter: Ethan Guo
>            Assignee: Frank Wong
>            Priority: Blocker
>             Fix For: 0.13.0
>
>
> We need to redesign the HoodieRecordPayload interface, which should not depend on avro, to pave the road for Spark Row writer work. Ideally, the new abstraction should have the individual implementation of avro-based record and spark-based Row, and the abstraction itself has more high-level operations like preCombine, getValue, etc., which are not tied to IndexedRecord. This should also make the write client easier to extend for Spark Dataset of Rows.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)