You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2024/10/19 21:12:00 UTC

[jira] [Created] (HUDI-8397) Refactor SparkHoodieBackedTableMetadataWriter.getFunctionalIndexRecords to abstract it out

sivabalan narayanan created HUDI-8397:
-----------------------------------------

             Summary: Refactor SparkHoodieBackedTableMetadataWriter.getFunctionalIndexRecords to abstract it out
                 Key: HUDI-8397
                 URL: https://issues.apache.org/jira/browse/HUDI-8397
             Project: Apache Hudi
          Issue Type: Improvement
          Components: metadata
            Reporter: sivabalan narayanan


Refactor SparkHoodieBackedTableMetadataWriter.getFunctionalIndexRecords to abstract it out so that other engines can leverage. the engine specific transformation can be overriden in spark, but rest of the logic should be moved to HoodieBackedTableMetadatWriter. 

 

Refer to [https://github.com/apache/hudi/pull/12127#discussion_r1807469757] for more info 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)