You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Jonathan Vexler (Jira)" <ji...@apache.org> on 2024/10/01 14:29:00 UTC

[jira] [Created] (HUDI-8286) Use filegroup reader for compaction

Jonathan Vexler created HUDI-8286:
-------------------------------------

             Summary: Use filegroup reader for compaction
                 Key: HUDI-8286
                 URL: https://issues.apache.org/jira/browse/HUDI-8286
             Project: Apache Hudi
          Issue Type: Improvement
          Components: compaction, reader-core, writer-core
            Reporter: Jonathan Vexler
             Fix For: 1.1.0


HoodieCompactor is the class that needs to be changed. We read the log files and then perform a cow upsert. We will either need to just read the log files with the fg reader and then do an upsert, or we will need to read the base file and log files with the fg reader and then do an insert. This will also require a new reader context to be created, but can be the same as the one we need for non row writer clustering



--
This message was sent by Atlassian Jira
(v8.20.10#820010)