[jira] [Closed] (HUDI-8286) Use filegroup reader for compaction

["Jonathan Vexler (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Vexler closed HUDI-8286.
---------------------------------
    Resolution: Fixed

> Use filegroup reader for compaction
> -----------------------------------
>
>                 Key: HUDI-8286
>                 URL: https://issues.apache.org/jira/browse/HUDI-8286
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: compaction, reader-core, writer-core
>            Reporter: Jonathan Vexler
>            Assignee: Timothy Brown
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.1.0
>
>
> HoodieCompactor is the class that needs to be changed. We read the log files and then perform a cow upsert. We will either need to just read the log files with the fg reader and then do an upsert, or we will need to read the base file and log files with the fg reader and then do an insert. This will also require a new reader context to be created, but can be the same as the one we need for non row writer clustering



--
This message was sent by Atlassian Jira
(v8.20.10#820010)