You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Jonathan Vexler (Jira)" <ji...@apache.org> on 2024/10/01 14:29:00 UTC
[jira] [Created] (HUDI-8286) Use filegroup reader for compaction
Jonathan Vexler created HUDI-8286:
-------------------------------------
Summary: Use filegroup reader for compaction
Key: HUDI-8286
URL: https://issues.apache.org/jira/browse/HUDI-8286
Project: Apache Hudi
Issue Type: Improvement
Components: compaction, reader-core, writer-core
Reporter: Jonathan Vexler
Fix For: 1.1.0
HoodieCompactor is the class that needs to be changed. We read the log files and then perform a cow upsert. We will either need to just read the log files with the fg reader and then do an upsert, or we will need to read the base file and log files with the fg reader and then do an insert. This will also require a new reader context to be created, but can be the same as the one we need for non row writer clustering
--
This message was sent by Atlassian Jira
(v8.20.10#820010)