You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Yann Byron (Jira)" <ji...@apache.org> on 2022/08/24 08:34:00 UTC

[jira] [Created] (HUDI-4705) Support Write-on-compaction mode when query cdc on MOR tables

Yann Byron created HUDI-4705:
--------------------------------

             Summary: Support Write-on-compaction mode when query cdc on MOR tables
                 Key: HUDI-4705
                 URL: https://issues.apache.org/jira/browse/HUDI-4705
             Project: Apache Hudi
          Issue Type: New Feature
          Components: compaction, spark
            Reporter: Yann Byron


For the case that query cdc on MOR tables, the initial implementation use the `Write-on-indexing`  way to extract the cdc data by merging the base file and log files in-flight.

This ticket wants to support the `Write-on-compaction` way to get the cdc data just by reading the persisted cdc files which are written at the compaction operation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)