You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/08/04 19:14:00 UTC

[jira] [Updated] (HUDI-74) Improve compaction support in HoodieDeltaStreamer & CLI

     [ https://issues.apache.org/jira/browse/HUDI-74?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Kudinkin updated HUDI-74:
--------------------------------
    Epic Link: HUDI-1388

> Improve compaction support in HoodieDeltaStreamer & CLI
> -------------------------------------------------------
>
>                 Key: HUDI-74
>                 URL: https://issues.apache.org/jira/browse/HUDI-74
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: cli, deltastreamer
>            Reporter: Balaji Varadarajan
>            Priority: Major
>
> Currently, the only way to safely schedule and execute a compaction which will preserve checkpoints is through inline compaction. But this is diasbled by default for HoodieDeltaStreamer. 
>  
> Also, the other option to schedule a compaction is through Hoodie CLI. We need to support option to copy last delta-instant's extra-metadata  to make this a viable option for working with DeltaStreamer.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)