You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2021/01/22 14:30:01 UTC

[jira] [Updated] (HUDI-74) Improve compaction support in HoodieDeltaStreamer & CLI

     [ https://issues.apache.org/jira/browse/HUDI-74?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan updated HUDI-74:
------------------------------------
    Labels: user-support-issues  (was: )

> Improve compaction support in HoodieDeltaStreamer & CLI
> -------------------------------------------------------
>
>                 Key: HUDI-74
>                 URL: https://issues.apache.org/jira/browse/HUDI-74
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: CLI, DeltaStreamer
>            Reporter: Balaji Varadarajan
>            Priority: Major
>              Labels: user-support-issues
>
> Currently, the only way to safely schedule and execute a compaction which will preserve checkpoints is through inline compaction. But this is diasbled by default for HoodieDeltaStreamer. 
>  
> Also, the other option to schedule a compaction is through Hoodie CLI. We need to support option to copy last delta-instant's extra-metadata  to make this a viable option for working with DeltaStreamer.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)