You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2019/09/09 14:04:00 UTC

[jira] [Updated] (HUDI-74) Improve compaction support in HoodieDeltaStreamer & CLI

     [ https://issues.apache.org/jira/browse/HUDI-74?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinoth Chandar updated HUDI-74:
-------------------------------
    Component/s:     (was: Incremental Pull)
                 deltastreamer

> Improve compaction support in HoodieDeltaStreamer & CLI
> -------------------------------------------------------
>
>                 Key: HUDI-74
>                 URL: https://issues.apache.org/jira/browse/HUDI-74
>             Project: Apache Hudi (incubating)
>          Issue Type: Improvement
>          Components: deltastreamer
>            Reporter: BALAJI VARADARAJAN
>            Priority: Major
>
> Currently, the only way to safely schedule and execute a compaction which will preserve checkpoints is through inline compaction. But this is diasbled by default for HoodieDeltaStreamer. 
>  
> Also, the other option to schedule a compaction is through Hoodie CLI. We need to support option to copy last delta-instant's extra-metadata  to make this a viable option for working with DeltaStreamer.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)