You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/02/10 19:27:00 UTC

[jira] [Closed] (HUDI-1847) Add ability to decouple configs for scheduling inline and running async

     [ https://issues.apache.org/jira/browse/HUDI-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan closed HUDI-1847.
-------------------------------------
    Resolution: Fixed

> Add ability to decouple configs for scheduling inline and running async
> -----------------------------------------------------------------------
>
>                 Key: HUDI-1847
>                 URL: https://issues.apache.org/jira/browse/HUDI-1847
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: compaction
>            Reporter: Nishith Agarwal
>            Assignee: sivabalan narayanan
>            Priority: Major
>              Labels: core-flow-ds, pull-request-available, sev:critical
>             Fix For: 0.11.0
>
>   Original Estimate: 3h
>          Time Spent: 3h
>  Remaining Estimate: 2h
>
> Currently, there are 2 ways to enable compaction:
>  
>  # Inline - This will schedule compaction inline and execute inline
>  # Async - This option is only available for HoodieDeltaStreamer based jobs. This turns on scheduling inline and running async as part of the same spark job.
>  
> Users need a config to be able to schedule only inline while having an ability to execute in their own spark job



--
This message was sent by Atlassian Jira
(v8.20.1#820001)