You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/01/14 14:19:00 UTC

[jira] [Updated] (HUDI-1847) Add ability to decouple configs for scheduling inline and running async

     [ https://issues.apache.org/jira/browse/HUDI-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan updated HUDI-1847:
--------------------------------------
    Sprint: Cont' improve -  2021/01/10

> Add ability to decouple configs for scheduling inline and running async
> -----------------------------------------------------------------------
>
>                 Key: HUDI-1847
>                 URL: https://issues.apache.org/jira/browse/HUDI-1847
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: Compaction
>            Reporter: Nishith Agarwal
>            Assignee: Vinay
>            Priority: Major
>              Labels: core-flow-ds, pull-request-available, sev:critical
>
> Currently, there are 2 ways to enable compaction:
>  
>  # Inline - This will schedule compaction inline and execute inline
>  # Async - This option is only available for HoodieDeltaStreamer based jobs. This turns on scheduling inline and running async as part of the same spark job.
>  
> Users need a config to be able to schedule only inline while having an ability to execute in their own spark job



--
This message was sent by Atlassian Jira
(v8.20.1#820001)