You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2021/12/13 14:18:00 UTC

[jira] [Commented] (HUDI-1847) Add ability to decouple configs for scheduling inline and running async

    [ https://issues.apache.org/jira/browse/HUDI-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17458423#comment-17458423 ] 

sivabalan narayanan commented on HUDI-1847:
-------------------------------------------

[~vinaypatil18] : Are you working on this, if not, I would like to work on it. 

> Add ability to decouple configs for scheduling inline and running async
> -----------------------------------------------------------------------
>
>                 Key: HUDI-1847
>                 URL: https://issues.apache.org/jira/browse/HUDI-1847
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: Compaction
>            Reporter: Nishith Agarwal
>            Assignee: Vinay
>            Priority: Major
>              Labels: core-flow-ds, sev:high
>
> Currently, there are 2 ways to enable compaction:
>  
>  # Inline - This will schedule compaction inline and execute inline
>  # Async - This option is only available for HoodieDeltaStreamer based jobs. This turns on scheduling inline and running async as part of the same spark job.
>  
> Users need a config to be able to schedule only inline while having an ability to execute in their own spark job



--
This message was sent by Atlassian Jira
(v8.20.1#820001)