You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/02/10 19:27:00 UTC
[jira] [Closed] (HUDI-1847) Add ability to decouple configs for scheduling inline and running async
[ https://issues.apache.org/jira/browse/HUDI-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
sivabalan narayanan closed HUDI-1847.
-------------------------------------
Resolution: Fixed
> Add ability to decouple configs for scheduling inline and running async
> -----------------------------------------------------------------------
>
> Key: HUDI-1847
> URL: https://issues.apache.org/jira/browse/HUDI-1847
> Project: Apache Hudi
> Issue Type: Improvement
> Components: compaction
> Reporter: Nishith Agarwal
> Assignee: sivabalan narayanan
> Priority: Major
> Labels: core-flow-ds, pull-request-available, sev:critical
> Fix For: 0.11.0
>
> Original Estimate: 3h
> Time Spent: 3h
> Remaining Estimate: 2h
>
> Currently, there are 2 ways to enable compaction:
>
> # Inline - This will schedule compaction inline and execute inline
> # Async - This option is only available for HoodieDeltaStreamer based jobs. This turns on scheduling inline and running async as part of the same spark job.
>
> Users need a config to be able to schedule only inline while having an ability to execute in their own spark job
--
This message was sent by Atlassian Jira
(v8.20.1#820001)