You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Sagar Sumit (Jira)" <ji...@apache.org> on 2022/05/09 06:26:00 UTC

[jira] [Resolved] (HUDI-3675) Add support to shutdown Deltastreamer gracefully on certain conditions w/ continuous mode

     [ https://issues.apache.org/jira/browse/HUDI-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sagar Sumit resolved HUDI-3675.
-------------------------------

> Add support to shutdown Deltastreamer gracefully on certain conditions w/ continuous mode
> -----------------------------------------------------------------------------------------
>
>                 Key: HUDI-3675
>                 URL: https://issues.apache.org/jira/browse/HUDI-3675
>             Project: Apache Hudi
>          Issue Type: New Feature
>          Components: deltastreamer
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.12.0
>
>
> Here is the use-case: 
> With continuous mode deltastreamer, the process have to be fully up consuming resources even if there is no data on the source. So, users may want to shutdown the process if there is no data to consume for some consecutive amount of times.
>  
> and later can restart a new pipeline after sometime.  something like, restart deltastreamer continuous mode after 1 hour of shutdown. 
>  
> But when started w/ continuous mode, do gracefull shudown if there is no new data for 5 consecutive times. 
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)