[jira] [Updated] (NIFI-14629) ConsumeKinesisStream backpressure handling may be blocked under load

["David Handermann (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NIFI-14629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

David Handermann updated NIFI-14629:
------------------------------------
    Summary: ConsumeKinesisStream backpressure handling may be blocked under load  (was: ConsumeKinesisStream backpressure handling may not work)

> ConsumeKinesisStream backpressure handling may be blocked under load
> --------------------------------------------------------------------
>
>                 Key: NIFI-14629
>                 URL: https://issues.apache.org/jira/browse/NIFI-14629
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>    Affects Versions: 2.4.0
>            Reporter: Dariusz Seweryn
>            Assignee: Dariusz Seweryn
>            Priority: Major
>             Fix For: 2.5.0
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> In NIFI-14358 I added backpressure handling in ConsumeKinesisStream. The processor gets scheduled even when the output queue is full, in which case it stops producing records.
> The processor may not be triggered on overwhelmed nodes in which case it will not get backpressured and will continue to overwhelm.
> There should be a stop mechanism added that would trigger when the processor is not triggered for X amount of time. 3 seconds?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)