You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Joseph Witt (JIRA)" <ji...@apache.org> on 2017/03/29 01:23:41 UTC

[jira] [Updated] (NIFI-3189) ConsumeKafka 0.9 and 0.10 can cause consumer rebalance when backpressure is engaged

     [ https://issues.apache.org/jira/browse/NIFI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joseph Witt updated NIFI-3189:
------------------------------
    Fix Version/s: 1.2.0

> ConsumeKafka 0.9 and 0.10 can cause consumer rebalance when backpressure is engaged
> -----------------------------------------------------------------------------------
>
>                 Key: NIFI-3189
>                 URL: https://issues.apache.org/jira/browse/NIFI-3189
>             Project: Apache NiFi
>          Issue Type: Bug
>    Affects Versions: 1.1.0
>            Reporter: Joseph Witt
>            Assignee: Koji Kawamura
>             Fix For: 1.2.0
>
>
> ConsumeKafka processors can alert to rebalance issues when backpressure is engaged on the output connection and is then freed up.  This is because we're not doing anything with those consumers for a period of time and the kafka client detects this and initiates a rebalance.  We should ensure that even when we cannot send more data due to back pressure that we at least have some sort of keep alive behavior with the kafka client.  Or, if that isn't an option we should at least document the situation.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)