[jira] [Created] (NIFI-3189) ConsumeKafka 0.9 and 0.10 can cause consumer rebalance when backpressure is engaged

["Joseph Witt (JIRA)" <ji...@apache.org>]

Joseph Witt created NIFI-3189:
---------------------------------

             Summary: ConsumeKafka 0.9 and 0.10 can cause consumer rebalance when backpressure is engaged
                 Key: NIFI-3189
                 URL: https://issues.apache.org/jira/browse/NIFI-3189
             Project: Apache NiFi
          Issue Type: Bug
    Affects Versions: 1.1.0
            Reporter: Joseph Witt


ConsumeKafka processors can alert to rebalance issues when backpressure is engaged on the output connection and is then freed up.  This is because we're not doing anything with those consumers for a period of time and the kafka client detects this and initiates a rebalance.  We should ensure that even when we cannot send more data due to back pressure that we at least have some sort of keep alive behavior with the kafka client.  Or, if that isn't an option we should at least document the situation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)