[jira] [Created] (KAFKA-3938) Fix consumer session timeout issue in Kafka Streams

["Guozhang Wang (JIRA)" <ji...@apache.org>]

Guozhang Wang created KAFKA-3938:
------------------------------------

             Summary: Fix consumer session timeout issue in Kafka Streams
                 Key: KAFKA-3938
                 URL: https://issues.apache.org/jira/browse/KAFKA-3938
             Project: Kafka
          Issue Type: Bug
          Components: streams
            Reporter: Guozhang Wang
            Assignee: Guozhang Wang


After KIP-62 / KAFKA-3888 is merged in, Kafka Streams should leverage this new feature to fix the session timeout issue that can be caused by:

1. long rebalance period due to state store restoration.
2. exceptional long processing time for a batch of records.

Also we need to consider:

1. state store directory locking mechanism between rebalances while one instance is grabbing tasks from another instance on the same machine.
2. exceptional handling in Kafka Streams: what should we really expose to users and what should be handled automatically?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)