You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Till Rohrmann (JIRA)" <ji...@apache.org> on 2016/02/29 16:47:18 UTC

[jira] [Created] (FLINK-3542) FlinkKafkaConsumer09 cannot handle changing number of partitions

Till Rohrmann created FLINK-3542:
------------------------------------

             Summary: FlinkKafkaConsumer09 cannot handle changing number of partitions
                 Key: FLINK-3542
                 URL: https://issues.apache.org/jira/browse/FLINK-3542
             Project: Flink
          Issue Type: Improvement
          Components: Kafka Connector
    Affects Versions: 1.0.0
            Reporter: Till Rohrmann
            Priority: Minor


The current {{FlinkKafkaConsumer09}} cannot handle increasing the number of partitions of a topic while running. The consumer will simply leave the newly created partitions out and thus miss all data which is written to the new partitions. The reason seems to be a static assignment of partitions to consumer tasks when the job is started.

We should either fix this behaviour or clearly document it in the online and code docs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)