You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Tzu-Li (Gordon) Tai (JIRA)" <ji...@apache.org> on 2016/07/22 06:45:21 UTC

[jira] [Updated] (FLINK-4023) Move Kafka consumer partition discovery from constructor to open()

     [ https://issues.apache.org/jira/browse/FLINK-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tzu-Li (Gordon) Tai updated FLINK-4023:
---------------------------------------
    Fix Version/s: 1.2.0

> Move Kafka consumer partition discovery from constructor to open()
> ------------------------------------------------------------------
>
>                 Key: FLINK-4023
>                 URL: https://issues.apache.org/jira/browse/FLINK-4023
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kafka Connector
>            Reporter: Michal Harish
>            Priority: Minor
>              Labels: kafka, kafka-0.8
>             Fix For: 1.2.0
>
>
> Currently, Flink queries Kafka for partition information when creating the Kafka consumer. This is done on the client when submitting the Flink job, which requires the client to be able to fetch the partition data from Kafka which may only be accessible from the cluster environment where the tasks will be running. Moving the partition discovery to the open() method should solve this problem.
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)