You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Robert Metzger (JIRA)" <ji...@apache.org> on 2016/10/10 12:48:20 UTC
[jira] [Comment Edited] (FLINK-4023) Move Kafka consumer partition
discovery from constructor to open()
[ https://issues.apache.org/jira/browse/FLINK-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15562211#comment-15562211 ]
Robert Metzger edited comment on FLINK-4023 at 10/10/16 12:48 PM:
------------------------------------------------------------------
This has been resolved in FLINK-4379.
I'm sorry that the communication didn't properly happen here. (@[~srichter], [~tzulitai] was assigned to that task, but I think its okay for Gordon that this is resolved. For the future, it would be nice if you could check if there's already a JIRA for a change)
was (Author: rmetzger):
This has been resolved in FLINK-4379.
> Move Kafka consumer partition discovery from constructor to open()
> ------------------------------------------------------------------
>
> Key: FLINK-4023
> URL: https://issues.apache.org/jira/browse/FLINK-4023
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
> Reporter: Michal Harish
> Assignee: Stefan Richter
> Priority: Minor
> Labels: kafka, kafka-0.8
> Fix For: 1.2.0
>
>
> Currently, Flink queries Kafka for partition information when creating the Kafka consumer. This is done on the client when submitting the Flink job, which requires the client to be able to fetch the partition data from Kafka which may only be accessible from the cluster environment where the tasks will be running. Moving the partition discovery to the open() method should solve this problem.
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)