[jira] [Created] (FLINK-3061) Kafka Consumer is not failing if broker is not available

["Robert Metzger (JIRA)" <ji...@apache.org>]

Robert Metzger created FLINK-3061:
-------------------------------------

             Summary: Kafka Consumer is not failing if broker is not available
                 Key: FLINK-3061
                 URL: https://issues.apache.org/jira/browse/FLINK-3061
             Project: Flink
          Issue Type: Bug
          Components: Kafka Connector
            Reporter: Robert Metzger
            Assignee: Robert Metzger
             Fix For: 1.0.0


It seems that the FlinkKafkaConsumer is just logging the errors when trying to get the initial list of partitions for the topic, but its not failing.

The following code ALWAYS runs, even if there is no broker or zookeeper running.
{code}
 def main(args: Array[String]) {
    val env = StreamExecutionEnvironment.getExecutionEnvironment
    val properties = new Properties()
    properties.setProperty("bootstrap.servers", "localhost:9092")
    properties.setProperty("zookeeper.connect", "localhost:2181")
    properties.setProperty("group.id", "test")
    val stream = env
      .addSource(new FlinkKafkaConsumer082[String]("topic", new SimpleStringSchema(), properties))
      .print

    env.execute("Flink Kafka Example")
  }
{code}

The runtime consumers are designed to idle when they have no partitions assigned, but there is no check that there are no partitions at all.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)