You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Raghu Angadi (JIRA)" <ji...@apache.org> on 2017/07/04 07:20:00 UTC

[jira] [Created] (BEAM-2551) KafkaIO reader blocks indefinitely if servers are not reachable

Raghu Angadi created BEAM-2551:
----------------------------------

             Summary: KafkaIO reader blocks indefinitely if servers are not reachable
                 Key: BEAM-2551
                 URL: https://issues.apache.org/jira/browse/BEAM-2551
             Project: Beam
          Issue Type: Bug
          Components: sdk-java-extensions
            Reporter: Raghu Angadi
            Assignee: Raghu Angadi



If the KafaIO source reader on the worker can't reach the server, Kafka consumer blocks forever inside {{UnboundedReader.start()}}. Users have no indication of the error. It is better if start() fails with an error. 

It is easy to reproduce in Kafka. I reported it on Kafka users list here : https://lists.apache.org/thread.html/98cebefacbd65b0d6c6817fe0b5197e26bc60252e72d05fced91e628@%3Cusers.kafka.apache.org%3E

It blocks inside Kafka client. Fortunately it can be unblocked with KafkaConsumer.wakeup(). We could run initialization in another thread and cancel it if takes longer than a minute.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)