You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Jean-Baptiste Onofré (JIRA)" <ji...@apache.org> on 2017/07/10 20:02:00 UTC

[jira] [Resolved] (BEAM-2551) KafkaIO reader blocks indefinitely if servers are not reachable

     [ https://issues.apache.org/jira/browse/BEAM-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jean-Baptiste Onofré resolved BEAM-2551.
----------------------------------------
    Resolution: Fixed

> KafkaIO reader blocks indefinitely if servers are not reachable
> ---------------------------------------------------------------
>
>                 Key: BEAM-2551
>                 URL: https://issues.apache.org/jira/browse/BEAM-2551
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-extensions
>    Affects Versions: 2.0.0
>            Reporter: Raghu Angadi
>            Assignee: Raghu Angadi
>             Fix For: 2.1.0
>
>
> If the KafaIO source reader on the worker can't reach the server, Kafka consumer blocks forever inside {{UnboundedReader.start()}}. Users have no indication of the error. It is better if start() fails with an error. 
> It is easy to reproduce in Kafka. I reported it on Kafka users list here : https://lists.apache.org/thread.html/98cebefacbd65b0d6c6817fe0b5197e26bc60252e72d05fced91e628@%3Cusers.kafka.apache.org%3E
> It blocks inside Kafka client. Fortunately it can be unblocked with KafkaConsumer.wakeup(). We could run initialization in another thread and cancel it if takes longer than a minute.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)