You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by 陈江枫 <ka...@gmail.com> on 2017/07/19 02:59:24 UTC
Consumer blocked when auth failed.
Hi,
I was integrating Kafka with Spark, using DirectStream, when my
authentication fail, the stream just blocked. No log, no exceptions were
thrown. Could some one help to address such situtation
Re: Consumer blocked when auth failed.
Posted by 陈江枫 <ka...@gmail.com>.
Hi,
I intentionally use the wrong credential, get the following log:
*java.net.ConnectException: Connection refused*
* at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)*
* at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)*
* at
org.apache.kafka.common.network.PlaintextTransportLayer.finishConnect(PlaintextTransportLayer.java:51)*
* at
org.apache.kafka.common.network.KafkaChannel.finishConnect(KafkaChannel.java:81)*
* at
org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:335)*
* at org.apache.kafka.common.network.Selector.poll(Selector.java:303)*
* at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:349)*
* at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:226)*
* at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:203)*
* at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.awaitMetadataUpdate(ConsumerNetworkClient.java:138)*
* at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:216)*
* at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:193)*
* at
org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:279)*
* at
org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029)*
* at
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995)*
* at
org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.paranoidPoll(DirectKafkaInputDStream.scala:168)*
* at
org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.start(DirectKafkaInputDStream.scala:244)*
Any Idea how to throw exception in the main thread instead of just blocking.
2017-07-20 14:11 GMT+08:00 Jason Gustafson <ja...@confluent.io>:
> What log level do you have configured? You might bump up to DEBUG or TRACE
> and see if anything stands out.
>
> -Jason
>
> On Tue, Jul 18, 2017 at 7:59 PM, 陈江枫 <ka...@gmail.com> wrote:
>
> > Hi,
> >
> > I was integrating Kafka with Spark, using DirectStream, when my
> > authentication fail, the stream just blocked. No log, no exceptions were
> > thrown. Could some one help to address such situtation
> >
>
Re: Consumer blocked when auth failed.
Posted by Jason Gustafson <ja...@confluent.io>.
What log level do you have configured? You might bump up to DEBUG or TRACE
and see if anything stands out.
-Jason
On Tue, Jul 18, 2017 at 7:59 PM, 陈江枫 <ka...@gmail.com> wrote:
> Hi,
>
> I was integrating Kafka with Spark, using DirectStream, when my
> authentication fail, the stream just blocked. No log, no exceptions were
> thrown. Could some one help to address such situtation
>
Re: Consumer blocked when auth failed.
Posted by Jason Gustafson <ja...@confluent.io>.
What log level do you have configured? You might bump up to DEBUG or TRACE
and see if anything stands out.
-Jason
On Tue, Jul 18, 2017 at 7:59 PM, 陈江枫 <ka...@gmail.com> wrote:
> Hi,
>
> I was integrating Kafka with Spark, using DirectStream, when my
> authentication fail, the stream just blocked. No log, no exceptions were
> thrown. Could some one help to address such situtation
>