You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by sham singh <si...@gmail.com> on 2017/12/21 20:27:27 UTC
Kafka SSL error
Hello All -
I'm getting this error, when publishing messages to Kafka topic using SSL
mode,
Command to publish messages :
*/usr/hdp/2.5.3.0-37/kafka/bin/kafka-producer-perf-test.sh --messages
1000000 --message-size 1000 --topics mmtest4 \*
*--broker-list <host1>:9093,<host2>:9093,<host3>:9093, \*
*--threads 1 --compression-codec 3 --batch-size 10000 \*
*--security-protocol SSL --show-detailed-stats*
*[2017-12-21 19:48:49,846] WARN Fetching topic metadata with correlation id
11 for topics [Set(mmtest4)] from broker [BrokerEndPoint(0,<host1>,9093)]
failed (kafka.client.ClientUtils$)*
*java.io.EOFException*
* at
org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:99)*
* at
kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:140)*
* at kafka.network.BlockingChannel.receive(BlockingChannel.scala:131)*
* at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:84)*
* at
kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:81)*
* at kafka.producer.SyncProducer.send(SyncProducer.scala:126)*
* at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)*
* at
kafka.producer.BrokerPartitionInfo.updateInfo(BrokerPartitionInfo.scala:83)*
* at
kafka.producer.BrokerPartitionInfo.getBrokerPartitionInfo(BrokerPartitionInfo.scala:50)*
* at
kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$getPartitionListForTopic(DefaultEventHandler.scala:206)*
* at
kafka.producer.async.DefaultEventHandler$$anonfun$partitionAndCollate$1.apply(DefaultEventHandler.scala:170)*
* at
kafka.producer.async.DefaultEventHandler$$anonfun$partitionAndCollate$1.apply(DefaultEventHandler.scala:169)*
* at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)*
* at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)*
* at
kafka.producer.async.DefaultEventHandler.partitionAndCollate(DefaultEventHandler.scala:169)*
* at
kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:101)*
* at
kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:78)*
* at
kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:106)*
* at
kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:89)*
* at
kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:69)*
* at scala.collection.Iterator$class.foreach(Iterator.scala:727)*
* at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)*
* at
kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:68)*
* at
kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:46)*
Seems SSL is setup correctly, when i run the following command, i get
expected result ->
*openssl s_client -debug -connect host1:9093 -tls1*
Setting done in the server.properties (using Ambari) ->
*listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093*
* advertised.listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093*
* ssl.truststore.location=/etc/kafka/truststore/kafka.server.truststore.jks*
* ssl.truststore.password=password*
* ssl.keystore.location=/etc/kafka/truststore//kafka.server.keystore.jks*
* ssl.keystore.password=password*
* ssl.key.password=password*
These setting seem to be working on another environment, however - on this
env (Prod),
it seem to be giving the error shown above.
Any ideas on what need to be done to debug/fix the error ?
Re: Kafka SSL error
Posted by sham singh <si...@gmail.com>.
hello,
here is the update on this ..
seems the script ->
*/usr/hdp/2.5.3.0-37/kafka/bin/kafka-producer-perf-test.sh *
has an issue in SSL mode, it seems to not be able to recognize the
security-protocol=SSL & the config file passed i.e. when the truststore,
password is passed through the config file ..
when i use the script ->
*/usr/hdp/2.5.3.0-37/kafka/bin/kafka-console-producer.sh**, *
i'm able to produce the messages in SSL mode, by passing the security
protocol & passing the same config files.
*/usr/hdp/2.5.3.0-37/kafka/bin/kafka-console-producer.sh --topic mmtest1
--security-protocol SSL --broker-list host1:9093 --producer.config
/usr/hdp/2.5.3.0-37/kafka/mirror-maker/client-ssl.properties *
I'm using Kafka 0.10 ..
anyone else faced similar issues ?
btw, i'm using Hortonworks distribution.
On Thu, Dec 21, 2017 at 1:06 PM, sham singh <si...@gmail.com>
wrote:
> Ted - i'm not seeing any difference in the Non-working & working clusters
> ..
>
> Another thing, seem like there is some issue with the connectivity .. the
> console consumer gets disconnected
>
> /usr/hdp/2.5.3.0-37/kafka/bin/kafka-console-consumer.sh --new-consumer
> --topic mmtest1 --bootstrap-server host1:9093 --property print.key=true
> --property print.value=true --property key.deserializer=org.apache.
> kafka.common.serialization.StringDeserializer --property
> value.deserializer=org.apache.kafka.common.serialization.
> StringDeserializer
> [2017-12-21 21:02:48,803] WARN Bootstrap broker host1:9093 disconnected
> (org.apache.kafka.clients.NetworkClient)
> [2017-12-21 21:02:48,981] WARN Bootstrap broker host1:9093 disconnected
> (org.apache.kafka.clients.NetworkClient)
> [2017-12-21 21:02:49,159] WARN Bootstrap broker host1:9093 disconnected
> (org.apache.kafka.clients.NetworkClient)
>
> On Thu, Dec 21, 2017 at 12:49 PM, Ted Yu <yu...@gmail.com> wrote:
>
>> Since you're using a Vendor's distro, can you post on their community
>> page ?
>>
>> BTW do you notice any difference in settings between the working cluster
>> and this cluster ?
>>
>> Cheers
>>
>> On Thu, Dec 21, 2017 at 12:27 PM, sham singh <si...@gmail.com>
>> wrote:
>>
>> > Hello All -
>> > I'm getting this error, when publishing messages to Kafka topic using
>> SSL
>> > mode,
>> >
>> > Command to publish messages :
>> >
>> > */usr/hdp/2.5.3.0-37/kafka/bin/kafka-producer-perf-test.sh --messages
>> > 1000000 --message-size 1000 --topics mmtest4 \*
>> > *--broker-list <host1>:9093,<host2>:9093,<host3>:9093, \*
>> > *--threads 1 --compression-codec 3 --batch-size 10000 \*
>> > *--security-protocol SSL --show-detailed-stats*
>> >
>> >
>> >
>> > *[2017-12-21 19:48:49,846] WARN Fetching topic metadata with
>> correlation id
>> > 11 for topics [Set(mmtest4)] from broker [BrokerEndPoint(0,<host1>,9093
>> )]
>> > failed (kafka.client.ClientUtils$)*
>> > *java.io.EOFException*
>> > * at
>> > org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(
>> > NetworkReceive.java:99)*
>> > * at
>> > kafka.network.BlockingChannel.readCompletely(BlockingChannel
>> .scala:140)*
>> > * at kafka.network.BlockingChannel.receive(BlockingChannel.scala:131)*
>> > * at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:84)*
>> > * at
>> > kafka.producer.SyncProducer.kafka$producer$SyncProducer$$
>> > doSend(SyncProducer.scala:81)*
>> > * at kafka.producer.SyncProducer.send(SyncProducer.scala:126)*
>> > * at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.
>> scala:59)*
>> > * at
>> > kafka.producer.BrokerPartitionInfo.updateInfo(
>> > BrokerPartitionInfo.scala:83)*
>> > * at
>> > kafka.producer.BrokerPartitionInfo.getBrokerPartitionInfo(
>> > BrokerPartitionInfo.scala:50)*
>> > * at
>> > kafka.producer.async.DefaultEventHandler.kafka$producer$async$
>> > DefaultEventHandler$$getPartitionListForTopic(
>> > DefaultEventHandler.scala:206)*
>> > * at
>> > kafka.producer.async.DefaultEventHandler$$anonfun$
>> > partitionAndCollate$1.apply(DefaultEventHandler.scala:170)*
>> > * at
>> > kafka.producer.async.DefaultEventHandler$$anonfun$
>> > partitionAndCollate$1.apply(DefaultEventHandler.scala:169)*
>> > * at
>> > scala.collection.mutable.ResizableArray$class.foreach(
>> > ResizableArray.scala:59)*
>> > * at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.
>> scala:47)*
>> > * at
>> > kafka.producer.async.DefaultEventHandler.partitionAndCollate(
>> > DefaultEventHandler.scala:169)*
>> > * at
>> > kafka.producer.async.DefaultEventHandler.dispatchSerializedData(
>> > DefaultEventHandler.scala:101)*
>> > * at
>> > kafka.producer.async.DefaultEventHandler.handle(
>> > DefaultEventHandler.scala:78)*
>> > * at
>> > kafka.producer.async.ProducerSendThread.tryToHandle(
>> > ProducerSendThread.scala:106)*
>> > * at
>> > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(
>> > ProducerSendThread.scala:89)*
>> > * at
>> > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(
>> > ProducerSendThread.scala:69)*
>> > * at scala.collection.Iterator$class.foreach(Iterator.scala:727)*
>> > * at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)*
>> > * at
>> > kafka.producer.async.ProducerSendThread.processEvents(
>> > ProducerSendThread.scala:68)*
>> > * at
>> > kafka.producer.async.ProducerSendThread.run(ProducerSendThre
>> ad.scala:46)*
>> > Seems SSL is setup correctly, when i run the following command, i get
>> > expected result ->
>> > *openssl s_client -debug -connect host1:9093 -tls1*
>> >
>> > Setting done in the server.properties (using Ambari) ->
>> > *listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093*
>> > * advertised.listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093*
>> > * ssl.truststore.location=/etc/kafka/truststore/kafka.server.
>> > truststore.jks*
>> > * ssl.truststore.password=password*
>> > * ssl.keystore.location=/etc/kafka/truststore//kafka.server.
>> keystore.jks*
>> > * ssl.keystore.password=password*
>> > * ssl.key.password=password*
>> > These setting seem to be working on another environment, however - on
>> this
>> > env (Prod),
>> > it seem to be giving the error shown above.
>> > Any ideas on what need to be done to debug/fix the error ?
>> >
>>
>
>
Re: Kafka SSL error
Posted by Martin Gainty <mg...@hotmail.com>.
possible you are either not connecting (someone is blocking/redirecting)
or possibly you are not authenticating with your security configuration parameters:
are your redirecting to other IP's or Ports by intervening proxys?
can you ping all the IP addresses in the cluster?
can u post the results of your authentication attempts ?
java -Djavax.net.debug=all
...
Martin
______________________________________________
_____ _ _____ _ _____ ___ _ _____ _ _ _ |_ _| |_ ___ | _ |___ ___ ___| |_ ___ | __|___| _| |_ _ _ _ ___ ___ ___ | __|___ _ _ ___ _| |___| |_|_|___ ___ | | | | -_| | | . | .'| _| | -_| |__ | . | _| _| | | | .'| _| -_| | __| . | | | | . | .'| _| | . | | |_| |_|_|___| |__|__| _|__,|___|_|_|___| |_____|___|_| |_| |_____|__,|_| |___| |__| |___|___|_|_|___|__,|_| |_|___|_|_| |_|
________________________________
From: sham singh <si...@gmail.com>
Sent: Thursday, December 21, 2017 4:06 PM
To: users@kafka.apache.org
Subject: Re: Kafka SSL error
Ted - i'm not seeing any difference in the Non-working & working clusters ..
Another thing, seem like there is some issue with the connectivity .. the
console consumer gets disconnected
/usr/hdp/2.5.3.0-37/kafka/bin/kafka-console-consumer.sh --new-consumer
--topic mmtest1 --bootstrap-server host1:9093 --property print.key=true
--property print.value=true --property
key.deserializer=org.apache.kafka.common.serialization.StringDeserializer
--property
value.deserializer=org.apache.kafka.common.serialization.StringDeserializer
[2017-12-21 21:02:48,803] WARN Bootstrap broker host1:9093 disconnected
(org.apache.kafka.clients.NetworkClient)
[2017-12-21 21:02:48,981] WARN Bootstrap broker host1:9093 disconnected
(org.apache.kafka.clients.NetworkClient)
[2017-12-21 21:02:49,159] WARN Bootstrap broker host1:9093 disconnected
(org.apache.kafka.clients.NetworkClient)
On Thu, Dec 21, 2017 at 12:49 PM, Ted Yu <yu...@gmail.com> wrote:
> Since you're using a Vendor's distro, can you post on their community page
> ?
>
> BTW do you notice any difference in settings between the working cluster
> and this cluster ?
>
> Cheers
>
> On Thu, Dec 21, 2017 at 12:27 PM, sham singh <si...@gmail.com>
> wrote:
>
> > Hello All -
> > I'm getting this error, when publishing messages to Kafka topic using SSL
> > mode,
> >
> > Command to publish messages :
> >
> > */usr/hdp/2.5.3.0-37/kafka/bin/kafka-producer-perf-test.sh --messages
> > 1000000 --message-size 1000 --topics mmtest4 \*
> > *--broker-list <host1>:9093,<host2>:9093,<host3>:9093, \*
> > *--threads 1 --compression-codec 3 --batch-size 10000 \*
> > *--security-protocol SSL --show-detailed-stats*
> >
> >
> >
> > *[2017-12-21 19:48:49,846] WARN Fetching topic metadata with correlation
> id
> > 11 for topics [Set(mmtest4)] from broker [BrokerEndPoint(0,<host1>,
> 9093)]
> > failed (kafka.client.ClientUtils$)*
> > *java.io.EOFException*
> > * at
> > org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(
> > NetworkReceive.java:99)*
> > * at
> > kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:140)*
> > * at kafka.network.BlockingChannel.receive(BlockingChannel.scala:131)*
> > * at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:84)*
> > * at
> > kafka.producer.SyncProducer.kafka$producer$SyncProducer$$
> > doSend(SyncProducer.scala:81)*
> > * at kafka.producer.SyncProducer.send(SyncProducer.scala:126)*
> > * at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)*
> > * at
> > kafka.producer.BrokerPartitionInfo.updateInfo(
> > BrokerPartitionInfo.scala:83)*
> > * at
> > kafka.producer.BrokerPartitionInfo.getBrokerPartitionInfo(
> > BrokerPartitionInfo.scala:50)*
> > * at
> > kafka.producer.async.DefaultEventHandler.kafka$producer$async$
> > DefaultEventHandler$$getPartitionListForTopic(
> > DefaultEventHandler.scala:206)*
> > * at
> > kafka.producer.async.DefaultEventHandler$$anonfun$
> > partitionAndCollate$1.apply(DefaultEventHandler.scala:170)*
> > * at
> > kafka.producer.async.DefaultEventHandler$$anonfun$
> > partitionAndCollate$1.apply(DefaultEventHandler.scala:169)*
> > * at
> > scala.collection.mutable.ResizableArray$class.foreach(
> > ResizableArray.scala:59)*
> > * at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)*
> > * at
> > kafka.producer.async.DefaultEventHandler.partitionAndCollate(
> > DefaultEventHandler.scala:169)*
> > * at
> > kafka.producer.async.DefaultEventHandler.dispatchSerializedData(
> > DefaultEventHandler.scala:101)*
> > * at
> > kafka.producer.async.DefaultEventHandler.handle(
> > DefaultEventHandler.scala:78)*
> > * at
> > kafka.producer.async.ProducerSendThread.tryToHandle(
> > ProducerSendThread.scala:106)*
> > * at
> > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(
> > ProducerSendThread.scala:89)*
> > * at
> > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(
> > ProducerSendThread.scala:69)*
> > * at scala.collection.Iterator$class.foreach(Iterator.scala:727)*
> > * at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)*
> > * at
> > kafka.producer.async.ProducerSendThread.processEvents(
> > ProducerSendThread.scala:68)*
> > * at
> > kafka.producer.async.ProducerSendThread.run(
> ProducerSendThread.scala:46)*
> > Seems SSL is setup correctly, when i run the following command, i get
> > expected result ->
> > *openssl s_client -debug -connect host1:9093 -tls1*
> >
> > Setting done in the server.properties (using Ambari) ->
> > *listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093*
> > * advertised.listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093*
> > * ssl.truststore.location=/etc/kafka/truststore/kafka.server.
> > truststore.jks*
> > * ssl.truststore.password=password*
> > * ssl.keystore.location=/etc/kafka/truststore//kafka.
> server.keystore.jks*
> > * ssl.keystore.password=password*
> > * ssl.key.password=password*
> > These setting seem to be working on another environment, however - on
> this
> > env (Prod),
> > it seem to be giving the error shown above.
> > Any ideas on what need to be done to debug/fix the error ?
> >
>
Re: Kafka SSL error
Posted by sham singh <si...@gmail.com>.
Ted - i'm not seeing any difference in the Non-working & working clusters ..
Another thing, seem like there is some issue with the connectivity .. the
console consumer gets disconnected
/usr/hdp/2.5.3.0-37/kafka/bin/kafka-console-consumer.sh --new-consumer
--topic mmtest1 --bootstrap-server host1:9093 --property print.key=true
--property print.value=true --property
key.deserializer=org.apache.kafka.common.serialization.StringDeserializer
--property
value.deserializer=org.apache.kafka.common.serialization.StringDeserializer
[2017-12-21 21:02:48,803] WARN Bootstrap broker host1:9093 disconnected
(org.apache.kafka.clients.NetworkClient)
[2017-12-21 21:02:48,981] WARN Bootstrap broker host1:9093 disconnected
(org.apache.kafka.clients.NetworkClient)
[2017-12-21 21:02:49,159] WARN Bootstrap broker host1:9093 disconnected
(org.apache.kafka.clients.NetworkClient)
On Thu, Dec 21, 2017 at 12:49 PM, Ted Yu <yu...@gmail.com> wrote:
> Since you're using a Vendor's distro, can you post on their community page
> ?
>
> BTW do you notice any difference in settings between the working cluster
> and this cluster ?
>
> Cheers
>
> On Thu, Dec 21, 2017 at 12:27 PM, sham singh <si...@gmail.com>
> wrote:
>
> > Hello All -
> > I'm getting this error, when publishing messages to Kafka topic using SSL
> > mode,
> >
> > Command to publish messages :
> >
> > */usr/hdp/2.5.3.0-37/kafka/bin/kafka-producer-perf-test.sh --messages
> > 1000000 --message-size 1000 --topics mmtest4 \*
> > *--broker-list <host1>:9093,<host2>:9093,<host3>:9093, \*
> > *--threads 1 --compression-codec 3 --batch-size 10000 \*
> > *--security-protocol SSL --show-detailed-stats*
> >
> >
> >
> > *[2017-12-21 19:48:49,846] WARN Fetching topic metadata with correlation
> id
> > 11 for topics [Set(mmtest4)] from broker [BrokerEndPoint(0,<host1>,
> 9093)]
> > failed (kafka.client.ClientUtils$)*
> > *java.io.EOFException*
> > * at
> > org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(
> > NetworkReceive.java:99)*
> > * at
> > kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:140)*
> > * at kafka.network.BlockingChannel.receive(BlockingChannel.scala:131)*
> > * at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:84)*
> > * at
> > kafka.producer.SyncProducer.kafka$producer$SyncProducer$$
> > doSend(SyncProducer.scala:81)*
> > * at kafka.producer.SyncProducer.send(SyncProducer.scala:126)*
> > * at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)*
> > * at
> > kafka.producer.BrokerPartitionInfo.updateInfo(
> > BrokerPartitionInfo.scala:83)*
> > * at
> > kafka.producer.BrokerPartitionInfo.getBrokerPartitionInfo(
> > BrokerPartitionInfo.scala:50)*
> > * at
> > kafka.producer.async.DefaultEventHandler.kafka$producer$async$
> > DefaultEventHandler$$getPartitionListForTopic(
> > DefaultEventHandler.scala:206)*
> > * at
> > kafka.producer.async.DefaultEventHandler$$anonfun$
> > partitionAndCollate$1.apply(DefaultEventHandler.scala:170)*
> > * at
> > kafka.producer.async.DefaultEventHandler$$anonfun$
> > partitionAndCollate$1.apply(DefaultEventHandler.scala:169)*
> > * at
> > scala.collection.mutable.ResizableArray$class.foreach(
> > ResizableArray.scala:59)*
> > * at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)*
> > * at
> > kafka.producer.async.DefaultEventHandler.partitionAndCollate(
> > DefaultEventHandler.scala:169)*
> > * at
> > kafka.producer.async.DefaultEventHandler.dispatchSerializedData(
> > DefaultEventHandler.scala:101)*
> > * at
> > kafka.producer.async.DefaultEventHandler.handle(
> > DefaultEventHandler.scala:78)*
> > * at
> > kafka.producer.async.ProducerSendThread.tryToHandle(
> > ProducerSendThread.scala:106)*
> > * at
> > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(
> > ProducerSendThread.scala:89)*
> > * at
> > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(
> > ProducerSendThread.scala:69)*
> > * at scala.collection.Iterator$class.foreach(Iterator.scala:727)*
> > * at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)*
> > * at
> > kafka.producer.async.ProducerSendThread.processEvents(
> > ProducerSendThread.scala:68)*
> > * at
> > kafka.producer.async.ProducerSendThread.run(
> ProducerSendThread.scala:46)*
> > Seems SSL is setup correctly, when i run the following command, i get
> > expected result ->
> > *openssl s_client -debug -connect host1:9093 -tls1*
> >
> > Setting done in the server.properties (using Ambari) ->
> > *listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093*
> > * advertised.listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093*
> > * ssl.truststore.location=/etc/kafka/truststore/kafka.server.
> > truststore.jks*
> > * ssl.truststore.password=password*
> > * ssl.keystore.location=/etc/kafka/truststore//kafka.
> server.keystore.jks*
> > * ssl.keystore.password=password*
> > * ssl.key.password=password*
> > These setting seem to be working on another environment, however - on
> this
> > env (Prod),
> > it seem to be giving the error shown above.
> > Any ideas on what need to be done to debug/fix the error ?
> >
>
Re: Kafka SSL error
Posted by Ted Yu <yu...@gmail.com>.
Since you're using a Vendor's distro, can you post on their community page ?
BTW do you notice any difference in settings between the working cluster
and this cluster ?
Cheers
On Thu, Dec 21, 2017 at 12:27 PM, sham singh <si...@gmail.com>
wrote:
> Hello All -
> I'm getting this error, when publishing messages to Kafka topic using SSL
> mode,
>
> Command to publish messages :
>
> */usr/hdp/2.5.3.0-37/kafka/bin/kafka-producer-perf-test.sh --messages
> 1000000 --message-size 1000 --topics mmtest4 \*
> *--broker-list <host1>:9093,<host2>:9093,<host3>:9093, \*
> *--threads 1 --compression-codec 3 --batch-size 10000 \*
> *--security-protocol SSL --show-detailed-stats*
>
>
>
> *[2017-12-21 19:48:49,846] WARN Fetching topic metadata with correlation id
> 11 for topics [Set(mmtest4)] from broker [BrokerEndPoint(0,<host1>,9093)]
> failed (kafka.client.ClientUtils$)*
> *java.io.EOFException*
> * at
> org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(
> NetworkReceive.java:99)*
> * at
> kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:140)*
> * at kafka.network.BlockingChannel.receive(BlockingChannel.scala:131)*
> * at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:84)*
> * at
> kafka.producer.SyncProducer.kafka$producer$SyncProducer$$
> doSend(SyncProducer.scala:81)*
> * at kafka.producer.SyncProducer.send(SyncProducer.scala:126)*
> * at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)*
> * at
> kafka.producer.BrokerPartitionInfo.updateInfo(
> BrokerPartitionInfo.scala:83)*
> * at
> kafka.producer.BrokerPartitionInfo.getBrokerPartitionInfo(
> BrokerPartitionInfo.scala:50)*
> * at
> kafka.producer.async.DefaultEventHandler.kafka$producer$async$
> DefaultEventHandler$$getPartitionListForTopic(
> DefaultEventHandler.scala:206)*
> * at
> kafka.producer.async.DefaultEventHandler$$anonfun$
> partitionAndCollate$1.apply(DefaultEventHandler.scala:170)*
> * at
> kafka.producer.async.DefaultEventHandler$$anonfun$
> partitionAndCollate$1.apply(DefaultEventHandler.scala:169)*
> * at
> scala.collection.mutable.ResizableArray$class.foreach(
> ResizableArray.scala:59)*
> * at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)*
> * at
> kafka.producer.async.DefaultEventHandler.partitionAndCollate(
> DefaultEventHandler.scala:169)*
> * at
> kafka.producer.async.DefaultEventHandler.dispatchSerializedData(
> DefaultEventHandler.scala:101)*
> * at
> kafka.producer.async.DefaultEventHandler.handle(
> DefaultEventHandler.scala:78)*
> * at
> kafka.producer.async.ProducerSendThread.tryToHandle(
> ProducerSendThread.scala:106)*
> * at
> kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(
> ProducerSendThread.scala:89)*
> * at
> kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(
> ProducerSendThread.scala:69)*
> * at scala.collection.Iterator$class.foreach(Iterator.scala:727)*
> * at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)*
> * at
> kafka.producer.async.ProducerSendThread.processEvents(
> ProducerSendThread.scala:68)*
> * at
> kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:46)*
> Seems SSL is setup correctly, when i run the following command, i get
> expected result ->
> *openssl s_client -debug -connect host1:9093 -tls1*
>
> Setting done in the server.properties (using Ambari) ->
> *listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093*
> * advertised.listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093*
> * ssl.truststore.location=/etc/kafka/truststore/kafka.server.
> truststore.jks*
> * ssl.truststore.password=password*
> * ssl.keystore.location=/etc/kafka/truststore//kafka.server.keystore.jks*
> * ssl.keystore.password=password*
> * ssl.key.password=password*
> These setting seem to be working on another environment, however - on this
> env (Prod),
> it seem to be giving the error shown above.
> Any ideas on what need to be done to debug/fix the error ?
>