You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Mats Brorsson (OLA)" <ma...@olamobile.com> on 2016/01/07 11:01:24 UTC
Problems using ssl
Hello,
I have added SSL support to bruce (https://github.com/ifwe/bruce) and need to test it with Kafka 0.9. However, I have problems getting it to work.
I have followed the instructions here: http://kafka.apache.org/documentation.html#security_ssl
to enable TLS with kafka but I cannot get the console producer and consumer to work. I get a FileNotFoundException to the truststore even though the file for certain exist in the location specified.
Any ideas on how to proceed with this is appreciated. Here is my output from the consumer:
$ bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --new-consumer --consumer.config config/consumer.properties
[2016-01-07 09:41:37,313] ERROR Unknown error when running consumer: (kafka.tools.ConsoleConsumer$)
org.apache.kafka.common.KafkaException: Failed to construct kafka consumer
at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:624)
at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:518)
at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:500)
at kafka.consumer.NewShinyConsumer.<init>(BaseConsumer.scala:42)
at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:60)
at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:47)
at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)
Caused by: org.apache.kafka.common.KafkaException: org.apache.kafka.common.KafkaException: java.io.FileNotFoundException: "/home/mats/kafkassl/kafka.client.truststore.jks" (No such file or directory)
at org.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:44)
at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:60)
at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:80)
at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:553)
... 6 more
Caused by: org.apache.kafka.common.KafkaException: java.io.FileNotFoundException: "/home/mats/kafkassl/kafka.client.truststore.jks" (No such file or directory)
at org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:95)
at org.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:41)
... 9 more
Caused by: java.io.FileNotFoundException: "/home/mats/kafkassl/kafka.client.truststore.jks" (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:146)
at java.io.FileInputStream.<init>(FileInputStream.java:101)
at org.apache.kafka.common.security.ssl.SslFactory$SecurityStore.load(SslFactory.java:190)
at org.apache.kafka.common.security.ssl.SslFactory$SecurityStore.access$000(SslFactory.java:175)
at org.apache.kafka.common.security.ssl.SslFactory.createSSLContext(SslFactory.java:119)
at org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:93)
... 10 more
I’m running this on Ubuntu 14.04 with openjdk:
$ java -version
java version "1.7.0_91"
OpenJDK Runtime Environment (IcedTea 2.6.3) (7u91-2.6.3-0ubuntu0.14.04.1)
OpenJDK 64-Bit Server VM (build 24.91-b01, mixed mode)
Kind regards
--
Mats Brorsson
---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus
Re: Problems using ssl
Posted by Ismael Juma <is...@gmail.com>.
For reference, here's the PR with the fixes:
https://github.com/apache/kafka/pull/745
Ismael
On Thu, Jan 7, 2016 at 7:51 PM, Ismael Juma <is...@gmail.com> wrote:
> Hi Mats,
>
> There's a bug in the documentation where quotes are used in the properties
> file even though they should not. I'll submit a PR to fix it in a moment.
>
> Is that the problem perhaps?
>
> Ismael
> On 7 Jan 2016 15:45, "Mats Brorsson (OLA)" <ma...@olamobile.com>
> wrote:
>
>> Hello,
>>
>> I have added SSL support to bruce (https://github.com/ifwe/bruce) and
>> need to test it with Kafka 0.9. However, I have problems getting it to work.
>>
>> I have followed the instructions here:
>> http://kafka.apache.org/documentation.html#security_ssl
>> to enable TLS with kafka but I cannot get the console producer and
>> consumer to work. I get a FileNotFoundException to the truststore even
>> though the file for certain exist in the location specified.
>>
>> Any ideas on how to proceed with this is appreciated. Here is my output
>> from the consumer:
>>
>> $ bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic
>> test --new-consumer --consumer.config config/consumer.properties
>> [2016-01-07 09:41:37,313] ERROR Unknown error when running consumer:
>> (kafka.tools.ConsoleConsumer$)
>> org.apache.kafka.common.KafkaException: Failed to construct kafka consumer
>> at
>> org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:624)
>> at
>> org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:518)
>> at
>> org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:500)
>> at kafka.consumer.NewShinyConsumer.<init>(BaseConsumer.scala:42)
>> at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:60)
>> at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:47)
>> at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)
>> Caused by: org.apache.kafka.common.KafkaException:
>> org.apache.kafka.common.KafkaException: java.io.FileNotFoundException:
>> "/home/mats/kafkassl/kafka.client.truststore.jks" (No such file or
>> directory)
>> at
>> org.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:44)
>> at
>> org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:60)
>> at
>> org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:80)
>> at
>> org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:553)
>> ... 6 more
>> Caused by: org.apache.kafka.common.KafkaException:
>> java.io.FileNotFoundException:
>> "/home/mats/kafkassl/kafka.client.truststore.jks" (No such file or
>> directory)
>> at
>> org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:95)
>> at
>> org.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:41)
>> ... 9 more
>> Caused by: java.io.FileNotFoundException:
>> "/home/mats/kafkassl/kafka.client.truststore.jks" (No such file or
>> directory)
>> at java.io.FileInputStream.open(Native Method)
>> at java.io.FileInputStream.<init>(FileInputStream.java:146)
>> at java.io.FileInputStream.<init>(FileInputStream.java:101)
>> at
>> org.apache.kafka.common.security.ssl.SslFactory$SecurityStore.load(SslFactory.java:190)
>> at
>> org.apache.kafka.common.security.ssl.SslFactory$SecurityStore.access$000(SslFactory.java:175)
>> at
>> org.apache.kafka.common.security.ssl.SslFactory.createSSLContext(SslFactory.java:119)
>> at
>> org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:93)
>> ... 10 more
>>
>> I’m running this on Ubuntu 14.04 with openjdk:
>> $ java -version
>> java version "1.7.0_91"
>> OpenJDK Runtime Environment (IcedTea 2.6.3) (7u91-2.6.3-0ubuntu0.14.04.1)
>> OpenJDK 64-Bit Server VM (build 24.91-b01, mixed mode)
>>
>> Kind regards
>>
>> --
>> Mats Brorsson
>>
>>
>>
>> ---
>> This email has been checked for viruses by Avast antivirus software.
>> https://www.avast.com/antivirus
>>
>
Re: Problems using ssl
Posted by Ismael Juma <is...@gmail.com>.
Hi Mats,
There's a bug in the documentation where quotes are used in the properties
file even though they should not. I'll submit a PR to fix it in a moment.
Is that the problem perhaps?
Ismael
On 7 Jan 2016 15:45, "Mats Brorsson (OLA)" <ma...@olamobile.com>
wrote:
> Hello,
>
> I have added SSL support to bruce (https://github.com/ifwe/bruce) and
> need to test it with Kafka 0.9. However, I have problems getting it to work.
>
> I have followed the instructions here:
> http://kafka.apache.org/documentation.html#security_ssl
> to enable TLS with kafka but I cannot get the console producer and
> consumer to work. I get a FileNotFoundException to the truststore even
> though the file for certain exist in the location specified.
>
> Any ideas on how to proceed with this is appreciated. Here is my output
> from the consumer:
>
> $ bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic
> test --new-consumer --consumer.config config/consumer.properties
> [2016-01-07 09:41:37,313] ERROR Unknown error when running consumer:
> (kafka.tools.ConsoleConsumer$)
> org.apache.kafka.common.KafkaException: Failed to construct kafka consumer
> at
> org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:624)
> at
> org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:518)
> at
> org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:500)
> at kafka.consumer.NewShinyConsumer.<init>(BaseConsumer.scala:42)
> at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:60)
> at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:47)
> at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)
> Caused by: org.apache.kafka.common.KafkaException:
> org.apache.kafka.common.KafkaException: java.io.FileNotFoundException:
> "/home/mats/kafkassl/kafka.client.truststore.jks" (No such file or
> directory)
> at
> org.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:44)
> at
> org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:60)
> at
> org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:80)
> at
> org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:553)
> ... 6 more
> Caused by: org.apache.kafka.common.KafkaException:
> java.io.FileNotFoundException:
> "/home/mats/kafkassl/kafka.client.truststore.jks" (No such file or
> directory)
> at
> org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:95)
> at
> org.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:41)
> ... 9 more
> Caused by: java.io.FileNotFoundException:
> "/home/mats/kafkassl/kafka.client.truststore.jks" (No such file or
> directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.<init>(FileInputStream.java:146)
> at java.io.FileInputStream.<init>(FileInputStream.java:101)
> at
> org.apache.kafka.common.security.ssl.SslFactory$SecurityStore.load(SslFactory.java:190)
> at
> org.apache.kafka.common.security.ssl.SslFactory$SecurityStore.access$000(SslFactory.java:175)
> at
> org.apache.kafka.common.security.ssl.SslFactory.createSSLContext(SslFactory.java:119)
> at
> org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:93)
> ... 10 more
>
> I’m running this on Ubuntu 14.04 with openjdk:
> $ java -version
> java version "1.7.0_91"
> OpenJDK Runtime Environment (IcedTea 2.6.3) (7u91-2.6.3-0ubuntu0.14.04.1)
> OpenJDK 64-Bit Server VM (build 24.91-b01, mixed mode)
>
> Kind regards
>
> --
> Mats Brorsson
>
>
>
> ---
> This email has been checked for viruses by Avast antivirus software.
> https://www.avast.com/antivirus
>