You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by Luciano Afranllie <li...@gmail.com> on 2016/06/29 21:16:49 UTC

Use Kafka 0.9.0.1 or 0.10.0.0 with Zookeeper 3.5

Hi

I would like some advice about what are the changes, at high level,
required to use kafka 0.9.0.1 or 0.10.0.0 with Zookeeper 3.5.x (3.5.1-alpha
for example) using TLS/SSL. How big are the changes required in Kafka in
order to be able to do this?

Regards
Luciano

Re: Use Kafka 0.9.0.1 or 0.10.0.0 with Zookeeper 3.5

Posted by Luciano Afranllie <li...@gmail.com>.
Hi

I was able to run Kafka 0.9 using zookeeper-3.5.2-alpha with SSL enabled. I
did not do a deep testing but was able to run Kafka and produce/consume
using console tools.

What I did is to build zkClient with zookeeper-3.5.2-alpha and then build
Kafka with this new zkClient, zookeeper-3.5.2-alpha and Netty.
After that, I modified Zookeeper and Kafka start scripts and config to use
SSL as described in ZooKeeper SSL User Guide
<https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide>

If you think it is useful I can add a detailed description in Kafka or some
other wiki.

Regards
Luciano

On Thu, Jun 30, 2016 at 8:42 AM, Luciano Afranllie <listas.luafran@gmail.com
> wrote:

> Thanks Flavio
>
> Your last statement is the key here. What we really need is to secure
> connections between Kafka and zk and between zk nodes. Our understanding so
> far is that zk 3.5 will allow us to do that so we want to understand what
> we need to do in Kafka side in order to use TLS connections to Zookeeper.
>
> Regards
> Luciano
>
>
> On Wed, Jun 29, 2016 at 7:10 PM, Flavio Junqueira <fp...@apache.org> wrote:
>
>> Hi Luciano,
>>
>> I can't remember seeing a discussion in this community about 3.5. I
>> suspect your real question is how to set it up to use TLS/SSL because
>> everything else should remain the same. You should be able to run a Kafka
>> cluster as is against a 3.5 ensemble, but you won't have a secure
>> connection to zk.
>>
>> -Flavio
>>
>> > On 29 Jun 2016, at 22:16, Luciano Afranllie <li...@gmail.com>
>> wrote:
>> >
>> > Hi
>> >
>> > I would like some advice about what are the changes, at high level,
>> > required to use kafka 0.9.0.1 or 0.10.0.0 with Zookeeper 3.5.x
>> (3.5.1-alpha
>> > for example) using TLS/SSL. How big are the changes required in Kafka in
>> > order to be able to do this?
>> >
>> > Regards
>> > Luciano
>>
>>
>

Re: Use Kafka 0.9.0.1 or 0.10.0.0 with Zookeeper 3.5

Posted by Luciano Afranllie <li...@gmail.com>.
Thanks Flavio

Your last statement is the key here. What we really need is to secure
connections between Kafka and zk and between zk nodes. Our understanding so
far is that zk 3.5 will allow us to do that so we want to understand what
we need to do in Kafka side in order to use TLS connections to Zookeeper.

Regards
Luciano


On Wed, Jun 29, 2016 at 7:10 PM, Flavio Junqueira <fp...@apache.org> wrote:

> Hi Luciano,
>
> I can't remember seeing a discussion in this community about 3.5. I
> suspect your real question is how to set it up to use TLS/SSL because
> everything else should remain the same. You should be able to run a Kafka
> cluster as is against a 3.5 ensemble, but you won't have a secure
> connection to zk.
>
> -Flavio
>
> > On 29 Jun 2016, at 22:16, Luciano Afranllie <li...@gmail.com>
> wrote:
> >
> > Hi
> >
> > I would like some advice about what are the changes, at high level,
> > required to use kafka 0.9.0.1 or 0.10.0.0 with Zookeeper 3.5.x
> (3.5.1-alpha
> > for example) using TLS/SSL. How big are the changes required in Kafka in
> > order to be able to do this?
> >
> > Regards
> > Luciano
>
>

Re: Use Kafka 0.9.0.1 or 0.10.0.0 with Zookeeper 3.5

Posted by Flavio Junqueira <fp...@apache.org>.
Hi Luciano,

I can't remember seeing a discussion in this community about 3.5. I suspect your real question is how to set it up to use TLS/SSL because everything else should remain the same. You should be able to run a Kafka cluster as is against a 3.5 ensemble, but you won't have a secure connection to zk.

-Flavio
 
> On 29 Jun 2016, at 22:16, Luciano Afranllie <li...@gmail.com> wrote:
> 
> Hi
> 
> I would like some advice about what are the changes, at high level,
> required to use kafka 0.9.0.1 or 0.10.0.0 with Zookeeper 3.5.x (3.5.1-alpha
> for example) using TLS/SSL. How big are the changes required in Kafka in
> order to be able to do this?
> 
> Regards
> Luciano