Without data loss migration | Kafka 10 to Kafka 11

[Sameer Kumar <sa...@gmail.com>]

Hi ,

I wanted to understand the process for production upgrade of Kafka. As
documented in the https://kafka.apache.org/documentation/#upgrade, it
should be seamless.

I had a 3 node cluster(single topic, partitions=60, replication factor =2
)on which i was trying the same.
As suggested, I first stopped first broker, did the property
changes(inter.broker.protocol.version , log.message.format.version to
10.2.1) with 11 downloaded package and restarted it. It was rebuilding
index and it took quite a bit of time.

Thereafter, when I started another node with same steps, it failed. The
partitions went offline. It seemed to me now the requirement for 2 Kafka10
nodes was not met, perhaps it wasnt able to recognize newly updated nodes.

Regards,
-Sameer.

Re: Without data loss migration | Kafka 10 to Kafka 11

[Sameer Kumar <sa...@gmail.com>]

Sure, will do that by tomorrow.

-Sameer.

On Wed, Jul 26, 2017 at 8:39 PM, Ismael Juma <is...@juma.me.uk> wrote:

> Hi Sameer,
>
> Yes, the upgrade should be seamless. Can you please share the log entries
> with the errors?
>
> Ismael
>
> On Wed, Jul 26, 2017 at 1:35 PM, Sameer Kumar <sa...@gmail.com>
> wrote:
>
> > Hi ,
> >
> > I wanted to understand the process for production upgrade of Kafka. As
> > documented in the https://kafka.apache.org/documentation/#upgrade, it
> > should be seamless.
> >
> > I had a 3 node cluster(single topic, partitions=60, replication factor =2
> > )on which i was trying the same.
> > As suggested, I first stopped first broker, did the property
> > changes(inter.broker.protocol.version , log.message.format.version to
> > 10.2.1) with 11 downloaded package and restarted it. It was rebuilding
> > index and it took quite a bit of time.
> >
> > Thereafter, when I started another node with same steps, it failed. The
> > partitions went offline. It seemed to me now the requirement for 2
> Kafka10
> > nodes was not met, perhaps it wasnt able to recognize newly updated
> nodes.
> >
> > Regards,
> > -Sameer.
> >
>

Re: Without data loss migration | Kafka 10 to Kafka 11

[Ismael Juma <is...@juma.me.uk>]

Hi Sameer,

Yes, the upgrade should be seamless. Can you please share the log entries
with the errors?

Ismael

On Wed, Jul 26, 2017 at 1:35 PM, Sameer Kumar <sa...@gmail.com>
wrote:

> Hi ,
>
> I wanted to understand the process for production upgrade of Kafka. As
> documented in the https://kafka.apache.org/documentation/#upgrade, it
> should be seamless.
>
> I had a 3 node cluster(single topic, partitions=60, replication factor =2
> )on which i was trying the same.
> As suggested, I first stopped first broker, did the property
> changes(inter.broker.protocol.version , log.message.format.version to
> 10.2.1) with 11 downloaded package and restarted it. It was rebuilding
> index and it took quite a bit of time.
>
> Thereafter, when I started another node with same steps, it failed. The
> partitions went offline. It seemed to me now the requirement for 2 Kafka10
> nodes was not met, perhaps it wasnt able to recognize newly updated nodes.
>
> Regards,
> -Sameer.
>