You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Praveen <pr...@gmail.com> on 2020/05/11 16:50:23 UTC
Kafka upgrade from 0.10 to 2.3.x
Hi folks,
I'd like to take downtime to upgrade to 2.3.x from 10.2.1. But I can't find
it in the doc for 2.3.x upgrade that I can take downtime to do this. The
instructions are for rolling upgrade only.
Has anyone tried this?
Praveen
Re: Kafka upgrade from 0.10 to 2.3.x
Posted by Xiangyuan LI <fl...@gmail.com>.
hi praveen:
we had done upgrade from 0.10.0.1 to 2.3.0 lasy year, it's feasible to
do a roll upgrade, just follow official upgrade document. although we have
met some serious problem during the process(it's such
a big change that all clients and related packages such as
spring,springboot should upgrade, too).
the most terrible one is mentioned in
https://issues.apache.org/jira/browse/KAFKA-9648. but i think most kafka
users wont meet this.
because the structure used by internal topic __consuemr_offsets is
upgraded between 0.10.X and 2.3.0, if you have already set
inter.broker.protocol.version=2.3.0(the second step during rolling
upgrade), you couldn't rollback this parameter to 0.10.0.X, because lower
version
kafka server couldn't know newer version structure. but if you just upgrade
step1(use 2.3.0 jar), it's ok to downgrade server program to 0.10.X.
Praveen <pr...@gmail.com> 于2020年5月18日周一 下午4:02写道：
> Thanks guys. We went with rolling upgrade since we couldn't redo the
> upgrade test on our test and staging envs.
> They were already upgraded in rolling fashion and we didn't want to spend
> cycles redoing the test for downtime upgrade again.
>
> If this is possible, it would have been nice to have had the documentation
> say downtime upgrade is ok. maybe its widely understood that downtime
> upgrade is ok?
> But it was a bit confusing when it was mentioned on some upgrade versions
> but not others.
>
> Praveen
>
> On Wed, May 13, 2020 at 8:51 AM Israel Ekpo <is...@gmail.com> wrote:
>
> > It would be a good idea to attempt this upgrade in a different
> environment
> > like QA or STAGING to make sure there are no surprises first before
> > upgrading PRODUCTION
> >
> > Going from 0.10 to 2.3.x is a significant jump with potential for issues
> >
> > Running a trial in a lower environment with exact setup as PROD will
> > prepare you better for a production upgrade experience
> >
> >
> >
> > On Wed, May 13, 2020 at 3:27 AM M. Manna <ma...@gmail.com> wrote:
> >
> > > I have done this before. What Matthias said below is correct.
> > >
> > > First you’ve got to stop all apps to prevent data consumption (if
> that’s
> > > what you also mean by having downtime)
> > >
> > > Then, you can go ahead and replace the bin.
> > >
> > > Regards,
> > >
> > > On Tue, 12 May 2020 at 18:33, Matthias J. Sax <mj...@apache.org>
> wrote:
> > >
> > > > I guess you can just stop all servers, update the binaries (and
> > > > potentially configs), and afterward restart the servers.
> > > >
> > > > Of course, you might want to stop all applications that connect to
> the
> > > > cluster first.
> > > >
> > > >
> > > > -Matthias
> > > >
> > > > On 5/11/20 9:50 AM, Praveen wrote:
> > > > > Hi folks,
> > > > >
> > > > > I'd like to take downtime to upgrade to 2.3.x from 10.2.1. But I
> > can't
> > > > find
> > > > > it in the doc for 2.3.x upgrade that I can take downtime to do
> this.
> > > The
> > > > > instructions are for rolling upgrade only.
> > > > >
> > > > > Has anyone tried this?
> > > > >
> > > > > Praveen
> > > > >
> > > >
> > > >
> > >
> >
>
Re: Kafka upgrade from 0.10 to 2.3.x
Posted by Praveen <pr...@gmail.com>.
Thanks guys. We went with rolling upgrade since we couldn't redo the
upgrade test on our test and staging envs.
They were already upgraded in rolling fashion and we didn't want to spend
cycles redoing the test for downtime upgrade again.
If this is possible, it would have been nice to have had the documentation
say downtime upgrade is ok. maybe its widely understood that downtime
upgrade is ok?
But it was a bit confusing when it was mentioned on some upgrade versions
but not others.
Praveen
On Wed, May 13, 2020 at 8:51 AM Israel Ekpo <is...@gmail.com> wrote:
> It would be a good idea to attempt this upgrade in a different environment
> like QA or STAGING to make sure there are no surprises first before
> upgrading PRODUCTION
>
> Going from 0.10 to 2.3.x is a significant jump with potential for issues
>
> Running a trial in a lower environment with exact setup as PROD will
> prepare you better for a production upgrade experience
>
>
>
> On Wed, May 13, 2020 at 3:27 AM M. Manna <ma...@gmail.com> wrote:
>
> > I have done this before. What Matthias said below is correct.
> >
> > First you’ve got to stop all apps to prevent data consumption (if that’s
> > what you also mean by having downtime)
> >
> > Then, you can go ahead and replace the bin.
> >
> > Regards,
> >
> > On Tue, 12 May 2020 at 18:33, Matthias J. Sax <mj...@apache.org> wrote:
> >
> > > I guess you can just stop all servers, update the binaries (and
> > > potentially configs), and afterward restart the servers.
> > >
> > > Of course, you might want to stop all applications that connect to the
> > > cluster first.
> > >
> > >
> > > -Matthias
> > >
> > > On 5/11/20 9:50 AM, Praveen wrote:
> > > > Hi folks,
> > > >
> > > > I'd like to take downtime to upgrade to 2.3.x from 10.2.1. But I
> can't
> > > find
> > > > it in the doc for 2.3.x upgrade that I can take downtime to do this.
> > The
> > > > instructions are for rolling upgrade only.
> > > >
> > > > Has anyone tried this?
> > > >
> > > > Praveen
> > > >
> > >
> > >
> >
>
Re: Kafka upgrade from 0.10 to 2.3.x
Posted by Israel Ekpo <is...@gmail.com>.
It would be a good idea to attempt this upgrade in a different environment
like QA or STAGING to make sure there are no surprises first before
upgrading PRODUCTION
Going from 0.10 to 2.3.x is a significant jump with potential for issues
Running a trial in a lower environment with exact setup as PROD will
prepare you better for a production upgrade experience
On Wed, May 13, 2020 at 3:27 AM M. Manna <ma...@gmail.com> wrote:
> I have done this before. What Matthias said below is correct.
>
> First you’ve got to stop all apps to prevent data consumption (if that’s
> what you also mean by having downtime)
>
> Then, you can go ahead and replace the bin.
>
> Regards,
>
> On Tue, 12 May 2020 at 18:33, Matthias J. Sax <mj...@apache.org> wrote:
>
> > I guess you can just stop all servers, update the binaries (and
> > potentially configs), and afterward restart the servers.
> >
> > Of course, you might want to stop all applications that connect to the
> > cluster first.
> >
> >
> > -Matthias
> >
> > On 5/11/20 9:50 AM, Praveen wrote:
> > > Hi folks,
> > >
> > > I'd like to take downtime to upgrade to 2.3.x from 10.2.1. But I can't
> > find
> > > it in the doc for 2.3.x upgrade that I can take downtime to do this.
> The
> > > instructions are for rolling upgrade only.
> > >
> > > Has anyone tried this?
> > >
> > > Praveen
> > >
> >
> >
>
Re: Kafka upgrade from 0.10 to 2.3.x
Posted by "M. Manna" <ma...@gmail.com>.
I have done this before. What Matthias said below is correct.
First you’ve got to stop all apps to prevent data consumption (if that’s
what you also mean by having downtime)
Then, you can go ahead and replace the bin.
Regards,
On Tue, 12 May 2020 at 18:33, Matthias J. Sax <mj...@apache.org> wrote:
> I guess you can just stop all servers, update the binaries (and
> potentially configs), and afterward restart the servers.
>
> Of course, you might want to stop all applications that connect to the
> cluster first.
>
>
> -Matthias
>
> On 5/11/20 9:50 AM, Praveen wrote:
> > Hi folks,
> >
> > I'd like to take downtime to upgrade to 2.3.x from 10.2.1. But I can't
> find
> > it in the doc for 2.3.x upgrade that I can take downtime to do this. The
> > instructions are for rolling upgrade only.
> >
> > Has anyone tried this?
> >
> > Praveen
> >
>
>
Re: Kafka upgrade from 0.10 to 2.3.x
Posted by "Matthias J. Sax" <mj...@apache.org>.
I guess you can just stop all servers, update the binaries (and
potentially configs), and afterward restart the servers.
Of course, you might want to stop all applications that connect to the
cluster first.
-Matthias
On 5/11/20 9:50 AM, Praveen wrote:
> Hi folks,
>
> I'd like to take downtime to upgrade to 2.3.x from 10.2.1. But I can't find
> it in the doc for 2.3.x upgrade that I can take downtime to do this. The
> instructions are for rolling upgrade only.
>
> Has anyone tried this?
>
> Praveen
>