You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pulsar.apache.org by Matteo Merli <mm...@apache.org> on 2022/01/12 00:08:52 UTC
[DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
https://github.com/apache/pulsar/issues/13717
-----
## Motivation
Since all the pieces that composed the proposal in PIP-45 were finally merged
and are currently ready for 2.10 release, it is now possible to add other
metadata backends that can be used to support a BookKeeper + Pulsar cluster.
One of the popular systems that is most commonly used as an alternative of
ZooKeeper is Etcd, thus it makes sense to have this as the first non-zookeeper
implementation.
## Goal
Provide an Etcd implementation for the `MetadataStore` API. This will allow
users to deploy Pulsar clusters using Etcd service for the metadata and it will
not require the presence of ZooKeeper.
## Implementation
* Use the existing JEtcd Java client library for Etcd
* Extends the `AbstractBatchedMetadataStore` class, in order to reuse the
transparent batching logic that will be shared with the ZooKeeper
implementation.
Work in progress: https://github.com/apache/pulsar/pull/13225
--
Matteo Merli
<mm...@apache.org>
Re: [DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
Posted by "rxl@apache.org" <ra...@gmail.com>.
+1
--
Thanks
Xiaolong Ran
Aloys Zhang <al...@apache.org> 于2022年1月13日周四 16:49写道：
> +1
>
> Hang Chen <ch...@apache.org> 于2022年1月13日周四 14:39写道：
>
> > +1
> >
> > Best,
> > Hang
> >
> > Enrico Olivelli <eo...@gmail.com> 于2022年1月13日周四 14:20写道：
> > >
> > > +1
> > >
> > > Enrico
> > >
> > > Il Gio 13 Gen 2022, 06:01 Joe F <jo...@gmail.com> ha scritto:
> > >
> > > > +1
> > > >
> > > > On Wed, Jan 12, 2022 at 3:52 PM Aloys Zhang <al...@apache.org>
> > wrote:
> > > >
> > > > > +1
> > > > >
> > > > > 陳智弘 <th...@gmail.com> 于2022年1月12日周三 10:19写道：
> > > > >
> > > > > > +1
> > > > > >
> > > > > > Haiting Jiang <ji...@apache.org> 於 2022年1月12日 週三 09:50
> 寫道：
> > > > > >
> > > > > > > +1
> > > > > > >
> > > > > > > On 2022/01/12 01:44:21 PengHui Li wrote:
> > > > > > > > +1
> > > > > > > >
> > > > > > > > Penghui
> > > > > > > >
> > > > > > > > On Wed, Jan 12, 2022 at 8:39 AM mattison chao <
> > > > > mattisonchao@gmail.com>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1
> > > > > > > > >
> > > > > > > > > On Wed, 12 Jan 2022 at 08:09, Matteo Merli <
> > mmerli@apache.org>
> > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > https://github.com/apache/pulsar/issues/13717
> > > > > > > > > >
> > > > > > > > > > -----
> > > > > > > > > >
> > > > > > > > > > ## Motivation
> > > > > > > > > >
> > > > > > > > > > Since all the pieces that composed the proposal in PIP-45
> > were
> > > > > > > finally
> > > > > > > > > > merged
> > > > > > > > > > and are currently ready for 2.10 release, it is now
> > possible to
> > > > > add
> > > > > > > other
> > > > > > > > > > metadata backends that can be used to support a
> BookKeeper
> > +
> > > > > Pulsar
> > > > > > > > > > cluster.
> > > > > > > > > >
> > > > > > > > > > One of the popular systems that is most commonly used as
> an
> > > > > > > alternative
> > > > > > > > > of
> > > > > > > > > > ZooKeeper is Etcd, thus it makes sense to have this as
> the
> > > > first
> > > > > > > > > > non-zookeeper
> > > > > > > > > > implementation.
> > > > > > > > > >
> > > > > > > > > > ## Goal
> > > > > > > > > >
> > > > > > > > > > Provide an Etcd implementation for the `MetadataStore`
> API.
> > > > This
> > > > > > will
> > > > > > > > > allow
> > > > > > > > > > users to deploy Pulsar clusters using Etcd service for
> the
> > > > > metadata
> > > > > > > and
> > > > > > > > > it
> > > > > > > > > > will
> > > > > > > > > > not require the presence of ZooKeeper.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > ## Implementation
> > > > > > > > > >
> > > > > > > > > > * Use the existing JEtcd Java client library for Etcd
> > > > > > > > > > * Extends the `AbstractBatchedMetadataStore` class, in
> > order
> > > > to
> > > > > > > reuse
> > > > > > > > > the
> > > > > > > > > > transparent batching logic that will be shared with
> the
> > > > > > ZooKeeper
> > > > > > > > > > implementation.
> > > > > > > > > >
> > > > > > > > > > Work in progress:
> > https://github.com/apache/pulsar/pull/13225
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Matteo Merli
> > > > > > > > > > <mm...@apache.org>
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> >
>
Re: [DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
Posted by Aloys Zhang <al...@apache.org>.
+1
Hang Chen <ch...@apache.org> 于2022年1月13日周四 14:39写道：
> +1
>
> Best,
> Hang
>
> Enrico Olivelli <eo...@gmail.com> 于2022年1月13日周四 14:20写道：
> >
> > +1
> >
> > Enrico
> >
> > Il Gio 13 Gen 2022, 06:01 Joe F <jo...@gmail.com> ha scritto:
> >
> > > +1
> > >
> > > On Wed, Jan 12, 2022 at 3:52 PM Aloys Zhang <al...@apache.org>
> wrote:
> > >
> > > > +1
> > > >
> > > > 陳智弘 <th...@gmail.com> 于2022年1月12日周三 10:19写道：
> > > >
> > > > > +1
> > > > >
> > > > > Haiting Jiang <ji...@apache.org> 於 2022年1月12日 週三 09:50 寫道：
> > > > >
> > > > > > +1
> > > > > >
> > > > > > On 2022/01/12 01:44:21 PengHui Li wrote:
> > > > > > > +1
> > > > > > >
> > > > > > > Penghui
> > > > > > >
> > > > > > > On Wed, Jan 12, 2022 at 8:39 AM mattison chao <
> > > > mattisonchao@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > +1
> > > > > > > >
> > > > > > > > On Wed, 12 Jan 2022 at 08:09, Matteo Merli <
> mmerli@apache.org>
> > > > > wrote:
> > > > > > > >
> > > > > > > > > https://github.com/apache/pulsar/issues/13717
> > > > > > > > >
> > > > > > > > > -----
> > > > > > > > >
> > > > > > > > > ## Motivation
> > > > > > > > >
> > > > > > > > > Since all the pieces that composed the proposal in PIP-45
> were
> > > > > > finally
> > > > > > > > > merged
> > > > > > > > > and are currently ready for 2.10 release, it is now
> possible to
> > > > add
> > > > > > other
> > > > > > > > > metadata backends that can be used to support a BookKeeper
> +
> > > > Pulsar
> > > > > > > > > cluster.
> > > > > > > > >
> > > > > > > > > One of the popular systems that is most commonly used as an
> > > > > > alternative
> > > > > > > > of
> > > > > > > > > ZooKeeper is Etcd, thus it makes sense to have this as the
> > > first
> > > > > > > > > non-zookeeper
> > > > > > > > > implementation.
> > > > > > > > >
> > > > > > > > > ## Goal
> > > > > > > > >
> > > > > > > > > Provide an Etcd implementation for the `MetadataStore` API.
> > > This
> > > > > will
> > > > > > > > allow
> > > > > > > > > users to deploy Pulsar clusters using Etcd service for the
> > > > metadata
> > > > > > and
> > > > > > > > it
> > > > > > > > > will
> > > > > > > > > not require the presence of ZooKeeper.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > ## Implementation
> > > > > > > > >
> > > > > > > > > * Use the existing JEtcd Java client library for Etcd
> > > > > > > > > * Extends the `AbstractBatchedMetadataStore` class, in
> order
> > > to
> > > > > > reuse
> > > > > > > > the
> > > > > > > > > transparent batching logic that will be shared with the
> > > > > ZooKeeper
> > > > > > > > > implementation.
> > > > > > > > >
> > > > > > > > > Work in progress:
> https://github.com/apache/pulsar/pull/13225
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Matteo Merli
> > > > > > > > > <mm...@apache.org>
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
Re: [DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
Posted by Hang Chen <ch...@apache.org>.
+1
Best,
Hang
Enrico Olivelli <eo...@gmail.com> 于2022年1月13日周四 14:20写道：
>
> +1
>
> Enrico
>
> Il Gio 13 Gen 2022, 06:01 Joe F <jo...@gmail.com> ha scritto:
>
> > +1
> >
> > On Wed, Jan 12, 2022 at 3:52 PM Aloys Zhang <al...@apache.org> wrote:
> >
> > > +1
> > >
> > > 陳智弘 <th...@gmail.com> 于2022年1月12日周三 10:19写道：
> > >
> > > > +1
> > > >
> > > > Haiting Jiang <ji...@apache.org> 於 2022年1月12日 週三 09:50 寫道：
> > > >
> > > > > +1
> > > > >
> > > > > On 2022/01/12 01:44:21 PengHui Li wrote:
> > > > > > +1
> > > > > >
> > > > > > Penghui
> > > > > >
> > > > > > On Wed, Jan 12, 2022 at 8:39 AM mattison chao <
> > > mattisonchao@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > +1
> > > > > > >
> > > > > > > On Wed, 12 Jan 2022 at 08:09, Matteo Merli <mm...@apache.org>
> > > > wrote:
> > > > > > >
> > > > > > > > https://github.com/apache/pulsar/issues/13717
> > > > > > > >
> > > > > > > > -----
> > > > > > > >
> > > > > > > > ## Motivation
> > > > > > > >
> > > > > > > > Since all the pieces that composed the proposal in PIP-45 were
> > > > > finally
> > > > > > > > merged
> > > > > > > > and are currently ready for 2.10 release, it is now possible to
> > > add
> > > > > other
> > > > > > > > metadata backends that can be used to support a BookKeeper +
> > > Pulsar
> > > > > > > > cluster.
> > > > > > > >
> > > > > > > > One of the popular systems that is most commonly used as an
> > > > > alternative
> > > > > > > of
> > > > > > > > ZooKeeper is Etcd, thus it makes sense to have this as the
> > first
> > > > > > > > non-zookeeper
> > > > > > > > implementation.
> > > > > > > >
> > > > > > > > ## Goal
> > > > > > > >
> > > > > > > > Provide an Etcd implementation for the `MetadataStore` API.
> > This
> > > > will
> > > > > > > allow
> > > > > > > > users to deploy Pulsar clusters using Etcd service for the
> > > metadata
> > > > > and
> > > > > > > it
> > > > > > > > will
> > > > > > > > not require the presence of ZooKeeper.
> > > > > > > >
> > > > > > > >
> > > > > > > > ## Implementation
> > > > > > > >
> > > > > > > > * Use the existing JEtcd Java client library for Etcd
> > > > > > > > * Extends the `AbstractBatchedMetadataStore` class, in order
> > to
> > > > > reuse
> > > > > > > the
> > > > > > > > transparent batching logic that will be shared with the
> > > > ZooKeeper
> > > > > > > > implementation.
> > > > > > > >
> > > > > > > > Work in progress: https://github.com/apache/pulsar/pull/13225
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Matteo Merli
> > > > > > > > <mm...@apache.org>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
Re: [DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
Posted by Enrico Olivelli <eo...@gmail.com>.
+1
Enrico
Il Gio 13 Gen 2022, 06:01 Joe F <jo...@gmail.com> ha scritto:
> +1
>
> On Wed, Jan 12, 2022 at 3:52 PM Aloys Zhang <al...@apache.org> wrote:
>
> > +1
> >
> > 陳智弘 <th...@gmail.com> 于2022年1月12日周三 10:19写道：
> >
> > > +1
> > >
> > > Haiting Jiang <ji...@apache.org> 於 2022年1月12日 週三 09:50 寫道：
> > >
> > > > +1
> > > >
> > > > On 2022/01/12 01:44:21 PengHui Li wrote:
> > > > > +1
> > > > >
> > > > > Penghui
> > > > >
> > > > > On Wed, Jan 12, 2022 at 8:39 AM mattison chao <
> > mattisonchao@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > +1
> > > > > >
> > > > > > On Wed, 12 Jan 2022 at 08:09, Matteo Merli <mm...@apache.org>
> > > wrote:
> > > > > >
> > > > > > > https://github.com/apache/pulsar/issues/13717
> > > > > > >
> > > > > > > -----
> > > > > > >
> > > > > > > ## Motivation
> > > > > > >
> > > > > > > Since all the pieces that composed the proposal in PIP-45 were
> > > > finally
> > > > > > > merged
> > > > > > > and are currently ready for 2.10 release, it is now possible to
> > add
> > > > other
> > > > > > > metadata backends that can be used to support a BookKeeper +
> > Pulsar
> > > > > > > cluster.
> > > > > > >
> > > > > > > One of the popular systems that is most commonly used as an
> > > > alternative
> > > > > > of
> > > > > > > ZooKeeper is Etcd, thus it makes sense to have this as the
> first
> > > > > > > non-zookeeper
> > > > > > > implementation.
> > > > > > >
> > > > > > > ## Goal
> > > > > > >
> > > > > > > Provide an Etcd implementation for the `MetadataStore` API.
> This
> > > will
> > > > > > allow
> > > > > > > users to deploy Pulsar clusters using Etcd service for the
> > metadata
> > > > and
> > > > > > it
> > > > > > > will
> > > > > > > not require the presence of ZooKeeper.
> > > > > > >
> > > > > > >
> > > > > > > ## Implementation
> > > > > > >
> > > > > > > * Use the existing JEtcd Java client library for Etcd
> > > > > > > * Extends the `AbstractBatchedMetadataStore` class, in order
> to
> > > > reuse
> > > > > > the
> > > > > > > transparent batching logic that will be shared with the
> > > ZooKeeper
> > > > > > > implementation.
> > > > > > >
> > > > > > > Work in progress: https://github.com/apache/pulsar/pull/13225
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Matteo Merli
> > > > > > > <mm...@apache.org>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: [DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
Posted by Joe F <jo...@gmail.com>.
+1
On Wed, Jan 12, 2022 at 3:52 PM Aloys Zhang <al...@apache.org> wrote:
> +1
>
> 陳智弘 <th...@gmail.com> 于2022年1月12日周三 10:19写道：
>
> > +1
> >
> > Haiting Jiang <ji...@apache.org> 於 2022年1月12日 週三 09:50 寫道：
> >
> > > +1
> > >
> > > On 2022/01/12 01:44:21 PengHui Li wrote:
> > > > +1
> > > >
> > > > Penghui
> > > >
> > > > On Wed, Jan 12, 2022 at 8:39 AM mattison chao <
> mattisonchao@gmail.com>
> > > > wrote:
> > > >
> > > > > +1
> > > > >
> > > > > On Wed, 12 Jan 2022 at 08:09, Matteo Merli <mm...@apache.org>
> > wrote:
> > > > >
> > > > > > https://github.com/apache/pulsar/issues/13717
> > > > > >
> > > > > > -----
> > > > > >
> > > > > > ## Motivation
> > > > > >
> > > > > > Since all the pieces that composed the proposal in PIP-45 were
> > > finally
> > > > > > merged
> > > > > > and are currently ready for 2.10 release, it is now possible to
> add
> > > other
> > > > > > metadata backends that can be used to support a BookKeeper +
> Pulsar
> > > > > > cluster.
> > > > > >
> > > > > > One of the popular systems that is most commonly used as an
> > > alternative
> > > > > of
> > > > > > ZooKeeper is Etcd, thus it makes sense to have this as the first
> > > > > > non-zookeeper
> > > > > > implementation.
> > > > > >
> > > > > > ## Goal
> > > > > >
> > > > > > Provide an Etcd implementation for the `MetadataStore` API. This
> > will
> > > > > allow
> > > > > > users to deploy Pulsar clusters using Etcd service for the
> metadata
> > > and
> > > > > it
> > > > > > will
> > > > > > not require the presence of ZooKeeper.
> > > > > >
> > > > > >
> > > > > > ## Implementation
> > > > > >
> > > > > > * Use the existing JEtcd Java client library for Etcd
> > > > > > * Extends the `AbstractBatchedMetadataStore` class, in order to
> > > reuse
> > > > > the
> > > > > > transparent batching logic that will be shared with the
> > ZooKeeper
> > > > > > implementation.
> > > > > >
> > > > > > Work in progress: https://github.com/apache/pulsar/pull/13225
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Matteo Merli
> > > > > > <mm...@apache.org>
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: [DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
Posted by Aloys Zhang <al...@apache.org>.
+1
陳智弘 <th...@gmail.com> 于2022年1月12日周三 10:19写道：
> +1
>
> Haiting Jiang <ji...@apache.org> 於 2022年1月12日 週三 09:50 寫道：
>
> > +1
> >
> > On 2022/01/12 01:44:21 PengHui Li wrote:
> > > +1
> > >
> > > Penghui
> > >
> > > On Wed, Jan 12, 2022 at 8:39 AM mattison chao <ma...@gmail.com>
> > > wrote:
> > >
> > > > +1
> > > >
> > > > On Wed, 12 Jan 2022 at 08:09, Matteo Merli <mm...@apache.org>
> wrote:
> > > >
> > > > > https://github.com/apache/pulsar/issues/13717
> > > > >
> > > > > -----
> > > > >
> > > > > ## Motivation
> > > > >
> > > > > Since all the pieces that composed the proposal in PIP-45 were
> > finally
> > > > > merged
> > > > > and are currently ready for 2.10 release, it is now possible to add
> > other
> > > > > metadata backends that can be used to support a BookKeeper + Pulsar
> > > > > cluster.
> > > > >
> > > > > One of the popular systems that is most commonly used as an
> > alternative
> > > > of
> > > > > ZooKeeper is Etcd, thus it makes sense to have this as the first
> > > > > non-zookeeper
> > > > > implementation.
> > > > >
> > > > > ## Goal
> > > > >
> > > > > Provide an Etcd implementation for the `MetadataStore` API. This
> will
> > > > allow
> > > > > users to deploy Pulsar clusters using Etcd service for the metadata
> > and
> > > > it
> > > > > will
> > > > > not require the presence of ZooKeeper.
> > > > >
> > > > >
> > > > > ## Implementation
> > > > >
> > > > > * Use the existing JEtcd Java client library for Etcd
> > > > > * Extends the `AbstractBatchedMetadataStore` class, in order to
> > reuse
> > > > the
> > > > > transparent batching logic that will be shared with the
> ZooKeeper
> > > > > implementation.
> > > > >
> > > > > Work in progress: https://github.com/apache/pulsar/pull/13225
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Matteo Merli
> > > > > <mm...@apache.org>
> > > > >
> > > >
> > >
> >
>
Re: [DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
Posted by 陳智弘 <th...@gmail.com>.
+1
Haiting Jiang <ji...@apache.org> 於 2022年1月12日 週三 09:50 寫道：
> +1
>
> On 2022/01/12 01:44:21 PengHui Li wrote:
> > +1
> >
> > Penghui
> >
> > On Wed, Jan 12, 2022 at 8:39 AM mattison chao <ma...@gmail.com>
> > wrote:
> >
> > > +1
> > >
> > > On Wed, 12 Jan 2022 at 08:09, Matteo Merli <mm...@apache.org> wrote:
> > >
> > > > https://github.com/apache/pulsar/issues/13717
> > > >
> > > > -----
> > > >
> > > > ## Motivation
> > > >
> > > > Since all the pieces that composed the proposal in PIP-45 were
> finally
> > > > merged
> > > > and are currently ready for 2.10 release, it is now possible to add
> other
> > > > metadata backends that can be used to support a BookKeeper + Pulsar
> > > > cluster.
> > > >
> > > > One of the popular systems that is most commonly used as an
> alternative
> > > of
> > > > ZooKeeper is Etcd, thus it makes sense to have this as the first
> > > > non-zookeeper
> > > > implementation.
> > > >
> > > > ## Goal
> > > >
> > > > Provide an Etcd implementation for the `MetadataStore` API. This will
> > > allow
> > > > users to deploy Pulsar clusters using Etcd service for the metadata
> and
> > > it
> > > > will
> > > > not require the presence of ZooKeeper.
> > > >
> > > >
> > > > ## Implementation
> > > >
> > > > * Use the existing JEtcd Java client library for Etcd
> > > > * Extends the `AbstractBatchedMetadataStore` class, in order to
> reuse
> > > the
> > > > transparent batching logic that will be shared with the ZooKeeper
> > > > implementation.
> > > >
> > > > Work in progress: https://github.com/apache/pulsar/pull/13225
> > > >
> > > >
> > > >
> > > > --
> > > > Matteo Merli
> > > > <mm...@apache.org>
> > > >
> > >
> >
>
Re: [DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
Posted by Haiting Jiang <ji...@apache.org>.
+1
On 2022/01/12 01:44:21 PengHui Li wrote:
> +1
>
> Penghui
>
> On Wed, Jan 12, 2022 at 8:39 AM mattison chao <ma...@gmail.com>
> wrote:
>
> > +1
> >
> > On Wed, 12 Jan 2022 at 08:09, Matteo Merli <mm...@apache.org> wrote:
> >
> > > https://github.com/apache/pulsar/issues/13717
> > >
> > > -----
> > >
> > > ## Motivation
> > >
> > > Since all the pieces that composed the proposal in PIP-45 were finally
> > > merged
> > > and are currently ready for 2.10 release, it is now possible to add other
> > > metadata backends that can be used to support a BookKeeper + Pulsar
> > > cluster.
> > >
> > > One of the popular systems that is most commonly used as an alternative
> > of
> > > ZooKeeper is Etcd, thus it makes sense to have this as the first
> > > non-zookeeper
> > > implementation.
> > >
> > > ## Goal
> > >
> > > Provide an Etcd implementation for the `MetadataStore` API. This will
> > allow
> > > users to deploy Pulsar clusters using Etcd service for the metadata and
> > it
> > > will
> > > not require the presence of ZooKeeper.
> > >
> > >
> > > ## Implementation
> > >
> > > * Use the existing JEtcd Java client library for Etcd
> > > * Extends the `AbstractBatchedMetadataStore` class, in order to reuse
> > the
> > > transparent batching logic that will be shared with the ZooKeeper
> > > implementation.
> > >
> > > Work in progress: https://github.com/apache/pulsar/pull/13225
> > >
> > >
> > >
> > > --
> > > Matteo Merli
> > > <mm...@apache.org>
> > >
> >
>
Re: [DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
Posted by PengHui Li <pe...@apache.org>.
+1
Penghui
On Wed, Jan 12, 2022 at 8:39 AM mattison chao <ma...@gmail.com>
wrote:
> +1
>
> On Wed, 12 Jan 2022 at 08:09, Matteo Merli <mm...@apache.org> wrote:
>
> > https://github.com/apache/pulsar/issues/13717
> >
> > -----
> >
> > ## Motivation
> >
> > Since all the pieces that composed the proposal in PIP-45 were finally
> > merged
> > and are currently ready for 2.10 release, it is now possible to add other
> > metadata backends that can be used to support a BookKeeper + Pulsar
> > cluster.
> >
> > One of the popular systems that is most commonly used as an alternative
> of
> > ZooKeeper is Etcd, thus it makes sense to have this as the first
> > non-zookeeper
> > implementation.
> >
> > ## Goal
> >
> > Provide an Etcd implementation for the `MetadataStore` API. This will
> allow
> > users to deploy Pulsar clusters using Etcd service for the metadata and
> it
> > will
> > not require the presence of ZooKeeper.
> >
> >
> > ## Implementation
> >
> > * Use the existing JEtcd Java client library for Etcd
> > * Extends the `AbstractBatchedMetadataStore` class, in order to reuse
> the
> > transparent batching logic that will be shared with the ZooKeeper
> > implementation.
> >
> > Work in progress: https://github.com/apache/pulsar/pull/13225
> >
> >
> >
> > --
> > Matteo Merli
> > <mm...@apache.org>
> >
>
Re: [DISCUSSION] PIP-135: Include MetadataStore backend for Etcd
Posted by mattison chao <ma...@gmail.com>.
+1
On Wed, 12 Jan 2022 at 08:09, Matteo Merli <mm...@apache.org> wrote:
> https://github.com/apache/pulsar/issues/13717
>
> -----
>
> ## Motivation
>
> Since all the pieces that composed the proposal in PIP-45 were finally
> merged
> and are currently ready for 2.10 release, it is now possible to add other
> metadata backends that can be used to support a BookKeeper + Pulsar
> cluster.
>
> One of the popular systems that is most commonly used as an alternative of
> ZooKeeper is Etcd, thus it makes sense to have this as the first
> non-zookeeper
> implementation.
>
> ## Goal
>
> Provide an Etcd implementation for the `MetadataStore` API. This will allow
> users to deploy Pulsar clusters using Etcd service for the metadata and it
> will
> not require the presence of ZooKeeper.
>
>
> ## Implementation
>
> * Use the existing JEtcd Java client library for Etcd
> * Extends the `AbstractBatchedMetadataStore` class, in order to reuse the
> transparent batching logic that will be shared with the ZooKeeper
> implementation.
>
> Work in progress: https://github.com/apache/pulsar/pull/13225
>
>
>
> --
> Matteo Merli
> <mm...@apache.org>
>