You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@incubator.apache.org by Liang Chen <ch...@apache.org> on 2022/04/09 08:17:59 UTC
[DISCUSSION] Incubating proposal of Kvrocks
Hi all
We would like to propose Kvrocks [1] as a new apache incubator project, you
can find the proposal [2] of Kvrocks for more detail.
Kvrocks is a distributed key-value NoSQL database, supporting the rich data
structure and be widely used by many internet business for example, the
recommendation service can use hashes to store user characteristics and the
sorted set to sort them. For supporting more users, Kvrocks also have good
integration and ecosystem compatibility with other NoSQL database API and
script.
In comparison to current open source NoSQL database like Redis, which also
has rich data structure, Kvrocks data be stored in disk storage, but the
redis data be stored in memory, it means the cost is higher and the
capacity is limited when compare to disk storage solution, this is why we
created Kvrocks project to solve the cost and capacity issues by using disk
storage solution, the following are key features of Kvrocks:
- Compatibly support Redis protocol and data structures
(String/List/Hash/Set/Sorted-set/Bitmap/GEO/Sorted-Int)
- Disk-Based, all data and updates always persist on the disk
- Proxyless centralized cluster
- Stored procedures based on Lua script
- Transaction(no strict ACID)
- Publish-Subscribe
- Tunable consistency(In-Progress)
Kvrocks was designed to decrease the cost of memory and increase the
capacity while compared to Redis. Also, Kvrocks aims to become a
distributed multi-model NoSQL database in the future. We will provide more
features to expand its usage scenarios but all data structures on disk.
Kvrocks is fully compatible with Redis in term of protocol.
We believe that the Kvrocks project will provide the diversity value for
community if Kvrocks is introduced into the Apache incubator.
I will help this project as champion and many thanks to 4 mentors :
Jean-Baptiste
Onofre [jbonofre@apache.org], Xiaoqiao He [hexiaoqiao@apache.org], Xun Liu[
liuxun@apache.org], Von Gosling[vongosling@apache.org].
[1] https://github.com/KvrocksLabs/kvrocks
[2] https://cwiki.apache.org/confluence/display/INCUBATOR/KvrocksProposal
Regards
Liang
Re: [DISCUSSION] Incubating proposal of Kvrocks
Posted by tison <wa...@gmail.com>.
@hulk Thanks for your reply! That sounds good to me.
Learned from @Liang Chen <ch...@apache.org> I've submitted an
application[1] for being an IPMC
member and willing to be a mentor of this proposed podling. Looking forward
to
further cooperation.
Best,
tison.
[1] https://lists.apache.org/thread/h0d7rxhzzmnbspzsmjocwng3cd2mzg5l
hulk <hu...@gmail.com> 于2022年4月15日周五 18:18写道：
> Thanks for your comment. We will update the Kvrocks proposal accordingly to
> it.
>
> For multi-model, we also agree that we should not become a software to do
> everything.
> We would mainly focus on data structures that are frequently used and fit
> the underlying storage.
>
> On Fri, Apr 15, 2022 at 11:28 AM tison <wa...@gmail.com> wrote:
>
> > +1
> >
> > I learned Kvrocks for a few months ago and read their previous report
> like
> > this one[1]. I believe its people can be good citizens of the Apache
> > community.
> >
> > Two coins from my side:
> >
> > 1. The proposal writes that Kvrocks aims to become a distributed
> > multi-model
> > NoSQL database. My personal feeling is that it's often stability and
> > efficiency
> > instead of more features users adopt a software or solution. I'd suggest
> > you
> > guys to connect to the wide ecosystem and to bring more user cases
> instead
> > of becoming a software to do everything.
> >
> > 2. The proposal writs:
> >
> > > If Kvrocks accepted for incubation, the primary initial goal is to
> build
> > a large community.
> > > We really trust that Kvrocks will become a good NoSQL database, we hope
> > to grow the
> > > base of contributors by inviting all those who offer contributions
> > through The Apache Way.
> >
> > I don't get it well and want to see more elaborations. For example, you
> > cannot grow contributors
> > "by inviting all those who offer contributions", which sounds like we
> grow
> > contributors when they
> > are contributors. If you can write down some contributor stories, real
> > or unreal, it will shape your
> > thoughts.
> >
> > 3. The proposal wants to run this podling with 5 IPMCs, but about a week
> > after the proposal
> > submitted, only the champion and one mentor participant the thread. Are
> > other mentors be aware
> > of this proposal?
> >
> > Anyway, it would be nice to accept Kvrocks to the incubator and we can
> > build
> > a healthy and storage community.
> >
> > Best,
> > tison.
> >
> > [1] https://mp.weixin.qq.com/s/FhVjCq8jSk7atWpnR9Xrsg
> >
> >
> > Xiaoqiao He <he...@apache.org> 于2022年4月10日周日 22:42写道：
> >
> > > +1.
> > >
> > > Thanks for starting this thread, Liang!
> > >
> > > I'm very glad to be the mentor of this project. I've connected with
> > > the core team online several times, and was attracted by their
> > > contributions, collaborations and willingness.
> > > Hope this project could be accepted by the incubator, and push forward
> > > healthily to build up a better community!
> > >
> > > Best Regards,
> > > - He Xiaoqiao
> > >
> > > On Sat, Apr 9, 2022 at 4:18 PM Liang Chen <ch...@apache.org>
> > wrote:
> > > >
> > > > Hi all
> > > >
> > > > We would like to propose Kvrocks [1] as a new apache incubator
> project,
> > > you
> > > > can find the proposal [2] of Kvrocks for more detail.
> > > >
> > > > Kvrocks is a distributed key-value NoSQL database, supporting the
> rich
> > > data
> > > > structure and be widely used by many internet business for example,
> the
> > > > recommendation service can use hashes to store user characteristics
> and
> > > the
> > > > sorted set to sort them. For supporting more users, Kvrocks also have
> > > good
> > > > integration and ecosystem compatibility with other NoSQL database API
> > and
> > > > script.
> > > > In comparison to current open source NoSQL database like Redis, which
> > > also
> > > > has rich data structure, Kvrocks data be stored in disk storage, but
> > the
> > > > redis data be stored in memory, it means the cost is higher and the
> > > > capacity is limited when compare to disk storage solution, this is
> why
> > we
> > > > created Kvrocks project to solve the cost and capacity issues by
> using
> > > disk
> > > > storage solution, the following are key features of Kvrocks:
> > > >
> > > > - Compatibly support Redis protocol and data structures
> > > > (String/List/Hash/Set/Sorted-set/Bitmap/GEO/Sorted-Int)
> > > > - Disk-Based, all data and updates always persist on the disk
> > > > - Proxyless centralized cluster
> > > > - Stored procedures based on Lua script
> > > > - Transaction(no strict ACID)
> > > > - Publish-Subscribe
> > > > - Tunable consistency(In-Progress)
> > > >
> > > >
> > > > Kvrocks was designed to decrease the cost of memory and increase the
> > > > capacity while compared to Redis. Also, Kvrocks aims to become a
> > > > distributed multi-model NoSQL database in the future. We will provide
> > > more
> > > > features to expand its usage scenarios but all data structures on
> disk.
> > > > Kvrocks is fully compatible with Redis in term of protocol.
> > > >
> > > > We believe that the Kvrocks project will provide the diversity value
> > for
> > > > community if Kvrocks is introduced into the Apache incubator.
> > > >
> > > >
> > > > I will help this project as champion and many thanks to 4 mentors :
> > > > Jean-Baptiste
> > > > Onofre [jbonofre@apache.org], Xiaoqiao He [hexiaoqiao@apache.org],
> > Xun
> > > Liu[
> > > > liuxun@apache.org], Von Gosling[vongosling@apache.org].
> > > >
> > > >
> > > > [1] https://github.com/KvrocksLabs/kvrocks
> > > >
> > > > [2]
> > > https://cwiki.apache.org/confluence/display/INCUBATOR/KvrocksProposal
> > > >
> > > >
> > > > Regards
> > > >
> > > > Liang
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> > >
> >
>
Re: [DISCUSSION] Incubating proposal of Kvrocks
Posted by hulk <hu...@gmail.com>.
Thanks for your comment. We will update the Kvrocks proposal accordingly to
it.
For multi-model, we also agree that we should not become a software to do
everything.
We would mainly focus on data structures that are frequently used and fit
the underlying storage.
On Fri, Apr 15, 2022 at 11:28 AM tison <wa...@gmail.com> wrote:
> +1
>
> I learned Kvrocks for a few months ago and read their previous report like
> this one[1]. I believe its people can be good citizens of the Apache
> community.
>
> Two coins from my side:
>
> 1. The proposal writes that Kvrocks aims to become a distributed
> multi-model
> NoSQL database. My personal feeling is that it's often stability and
> efficiency
> instead of more features users adopt a software or solution. I'd suggest
> you
> guys to connect to the wide ecosystem and to bring more user cases instead
> of becoming a software to do everything.
>
> 2. The proposal writs:
>
> > If Kvrocks accepted for incubation, the primary initial goal is to build
> a large community.
> > We really trust that Kvrocks will become a good NoSQL database, we hope
> to grow the
> > base of contributors by inviting all those who offer contributions
> through The Apache Way.
>
> I don't get it well and want to see more elaborations. For example, you
> cannot grow contributors
> "by inviting all those who offer contributions", which sounds like we grow
> contributors when they
> are contributors. If you can write down some contributor stories, real
> or unreal, it will shape your
> thoughts.
>
> 3. The proposal wants to run this podling with 5 IPMCs, but about a week
> after the proposal
> submitted, only the champion and one mentor participant the thread. Are
> other mentors be aware
> of this proposal?
>
> Anyway, it would be nice to accept Kvrocks to the incubator and we can
> build
> a healthy and storage community.
>
> Best,
> tison.
>
> [1] https://mp.weixin.qq.com/s/FhVjCq8jSk7atWpnR9Xrsg
>
>
> Xiaoqiao He <he...@apache.org> 于2022年4月10日周日 22:42写道：
>
> > +1.
> >
> > Thanks for starting this thread, Liang!
> >
> > I'm very glad to be the mentor of this project. I've connected with
> > the core team online several times, and was attracted by their
> > contributions, collaborations and willingness.
> > Hope this project could be accepted by the incubator, and push forward
> > healthily to build up a better community!
> >
> > Best Regards,
> > - He Xiaoqiao
> >
> > On Sat, Apr 9, 2022 at 4:18 PM Liang Chen <ch...@apache.org>
> wrote:
> > >
> > > Hi all
> > >
> > > We would like to propose Kvrocks [1] as a new apache incubator project,
> > you
> > > can find the proposal [2] of Kvrocks for more detail.
> > >
> > > Kvrocks is a distributed key-value NoSQL database, supporting the rich
> > data
> > > structure and be widely used by many internet business for example, the
> > > recommendation service can use hashes to store user characteristics and
> > the
> > > sorted set to sort them. For supporting more users, Kvrocks also have
> > good
> > > integration and ecosystem compatibility with other NoSQL database API
> and
> > > script.
> > > In comparison to current open source NoSQL database like Redis, which
> > also
> > > has rich data structure, Kvrocks data be stored in disk storage, but
> the
> > > redis data be stored in memory, it means the cost is higher and the
> > > capacity is limited when compare to disk storage solution, this is why
> we
> > > created Kvrocks project to solve the cost and capacity issues by using
> > disk
> > > storage solution, the following are key features of Kvrocks:
> > >
> > > - Compatibly support Redis protocol and data structures
> > > (String/List/Hash/Set/Sorted-set/Bitmap/GEO/Sorted-Int)
> > > - Disk-Based, all data and updates always persist on the disk
> > > - Proxyless centralized cluster
> > > - Stored procedures based on Lua script
> > > - Transaction(no strict ACID)
> > > - Publish-Subscribe
> > > - Tunable consistency(In-Progress)
> > >
> > >
> > > Kvrocks was designed to decrease the cost of memory and increase the
> > > capacity while compared to Redis. Also, Kvrocks aims to become a
> > > distributed multi-model NoSQL database in the future. We will provide
> > more
> > > features to expand its usage scenarios but all data structures on disk.
> > > Kvrocks is fully compatible with Redis in term of protocol.
> > >
> > > We believe that the Kvrocks project will provide the diversity value
> for
> > > community if Kvrocks is introduced into the Apache incubator.
> > >
> > >
> > > I will help this project as champion and many thanks to 4 mentors :
> > > Jean-Baptiste
> > > Onofre [jbonofre@apache.org], Xiaoqiao He [hexiaoqiao@apache.org],
> Xun
> > Liu[
> > > liuxun@apache.org], Von Gosling[vongosling@apache.org].
> > >
> > >
> > > [1] https://github.com/KvrocksLabs/kvrocks
> > >
> > > [2]
> > https://cwiki.apache.org/confluence/display/INCUBATOR/KvrocksProposal
> > >
> > >
> > > Regards
> > >
> > > Liang
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >
>
Re: terminology (was: [DISCUSSION] Incubating proposal of Kvrocks)
Posted by Greg Stein <gs...@gmail.com>.
Oh, sure. That totally works!
On Tue, Apr 26, 2022 at 10:14 PM tison <wa...@gmail.com> wrote:
> Hi Greg,
>
> Thanks for pointing that out. Is "5 IPMC members" correct also? "5 members
> of the IPMC" is a bit wordy, though.
>
> Best,
> tison.
>
>
> Greg Stein <gs...@gmail.com> 于2022年4月27日周三 10:52写道：
>
> > I have a problem with the terminology some people are using:
> >
> > On Thu, Apr 14, 2022 at 10:28 PM tison <wa...@gmail.com> wrote:
> > >...
> >
> > > 3. The proposal wants to run this podling with 5 IPMCs,
> >
> >
> > There is ONLY ONE IPMC. aka the Incubator Project Management Committee.
> >
> > ONE.
> >
> > IPMC refers to the committee.
> >
> > The use of "IPMC" to refer to a *MEMBER* of the IPMC is erroneous. The
> > correct phrase is "5 members of the IPMC".
> >
> > NOTE: I have seen this elsewhere. A "PMC" is a committee. It is NOT A
> > PERSON.
> >
> > -g
> >
>
Re: terminology (was: [DISCUSSION] Incubating proposal of Kvrocks)
Posted by tison <wa...@gmail.com>.
Hi Greg,
Thanks for pointing that out. Is "5 IPMC members" correct also? "5 members
of the IPMC" is a bit wordy, though.
Best,
tison.
Greg Stein <gs...@gmail.com> 于2022年4月27日周三 10:52写道：
> I have a problem with the terminology some people are using:
>
> On Thu, Apr 14, 2022 at 10:28 PM tison <wa...@gmail.com> wrote:
> >...
>
> > 3. The proposal wants to run this podling with 5 IPMCs,
>
>
> There is ONLY ONE IPMC. aka the Incubator Project Management Committee.
>
> ONE.
>
> IPMC refers to the committee.
>
> The use of "IPMC" to refer to a *MEMBER* of the IPMC is erroneous. The
> correct phrase is "5 members of the IPMC".
>
> NOTE: I have seen this elsewhere. A "PMC" is a committee. It is NOT A
> PERSON.
>
> -g
>
terminology (was: [DISCUSSION] Incubating proposal of Kvrocks)
Posted by Greg Stein <gs...@gmail.com>.
I have a problem with the terminology some people are using:
On Thu, Apr 14, 2022 at 10:28 PM tison <wa...@gmail.com> wrote:
>...
> 3. The proposal wants to run this podling with 5 IPMCs,
There is ONLY ONE IPMC. aka the Incubator Project Management Committee.
ONE.
IPMC refers to the committee.
The use of "IPMC" to refer to a *MEMBER* of the IPMC is erroneous. The
correct phrase is "5 members of the IPMC".
NOTE: I have seen this elsewhere. A "PMC" is a committee. It is NOT A
PERSON.
-g
Re: [DISCUSSION] Incubating proposal of Kvrocks
Posted by tison <wa...@gmail.com>.
+1
I learned Kvrocks for a few months ago and read their previous report like
this one[1]. I believe its people can be good citizens of the Apache
community.
Two coins from my side:
1. The proposal writes that Kvrocks aims to become a distributed multi-model
NoSQL database. My personal feeling is that it's often stability and
efficiency
instead of more features users adopt a software or solution. I'd suggest you
guys to connect to the wide ecosystem and to bring more user cases instead
of becoming a software to do everything.
2. The proposal writs:
> If Kvrocks accepted for incubation, the primary initial goal is to build
a large community.
> We really trust that Kvrocks will become a good NoSQL database, we hope
to grow the
> base of contributors by inviting all those who offer contributions
through The Apache Way.
I don't get it well and want to see more elaborations. For example, you
cannot grow contributors
"by inviting all those who offer contributions", which sounds like we grow
contributors when they
are contributors. If you can write down some contributor stories, real
or unreal, it will shape your
thoughts.
3. The proposal wants to run this podling with 5 IPMCs, but about a week
after the proposal
submitted, only the champion and one mentor participant the thread. Are
other mentors be aware
of this proposal?
Anyway, it would be nice to accept Kvrocks to the incubator and we can build
a healthy and storage community.
Best,
tison.
[1] https://mp.weixin.qq.com/s/FhVjCq8jSk7atWpnR9Xrsg
Xiaoqiao He <he...@apache.org> 于2022年4月10日周日 22:42写道：
> +1.
>
> Thanks for starting this thread, Liang!
>
> I'm very glad to be the mentor of this project. I've connected with
> the core team online several times, and was attracted by their
> contributions, collaborations and willingness.
> Hope this project could be accepted by the incubator, and push forward
> healthily to build up a better community!
>
> Best Regards,
> - He Xiaoqiao
>
> On Sat, Apr 9, 2022 at 4:18 PM Liang Chen <ch...@apache.org> wrote:
> >
> > Hi all
> >
> > We would like to propose Kvrocks [1] as a new apache incubator project,
> you
> > can find the proposal [2] of Kvrocks for more detail.
> >
> > Kvrocks is a distributed key-value NoSQL database, supporting the rich
> data
> > structure and be widely used by many internet business for example, the
> > recommendation service can use hashes to store user characteristics and
> the
> > sorted set to sort them. For supporting more users, Kvrocks also have
> good
> > integration and ecosystem compatibility with other NoSQL database API and
> > script.
> > In comparison to current open source NoSQL database like Redis, which
> also
> > has rich data structure, Kvrocks data be stored in disk storage, but the
> > redis data be stored in memory, it means the cost is higher and the
> > capacity is limited when compare to disk storage solution, this is why we
> > created Kvrocks project to solve the cost and capacity issues by using
> disk
> > storage solution, the following are key features of Kvrocks:
> >
> > - Compatibly support Redis protocol and data structures
> > (String/List/Hash/Set/Sorted-set/Bitmap/GEO/Sorted-Int)
> > - Disk-Based, all data and updates always persist on the disk
> > - Proxyless centralized cluster
> > - Stored procedures based on Lua script
> > - Transaction(no strict ACID)
> > - Publish-Subscribe
> > - Tunable consistency(In-Progress)
> >
> >
> > Kvrocks was designed to decrease the cost of memory and increase the
> > capacity while compared to Redis. Also, Kvrocks aims to become a
> > distributed multi-model NoSQL database in the future. We will provide
> more
> > features to expand its usage scenarios but all data structures on disk.
> > Kvrocks is fully compatible with Redis in term of protocol.
> >
> > We believe that the Kvrocks project will provide the diversity value for
> > community if Kvrocks is introduced into the Apache incubator.
> >
> >
> > I will help this project as champion and many thanks to 4 mentors :
> > Jean-Baptiste
> > Onofre [jbonofre@apache.org], Xiaoqiao He [hexiaoqiao@apache.org], Xun
> Liu[
> > liuxun@apache.org], Von Gosling[vongosling@apache.org].
> >
> >
> > [1] https://github.com/KvrocksLabs/kvrocks
> >
> > [2]
> https://cwiki.apache.org/confluence/display/INCUBATOR/KvrocksProposal
> >
> >
> > Regards
> >
> > Liang
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
Re: [DISCUSSION] Incubating proposal of Kvrocks
Posted by Xiaoqiao He <he...@apache.org>.
+1.
Thanks for starting this thread, Liang!
I'm very glad to be the mentor of this project. I've connected with
the core team online several times, and was attracted by their
contributions, collaborations and willingness.
Hope this project could be accepted by the incubator, and push forward
healthily to build up a better community!
Best Regards,
- He Xiaoqiao
On Sat, Apr 9, 2022 at 4:18 PM Liang Chen <ch...@apache.org> wrote:
>
> Hi all
>
> We would like to propose Kvrocks [1] as a new apache incubator project, you
> can find the proposal [2] of Kvrocks for more detail.
>
> Kvrocks is a distributed key-value NoSQL database, supporting the rich data
> structure and be widely used by many internet business for example, the
> recommendation service can use hashes to store user characteristics and the
> sorted set to sort them. For supporting more users, Kvrocks also have good
> integration and ecosystem compatibility with other NoSQL database API and
> script.
> In comparison to current open source NoSQL database like Redis, which also
> has rich data structure, Kvrocks data be stored in disk storage, but the
> redis data be stored in memory, it means the cost is higher and the
> capacity is limited when compare to disk storage solution, this is why we
> created Kvrocks project to solve the cost and capacity issues by using disk
> storage solution, the following are key features of Kvrocks:
>
> - Compatibly support Redis protocol and data structures
> (String/List/Hash/Set/Sorted-set/Bitmap/GEO/Sorted-Int)
> - Disk-Based, all data and updates always persist on the disk
> - Proxyless centralized cluster
> - Stored procedures based on Lua script
> - Transaction(no strict ACID)
> - Publish-Subscribe
> - Tunable consistency(In-Progress)
>
>
> Kvrocks was designed to decrease the cost of memory and increase the
> capacity while compared to Redis. Also, Kvrocks aims to become a
> distributed multi-model NoSQL database in the future. We will provide more
> features to expand its usage scenarios but all data structures on disk.
> Kvrocks is fully compatible with Redis in term of protocol.
>
> We believe that the Kvrocks project will provide the diversity value for
> community if Kvrocks is introduced into the Apache incubator.
>
>
> I will help this project as champion and many thanks to 4 mentors :
> Jean-Baptiste
> Onofre [jbonofre@apache.org], Xiaoqiao He [hexiaoqiao@apache.org], Xun Liu[
> liuxun@apache.org], Von Gosling[vongosling@apache.org].
>
>
> [1] https://github.com/KvrocksLabs/kvrocks
>
> [2] https://cwiki.apache.org/confluence/display/INCUBATOR/KvrocksProposal
>
>
> Regards
>
> Liang
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org