You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@directory.apache.org by Emmanuel Lécharny <el...@gmail.com> on 2013/08/01 13:29:22 UTC
[VOTE] Make Mavibot a Directory subproject
Hi guys,
last year, I started an experiment in labs@apache.org, the Mavibot MVCC
Btree. It has reached a first step, we can now use it as a backend for
ApacheDS, thanks to Kiran - who joined me on the Mavibot effort, making
it stable enough to be used in ApacheDS).
This morning, I conducted some performance tests, comparing JDBM and
Mavibot on a 10K entries base :
CoreSession
===========
Mavibot 10K entries
-------------------
Add : 80s, 125/s
Search : 7392/s
Jdbm 10k entries
----------------
Add : 167s, 59/s
Search : 654/s
NetworkeSession
===============
Mavibot 10K entries
-------------------
Add : 85s, 117/s
Search : 1802/s
Jdbm 10k entries
----------------
Add : 176s, 56/s
Search : 506/s
As we can see, either on CoreSession, or through the network, the gain
over JDBM is really clear. It's ten time faster.
So this vote to integrate Mavibot as a Directory Subproject, in order to
be able to release it and use it as our base backend in a near future.
It's not feature complete yet, but the core BTree already works.
So let's vote :
[ ] +1 : make Mavibot a Directory Subproject
[ ] +/-0 : I don't mind
[ ] -1 : No, Mavibot should not become a Directory subproject
Thanks !
and of course, my +1
--
Regards,
Cordialement,
Emmanuel Lécharny
www.iktek.com
Re: [VOTE] Make Mavibot a Directory subproject
Posted by Stefan Seelmann <ma...@stefan-seelmann.de>.
On 08/01/2013 01:29 PM, Emmanuel Lécharny wrote:
> [X] +1 : make Mavibot a Directory Subproject
Well done!
Re: [VOTE] Make Mavibot a Directory subproject
Posted by Emmanuel Lécharny <el...@gmail.com>.
Le 8/1/13 1:32 PM, Alex Karasulu a écrit :
> +1
>
> Great job guys this is a true advance!
Regarding the performances we get with JDBM, I would say I was really
disapointed. I remember we have made some perf test 3 years ago with
SLAMD, and get up to 13 000 search/s, so getting down to 506/s with JDBM
is just really really bad.
Now, the server has been heavily modified to protect the database
against concurrent modifications, and that forces us to add locks and to
use a journal and transactions in JDBM. This has certainly slowed down
the server a lot, but still, I would like to run the exact same tests
with older versions (I have all of them since 1.5.0 installed on an old
machine).
Will do that next week.
--
Regards,
Cordialement,
Emmanuel Lécharny
www.iktek.com
Re: [VOTE] Make Mavibot a Directory subproject
Posted by Alex Karasulu <ak...@apache.org>.
+1
Great job guys this is a true advance!
On Thu, Aug 1, 2013 at 2:29 PM, Emmanuel Lécharny <el...@gmail.com>wrote:
> Hi guys,
>
> last year, I started an experiment in labs@apache.org, the Mavibot MVCC
> Btree. It has reached a first step, we can now use it as a backend for
> ApacheDS, thanks to Kiran - who joined me on the Mavibot effort, making
> it stable enough to be used in ApacheDS).
>
> This morning, I conducted some performance tests, comparing JDBM and
> Mavibot on a 10K entries base :
>
> CoreSession
> ===========
>
> Mavibot 10K entries
> -------------------
> Add : 80s, 125/s
> Search : 7392/s
>
> Jdbm 10k entries
> ----------------
> Add : 167s, 59/s
> Search : 654/s
>
> NetworkeSession
> ===============
>
> Mavibot 10K entries
> -------------------
> Add : 85s, 117/s
> Search : 1802/s
>
> Jdbm 10k entries
> ----------------
> Add : 176s, 56/s
> Search : 506/s
>
> As we can see, either on CoreSession, or through the network, the gain
> over JDBM is really clear. It's ten time faster.
>
> So this vote to integrate Mavibot as a Directory Subproject, in order to
> be able to release it and use it as our base backend in a near future.
> It's not feature complete yet, but the core BTree already works.
>
> So let's vote :
> [ ] +1 : make Mavibot a Directory Subproject
> [ ] +/-0 : I don't mind
> [ ] -1 : No, Mavibot should not become a Directory subproject
>
> Thanks !
>
> and of course, my +1
>
> --
> Regards,
> Cordialement,
> Emmanuel Lécharny
> www.iktek.com
>
>
--
Best Regards,
-- Alex
Re: [Result] [VOTE] Make Mavibot a Directory subproject
Posted by Pierre-Arnaud Marcelot <pa...@marcelot.net>.
Awesome!
Congrats guys!
Regards,
Pierre-Arnaud
On 4 août 2013, at 11:44, Kiran Ayyagari <ka...@apache.org> wrote:
> moved mavibot to directory SVN [1]
>
> set up a jenkins job to build and deploy to snapshot repo [2]
>
> committed the mavibot based partition factory and added
> mavibot-partition module in the apacheds/pom.xml
>
> now anyone who want to run tests with mavibot should pass
> the below argument to the JVM
>
> -Dapacheds.partition.factory=org.apache.directory.server.core.factory.MavibotPartitionFactory
>
> [1] https://svn.apache.org/repos/asf/directory/mavibot
> [2] https://builds.apache.org/job/dir-mavibot
>
>
> On Sat, Aug 3, 2013 at 2:38 PM, Emmanuel Lécharny <el...@gmail.com> wrote:
> Hi guys,
>
> I close this vote. We have had 6 +1 binding votes :
>
> Alex
> Emmanuel
> Felix
> Kiran
> Pierre-Arnaud
> Stefan
>
> I will move the code base in Directory, and update the site to expose
> the project.
>
> Thanks !
>
> --
> Regards,
> Cordialement,
> Emmanuel Lécharny
> www.iktek.com
>
>
>
>
> --
> Kiran Ayyagari
> http://keydap.com
Re: [Result] [VOTE] Make Mavibot a Directory subproject
Posted by Kiran Ayyagari <ka...@apache.org>.
moved mavibot to directory SVN [1]
set up a jenkins job to build and deploy to snapshot repo [2]
committed the mavibot based partition factory and added
mavibot-partition module in the apacheds/pom.xml
now anyone who want to run tests with mavibot should pass
the below argument to the JVM
-Dapacheds.partition.factory=org.apache.directory.server.core.factory.MavibotPartitionFactory
[1] https://svn.apache.org/repos/asf/directory/mavibot
[2] https://builds.apache.org/job/dir-mavibot
On Sat, Aug 3, 2013 at 2:38 PM, Emmanuel Lécharny <el...@gmail.com>wrote:
> Hi guys,
>
> I close this vote. We have had 6 +1 binding votes :
>
> Alex
> Emmanuel
> Felix
> Kiran
> Pierre-Arnaud
> Stefan
>
> I will move the code base in Directory, and update the site to expose
> the project.
>
> Thanks !
>
> --
> Regards,
> Cordialement,
> Emmanuel Lécharny
> www.iktek.com
>
>
--
Kiran Ayyagari
http://keydap.com
[Result] [VOTE] Make Mavibot a Directory subproject
Posted by Emmanuel Lécharny <el...@gmail.com>.
Hi guys,
I close this vote. We have had 6 +1 binding votes :
Alex
Emmanuel
Felix
Kiran
Pierre-Arnaud
Stefan
I will move the code base in Directory, and update the site to expose
the project.
Thanks !
--
Regards,
Cordialement,
Emmanuel Lécharny
www.iktek.com
Re: [VOTE] Make Mavibot a Directory subproject
Posted by Alex Karasulu <ak...@apache.org>.
On Thu, Aug 1, 2013 at 3:48 PM, Pierre-Arnaud Marcelot <pa...@marcelot.net>wrote:
> [X] +1 : make Mavibot a Directory Subproject
>
> This is going to make a huge different for ApacheDS.
>
> Regards,
> Pierre-Arnaud
>
> PS: Should the Labs ML be in copy of the vote?
>
>
>
You probably want just the summary sent to them to prevent the noise.
Regards,
Alex
Re: [VOTE] Make Mavibot a Directory subproject
Posted by Kiran Ayyagari <ka...@apache.org>.
[X] +1 : make Mavibot a Directory Subproject
thanks Emmanuel
On Thu, Aug 1, 2013 at 6:18 PM, Pierre-Arnaud Marcelot <pa...@marcelot.net>wrote:
> [X] +1 : make Mavibot a Directory Subproject
>
> This is going to make a huge different for ApacheDS.
>
> Regards,
> Pierre-Arnaud
>
> PS: Should the Labs ML be in copy of the vote?
>
>
> On 1 août 2013, at 13:29, Emmanuel Lécharny <el...@gmail.com> wrote:
>
> > Hi guys,
> >
> > last year, I started an experiment in labs@apache.org, the Mavibot MVCC
> > Btree. It has reached a first step, we can now use it as a backend for
> > ApacheDS, thanks to Kiran - who joined me on the Mavibot effort, making
> > it stable enough to be used in ApacheDS).
> >
> > This morning, I conducted some performance tests, comparing JDBM and
> > Mavibot on a 10K entries base :
> >
> > CoreSession
> > ===========
> >
> > Mavibot 10K entries
> > -------------------
> > Add : 80s, 125/s
> > Search : 7392/s
> >
> > Jdbm 10k entries
> > ----------------
> > Add : 167s, 59/s
> > Search : 654/s
> >
> > NetworkeSession
> > ===============
> >
> > Mavibot 10K entries
> > -------------------
> > Add : 85s, 117/s
> > Search : 1802/s
> >
> > Jdbm 10k entries
> > ----------------
> > Add : 176s, 56/s
> > Search : 506/s
> >
> > As we can see, either on CoreSession, or through the network, the gain
> > over JDBM is really clear. It's ten time faster.
> >
> > So this vote to integrate Mavibot as a Directory Subproject, in order to
> > be able to release it and use it as our base backend in a near future.
> > It's not feature complete yet, but the core BTree already works.
> >
> > So let's vote :
> > [ ] +1 : make Mavibot a Directory Subproject
> > [ ] +/-0 : I don't mind
> > [ ] -1 : No, Mavibot should not become a Directory subproject
> >
> > Thanks !
> >
> > and of course, my +1
> >
> > --
> > Regards,
> > Cordialement,
> > Emmanuel Lécharny
> > www.iktek.com
> >
>
>
--
Kiran Ayyagari
http://keydap.com
Re: [VOTE] Make Mavibot a Directory subproject
Posted by Pierre-Arnaud Marcelot <pa...@marcelot.net>.
[X] +1 : make Mavibot a Directory Subproject
This is going to make a huge different for ApacheDS.
Regards,
Pierre-Arnaud
PS: Should the Labs ML be in copy of the vote?
On 1 août 2013, at 13:29, Emmanuel Lécharny <el...@gmail.com> wrote:
> Hi guys,
>
> last year, I started an experiment in labs@apache.org, the Mavibot MVCC
> Btree. It has reached a first step, we can now use it as a backend for
> ApacheDS, thanks to Kiran - who joined me on the Mavibot effort, making
> it stable enough to be used in ApacheDS).
>
> This morning, I conducted some performance tests, comparing JDBM and
> Mavibot on a 10K entries base :
>
> CoreSession
> ===========
>
> Mavibot 10K entries
> -------------------
> Add : 80s, 125/s
> Search : 7392/s
>
> Jdbm 10k entries
> ----------------
> Add : 167s, 59/s
> Search : 654/s
>
> NetworkeSession
> ===============
>
> Mavibot 10K entries
> -------------------
> Add : 85s, 117/s
> Search : 1802/s
>
> Jdbm 10k entries
> ----------------
> Add : 176s, 56/s
> Search : 506/s
>
> As we can see, either on CoreSession, or through the network, the gain
> over JDBM is really clear. It's ten time faster.
>
> So this vote to integrate Mavibot as a Directory Subproject, in order to
> be able to release it and use it as our base backend in a near future.
> It's not feature complete yet, but the core BTree already works.
>
> So let's vote :
> [ ] +1 : make Mavibot a Directory Subproject
> [ ] +/-0 : I don't mind
> [ ] -1 : No, Mavibot should not become a Directory subproject
>
> Thanks !
>
> and of course, my +1
>
> --
> Regards,
> Cordialement,
> Emmanuel Lécharny
> www.iktek.com
>
Re: [VOTE] Make Mavibot a Directory subproject
Posted by Felix Knecht <fe...@apache.org>.
[X] +1 : make Mavibot a Directory Subproject
Regards
Felix