You are viewing a plain text version of this content. The canonical link for it is here.
Posted to slide-dev@jakarta.apache.org by Thomas BELLEMBOIS <th...@univ-rennes1.fr> on 2004/09/10 10:34:07 UTC
Pb creating big amount of users.
Hello !
I am working on a Slide server 2.0 connected to a mySQL database to
store users and roles.
I have made a Java application getting users from an LDAP directory
(about 15000 users) and making mkcol request to my Slide server to
create users.
At the beginning, mkcol requests take only about 125ms, but this number
increases quickly to reach 15sec after few hours !
Apparently there are no problem in my application (checked by my
collegues). The database is correct too. We have made different tests
with different servers in different places, but the problem still remains.
Have you ever met this problem ?
Thank you.
Thomas.
--
BELLEMBOIS Thomas
CRI, Université de Rennes 1
Campus de beaulieu
Avenue du Général Leclerc
35042 RENNES Cedex
Tél.: 02.23.23.69.60
Mail: Thomas.Bellembois@univ-rennes1.fr
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: Pb creating big amount of users.
Posted by Jim Myers <ji...@verizon.net>.
Thomas,
Tara Talbott from our project submitted some fixes that improve the scaling
when adding new children to a collection. I think Oliver committed them but
they are not in the 2.0 release (after 2.1 also I think). The updates stop
slide from deleting and writing back all children when adding one child to a
collection by keeping a changed list' and just writing back the difference
(removing any children deleted, adding new ones).
Jim
----- Original Message -----
From: "Thomas BELLEMBOIS" <th...@univ-rennes1.fr>
To: <sl...@jakarta.apache.org>
Sent: Friday, September 10, 2004 4:34 AM
Subject: Pb creating big amount of users.
> Hello !
>
> I am working on a Slide server 2.0 connected to a mySQL database to store
> users and roles.
> I have made a Java application getting users from an LDAP directory (about
> 15000 users) and making mkcol request to my Slide server to create users.
> At the beginning, mkcol requests take only about 125ms, but this number
> increases quickly to reach 15sec after few hours !
> Apparently there are no problem in my application (checked by my
> collegues). The database is correct too. We have made different tests with
> different servers in different places, but the problem still remains.
> Have you ever met this problem ?
> Thank you.
>
> Thomas.
>
> --
> BELLEMBOIS Thomas
> CRI, Université de Rennes 1
> Campus de beaulieu
> Avenue du Général Leclerc
> 35042 RENNES Cedex
> Tél.: 02.23.23.69.60
> Mail: Thomas.Bellembois@univ-rennes1.fr
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: Pb creating big amount of users.
Posted by Andreas Probst <an...@gmx.net>.
On 10 Sep 2004 at 15:15, Thomas BELLEMBOIS wrote:
>
>
> Martin Holz wrote:
>
> >
> >There are 15 000 entries in /users and you try to add a other one?
> >Unfortunately adding a child to a collection scales linear with the
> >number of existing children. Changing this behavior would require
> >serious changes to the slide core especially the store interfaces.
> >
> >
> >Martin
> >
> >
> I have reached 6000 entries in /users (stored in a database). Now it
> takes 18sec to make an mkcol.
> Is it possible to store users in subdirectories in the user directory
> (to improve performances)?
> I have tried but without success.
>
Do you import, i.e. copy the users? Maybe it would be better to
develop a users store which queries the LDAP each time a user is
requested. This way there wouldn't be differences between the
two systems.
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: Pb creating big amount of users.
Posted by Thomas BELLEMBOIS <th...@univ-rennes1.fr>.
Martin Holz wrote:
>Thomas BELLEMBOIS <th...@univ-rennes1.fr> writes:
>
>
>
>>Hello !
>>
>>I am working on a Slide server 2.0 connected to a mySQL database to
>>store users and roles.
>>
>>I have made a Java application getting users from an LDAP directory
>>(about 15000 users) and making mkcol request to my Slide server to
>>create users.
>>
>>At the beginning, mkcol requests take only about 125ms, but this
>>number increases quickly to reach 15sec after few hours !
>>
>>Apparently there are no problem in my application (checked by my
>>collegues). The database is correct too. We have made different tests
>>with different servers in different places, but the problem still
>>remains.
>>
>>Have you ever met this problem ?
>>Thank you.
>>
>>
>
>There are 15 000 entries in /users and you try to add a other one?
>Unfortunately adding a child to a collection scales linear with the
>number of existing children. Changing this behavior would require
>serious changes to the slide core especially the store interfaces.
>
>
>Martin
>
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
>
>
>
>
I have reached 6000 entries in /users (stored in a database). Now it
takes 18sec to make an mkcol.
Is it possible to store users in subdirectories in the user directory
(to improve performances)?
I have tried but without success.
--
BELLEMBOIS Thomas
CRI, Université de Rennes 1
Campus de beaulieu
Avenue du Général Leclerc
35042 RENNES Cedex
Tél.: 02.23.23.69.60
Mail: Thomas.Bellembois@univ-rennes1.fr
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: Pb creating big amount of users.
Posted by Martin Holz <ho...@fiz-chemie.de>.
Thomas BELLEMBOIS <th...@univ-rennes1.fr> writes:
> Hello !
>
> I am working on a Slide server 2.0 connected to a mySQL database to
> store users and roles.
>
> I have made a Java application getting users from an LDAP directory
> (about 15000 users) and making mkcol request to my Slide server to
> create users.
>
> At the beginning, mkcol requests take only about 125ms, but this
> number increases quickly to reach 15sec after few hours !
>
> Apparently there are no problem in my application (checked by my
> collegues). The database is correct too. We have made different tests
> with different servers in different places, but the problem still
> remains.
>
> Have you ever met this problem ?
> Thank you.
There are 15 000 entries in /users and you try to add a other one?
Unfortunately adding a child to a collection scales linear with the
number of existing children. Changing this behavior would require
serious changes to the slide core especially the store interfaces.
Martin
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org