Scalability Questions

[MarkD <bu...@hotmail.com>]

Hi,

I have a few questions regarding Apache Directory scaling to a large number
of users (>100k, up to 1 million).

1) what is the default persistence implementation? 
2) how many users does Apache DS support? 
3) is performance related to number of users? 
4) what are the best practices for initially loading the directory with a
large number of users? 
5)what are the best practices / tradeoffs sessions & are they directly
correlated with JNDI InitialContext’s?

Thanks,
Mark


--
View this message in context: http://www.nabble.com/Scalability-Questions-t1464730.html#a3958763
Sent from the Apache Directory Project forum at Nabble.com.

Re: Scalability Questions

[Emmanuel Lecharny <el...@gmail.com>]

Alex Karasulu a écrit :

> Hi Mark,
>
> MarkD wrote:
>
>> Hi,
>>
<snip/>

>> 2) how many users does Apache DS support?   
>
> Don't know yet I have not tried to fill it up.  I do know the 
> theoretical limit for a single partition which is Integer.MAX 2^32-1.

This is complicated. It depends if you mean connected users, or possible 
users. I'm not 100% sure that ADS could store 1 million entries, but I 
bet it can. If you want to know if we can handle 1 million connected 
users, I bet the answer is no. I'm afraid that we can't even handle more 
than 32765 simultaneous connected users, but odes it make sense ? 
Generally speaking, a user does not keep a connection open for hours ...

Can you told us if users mean "connected" users, or just entries in the 
server ?

<snip/>

>> 4) what are the best practices for initially loading the directory 
>> with a
>> large number of users?   
>
> Hmmm I recommend making sure you have the right indices created before 
> loading the directory.

yep, for sure. If you don't have the right indices, then your server 
will just crawl down. However, the best solution is definitively to use 
a ldif file if you want to import millions of entries.

Emmanuel

Re: Scalability Questions

[Alex Karasulu <ao...@bellsouth.net>]

Hi Mark,

MarkD wrote:
> Hi,
>
> I have a few questions regarding Apache Directory scaling to a large number
> of users (>100k, up to 1 million).
>   
We're in the process of testing and discovering these aspects of the 
server with quantitative data to show performance degradation with the 
side of the database.  Emmanuel is working on this btw.
> 1) what is the default persistence implementation?
The default implementation is based on JDBM a B+Tree implementation in Java.
>  
> 2) how many users does Apache DS support? 
>   
Don't know yet I have not tried to fill it up.  I do know the 
theoretical limit for a single partition which is Integer.MAX 2^32-1.
> 3) is performance related to number of users? 
>   
Should not really be since the BTree will scale well.  But I cannot say 
definitively without performing these tests and having conclusive data 
to give you.
> 4) what are the best practices for initially loading the directory with a
> large number of users? 
>   
Hmmm I recommend making sure you have the right indices created before 
loading the directory. 
> 5)what are the best practices / tradeoffs sessions & are they directly
> correlated with JNDI InitialContext’s?
>   
Could you restate this question having trouble understanding it?

Alex