You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@directory.apache.org by "Jörg Andreas (Galexis)" <an...@galexis.com> on 2019/12/19 16:34:46 UTC

ApacheDS increasing partition size without adding entries

Hi Emmanuel

We see an increasing use of disk space on our partition without adding much new entries to the database. Currently we have close to 22’000 objects stored in the database. The server is used in production and has traffic (some 100 requests per minute)

Weekly Backup sizes:
3.1G/../partitions_2019-09-22-03:00:01
3.3G/../partitions_2019-09-29-03:00:01
3.5G/../partitions_2019-10-06-03:00:02
3.8G/../partitions_2019-10-13-03:00:02
3.9G/../partitions_2019-10-20-03:00:02
4.1G/../partitions_2019-10-27-03:00:02
4.4G/../partitions_2019-11-03-03:00:01
4.6G/../partitions_2019-11-10-03:00:01
4.8G/../partitions_2019-11-17-03:00:02
5.1G/../partitions_2019-11-24-03:00:02
5.3G/../partitions_2019-12-01-03:00:01
5.5G/../partitions_2019-12-08-03:00:02
5.7G/../partitions_2019-12-15-03:00:01

The following file is the largest with aprox. 5.5G

5.5G/../partitions/system/1.3.6.1.4.1.4203.666.1.7.db
4.0K  /../partitions/system/1.3.6.1.4.1.4203.666.1.7-entryCSN.txt
4.0K/../partitions/system/1.3.6.1.4.1.4203.666.1.7.lg

Can you tell us, what this file is for and what could cause the weekly increase of +- 200 MB in file size. And are there any tools for cleaning and stabilizing the disk usage?

Kind regards

Andreas Jörg
Software Developer
Galexis AG




This message may contain confidential information and is intended only for the individual named herein. If you are not the herein named addressee you should not disseminate, distribute, copy or otherwise make use of this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake, and delete this e-mail from your system. Thank you.

Re: ApacheDS increasing partition size without adding entries

Posted by Emmanuel Lécharny <el...@gmail.com>.
Hi,


I suspect that PasswordPolicy is responsible for this beahaviour. Each 
time some user binds on the server, the entry will be updated, thus 
generating a new entryCSN. (I have to double check that).

In any case, the previous entryCSN should get removed.

I'll check the code.


On 20/12/2019 15:54, Jörg Andreas (Galexis) wrote:
> Yes we have PasswordPolicy set. I’ll send you the file to elech….@gmai.com<http://gmai.com>.
>
> Andreas
>
>
> Am 20.12.2019 um 15:26 schrieb Emmanuel Lécharny <el...@gmail.com>>:
>
>
> On 20/12/2019 14:31, Jörg Andreas (Galexis) wrote:
> Hi Emmanuel
>
> Thanks for the fast reply. We have no replication enabled and no replication consumer configured. I can send you our current configuration file. We also checked, that journaling is disabled, but that would be a different file anyway.
>
>
> Yes, please, send the configuration file.
>
>
> Maybe there is a flag we missed?
>
> hmmm, I don't see which one could cause such a behavior. This index is not supposed to move as soon as the entry has been created, unless it's updated.
>
>
> May be you have PasswordPolicy set ?
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@directory.apache.org<ma...@directory.apache.org>
> For additional commands, e-mail: users-help@directory.apache.org<ma...@directory.apache.org>
>
>
>
> This message may contain confidential information and is intended only for the individual named herein. If you are not the herein named addressee you should not disseminate, distribute, copy or otherwise make use of this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake, and delete this e-mail from your system. Thank you.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@directory.apache.org
For additional commands, e-mail: users-help@directory.apache.org


Re: ApacheDS increasing partition size without adding entries

Posted by "Jörg Andreas (Galexis)" <an...@galexis.com>.
Yes we have PasswordPolicy set. I’ll send you the file to elech….@gmai.com<http://gmai.com>.

Andreas


Am 20.12.2019 um 15:26 schrieb Emmanuel Lécharny <el...@gmail.com>>:


On 20/12/2019 14:31, Jörg Andreas (Galexis) wrote:
Hi Emmanuel

Thanks for the fast reply. We have no replication enabled and no replication consumer configured. I can send you our current configuration file. We also checked, that journaling is disabled, but that would be a different file anyway.


Yes, please, send the configuration file.


Maybe there is a flag we missed?

hmmm, I don't see which one could cause such a behavior. This index is not supposed to move as soon as the entry has been created, unless it's updated.


May be you have PasswordPolicy set ?



---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@directory.apache.org<ma...@directory.apache.org>
For additional commands, e-mail: users-help@directory.apache.org<ma...@directory.apache.org>



This message may contain confidential information and is intended only for the individual named herein. If you are not the herein named addressee you should not disseminate, distribute, copy or otherwise make use of this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake, and delete this e-mail from your system. Thank you.

Re: ApacheDS increasing partition size without adding entries

Posted by Emmanuel Lécharny <el...@gmail.com>.
On 20/12/2019 14:31, Jörg Andreas (Galexis) wrote:
> Hi Emmanuel
>
> Thanks for the fast reply. We have no replication enabled and no replication consumer configured. I can send you our current configuration file. We also checked, that journaling is disabled, but that would be a different file anyway.


Yes, please, send the configuration file.

>
> Maybe there is a flag we missed?

hmmm, I don't see which one could cause such a behavior. This index is 
not supposed to move as soon as the entry has been created, unless it's 
updated.


May be you have PasswordPolicy set ?



---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@directory.apache.org
For additional commands, e-mail: users-help@directory.apache.org


Re: ApacheDS increasing partition size without adding entries

Posted by "Jörg Andreas (Galexis)" <an...@galexis.com>.
Hi Emmanuel

Thanks for the fast reply. We have no replication enabled and no replication consumer configured. I can send you our current configuration file. We also checked, that journaling is disabled, but that would be a different file anyway.

Maybe there is a flag we missed?

Kind Regards

Andreas ;)

Andreas Jörg
Software Developer
Galexis AG
This message may contain confidential information and is intended only for the individual named herein. If you are not the herein named addressee you should not disseminate, distribute, copy or otherwise make use of this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake, and delete this e-mail from your system. Thank you.

Re: ApacheDS increasing partition size without adding entries

Posted by Emmanuel Lécharny <el...@gmail.com>.
Hi Jörg,

On 19/12/2019 17:34, Jörg Andreas (Galexis) wrote:
> Hi Emmanuel
>
> We see an increasing use of disk space on our partition without adding much new entries to the database. Currently we have close to 22’000 objects stored in the database. The server is used in production and has traffic (some 100 requests per minute)
>
> Weekly Backup sizes:
> 3.1G/../partitions_2019-09-22-03:00:01
> 3.3G/../partitions_2019-09-29-03:00:01
> 3.5G/../partitions_2019-10-06-03:00:02
> 3.8G/../partitions_2019-10-13-03:00:02
> 3.9G/../partitions_2019-10-20-03:00:02
> 4.1G/../partitions_2019-10-27-03:00:02
> 4.4G/../partitions_2019-11-03-03:00:01
> 4.6G/../partitions_2019-11-10-03:00:01
> 4.8G/../partitions_2019-11-17-03:00:02
> 5.1G/../partitions_2019-11-24-03:00:02
> 5.3G/../partitions_2019-12-01-03:00:01
> 5.5G/../partitions_2019-12-08-03:00:02
> 5.7G/../partitions_2019-12-15-03:00:01
>
> The following file is the largest with aprox. 5.5G
>
> 5.5G/../partitions/system/1.3.6.1.4.1.4203.666.1.7.db
> 4.0K  /../partitions/system/1.3.6.1.4.1.4203.666.1.7-entryCSN.txt
> 4.0K/../partitions/system/1.3.6.1.4.1.4203.666.1.7.lg
>
> Can you tell us, what this file is for and what could cause the weekly increase of +- 200 MB in file size. And are there any tools for cleaning and stabilizing the disk usage?


have you set up replication ?


The growing database is not supposed to move, unless new entries are 
added, or if replication is activated.



---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@directory.apache.org
For additional commands, e-mail: users-help@directory.apache.org