You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jackrabbit.apache.org by "deepak.singhvi@gmail.com" <de...@gmail.com> on 2012/07/13 06:28:31 UTC
With more number of nodes performance of node addition degraded
Hi,
I am using Jackrabbit to create the repository.
Moving from my traditional database approach to Jackrabbit's file based
repository approach.
I have number of binary contents files under each node and that varies.
With 1000 nodes, i was able to add new node within 3 minutes and now after
adding 75000 its taking almost
12 or more minutes for each node creation/addition.
I am not using DBStore as my binary contents will have minimum 3 KB, most
other files are between 4 - 10 kb, some might have more.
I have attached my repository file(repository.txt).
using LocalFileSystem for FileSystem and BundleFsPersistenceManager for
persistence.
Any suggestion to improve the node addition performance?
Regards,
Deepak Singhvi
http://jackrabbit.510166.n4.nabble.com/file/n4655969/repository.txt
repository.txt
--
View this message in context: http://jackrabbit.510166.n4.nabble.com/With-more-number-of-nodes-performance-of-node-addition-degraded-tp4655969.html
Sent from the Jackrabbit - Dev mailing list archive at Nabble.com.
Re: With more number of nodes performance of node addition degraded
Posted by Alexander Klimetschek <ak...@adobe.com>.
On 20.07.2012, at 06:14, deepak.singhvi@gmail.com wrote:
> And about the hierarchy i have no choice and most of them is going to come
> as flat.
There is always a choice. Either get some categorization based on additional user input or from extracting metadata etc. from the files, or if nothing helps, you can always use a date structure (e.g. 2012/07/30).
Cheers,
Alex
Re: With more number of nodes performance of node addition degraded
Posted by "deepak.singhvi@gmail.com" <de...@gmail.com>.
Thanks for your suggestions Alex,
yeah i am aware about the dbstore and used it for dbdatastore, i am going
to use that for file as well.
And about the hierarchy i have no choice and most of them is going to come
as flat.
Regards,
Deepak
http://deepaksinghviblog.blogspot.in/
--
View this message in context: http://jackrabbit.510166.n4.nabble.com/With-more-number-of-nodes-performance-of-node-addition-degraded-tp4655969p4656072.html
Sent from the Jackrabbit - Dev mailing list archive at Nabble.com.
Re: With more number of nodes performance of node addition degraded
Posted by Alexander Klimetschek <ak...@adobe.com>.
On 13.07.2012, at 06:28, deepak.singhvi@gmail.com wrote:
> With 1000 nodes, i was able to add new node within 3 minutes and now after
> adding 75000 its taking almost
> 12 or more minutes for each node creation/addition.
>
> I am not using DBStore as my binary contents will have minimum 3 KB, most
> other files are between 4 - 10 kb, some might have more.
>
> I have attached my repository file(repository.txt).
> using LocalFileSystem for FileSystem and BundleFsPersistenceManager for
> persistence.
Have you:
- read http://wiki.apache.org/jackrabbit/PersistenceManagerFAQ#Bundle_File-System_PM ?
- tried the FileDataStore?
- using a hierarchy and not a flat structure? (i.e. not put all 75000 nodes under one common parent)
Cheers,
Alex