You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jackrabbit.apache.org by "deepak.singhvi@gmail.com" <de...@gmail.com> on 2012/07/13 06:28:31 UTC

With more number of nodes performance of node addition degraded

Hi,
 I am using Jackrabbit to create the repository. 
 Moving from my traditional database approach to Jackrabbit's file based
repository approach. 
 I have number of binary contents files under each node and that varies.
 With 1000 nodes, i was able to add new node within 3 minutes and now after
adding 75000 its taking almost   
 12 or more minutes for each node creation/addition.

 I am not using DBStore as my binary contents will have minimum 3 KB, most
other files are between 4 - 10 kb, some might have more.
 

 I have attached my repository file(repository.txt).
 using LocalFileSystem for FileSystem and BundleFsPersistenceManager for
persistence.

 Any suggestion to improve the node addition performance?


Regards,
Deepak Singhvi


http://jackrabbit.510166.n4.nabble.com/file/n4655969/repository.txt
repository.txt 

--
View this message in context: http://jackrabbit.510166.n4.nabble.com/With-more-number-of-nodes-performance-of-node-addition-degraded-tp4655969.html
Sent from the Jackrabbit - Dev mailing list archive at Nabble.com.

Re: With more number of nodes performance of node addition degraded

Posted by Alexander Klimetschek <ak...@adobe.com>.
On 20.07.2012, at 06:14, deepak.singhvi@gmail.com wrote:

>  And about the hierarchy i have no choice and most of them is going to come
> as flat.

There is always a choice. Either get some categorization based on additional user input or from extracting metadata etc. from the files, or if nothing helps, you can always use a date structure (e.g. 2012/07/30).

Cheers,
Alex


Re: With more number of nodes performance of node addition degraded

Posted by "deepak.singhvi@gmail.com" <de...@gmail.com>.
Thanks for your suggestions Alex, 
  yeah i am aware about the dbstore and used it for dbdatastore, i am going
to use that for file as well.
  And about the hierarchy i have no choice and most of them is going to come
as flat.

Regards,
Deepak
http://deepaksinghviblog.blogspot.in/
  

--
View this message in context: http://jackrabbit.510166.n4.nabble.com/With-more-number-of-nodes-performance-of-node-addition-degraded-tp4655969p4656072.html
Sent from the Jackrabbit - Dev mailing list archive at Nabble.com.

Re: With more number of nodes performance of node addition degraded

Posted by Alexander Klimetschek <ak...@adobe.com>.
On 13.07.2012, at 06:28, deepak.singhvi@gmail.com wrote:

> With 1000 nodes, i was able to add new node within 3 minutes and now after
> adding 75000 its taking almost   
> 12 or more minutes for each node creation/addition.
> 
> I am not using DBStore as my binary contents will have minimum 3 KB, most
> other files are between 4 - 10 kb, some might have more.
> 
>  I have attached my repository file(repository.txt).
> using LocalFileSystem for FileSystem and BundleFsPersistenceManager for
> persistence.

Have you:

- read http://wiki.apache.org/jackrabbit/PersistenceManagerFAQ#Bundle_File-System_PM ?
- tried the FileDataStore?
- using a hierarchy and not a flat structure? (i.e. not put all 75000 nodes under one common parent)

Cheers,
Alex