You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@clerezza.apache.org by "Minto van der Sluis (JIRA)" <ji...@apache.org> on 2013/03/12 14:41:13 UTC
[jira] [Comment Edited] (CLEREZZA-736) Create a scalable Jena TDB
based TcProvider to support up to 100,000+ named graphs
[ https://issues.apache.org/jira/browse/CLEREZZA-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13600035#comment-13600035 ]
Minto van der Sluis edited comment on CLEREZZA-736 at 3/12/13 1:39 PM:
-----------------------------------------------------------------------
Ahh, this look much better :-)
Performance is nearly identical, memory consumption is however a major improvement. See attached cpu and memory diagram https://issues.apache.org/jira/secure/attachment/12573330/visual%20VM%20screen.png
Number of graphs: 30000
Duration: aprox. 18 minutes
Average per graph: 36 ms
Start: 30 graphs / second
End: 26-28 graphs / second
14:10:02,342 INFO [AStoreTestRunner] Completed message (seq#[0])
14:10:02,370 INFO [AStoreTestRunner] Completed message (seq#[1])
...
14:27:52,719 INFO [AStoreTestRunner] Completed message (seq#[29998])
14:27:52,766 INFO [AStoreTestRunner] Completed message (seq#[29999])
14:27:52,769 INFO [AStoreTestRunner] Number of messages: 30000
14:27:52,769 INFO [AStoreTestRunner] Success : 30000 (100%)
14:27:52,769 INFO [AStoreTestRunner] Failed : 0 (0%)
14:27:52,787 INFO [AStoreTestRunner] Start time : 2013-03-12T14:10:02.193+01:00
14:27:52,787 INFO [AStoreTestRunner] End time : 2013-03-12T14:27:52.766+01:00
14:27:52,790 INFO [AStoreTestRunner] Duration : PT1070.573S
14:27:52,790 INFO [AStoreTestRunner] Duration per msg : 35683046 ns
was (Author: misl):
Ahh, this look much better :-)
Performance is nearly identical, memory consumption is however a major improvement.
Number of graphs: 30000
Duration: aprox. 18 minutes
Average per graph: 36 ms
Start: 30 graphs / second
End: 26-28 graphs / second
14:10:02,342 INFO [AStoreTestRunner] Completed message (seq#[0])
14:10:02,370 INFO [AStoreTestRunner] Completed message (seq#[1])
...
14:27:52,719 INFO [AStoreTestRunner] Completed message (seq#[29998])
14:27:52,766 INFO [AStoreTestRunner] Completed message (seq#[29999])
14:27:52,769 INFO [AStoreTestRunner] Number of messages: 30000
14:27:52,769 INFO [AStoreTestRunner] Success : 30000 (100%)
14:27:52,769 INFO [AStoreTestRunner] Failed : 0 (0%)
14:27:52,787 INFO [AStoreTestRunner] Start time : 2013-03-12T14:10:02.193+01:00
14:27:52,787 INFO [AStoreTestRunner] End time : 2013-03-12T14:27:52.766+01:00
14:27:52,790 INFO [AStoreTestRunner] Duration : PT1070.573S
14:27:52,790 INFO [AStoreTestRunner] Duration per msg : 35683046 ns
> Create a scalable Jena TDB based TcProvider to support up to 100,000+ named graphs
> ----------------------------------------------------------------------------------
>
> Key: CLEREZZA-736
> URL: https://issues.apache.org/jira/browse/CLEREZZA-736
> Project: Clerezza
> Issue Type: Bug
> Components: storage
> Reporter: Minto van der Sluis
> Attachments: Performance test report.pdf, ScalableTdbSingleDatasetTcProvider.patch, visual VM screen.png
>
>
> The current SingleTdbSingleDatasetTcProvider supports multiple named graphs. The current implementation however is not very scalable. See attached performance report.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira