You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@jena.apache.org by "arne-bdt (via GitHub)" <gi...@apache.org> on 2024/01/13 21:14:15 UTC

Re: [I] [question] concurrent `org.apache.jena.graph.Graph` implementations [jena]

arne-bdt commented on issue #1961:
URL: https://github.com/apache/jena/issues/1961#issuecomment-1890770500

   @sszuev, I would greatly appreciate it if you could include my implementation in your benchmarking tests.
   
   My own benchmarks and tests suggest that this implementation of a SWMR+ graph will soon be viable for deployment with our clients. However, it's important to note that testing and documentation are still works in progress, and some refactoring is anticipated. Despite these ongoing developments, the implementation is functioning as intended and meets our speed requirements.
   
   In our use case, we manage a graph with approximately 600,000 triples. We face a demanding scenario where 375,000 triples are updated every three seconds, alongside smaller updates involving about 100 triples every second. This occurs concurrently with eight threads, each reading all triples once per second. On my new notebook, which has sufficient processing power, I've been able to simulate this scenario in a single unit test. You can find these tests here:
   
   - [testOneThreadUpdatingWithSeveralThreadsReading](https://github.com/arne-bdt/jena/blob/5c230d1697b3a2a14cff7ee6328d599cf8699feb/jena-benchmarks/jena-benchmarks-jmh/src/test/java/org/apache/jena/mem/graph/TestMEASTransactional2.java#L316)
   
   - [testMultipleThreadsUpdatingWithSeveralThreadsReading](https://github.com/arne-bdt/jena/blob/5c230d1697b3a2a14cff7ee6328d599cf8699feb/jena-benchmarks/jena-benchmarks-jmh/src/test/java/org/apache/jena/mem/graph/TestMEASTransactional2.java#L187)
   
   To run these tests, you'll need to check out my [SMMR_Dataset branch ](https://github.com/arne-bdt/jena/tree/SWMR_Dataset) to get it running.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@jena.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@jena.apache.org
For additional commands, e-mail: issues-help@jena.apache.org