You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-issues@jackrabbit.apache.org by "Davide Giannella (JIRA)" <ji...@apache.org> on 2015/04/28 15:26:07 UTC

[jira] [Comment Edited] (OAK-2813) Create a benchmark for measuring the lag of async index

    [ https://issues.apache.org/jira/browse/OAK-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516957#comment-14516957 ] 

Davide Giannella edited comment on OAK-2813 at 4/28/15 1:25 PM:
----------------------------------------------------------------

I run the benchmark for 15 minutes importing the full wikipedia (11GB dump above) with the following results

{noformat}
$ java -Druntime=900 -Dlogback.configurationFile=logback-benchmark.xml -jar ~/.m2/repository/org/apache/jackrabbit/oak-run/1.4-SNAPSHOT/oak-run-1.4-SNAPSHOT.jar benchmark --wikipedia enwiki-20150403-pages-articles.xml.bz2 --base ~/tmp/oak/ LucenePropertyFullTextTest Oak-Tar Oak-Mongo
Apache Jackrabbit Oak 1.4-SNAPSHOT
# LucenePropertyFullTextTest       C     min     10%     50%     90%     max       N
Oak-Mongo                          1   71083   71083  276668  563857  563857       4
Oak-Tar                            1  327910  327910  335555  339525  339525       3
{noformat}

In [^oak-1430224050.log] the logs from the execution.

Before committing to trunk I'll have a look on how to split global full-text from lucene property.


was (Author: edivad):
I run the benchmark for 15 minutes importing the full wikipedia (11GB dump above) with the following results

{noformat}
$ java -Druntime=900 -Dlogback.configurationFile=/Users/dgiannel/work/sources/github/misc/oaky-stuff/logback-benchmark.xml -jar ~/.m2/repository/org/apache/jackrabbit/oak-run/1.4-SNAPSHOT/oak-run-1.4-SNAPSHOT.jar benchmark --wikipedia /Users/dgiannel/Downloads/enwiki-20150403-pages-articles.xml.bz2 --base /Users/dgiannel/tmp/oak/ LucenePropertyFullTextTest Oak-Tar Oak-Mongo
Apache Jackrabbit Oak 1.4-SNAPSHOT
# LucenePropertyFullTextTest       C     min     10%     50%     90%     max       N
Oak-Mongo                          1   71083   71083  276668  563857  563857       4
Oak-Tar                            1  327910  327910  335555  339525  339525       3
{noformat}

In [^oak-1430224050.log] the logs from the execution.

Before committing to trunk I'll have a look on how to split global full-text from lucene property.

> Create a benchmark for measuring the lag of async index
> -------------------------------------------------------
>
>                 Key: OAK-2813
>                 URL: https://issues.apache.org/jira/browse/OAK-2813
>             Project: Jackrabbit Oak
>          Issue Type: Sub-task
>          Components: core
>            Reporter: Davide Giannella
>            Assignee: Davide Giannella
>             Fix For: 1.3.0
>
>         Attachments: OAK-2813-r1.diff, benchmark-run.log, logback-benchmark.xml, oak-1430224050.log
>
>
> As with OAK-2749 (and others) we're taking routes for optimising the speed of async indexing, we need a benchmark that will measure how long it takes for a lucene property index to have the content indexed. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)