You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Mark Miller <ma...@gmail.com> on 2009/08/05 22:00:22 UTC
benchmark: lucene24 vs lucene29
Has anything changed in benchmark that would make things uncomparable
between 2.9 and 2.4?
I don't see anything in Changes that should have that much of an affect ...
I tried micro bench on each and 2.9 ran twice as fast.
I also tried standard. Which is a crazy difference. Particularly, with
indexing I think. Its too big of a dif to make sense ...
Any thoughts?
--
- Mark
http://www.lucidimagination.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Mark Miller <ma...@gmail.com>.
I ran micro a bunch for both, than ran standard for each, 2.9 first:
about 4 minutes for 2.9 vs 25 for 2.4
I could be doing something wrong - but they are both fresh checkouts and
all I did was run-micro and run-standard on the benchmark ant file.
Buildfile: /home/mark/workspace/Lucene2/contrib/benchmark/build.xml
[echo] Building benchmark...
javacc-uptodate-check:
javacc-notice:
jflex-uptodate-check:
jflex-notice:
common.init:
compile-demo:
javacc-uptodate-check:
javacc-notice:
jflex-uptodate-check:
jflex-notice:
init:
clover.setup:
clover.info:
[echo]
[echo] Clover not found. Code coverage reports disabled.
[echo]
clover:
compile-core:
compile-demo:
run-task:
[echo] Working Directory:
/home/mark/workspace/Lucene2/contrib/benchmark/work
[java] Running algorithm from:
/home/mark/workspace/Lucene2/contrib/benchmark/conf/standard.alg
[java] ------------> config properties:
[java] analyzer = org.apache.lucene.analysis.standard.StandardAnalyzer
[java] compound = cmpnd:true:true:true:true:false:false:false:false
[java] content.source =
org.apache.lucene.benchmark.byTask.feeds.ReutersContentSource
[java] directory = FSDirectory
[java] doc.stored = true
[java] doc.term.vector = false
[java] doc.tokenized = true
[java] docs.dir = reuters-out
[java] log.queries = true
[java] log.step = 2000
[java] max.buffered = buf:10:10:100:100:10:10:100:100
[java] merge.factor = mrg:10:100:10:100:10:100:10:100
[java] query.maker =
org.apache.lucene.benchmark.byTask.feeds.ReutersQueryMaker
[java] task.max.depth.log = 2
[java] work.dir = work
[java] -------------------------------
[java] ------------> queries:
[java] 0. TermQuery - body:salomon
[java] 1. TermQuery - body:comex
[java] 2. BooleanQuery - body:night body:trading
[java] 3. BooleanQuery - body:japan body:sony
[java] 4. PhraseQuery - body:"sony japan"
[java] 5. PhraseQuery - body:"food needs"~3
[java] 6. BooleanQuery - +body:"world bank"^2.0 +body:nigeria
[java] 7. BooleanQuery - body:"world bank" -body:nigeria
[java] 8. PhraseQuery - body:"ford credit"~5
[java] 9. BooleanQuery - body:airline body:europe body:canada
body:destination
[java] 10. BooleanQuery - body:long body:term body:pressure
body:trade body:ministers body:necessary body:current body:uruguay
body:round body:talks body:general body:agreement body:trade
body:tariffs body:gatt body:succeed
[java] 11. SpanFirstQuery - spanFirst(body:ford, 5)
[java] 12. SpanNearQuery - spanNear([body:night, body:trading], 4,
false)
[java] 13. SpanNearQuery - spanNear([spanFirst(body:ford, 10),
body:credit], 10, false)
[java] 14. WildcardQuery - body:fo*
[java] ------------> algorithm:
[java] Seq {
[java] Rounds_8 {
[java] ResetSystemErase
[java] Populate {
[java] CreateIndex
[java] MAddDocs_20000 {
[java] AddDoc
[java] } * 20000
[java] Optimize
[java] CloseIndex
[java] }
[java] OpenReader
[java] SearchSameRdr_5000 {
[java] Search
[java] > * 5000
[java] CloseReader
[java] WarmNewRdr_50 {
[java] Warm
[java] > * 50
[java] SrchNewRdr_500 {
[java] Search
[java] > * 500
[java] SrchTrvNewRdr_300 {
[java] SearchTrav
[java] > * 300
[java] SrchTrvRetNewRdr_100 {
[java] SearchTravRet
[java] > * 100
[java] OpenReader
[java] SearchSameRdr_5000_2500/sec_Par [
[java] Search
[java] > * 5000, rate: 2500/sec
[java] CloseReader
[java] WarmNewRdr_50_25/sec_Par [
[java] Warm
[java] > * 50, rate: 25/sec
[java] SrchNewRdr_50_25/sec_Par [
[java] Search
[java] > * 50, rate: 25/sec
[java] SrchTrvNewRdr_300_150/sec_Par [
[java] SearchTrav
[java] > * 300, rate: 150/sec
[java] SrchTrvRetNewRdr_100_50/sec_Par [
[java] SearchTravRet
[java] > * 100, rate: 50/sec
[java] RepSumByPref MAddDocs
[java] NewRound
[java] } * 8
[java] RepSumByNameRound
[java] RepSumByName
[java] RepSumByPrefRound MAddDocs
[java] }
[java] ------------> starting task: Seq
[java] ------------> starting task: Rounds_8
[java] ------------> starting task: ResetSystemErase
[java] ------------> starting task: Populate
[java] 2.45 sec --> main added 2000 docs
[java] 4.16 sec --> main added 4000 docs
[java] 5.92 sec --> main added 6000 docs
[java] 7.53 sec --> main added 8000 docs
[java] 9.12 sec --> main added 10000 docs
[java] 10.63 sec --> main added 12000 docs
[java] 12.16 sec --> main added 14000 docs
[java] 13.53 sec --> main added 16000 docs
[java] 14.92 sec --> main added 18000 docs
[java] 16.41 sec --> main added 20000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] 19.14 sec --> main processed 2000 records
[java] 19.86 sec --> main processed 4000 records
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 1 out
of 20021)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 0 10 10 true 1 20000
1,229.11 16.27 18,340,664 61,669,376
[java] ------------> starting task: NewRound
[java] --> Round 0-->1: merge.factor:10-->100
max.buffered:10-->10 compound:true-->true
[java] ------------> starting task: ResetSystemErase
[java] ------------> DocMaker statistics (0):
[java] total bytes of unique texts: 16,594,170
[java] ------------> starting task: Populate
[java] 0.96 sec --> main added 22000 docs
[java] 1.82 sec --> main added 24000 docs
[java] 2.72 sec --> main added 26000 docs
[java] 3.54 sec --> main added 28000 docs
[java] 4.55 sec --> main added 30000 docs
[java] 5.41 sec --> main added 32000 docs
[java] 6.24 sec --> main added 34000 docs
[java] 7.02 sec --> main added 36000 docs
[java] 7.84 sec --> main added 38000 docs
[java] 8.66 sec --> main added 40000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] 10.29 sec --> main processed 6000 records
[java] 10.97 sec --> main processed 8000 records
[java] 11.64 sec --> main processed 10000 records
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 2 out
of 40040)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 2 20000
1,609.14 24.86 27,463,624 62,914,560
[java] ------------> starting task: NewRound
[java] --> Round 1-->2: merge.factor:100-->10
max.buffered:10-->100 compound:true-->true
[java] ------------> starting task: ResetSystemErase
[java] ------------> starting task: Populate
[java] 0.61 sec --> main added 42000 docs
[java] 1.12 sec --> main added 44000 docs
[java] 1.67 sec --> main added 46000 docs
[java] 2.22 sec --> main added 48000 docs
[java] 2.83 sec --> main added 50000 docs
[java] 3.37 sec --> main added 52000 docs
[java] 3.86 sec --> main added 54000 docs
[java] 4.34 sec --> main added 56000 docs
[java] 4.91 sec --> main added 58000 docs
[java] 5.44 sec --> main added 60000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] 7.6 sec --> main processed 12000 records
[java] 8.28 sec --> main processed 14000 records
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 3 out
of 60059)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 3 20000
1,984.59 30.23 33,956,724 65,536,000
[java] ------------> starting task: NewRound
[java] --> Round 2-->3: merge.factor:10-->100
max.buffered:100-->100 compound:true-->true
[java] ------------> starting task: ResetSystemErase
[java] ------------> starting task: Populate
[java] 0.81 sec --> main added 62000 docs
[java] 1.31 sec --> main added 64000 docs
[java] 1.83 sec --> main added 66000 docs
[java] 2.35 sec --> main added 68000 docs
[java] 2.92 sec --> main added 70000 docs
[java] 3.66 sec --> main added 72000 docs
[java] 4.26 sec --> main added 74000 docs
[java] 4.74 sec --> main added 76000 docs
[java] 5.31 sec --> main added 78000 docs
[java] 5.83 sec --> main added 80000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] 8.34 sec --> main processed 16000 records
[java] 9.01 sec --> main processed 18000 records
[java] 9.68 sec --> main processed 20000 records
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] 14.96 sec --> main processed 2000 records
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 4 out
of 80078)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 4 20000
2,234.82 35.80 33,287,580 67,895,296
[java] ------------> starting task: NewRound
[java] --> Round 3-->4: merge.factor:100-->10
max.buffered:100-->10 compound:true-->false
[java] ------------> starting task: ResetSystemErase
[java] ------------> starting task: Populate
[java] 0.92 sec --> main added 82000 docs
[java] 1.81 sec --> main added 84000 docs
[java] 2.64 sec --> main added 86000 docs
[java] 3.36 sec --> main added 88000 docs
[java] 4.18 sec --> main added 90000 docs
[java] 5.01 sec --> main added 92000 docs
[java] 5.9 sec --> main added 94000 docs
[java] 6.77 sec --> main added 96000 docs
[java] 7.63 sec --> main added 98000 docs
[java] 8.46 sec --> main added 100000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] 11.13 sec --> main processed 22000 records
[java] 11.79 sec --> main processed 24000 records
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 5 out
of 100097)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 5 20000
2,263.01 44.19 36,514,460 69,258,448
[java] ------------> starting task: NewRound
[java] --> Round 4-->5: merge.factor:10-->100
max.buffered:10-->10 compound:false-->false
[java] ------------> starting task: ResetSystemErase
[java] ------------> starting task: Populate
[java] 0.85 sec --> main added 102000 docs
[java] 1.66 sec --> main added 104000 docs
[java] 2.53 sec --> main added 106000 docs
[java] 3.37 sec --> main added 108000 docs
[java] 4.33 sec --> main added 110000 docs
[java] 5.19 sec --> main added 112000 docs
[java] 6.02 sec --> main added 114000 docs
[java] 6.84 sec --> main added 116000 docs
[java] 7.75 sec --> main added 118000 docs
[java] 8.66 sec --> main added 120000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] 10.84 sec --> main processed 26000 records
[java] 11.48 sec --> main processed 28000 records
[java] 12.12 sec --> main processed 30000 records
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 6 out
of 120116)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 6 20000
2,274.58 52.76 39,947,984 72,045,912
[java] ------------> starting task: NewRound
[java] --> Round 5-->6: merge.factor:100-->10
max.buffered:10-->100 compound:false-->false
[java] ------------> starting task: ResetSystemErase
[java] ------------> starting task: Populate
[java] 0.6 sec --> main added 122000 docs
[java] 1.11 sec --> main added 124000 docs
[java] 1.64 sec --> main added 126000 docs
[java] 2.15 sec --> main added 128000 docs
[java] 2.69 sec --> main added 130000 docs
[java] 3.22 sec --> main added 132000 docs
[java] 3.71 sec --> main added 134000 docs
[java] 4.19 sec --> main added 136000 docs
[java] 4.75 sec --> main added 138000 docs
[java] 5.26 sec --> main added 140000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] 7.78 sec --> main processed 32000 records
[java] 8.42 sec --> main processed 34000 records
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] 14.43 sec --> main processed 2000 records
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 7 out
of 140135)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 7 20000
2,416.25 57.94 42,471,832 73,821,624
[java] ------------> starting task: NewRound
[java] --> Round 6-->7: merge.factor:10-->100
max.buffered:100-->100 compound:false-->false
[java] ------------> starting task: ResetSystemErase
[java] ------------> starting task: Populate
[java] 0.6 sec --> main added 142000 docs
[java] 1.1 sec --> main added 144000 docs
[java] 1.66 sec --> main added 146000 docs
[java] 2.18 sec --> main added 148000 docs
[java] 2.73 sec --> main added 150000 docs
[java] 3.29 sec --> main added 152000 docs
[java] 3.8 sec --> main added 154000 docs
[java] 4.27 sec --> main added 156000 docs
[java] 4.82 sec --> main added 158000 docs
[java] 5.32 sec --> main added 160000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] 7.71 sec --> main processed 36000 records
[java] 8.35 sec --> main processed 38000 records
[java] 8.98 sec --> main processed 40000 records
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] 14.28 sec --> main processed 4000 records
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 8 out
of 160154)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 8 20000
2,532.21 63.19 41,519,020 75,603,968
[java] ------------> starting task: NewRound
[java] --> Round 7-->8: merge.factor:100-->10
max.buffered:100-->10 compound:false-->true
[java] ------------> Report Sum By (any) Name and Round (145 about
160153 out of 160154)
[java] Operation round mrg buf cmpnd
runCnt recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] Rounds_8 0 10 10 true
1 16316440 71,569.92 227.98 47,136,632 93,913,088
[java] Populate - - - - - - - - - 0 10 10 true - - 1
- - 20003 - 1,115.37 - - 17.93 - 25,779,176 - 61,472,768
[java] CreateIndex 0 10 10 true
1 1 7.14 0.14 5,809,592 42,205,184
[java] MAddDocs_20000 - - - - - - - 0 10 10 true - - 1
- - 20000 - 1,229.11 - - 16.27 - 18,340,664 - 61,669,376
[java] AddDoc 0 10 10 true
20000 1 2,064.20 9.69 27,211,360 58,632,496
[java] Optimize - - - - - - - - - 0 10 10 true - - 1
- - - - 1 - - - 1.16 - - 0.86 - 25,779,176 - 61,669,376
[java] CloseIndex 0 10 10 true
1 1 1.51 0.66 25,779,176 61,472,768
[java] OpenReader - - - - - - - - 0 10 10 true - - 2
- - - - 1 - - 166.67 - - 0.01 - 24,513,252 - 62,357,504
[java] SearchSameRdr_5000 0 10 10 true
1 5000 2,203.61 2.27 39,157,688 61,800,448
[java] CloseReader - - - - - - - - 0 10 10 true - - 2
- - - - 1 - 2,000.00 - - 0.00 - 35,596,868 - 61,931,520
[java] WarmNewRdr_50 0 10 10 true
1 1000000 204,582.66 4.89 43,228,488 63,373,312
[java] SrchNewRdr_500 - - - - - - - 0 10 10 true - - 1
- - - 500 - - 880.28 - - 0.57 - 43,228,488 - 63,373,312
[java] SrchTrvNewRdr_300 0 10 10 true
1 2760 8,093.84 0.34 30,743,872 63,242,240
[java] SrchTrvRetNewRdr_100 - - - - - 0 10 10 true - - 1
- - - 1728 - 13,935.48 - - 0.12 - 30,743,872 - 63,242,240
[java] SearchSameRdr_5000_2500/sec_Par 0 10 10 true
1 5000 1,796.62 2.78 31,722,512 63,242,240
[java] WarmNewRdr_50_25/sec_Par - - - - 0 10 10 true - - 1
- - 1000000 - 390,472.47 - - 2.56 - 57,790,552 - 64,290,816
[java] SrchNewRdr_50_25/sec_Par 0 10 10 true
1 50 25.50 1.96 57,991,856 64,290,816
[java] SrchTrvNewRdr_300_150/sec_Par - - 0 10 10 true - - 1
- - - 2760 - 1,531.63 - - 1.80 - 42,089,960 - 64,552,960
[java] SrchTrvRetNewRdr_100_50/sec_Par 0 10 10 true
1 1750 882.50 1.98 51,673,648 64,618,496
[java] Populate - - - - - - - - - 1 100 10 true - - 1
- - 20003 - 2,014.60 - - 9.93 - 16,298,680 - 64,159,744
[java] CreateIndex 1 100 10 true
1 1 13.16 0.08 6,927,456 64,159,744
[java] MAddDocs_20000 - - - - - - - 1 100 10 true - - 1
- - 20000 - 2,329.37 - - 8.59 - 36,586,584 - 64,159,744
[java] AddDoc 1 100 10 true
20000 1 3,021.15 6.62 29,068,414 59,813,540
[java] Optimize - - - - - - - - - 1 100 10 true - - 1
- - - - 1 - - - 1.58 - - 0.63 - 36,586,584 - 63,045,632
[java] CloseIndex 1 100 10 true
1 1 1.58 0.63 16,298,680 63,045,632
[java] OpenReader - - - - - - - - 1 100 10 true - - 2
- - - - 1 - 1,000.00 - - 0.00 - 25,960,516 - 66,748,416
[java] SearchSameRdr_5000 1 100 10 true
1 5000 2,920.56 1.71 42,263,104 65,011,712
[java] CloseReader - - - - - - - - 1 100 10 true - - 2
- - - - 1 - 2,000.00 - - 0.00 - 51,947,564 - 67,502,080
[java] WarmNewRdr_50 1 100 10 true
1 1000000 206,654.27 4.84 59,434,632 70,516,736
[java] SrchNewRdr_500 - - - - - - - 1 100 10 true - - 1
- - - 500 - 1,016.26 - - 0.49 - 59,434,632 - 70,516,736
[java] SrchTrvNewRdr_300 1 100 10 true
1 2760 8,000.00 0.34 45,171,432 70,516,736
[java] SrchTrvRetNewRdr_100 - - - - - 1 100 10 true - - 1
- - - 1728 - 16,301.89 - - 0.11 - 45,171,432 - 70,451,200
[java] SearchSameRdr_5000_2500/sec_Par 1 100 10 true
1 5000 1,910.58 2.62 60,821,472 70,451,200
[java] WarmNewRdr_50_25/sec_Par - - - - 1 100 10 true - - 1
- - 1000000 - 407,664.09 - - 2.45 - 61,632,024 - 73,072,640
[java] SrchNewRdr_50_25/sec_Par 1 100 10 true
1 50 25.50 1.96 48,234,464 73,072,640
[java] SrchTrvNewRdr_300_150/sec_Par - - 1 100 10 true - - 1
- - - 2760 - 1,533.33 - - 1.80 - 51,106,544 - 73,072,640
[java] SrchTrvRetNewRdr_100_50/sec_Par 1 100 10 true
1 1750 883.39 1.98 58,103,912 73,007,104
[java] Populate - - - - - - - - - 2 10 100 true - - 1
- - 20003 - 2,913.77 - - 6.86 - 52,287,656 - 70,582,272
[java] CreateIndex 2 10 100 true
1 1 14.49 0.07 9,340,760 68,681,728
[java] MAddDocs_20000 - - - - - - - 2 10 100 true - - 1
- - 20000 - 3,720.93 - - 5.38 - 46,942,920 - 70,778,880
[java] AddDoc 2 10 100 true
20000 1 5,464.48 3.66 32,688,658 70,358,032
[java] Optimize - - - - - - - - - 2 10 100 true - - 1
- - - - 1 - - - 1.34 - - 0.75 - 52,287,656 - 70,778,880
[java] CloseIndex 2 10 100 true
1 1 1.48 0.68 52,287,656 70,582,272
[java] OpenReader - - - - - - - - 2 10 100 true - - 2
- - - - 1 - 1,000.00 - - 0.00 - 55,991,488 - 71,270,400
[java] SearchSameRdr_5000 2 10 100 true
1 5000 2,852.25 1.75 52,287,656 70,582,272
[java] CloseReader - - - - - - - - 2 10 100 true - - 2
- - - - 1 - 2,000.00 - - 0.00 - 45,641,160 - 71,008,256
[java] WarmNewRdr_50 2 10 100 true
1 1000000 205,044.08 4.88 45,213,360 73,400,320
[java] SrchNewRdr_500 - - - - - - - 2 10 100 true - - 1
- - - 500 - - 961.54 - - 0.52 - 54,965,488 - 73,400,320
[java] SrchTrvNewRdr_300 2 10 100 true
1 2760 8,263.47 0.33 54,965,488 71,958,528
[java] SrchTrvRetNewRdr_100 - - - - - 2 10 100 true - - 1
- - - 1728 - 17,108.91 - - 0.10 - 59,695,320 - 71,958,528
[java] SearchSameRdr_5000_2500/sec_Par 2 10 100 true
1 5000 1,966.96 2.54 59,695,320 71,958,528
[java] WarmNewRdr_50_25/sec_Par - - - - 2 10 100 true - - 1
- - 1000000 - 402,576.50 - - 2.48 - 52,212,720 - 75,104,256
[java] SrchNewRdr_50_25/sec_Par 2 10 100 true
1 50 25.50 1.96 52,625,968 75,104,256
[java] SrchTrvNewRdr_300_150/sec_Par - - 2 10 100 true - - 1
- - - 2760 - 1,530.78 - - 1.80 - 28,571,040 - 75,104,256
[java] SrchTrvRetNewRdr_100_50/sec_Par 2 10 100 true
1 1750 882.50 1.98 28,046,984 75,038,720
[java] Populate - - - - - - - - - 3 100 100 true - - 1
- - 20003 - 2,512.62 - - 7.96 - 33,731,624 - 74,973,184
[java] CreateIndex 3 100 100 true
1 1 3.72 0.27 10,676,360 74,973,184
[java] MAddDocs_20000 - - - - - - - 3 100 100 true - - 1
- - 20000 - 3,594.54 - - 5.56 - 31,280,152 - 74,973,184
[java] AddDoc 3 100 100 true
20000 1 5,217.85 3.83 35,585,832 72,716,536
[java] Optimize - - - - - - - - - 3 100 100 true - - 1
- - - - 1 - - - 0.77 - - 1.29 - 33,731,624 - 72,220,672
[java] CloseIndex 3 100 100 true
1 1 1.20 0.83 33,731,624 71,041,024
[java] OpenReader - - - - - - - - 3 100 100 true - - 2
- - - - 1 - - 666.67 - - 0.00 - 42,532,748 - 73,105,408
[java] SearchSameRdr_5000 3 100 100 true
1 5000 2,922.27 1.71 48,942,504 71,761,920
[java] CloseReader - - - - - - - - 3 100 100 true - - 2
- - - - 1 - 2,000.00 - - 0.00 - 43,550,192 - 73,203,712
[java] WarmNewRdr_50 3 100 100 true
1 1000000 207,900.20 4.81 48,942,504 75,169,792
[java] SrchNewRdr_500 - - - - - - - 3 100 100 true - - 1
- - - 500 - 1,052.63 - - 0.47 - 54,031,360 - 75,235,328
[java] SrchTrvNewRdr_300 3 100 100 true
1 2760 9,583.33 0.29 60,711,928 75,235,328
[java] SrchTrvRetNewRdr_100 - - - - - 3 100 100 true - - 1
- - - 1728 - 16,941.18 - - 0.10 - 60,711,928 - 75,169,792
[java] SearchSameRdr_5000_2500/sec_Par 3 100 100 true
1 5000 1,966.18 2.54 51,333,872 75,169,792
[java] WarmNewRdr_50_25/sec_Par - - - - 3 100 100 true - - 1
- - 1000000 - 398,406.38 - - 2.51 - 38,157,880 - 76,021,760
[java] SrchNewRdr_50_25/sec_Par 3 100 100 true
1 50 25.48 1.96 43,152,808 76,021,760
[java] SrchTrvNewRdr_300_150/sec_Par - - 3 100 100 true - - 1
- - - 2760 - 1,533.33 - - 1.80 - 43,152,808 - 76,021,760
[java] SrchTrvRetNewRdr_100_50/sec_Par 3 100 100 true
1 1750 882.50 1.98 47,047,416 76,021,760
[java] Populate - - - - - - - - - 4 10 10 false - - 1
- - 20003 - 1,934.34 - - 10.34 - 57,972,104 - 74,711,040
[java] CreateIndex 4 10 10 false
1 1 15.38 0.06 12,281,296 74,711,040
[java] MAddDocs_20000 - - - - - - - 4 10 10 false - - 1
- - 20000 - 2,383.22 - - 8.39 - 49,421,984 - 74,711,040
[java] AddDoc 4 10 10 false
20000 1 3,120.61 6.41 36,463,584 73,523,616
[java] Optimize - - - - - - - - - 4 10 10 false - - 1
- - - - 1 - - - 1.17 - - 0.85 - 57,972,104 - 73,793,536
[java] CloseIndex 4 10 10 false
1 1 0.97 1.03 57,972,104 73,793,536
[java] OpenReader - - - - - - - - 4 10 10 false - - 2
- - - - 1 - - 666.67 - - 0.00 - 49,797,476 - 74,285,056
[java] SearchSameRdr_5000 4 10 10 false
1 5000 2,831.26 1.77 57,972,104 74,252,288
[java] CloseReader - - - - - - - - 4 10 10 false - - 2
- - - - 1 - 2,000.00 - - 0.00 - 42,529,104 - 74,776,576
[java] WarmNewRdr_50 4 10 10 false
1 1000000 201,979.39 4.95 33,529,368 76,349,440
[java] SrchNewRdr_500 - - - - - - - 4 10 10 false - - 1
- - - 500 - - 847.46 - - 0.59 - 33,529,368 - 76,349,440
[java] SrchTrvNewRdr_300 4 10 10 false
1 2760 7,953.89 0.35 46,326,760 76,218,368
[java] SrchTrvRetNewRdr_100 - - - - - 4 10 10 false - - 1
- - - 1728 - 13,395.35 - - 0.13 - 46,326,760 - 74,973,184
[java] SearchSameRdr_5000_2500/sec_Par 4 10 10 false
1 5000 2,004.01 2.49 59,831,920 75,300,864
[java] WarmNewRdr_50_25/sec_Par - - - - 4 10 10 false - - 1
- - 1000000 - 414,765.66 - - 2.41 - 60,615,552 - 79,429,632
[java] SrchNewRdr_50_25/sec_Par 4 10 10 false
1 50 25.48 1.96 51,068,696 79,429,632
[java] SrchTrvNewRdr_300_150/sec_Par - - 4 10 10 false - - 1
- - - 2760 - 1,534.19 - - 1.80 - 40,207,144 - 78,970,880
[java] SrchTrvRetNewRdr_100_50/sec_Par 4 10 10 false
1 1750 882.95 1.98 50,288,320 79,167,488
[java] Populate - - - - - - - - - 5 100 10 false - - 1
- - 20003 - 1,910.32 - - 10.47 - 26,872,720 - 86,048,768
[java] CreateIndex 5 100 10 false
1 1 11.36 0.09 14,020,632 77,856,768
[java] MAddDocs_20000 - - - - - - - 5 100 10 false - - 1
- - 20000 - 2,334.27 - - 8.57 - 57,115,592 - 85,983,232
[java] AddDoc 5 100 10 false
20000 1 3,037.21 6.59 45,571,428 79,485,784
[java] Optimize - - - - - - - - - 5 100 10 false - - 1
- - - - 1 - - - 1.49 - - 0.67 - 57,115,592 - 86,048,768
[java] CloseIndex 5 100 10 false
1 1 0.87 1.15 26,872,720 86,048,768
[java] OpenReader - - - - - - - - 5 100 10 false - - 2
- - - - 1 - 1,000.00 - - 0.00 - 45,413,928 - 88,440,832
[java] SearchSameRdr_5000 5 100 10 false
1 5000 3,039.51 1.64 37,639,352 87,359,488
[java] CloseReader - - - - - - - - 5 100 10 false - - 2
- - - - 1 - 2,000.00 - - 0.00 - 45,663,748 - 88,834,048
[java] WarmNewRdr_50 5 100 10 false
1 1000000 210,881.48 4.74 63,651,168 91,095,040
[java] SrchNewRdr_500 - - - - - - - 5 100 10 false - - 1
- - - 500 - - 883.39 - - 0.57 - 63,651,168 - 91,095,040
[java] SrchTrvNewRdr_300 5 100 10 false
1 2760 7,379.68 0.37 70,478,200 91,029,504
[java] SrchTrvRetNewRdr_100 - - - - - 5 100 10 false - - 1
- - - 1728 - 13,090.91 - - 0.13 - 70,478,200 - 90,832,896
[java] SearchSameRdr_5000_2500/sec_Par 5 100 10 false
1 5000 2,036.66 2.45 63,955,136 90,832,896
[java] WarmNewRdr_50_25/sec_Par - - - - 5 100 10 false - - 1
- - 1000000 - 425,894.38 - - 2.35 - 66,518,728 - 90,767,360
[java] SrchNewRdr_50_25/sec_Par 5 100 10 false
1 50 25.50 1.96 67,130,512 90,832,896
[java] SrchTrvNewRdr_300_150/sec_Par - - 5 100 10 false - - 1
- - - 2760 - 1,533.33 - - 1.80 - 54,991,408 - 90,963,968
[java] SrchTrvRetNewRdr_100_50/sec_Par 5 100 10 false
1 1750 883.39 1.98 65,519,032 90,963,968
[java] Populate - - - - - - - - - 6 10 100 false - - 1
- - 20003 - 2,820.10 - - 7.09 - 63,195,552 - 84,475,904
[java] CreateIndex 6 10 100 false
1 1 12.99 0.08 15,905,704 84,475,904
[java] MAddDocs_20000 - - - - - - - 6 10 100 false - - 1
- - 20000 - 3,858.02 - - 5.18 - 57,614,928 - 84,475,904
[java] AddDoc 6 10 100 false
20000 1 5,745.48 3.48 42,115,612 83,867,744
[java] Optimize - - - - - - - - - 6 10 100 false - - 1
- - - - 1 - - - 1.28 - - 0.78 - 63,195,552 - 83,230,720
[java] CloseIndex 6 10 100 false
1 1 0.95 1.05 63,195,552 83,230,720
[java] OpenReader - - - - - - - - 6 10 100 false - - 2
- - - - 1 - 1,000.00 - - 0.00 - 66,302,688 - 84,312,064
[java] SearchSameRdr_5000 6 10 100 false
1 5000 3,019.32 1.66 63,195,552 84,148,224
[java] CloseReader - - - - - - - - 6 10 100 false - - 2
- - - - 1 - 2,000.00 - - 0.00 - 55,085,812 - 84,738,048
[java] WarmNewRdr_50 6 10 100 false
1 1000000 204,918.03 4.88 65,948,032 85,983,232
[java] SrchNewRdr_500 - - - - - - - 6 10 100 false - - 1
- - - 500 - - 875.66 - - 0.57 - 65,948,032 - 85,983,232
[java] SrchTrvNewRdr_300 6 10 100 false
1 2760 8,070.18 0.34 75,649,472 85,721,088
[java] SrchTrvRetNewRdr_100 - - - - - 6 10 100 false - - 1
- - - 1728 - 14,163.93 - - 0.12 - 75,649,472 - 85,721,088
[java] SearchSameRdr_5000_2500/sec_Par 6 10 100 false
1 5000 1,901.14 2.63 77,908,040 85,393,408
[java] WarmNewRdr_50_25/sec_Par - - - - 6 10 100 false - - 1
- - 1000000 - 406,008.94 - - 2.46 - 78,803,960 - 90,570,752
[java] SrchNewRdr_50_25/sec_Par 6 10 100 false
1 50 25.48 1.96 70,997,520 90,570,752
[java] SrchTrvNewRdr_300_150/sec_Par - - 6 10 100 false - - 1
- - - 2760 - 1,532.48 - - 1.80 - 48,652,352 - 90,636,288
[java] SrchTrvRetNewRdr_100_50/sec_Par 6 10 100 false
1 1750 882.50 1.98 55,430,112 90,701,824
[java] Populate - - - - - - - - - 7 100 100 false - - 1
- - 20003 - 2,724.09 - - 7.34 - 76,275,768 - 88,080,384
[java] CreateIndex 7 100 100 false
1 1 12.50 0.08 18,908,864 88,080,384
[java] MAddDocs_20000 - - - - - - - 7 100 100 false - - 1
- - 20000 - 3,813.16 - - 5.24 - 34,849,328 - 88,080,384
[java] AddDoc 7 100 100 false
20000 1 5,729.02 3.49 48,379,244 87,458,776
[java] Optimize - - - - - - - - - 7 100 100 false - - 1
- - - - 1 - - - 1.00 - - 1.00 - 76,275,768 - 87,883,776
[java] CloseIndex 7 100 100 false
1 1 0.99 1.01 76,275,768 87,097,344
[java] OpenReader - - - - - - - - 7 100 100 false - - 2
- - - - 1 - 1,000.00 - - 0.00 - 63,561,404 - 88,768,512
[java] SearchSameRdr_5000 7 100 100 false
1 5000 3,050.64 1.64 76,275,768 88,342,528
[java] CloseReader - - - - - - - - 7 100 100 false - - 2
- - - - 1 - 2,000.00 - - 0.00 - 45,015,936 - 90,996,736
[java] WarmNewRdr_50 7 100 100 false
1 1000000 210,970.47 4.74 51,056,784 90,636,288
[java] SrchNewRdr_500 - - - - - - - 7 100 100 false - - 1
- - - 500 - - 892.86 - - 0.56 - 47,221,624 - 90,636,288
[java] SrchTrvNewRdr_300 7 100 100 false
1 2760 8,189.91 0.34 57,531,248 90,374,144
[java] SrchTrvRetNewRdr_100 - - - - - 7 100 100 false - - 1
- - - 1728 - 14,521.01 - - 0.12 - 57,531,248 - 90,439,680
[java] SearchSameRdr_5000_2500/sec_Par 7 100 100 false
1 5000 2,004.01 2.49 50,847,040 93,650,944
[java] WarmNewRdr_50_25/sec_Par - - - - 7 100 100 false - - 1
- - 1000000 - 412,201.16 - - 2.43 - 51,861,456 - 93,913,088
[java] SrchNewRdr_50_25/sec_Par 7 100 100 false
1 50 25.50 1.96 76,642,320 93,913,088
[java] SrchTrvNewRdr_300_150/sec_Par - - 7 100 100 false - - 1
- - - 2760 - 1,532.48 - - 1.80 - 80,015,680 - 93,913,088
[java] SrchTrvRetNewRdr_100_50/sec_Par 7 100 100 false
1 1750 882.95 1.98 80,331,656 93,913,088
[java] ------------> Report Sum By (any) Name (19 about 160153 out
of 160154)
[java] Operation round mrg buf cmpnd
runCnt recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] Rounds_8 0 10 10 true
1 16316440 71,569.92 227.98 47,136,632 93,913,088
[java] Populate - - - - - - - - - - - - - - - - - - 8
- - 20003 - 2,053.25 - - 77.94 - 44,051,660 - 75,563,008
[java] CreateIndex - - - -
8 1 9.26 0.86 11,733,833 71,892,992
[java] MAddDocs_20000 - - - - - - - - - - - - - - - - 8
- - 20000 - 2,532.21 - - 63.19 - 41,519,020 - 75,603,968
[java] AddDoc - - - -
160000 1 3,655.64 43.77 37,135,520 73,232,064
[java] Optimize - - - - - - - - - - - - - - - - - - 8
- - - - 1 - - - 1.17 - - 6.84 - 50,368,008 - 74,833,920
[java] CloseIndex - - - -
8 1 1.14 7.05 44,051,660 74,539,008
[java] OpenReader - - - - - - - - - - - - - - - - - 16
- - - - 1 - - 571.43 - - 0.03 - 46,759,188 - 76,161,024
[java] SearchSameRdr_5000 - - - -
8 5000 2,826.66 14.15 52,216,716 75,407,360
[java] CloseReader - - - - - - - - - - - - - - - - - 16
- - - - 1 - 16,000.00 - - 0.00 - 45,628,800 - 76,623,872
[java] WarmNewRdr_50 - - - -
8 1000000 206,574.22 38.73 51,375,544 78,315,520
[java] SrchNewRdr_500 - - - - - - - - - - - - - - - - 8
- - - 500 - - 921.23 - - 4.34 - 52,751,272 - 78,323,712
[java] SrchTrvNewRdr_300 - - - -
8 2760 8,153.62 2.71 55,197,300 78,036,992
[java] SrchTrvRetNewRdr_100 - - - - - - - - - - - - - - 8
- - - 1728 - 14,785.03 - - 0.94 - 55,788,528 - 77,848,576
[java] SearchSameRdr_5000_2500/sec_Par - - - -
8 5000 1,945.53 20.56 57,014,416 78,249,984
[java] WarmNewRdr_50_25/sec_Par - - - - - - - - - - - - - 8
- - 1000000 - 407,000.41 - - 19.66 - 58,449,108 - 80,396,288
[java] SrchNewRdr_50_25/sec_Par - - - -
8 50 25.49 15.69 58,480,520 80,404,480
[java] SrchTrvNewRdr_300_150/sec_Par - - - - - - - - - - - 8
- - - 2760 - 1,532.69 - - 14.41 - 48,598,368 - 80,404,480
[java] SrchTrvRetNewRdr_100_50/sec_Par - - - -
8 1750 882.84 15.86 54,555,136 80,429,056
[java] ------------> Report sum by Prefix (MAddDocs) and Round (8
about 8 out of 160154)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 0 10 10 true 1 20000
1,229.11 16.27 18,340,664 61,669,376
[java] MAddDocs_20000 - 1 100 10 true - - 1 - - 20000 -
2,329.37 - - 8.59 - 36,586,584 - 64,159,744
[java] MAddDocs_20000 2 10 100 true 1 20000
3,720.93 5.38 46,942,920 70,778,880
[java] MAddDocs_20000 - 3 100 100 true - - 1 - - 20000 -
3,594.54 - - 5.56 - 31,280,152 - 74,973,184
[java] MAddDocs_20000 4 10 10 false 1 20000
2,383.22 8.39 49,421,984 74,711,040
[java] MAddDocs_20000 - 5 100 10 false - - 1 - - 20000 -
2,334.27 - - 8.57 - 57,115,592 - 85,983,232
[java] MAddDocs_20000 6 10 100 false 1 20000
3,858.02 5.18 57,614,928 84,475,904
[java] MAddDocs_20000 - 7 100 100 false - - 1 - - 20000 -
3,813.16 - - 5.24 - 34,849,328 - 88,080,384
[java] ####################
[java] ### D O N E !!! ###
[java] ####################
BUILD SUCCESSFUL
Total time: 3 minutes 52 seconds
run-task:
[echo] Working Directory:
/home/mark/workspace/lucene_24/contrib/benchmark/work
[java] Running algorithm from:
/home/mark/workspace/lucene_24/contrib/benchmark/conf/standard.alg
[java] ------------> config properties:
[java] analyzer = org.apache.lucene.analysis.standard.StandardAnalyzer
[java] compound = cmpnd:true:true:true:true:false:false:false:false
[java] directory = FSDirectory
[java] doc.add.log.step = 2000
[java] doc.maker =
org.apache.lucene.benchmark.byTask.feeds.ReutersDocMaker
[java] doc.stored = true
[java] doc.term.vector = false
[java] doc.tokenized = true
[java] docs.dir = reuters-out
[java] log.queries = true
[java] max.buffered = buf:10:10:100:100:10:10:100:100
[java] merge.factor = mrg:10:100:10:100:10:100:10:100
[java] query.maker =
org.apache.lucene.benchmark.byTask.feeds.ReutersQueryMaker
[java] task.max.depth.log = 2
[java] work.dir = work
[java] -------------------------------
[java] ------------> ReutersDocMaker statistics (0):
[java] total count of unique texts: 21,578
[java] total bytes of unique texts: 17,550,748
[java] ------------> queries:
[java] 0. TermQuery - body:salomon
[java] 1. TermQuery - body:comex
[java] 2. BooleanQuery - body:night body:trading
[java] 3. BooleanQuery - body:japan body:sony
[java] 4. PhraseQuery - body:"sony japan"
[java] 5. PhraseQuery - body:"food needs"~3
[java] 6. BooleanQuery - +body:"world bank"^2.0 +body:nigeria
[java] 7. BooleanQuery - body:"world bank" -body:nigeria
[java] 8. PhraseQuery - body:"ford credit"~5
[java] 9. BooleanQuery - body:airline body:europe body:canada
body:destination
[java] 10. BooleanQuery - body:long body:term body:pressure
body:trade body:ministers body:necessary body:current body:uruguay
body:round body:talks body:general body:agreement body:trade
body:tariffs body:gatt body:succeed
[java] 11. SpanFirstQuery - spanFirst(body:ford, 5)
[java] 12. SpanNearQuery - spanNear([body:night, body:trading], 4,
false)
[java] 13. SpanNearQuery - spanNear([spanFirst(body:ford, 10),
body:credit], 10, false)
[java] 14. WildcardQuery - body:fo*
[java] ------------> algorithm:
[java] Seq {
[java] Rounds_8 {
[java] ResetSystemErase
[java] Populate {
[java] CreateIndex
[java] MAddDocs_20000 {
[java] AddDoc
[java] } * 20000
[java] Optimize
[java] CloseIndex
[java] }
[java] OpenReader
[java] SearchSameRdr_5000 {
[java] Search
[java] > * 5000
[java] CloseReader
[java] WarmNewRdr_50 {
[java] Warm
[java] > * 50
[java] SrchNewRdr_500 {
[java] Search
[java] > * 500
[java] SrchTrvNewRdr_300 {
[java] SearchTrav
[java] > * 300
[java] SrchTrvRetNewRdr_100 {
[java] SearchTravRet
[java] > * 100
[java] OpenReader
[java] SearchSameRdr_5000_2500/sec_Par [
[java] Search
[java] > * 5000, rate: 2500/sec
[java] CloseReader
[java] WarmNewRdr_50_25/sec_Par [
[java] Warm
[java] > * 50, rate: 25/sec
[java] SrchNewRdr_50_25/sec_Par [
[java] Search
[java] > * 50, rate: 25/sec
[java] SrchTrvNewRdr_300_150/sec_Par [
[java] SearchTrav
[java] > * 300, rate: 150/sec
[java] SrchTrvRetNewRdr_100_50/sec_Par [
[java] SearchTravRet
[java] > * 100, rate: 50/sec
[java] RepSumByPref MAddDocs
[java] NewRound
[java] } * 8
[java] RepSumByNameRound
[java] RepSumByName
[java] RepSumByPrefRound MAddDocs
[java] }
[java] ------------> starting task: Seq
[java] ------------> starting task: Rounds_8
[java] ------------> starting task: ResetSystemErase
[java] ------------> starting task: Populate
[java] --> 7.76 sec: main processed (add) 2000 docs
[java] --> 18.66 sec: main processed (add) 4000 docs
[java] --> 28.44 sec: main processed (add) 6000 docs
[java] --> 40.56 sec: main processed (add) 8000 docs
[java] --> 49.97 sec: main processed (add) 10000 docs
[java] --> 61.52 sec: main processed (add) 12000 docs
[java] --> 73.58 sec: main processed (add) 14000 docs
[java] --> 86.78 sec: main processed (add) 16000 docs
[java] --> 97.71 sec: main processed (add) 18000 docs
[java] --> 108.36 sec: main processed (add) 20000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 1 out
of 20021)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 0 10 10 true 1
20000 184.8 108.22 17,976,160 21,037,056
[java] ------------> starting task: NewRound
[java] --> Round 0-->1: merge.factor:10-->100
max.buffered:10-->10 compound:true-->true
[java] ------------> starting task: ResetSystemErase
[java] ------------> ReutersDocMaker statistics (1):
[java] num docs added since last inputs reset: 20,000
[java] total bytes added since last inputs reset: 16,594,170
[java] ------------> starting task: Populate
[java] --> 0.89 sec: main processed (add) 22000 docs
[java] --> 1.75 sec: main processed (add) 24000 docs
[java] --> 2.75 sec: main processed (add) 26000 docs
[java] --> 26.8 sec: main processed (add) 28000 docs
[java] --> 27.75 sec: main processed (add) 30000 docs
[java] --> 28.83 sec: main processed (add) 32000 docs
[java] --> 52.63 sec: main processed (add) 34000 docs
[java] --> 53.41 sec: main processed (add) 36000 docs
[java] --> 54.5 sec: main processed (add) 38000 docs
[java] --> 79.96 sec: main processed (add) 40000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 2 out
of 40040)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 2
20000 212.6 188.11 19,880,352 36,044,800
[java] ------------> starting task: NewRound
[java] --> Round 1-->2: merge.factor:100-->10
max.buffered:10-->100 compound:true-->true
[java] ------------> starting task: ResetSystemErase
[java] ------------> ReutersDocMaker statistics (2):
[java] num docs added since last inputs reset: 20,000
[java] total bytes added since last inputs reset: 16,594,170
[java] ------------> starting task: Populate
[java] --> 0.72 sec: main processed (add) 42000 docs
[java] --> 1.5 sec: main processed (add) 44000 docs
[java] --> 2.69 sec: main processed (add) 46000 docs
[java] --> 3.33 sec: main processed (add) 48000 docs
[java] --> 4.12 sec: main processed (add) 50000 docs
[java] --> 5.18 sec: main processed (add) 52000 docs
[java] --> 7.63 sec: main processed (add) 54000 docs
[java] --> 8.62 sec: main processed (add) 56000 docs
[java] --> 9.92 sec: main processed (add) 58000 docs
[java] --> 10.6 sec: main processed (add) 60000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 3 out
of 60059)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 3
20000 302.1 198.64 19,898,008 40,981,844
[java] ------------> starting task: NewRound
[java] --> Round 2-->3: merge.factor:10-->100
max.buffered:100-->100 compound:true-->true
[java] ------------> starting task: ResetSystemErase
[java] ------------> ReutersDocMaker statistics (3):
[java] num docs added since last inputs reset: 20,000
[java] total bytes added since last inputs reset: 16,594,170
[java] ------------> starting task: Populate
[java] --> 0.68 sec: main processed (add) 62000 docs
[java] --> 1.22 sec: main processed (add) 64000 docs
[java] --> 1.8 sec: main processed (add) 66000 docs
[java] --> 2.34 sec: main processed (add) 68000 docs
[java] --> 2.92 sec: main processed (add) 70000 docs
[java] --> 3.51 sec: main processed (add) 72000 docs
[java] --> 4.2 sec: main processed (add) 74000 docs
[java] --> 4.71 sec: main processed (add) 76000 docs
[java] --> 5.3 sec: main processed (add) 78000 docs
[java] --> 5.92 sec: main processed (add) 80000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 4 out
of 80078)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 4
20000 391.3 204.44 21,033,678 45,678,592
[java] ------------> starting task: NewRound
[java] --> Round 3-->4: merge.factor:100-->10
max.buffered:100-->10 compound:true-->false
[java] ------------> starting task: ResetSystemErase
[java] ------------> ReutersDocMaker statistics (4):
[java] num docs added since last inputs reset: 20,000
[java] total bytes added since last inputs reset: 16,594,170
[java] ------------> starting task: Populate
[java] --> 66.48 sec: main processed (add) 82000 docs
[java] --> 143.86 sec: main processed (add) 84000 docs
[java] --> 207.74 sec: main processed (add) 86000 docs
[java] --> 290.97 sec: main processed (add) 88000 docs
[java] --> 382.98 sec: main processed (add) 90000 docs
[java] --> 457.45 sec: main processed (add) 92000 docs
[java] --> 537.84 sec: main processed (add) 94000 docs
[java] --> 618.15 sec: main processed (add) 96000 docs
[java] --> 683.85 sec: main processed (add) 98000 docs
[java] --> 764.84 sec: main processed (add) 100000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 5 out
of 100097)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 5
20000 103.2 969.22 23,052,612 48,457,320
[java] ------------> starting task: NewRound
[java] --> Round 4-->5: merge.factor:10-->100
max.buffered:10-->10 compound:false-->false
[java] ------------> starting task: ResetSystemErase
[java] ------------> ReutersDocMaker statistics (5):
[java] num docs added since last inputs reset: 20,000
[java] total bytes added since last inputs reset: 16,594,170
[java] ------------> starting task: Populate
[java] --> 0.86 sec: main processed (add) 102000 docs
[java] --> 1.7 sec: main processed (add) 104000 docs
[java] --> 2.69 sec: main processed (add) 106000 docs
[java] --> 53.51 sec: main processed (add) 108000 docs
[java] --> 54.52 sec: main processed (add) 110000 docs
[java] --> 55.55 sec: main processed (add) 112000 docs
[java] --> 108.44 sec: main processed (add) 114000 docs
[java] --> 109.42 sec: main processed (add) 116000 docs
[java] --> 110.52 sec: main processed (add) 118000 docs
[java] --> 163.5 sec: main processed (add) 120000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 6 out
of 120116)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 6
20000 105.9 1,132.64 28,005,136 52,942,164
[java] ------------> starting task: NewRound
[java] --> Round 5-->6: merge.factor:100-->10
max.buffered:10-->100 compound:false-->false
[java] ------------> starting task: ResetSystemErase
[java] ------------> ReutersDocMaker statistics (6):
[java] num docs added since last inputs reset: 20,000
[java] total bytes added since last inputs reset: 16,594,170
[java] ------------> starting task: Populate
[java] --> 0.67 sec: main processed (add) 122000 docs
[java] --> 1.31 sec: main processed (add) 124000 docs
[java] --> 2.28 sec: main processed (add) 126000 docs
[java] --> 20.08 sec: main processed (add) 128000 docs
[java] --> 20.81 sec: main processed (add) 130000 docs
[java] --> 21.7 sec: main processed (add) 132000 docs
[java] --> 39.28 sec: main processed (add) 134000 docs
[java] --> 40.03 sec: main processed (add) 136000 docs
[java] --> 40.9 sec: main processed (add) 138000 docs
[java] --> 62.42 sec: main processed (add) 140000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 7 out
of 140135)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 7
20000 117.2 1,194.94 30,144,784 56,267,336
[java] ------------> starting task: NewRound
[java] --> Round 6-->7: merge.factor:10-->100
max.buffered:100-->100 compound:false-->false
[java] ------------> starting task: ResetSystemErase
[java] ------------> ReutersDocMaker statistics (7):
[java] num docs added since last inputs reset: 20,000
[java] total bytes added since last inputs reset: 16,594,170
[java] ------------> starting task: Populate
[java] --> 0.63 sec: main processed (add) 142000 docs
[java] --> 1.16 sec: main processed (add) 144000 docs
[java] --> 1.72 sec: main processed (add) 146000 docs
[java] --> 2.25 sec: main processed (add) 148000 docs
[java] --> 2.83 sec: main processed (add) 150000 docs
[java] --> 3.46 sec: main processed (add) 152000 docs
[java] --> 4.16 sec: main processed (add) 154000 docs
[java] --> 4.83 sec: main processed (add) 156000 docs
[java] --> 5.44 sec: main processed (add) 158000 docs
[java] --> 5.99 sec: main processed (add) 160000 docs
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50
[java] ------------> starting task: SrchNewRdr_500
[java] ------------> starting task: SrchTrvNewRdr_300
[java] ------------> starting task: SrchTrvRetNewRdr_100
[java] ------------> starting task: OpenReader
[java] ------------> starting task: SearchSameRdr_5000_2500/sec_Par
[java] ------------> starting task: CloseReader
[java] ------------> starting task: WarmNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchNewRdr_50_25/sec_Par
[java] ------------> starting task: SrchTrvNewRdr_300_150/sec_Par
[java] ------------> starting task: SrchTrvRetNewRdr_100_50/sec_Par
[java] ------------> Report Sum By Prefix (MAddDocs) (1 about 8 out
of 160154)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 - - - - 8
20000 133.2 1,200.86 32,650,116 58,793,984
[java] ------------> starting task: NewRound
[java] --> Round 7-->8: merge.factor:100-->10
max.buffered:100-->10 compound:false-->true
[java] ------------> Report Sum By (any) Name and Round (145 about
160153 out of 160154)
[java] Operation round mrg buf cmpnd
runCnt recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] Rounds_8 0 10 10 true
1 25142792 16,946.2 1,483.68 58,848,944 83,165,184
[java] Populate - - - - - - - - - 0 10 10 true - - 1
- - 20003 - - 178.3 - - 112.18 - 9,888,320 - 20,643,840
[java] CreateIndex 0 10 10 true
1 1 7.2 0.14 4,421,136 20,643,840
[java] MAddDocs_20000 - - - - - - - 0 10 10 true - - 1
- - 20000 - - 184.8 - - 108.22 - 17,976,160 - 21,037,056
[java] AddDoc 0 10 10 true
20000 1 224.4 89.13 12,610,885 23,048,048
[java] Optimize - - - - - - - - - 0 10 10 true - - 1
- - - - 1 - - - 0.3 - - 3.83 - 17,976,160 - 21,037,056
[java] CloseIndex 0 10 10 true
1 1 1,000.0 0.00 9,888,320 19,070,976
[java] OpenReader - - - - - - - - 0 10 10 true - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 15,550,904 - 29,163,520
[java] SearchSameRdr_5000 0 10 10 true
1 5000 1,684.6 2.97 13,501,960 20,316,160
[java] CloseReader - - - - - - - - 0 10 10 true - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 12,356,240 - 25,100,288
[java] WarmNewRdr_50 0 10 10 true
1 1000000 148,016.6 6.76 16,705,608 25,952,256
[java] SrchNewRdr_500 - - - - - - - 0 10 10 true - - 1
- - - 500 - - 413.6 - - 1.21 - 22,346,608 - 35,454,976
[java] SrchTrvNewRdr_300 0 10 10 true
1 335500 196,313.6 1.71 24,281,576 37,355,520
[java] SrchTrvRetNewRdr_100 - - - - - 0 10 10 true - - 1
- - 209216 - 112,481.7 - - 1.86 - 24,281,576 - 39,256,064
[java] SearchSameRdr_5000_2500/sec_Par 0 10 10 true
1 5000 1,622.8 3.08 21,213,488 39,256,064
[java] WarmNewRdr_50_25/sec_Par - - - - 0 10 10 true - - 1
- - 1000000 - 281,214.8 - - 3.56 - 21,518,872 - 34,799,616
[java] SrchNewRdr_50_25/sec_Par 0 10 10 true
1 50 25.5 1.96 21,552,072 35,127,296
[java] SrchTrvNewRdr_300_150/sec_Par - - 0 10 10 true - - 1
- - 335500 - 181,253.4 - - 1.85 - 28,852,968 - 35,127,296
[java] SrchTrvRetNewRdr_100_50/sec_Par 0 10 10 true
1 232076 112,932.4 2.06 28,862,208 35,979,264
[java] Populate - - - - - - - - - 1 100 10 true - - 1
- - 20003 - - 243.2 - - 82.26 - 27,963,656 - 51,183,616
[java] CreateIndex 1 100 10 true
1 1 14.5 0.07 7,417,736 35,389,440
[java] MAddDocs_20000 - - - - - - - 1 100 10 true - - 1
- - 20000 - - 250.3 - - 79.89 - 21,784,544 - 51,052,544
[java] AddDoc 1 100 10 true
20000 1 257.5 77.68 26,308,054 41,919,796
[java] Optimize - - - - - - - - - 1 100 10 true - - 1
- - - - 1 - - - 0.4 - - 2.30 - 27,963,656 - 51,183,616
[java] CloseIndex 1 100 10 true
1 1 1,000.0 0.00 27,963,656 51,183,616
[java] OpenReader - - - - - - - - 1 100 10 true - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 33,484,576 - 54,329,344
[java] SearchSameRdr_5000 1 100 10 true
1 5000 2,078.1 2.41 34,162,888 54,657,024
[java] CloseReader - - - - - - - - 1 100 10 true - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 33,884,424 - 53,051,392
[java] WarmNewRdr_50 1 100 10 true
1 1000000 148,566.3 6.73 35,630,072 55,967,744
[java] SrchNewRdr_500 - - - - - - - 1 100 10 true - - 1
- - - 500 - - 448.0 - - 1.12 - 35,630,072 - 55,967,744
[java] SrchTrvNewRdr_300 1 100 10 true
1 335500 182,634.7 1.84 35,120,576 55,115,776
[java] SrchTrvRetNewRdr_100 - - - - - 1 100 10 true - - 1
- - 209216 - 115,080.3 - - 1.82 - 39,005,496 - 57,475,072
[java] SearchSameRdr_5000_2500/sec_Par 1 100 10 true
1 5000 1,731.3 2.89 39,005,496 57,475,072
[java] WarmNewRdr_50_25/sec_Par - - - - 1 100 10 true - - 1
- - 1000000 - 306,654.4 - - 3.26 - 42,136,496 - 54,984,704
[java] SrchNewRdr_50_25/sec_Par 1 100 10 true
1 50 25.5 1.96 42,312,960 54,984,704
[java] SrchTrvNewRdr_300_150/sec_Par - - 1 100 10 true - - 1
- - 335500 - 181,155.5 - - 1.85 - 40,355,672 - 53,542,912
[java] SrchTrvRetNewRdr_100_50/sec_Par 1 100 10 true
1 232076 113,651.3 2.04 48,151,328 52,232,192
[java] Populate - - - - - - - - - 2 10 100 true - - 1
- - 20003 - - 1,463.3 - - 13.67 - 29,162,528 - 50,266,112
[java] CreateIndex 2 10 100 true
1 1 14.5 0.07 6,594,184 50,200,576
[java] MAddDocs_20000 - - - - - - - 2 10 100 true - - 1
- - 20000 - - 1,899.7 - - 10.53 - 19,933,320 - 50,855,936
[java] AddDoc 2 10 100 true
20000 1 2,394.9 8.35 18,618,802 50,714,836
[java] Optimize - - - - - - - - - 2 10 100 true - - 1
- - - - 1 - - - 0.3 - - 3.07 - 29,162,528 - 50,855,936
[java] CloseIndex 2 10 100 true
1 1 1,000.0 0.00 29,162,528 50,266,112
[java] OpenReader - - - - - - - - 2 10 100 true - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 37,348,644 - 57,507,840
[java] SearchSameRdr_5000 2 10 100 true
1 5000 2,093.8 2.39 29,162,528 50,266,112
[java] CloseReader - - - - - - - - 2 10 100 true - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 30,653,704 - 52,822,016
[java] WarmNewRdr_50 2 10 100 true
1 1000000 149,342.9 6.70 28,747,976 51,904,512
[java] SrchNewRdr_500 - - - - - - - 2 10 100 true - - 1
- - - 500 - - 439.8 - - 1.14 - 29,321,480 - 60,948,480
[java] SrchTrvNewRdr_300 2 10 100 true
1 335500 181,253.4 1.85 38,258,696 63,045,632
[java] SrchTrvRetNewRdr_100 - - - - - 2 10 100 true - - 1
- - 209216 - 113,890.0 - - 1.84 - 45,534,760 - 64,749,568
[java] SearchSameRdr_5000_2500/sec_Par 2 10 100 true
1 5000 1,656.2 3.02 45,534,760 64,749,568
[java] WarmNewRdr_50_25/sec_Par - - - - 2 10 100 true - - 1
- - 1000000 - 300,932.9 - - 3.32 - 43,646,592 - 60,555,264
[java] SrchNewRdr_50_25/sec_Par 2 10 100 true
1 50 25.5 1.96 44,542,824 60,555,264
[java] SrchTrvNewRdr_300_150/sec_Par - - 2 10 100 true - - 1
- - 335500 - 180,570.5 - - 1.86 - 44,649,208 - 57,540,608
[java] SrchTrvRetNewRdr_100_50/sec_Par 2 10 100 true
1 232076 114,832.3 2.02 41,301,920 54,067,200
[java] Populate - - - - - - - - - 3 100 100 true - - 1
- - 20003 - - 2,475.0 - - 8.08 - 29,691,200 - 58,392,576
[java] CreateIndex 3 100 100 true
1 1 8.4 0.12 8,140,832 58,195,968
[java] MAddDocs_20000 - - - - - - - 3 100 100 true - - 1
- - 20000 - - 3,450.1 - - 5.80 - 24,440,688 - 59,768,832
[java] AddDoc 3 100 100 true
20000 1 5,121.6 3.90 18,628,736 58,944,048
[java] Optimize - - - - - - - - - 3 100 100 true - - 1
- - - - 1 - - - 0.5 - - 2.16 - 29,691,200 - 59,768,832
[java] CloseIndex 3 100 100 true
1 1 1,000.0 0.00 29,691,200 58,392,576
[java] OpenReader - - - - - - - - 3 100 100 true - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 30,452,524 - 60,391,424
[java] SearchSameRdr_5000 3 100 100 true
1 5000 2,104.4 2.38 29,691,200 58,785,792
[java] CloseReader - - - - - - - - 3 100 100 true - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 29,404,780 - 56,918,016
[java] WarmNewRdr_50 3 100 100 true
1 1000000 149,365.2 6.70 29,103,696 60,162,048
[java] SrchNewRdr_500 - - - - - - - 3 100 100 true - - 1
- - - 500 - - 623.4 - - 0.80 - 43,420,448 - 60,162,048
[java] SrchTrvNewRdr_300 3 100 100 true
1 335500 201,018.6 1.67 43,420,448 56,426,496
[java] SrchTrvRetNewRdr_100 - - - - - 3 100 100 true - - 1
- - 209216 - 111,760.7 - - 1.87 - 41,901,632 - 62,390,272
[java] SearchSameRdr_5000_2500/sec_Par 3 100 100 true
1 5000 1,706.5 2.93 31,213,848 62,390,272
[java] WarmNewRdr_50_25/sec_Par - - - - 3 100 100 true - - 1
- - 1000000 - 297,265.2 - - 3.36 - 43,270,208 - 58,523,648
[java] SrchNewRdr_50_25/sec_Par 3 100 100 true
1 50 25.5 1.96 44,579,048 58,523,648
[java] SrchTrvNewRdr_300_150/sec_Par - - 3 100 100 true - - 1
- - 335500 - 181,842.8 - - 1.85 - 44,682,784 - 57,802,752
[java] SrchTrvRetNewRdr_100_50/sec_Par 3 100 100 true
1 232076 113,263.1 2.05 44,719,776 60,227,584
[java] Populate - - - - - - - - - 4 10 10 false - - 1
- - 20003 - - - 25.7 - - 778.71 - 38,801,200 - 59,572,224
[java] CreateIndex 4 10 10 false
1 1 17.9 0.06 19,652,008 59,572,224
[java] MAddDocs_20000 - - - - - - - 4 10 10 false - - 1
- - 20000 - - - 26.2 - - 764.78 - 31,128,352 - 59,572,224
[java] AddDoc 4 10 10 false
20000 1 26.3 761.89 31,862,614 58,937,836
[java] Optimize - - - - - - - - - 4 10 10 false - - 1
- - - - 1 - - - 0.1 - - 13.88 - 38,801,200 - 58,851,328
[java] CloseIndex 4 10 10 false
1 1 1,000.0 0.00 38,801,200 58,654,720
[java] OpenReader - - - - - - - - 4 10 10 false - - 2
- - - - 1 - - 333.3 - - 0.01 - 38,467,764 - 62,521,344
[java] SearchSameRdr_5000 4 10 10 false
1 5000 2,080.7 2.40 35,202,712 59,703,296
[java] CloseReader - - - - - - - - 4 10 10 false - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 38,653,040 - 63,307,776
[java] WarmNewRdr_50 4 10 10 false
1 1000000 147,688.7 6.77 35,202,712 61,407,232
[java] SrchNewRdr_500 - - - - - - - 4 10 10 false - - 1
- - - 500 - - 383.1 - - 1.30 - 31,108,144 - 62,717,952
[java] SrchTrvNewRdr_300 4 10 10 false
1 335500 187,849.9 1.79 36,915,272 64,684,032
[java] SrchTrvRetNewRdr_100 - - - - - 4 10 10 false - - 1
- - 209216 - 113,273.4 - - 1.85 - 38,134,328 - 66,387,968
[java] SearchSameRdr_5000_2500/sec_Par 4 10 10 false
1 5000 1,644.7 3.04 41,898,360 66,912,256
[java] WarmNewRdr_50_25/sec_Par - - - - 4 10 10 false - - 1
- - 1000000 - 294,204.2 - - 3.40 - 60,536,336 - 67,960,832
[java] SrchNewRdr_50_25/sec_Par 4 10 10 false
1 50 25.5 1.96 60,690,632 67,960,832
[java] SrchTrvNewRdr_300_150/sec_Par - - 4 10 10 false - - 1
- - 335500 - 181,253.4 - - 1.85 - 57,823,008 - 72,024,064
[java] SrchTrvRetNewRdr_100_50/sec_Par 4 10 10 false
1 232076 114,098.3 2.03 62,340,288 74,514,432
[java] Populate - - - - - - - - - 5 100 10 false - - 1
- - 20003 - - 107.5 - - 186.12 - 51,717,136 - 75,956,224
[java] CreateIndex 5 100 10 false
1 1 12.5 0.08 27,620,048 73,859,072
[java] MAddDocs_20000 - - - - - - - 5 100 10 false - - 1
- - 20000 - - 122.4 - - 163.42 - 52,767,744 - 75,366,400
[java] AddDoc 5 100 10 false
20000 1 124.2 161.06 47,749,276 73,327,696
[java] Optimize - - - - - - - - - 5 100 10 false - - 1
- - - - 1 - - - 0.0 - - 22.62 - 52,767,744 - 75,956,224
[java] CloseIndex 5 100 10 false
1 1 1,000.0 0.00 51,717,136 75,956,224
[java] OpenReader - - - - - - - - 5 100 10 false - - 2
- - - - 1 - - 1,000.0 - - 0.00 - 56,555,848 - 78,872,576
[java] SearchSameRdr_5000 5 100 10 false
1 5000 2,124.0 2.35 61,005,208 77,987,840
[java] CloseReader - - - - - - - - 5 100 10 false - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 60,729,740 - 80,216,064
[java] WarmNewRdr_50 5 100 10 false
1 1000000 147,819.7 6.76 61,005,208 79,167,488
[java] SrchNewRdr_500 - - - - - - - 5 100 10 false - - 1
- - - 500 - - 365.5 - - 1.37 - 57,169,480 - 79,167,488
[java] SrchTrvNewRdr_300 5 100 10 false
1 335500 179,315.9 1.87 55,786,912 79,953,920
[java] SrchTrvRetNewRdr_100 - - - - - 5 100 10 false - - 1
- - 209216 - 110,754.9 - - 1.89 - 61,394,560 - 81,788,928
[java] SearchSameRdr_5000_2500/sec_Par 5 100 10 false
1 5000 1,690.9 2.96 61,394,560 82,444,288
[java] WarmNewRdr_50_25/sec_Par - - - - 5 100 10 false - - 1
- - 1000000 - 291,885.6 - - 3.43 - 67,247,848 - 83,165,184
[java] SrchNewRdr_50_25/sec_Par 5 100 10 false
1 50 25.5 1.96 67,435,456 83,165,184
[java] SrchTrvNewRdr_300_150/sec_Par - - 5 100 10 false - - 1
- - 335500 - 182,040.2 - - 1.84 - 49,248,496 - 76,939,264
[java] SrchTrvRetNewRdr_100_50/sec_Par 5 100 10 false
1 232076 113,651.3 2.04 52,962,528 75,825,152
[java] Populate - - - - - - - - - 6 10 100 false - - 1
- - 20003 - - 297.4 - - 67.26 - 45,801,512 - 76,021,760
[java] CreateIndex 6 10 100 false
1 1 9.2 0.11 30,273,760 74,842,112
[java] MAddDocs_20000 - - - - - - - 6 10 100 false - - 1
- - 20000 - - 321.0 - - 62.31 - 42,982,680 - 76,218,368
[java] AddDoc 6 10 100 false
20000 1 333.0 60.07 42,097,752 75,756,768
[java] Optimize - - - - - - - - - 6 10 100 false - - 1
- - - - 1 - - - 0.2 - - 4.84 - 45,801,512 - 76,218,368
[java] CloseIndex 6 10 100 false
1 1 1,000.0 0.00 45,801,512 76,021,760
[java] OpenReader - - - - - - - - 6 10 100 false - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 44,670,608 - 76,414,976
[java] SearchSameRdr_5000 6 10 100 false
1 5000 2,126.8 2.35 45,801,512 76,283,904
[java] CloseReader - - - - - - - - 6 10 100 false - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 46,682,592 - 76,972,032
[java] WarmNewRdr_50 6 10 100 false
1 1000000 145,560.4 6.87 51,889,584 77,004,800
[java] SrchNewRdr_500 - - - - - - - 6 10 100 false - - 1
- - - 500 - - 376.8 - - 1.33 - 51,889,584 - 77,004,800
[java] SrchTrvNewRdr_300 6 10 100 false
1 335500 165,760.9 2.02 42,985,088 75,235,328
[java] SrchTrvRetNewRdr_100 - - - - - 6 10 100 false - - 1
- - 209216 - 112,967.6 - - 1.85 - 43,279,104 - 76,808,192
[java] SearchSameRdr_5000_2500/sec_Par 6 10 100 false
1 5000 1,784.4 2.80 49,796,360 77,660,160
[java] WarmNewRdr_50_25/sec_Par - - - - 6 10 100 false - - 1
- - 1000000 - 305,903.9 - - 3.27 - 55,917,040 - 78,381,056
[java] SrchNewRdr_50_25/sec_Par 6 10 100 false
1 50 25.5 1.96 58,433,776 78,381,056
[java] SrchTrvNewRdr_300_150/sec_Par - - 6 10 100 false - - 1
- - 335500 - 183,233.2 - - 1.83 - 58,512,224 - 74,973,184
[java] SrchTrvRetNewRdr_100_50/sec_Par 6 10 100 false
1 232076 111,682.4 2.08 51,694,968 75,628,544
[java] Populate - - - - - - - - - 7 100 100 false - - 1
- - 20003 - - 929.0 - - 21.53 - 43,511,248 - 75,169,792
[java] CreateIndex 7 100 100 false
1 1 15.4 0.06 23,879,032 75,169,792
[java] MAddDocs_20000 - - - - - - - 7 100 100 false - - 1
- - 20000 - - 3,378.4 - - 5.92 - 50,187,448 - 76,480,512
[java] AddDoc 7 100 100 false
20000 1 5,141.4 3.89 38,388,220 75,728,608
[java] Optimize - - - - - - - - - 7 100 100 false - - 1
- - - - 1 - - - 0.1 - - 15.55 - 50,187,448 - 76,480,512
[java] CloseIndex 7 100 100 false
1 1 1,000.0 0.00 43,511,248 75,169,792
[java] OpenReader - - - - - - - - 7 100 100 false - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 51,265,468 - 78,184,448
[java] SearchSameRdr_5000 7 100 100 false
1 5000 2,152.4 2.32 43,511,248 76,152,832
[java] CloseReader - - - - - - - - 7 100 100 false - - 2
- - - - 1 - - 2,000.0 - - 0.00 - 48,399,136 - 78,512,128
[java] WarmNewRdr_50 7 100 100 false
1 1000000 147,318.8 6.79 51,508,560 77,004,800
[java] SrchNewRdr_500 - - - - - - - 7 100 100 false - - 1
- - - 500 - - 419.5 - - 1.19 - 51,508,560 - 77,463,552
[java] SrchTrvNewRdr_300 7 100 100 false
1 335500 188,801.3 1.78 47,232,208 79,626,240
[java] SrchTrvRetNewRdr_100 - - - - - 7 100 100 false - - 1
- - 209216 - 113,952.1 - - 1.84 - 59,019,688 - 81,199,104
[java] SearchSameRdr_5000_2500/sec_Par 7 100 100 false
1 5000 1,630.3 3.07 59,019,688 81,199,104
[java] WarmNewRdr_50_25/sec_Par - - - - 7 100 100 false - - 1
- - 1000000 - 302,755.1 - - 3.30 - 60,712,360 - 82,706,432
[java] SrchNewRdr_50_25/sec_Par 7 100 100 false
1 50 25.5 1.96 67,972,792 82,706,432
[java] SrchTrvNewRdr_300_150/sec_Par - - 7 100 100 false - - 1
- - 335500 - 181,057.8 - - 1.85 - 68,070,456 - 82,706,432
[java] SrchTrvRetNewRdr_100_50/sec_Par 7 100 100 false
1 232076 113,930.3 2.04 58,810,784 83,165,184
[java] ------------> Report Sum By (any) Name (19 about 160153 out
of 160154)
[java] Operation round mrg buf cmpnd
runCnt recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] Rounds_8 0 10 10 true
1 25142792 16,946.2 1,483.68 58,848,944 83,165,184
[java] Populate - - - - - - - - - - - - - - - - - - 8
- - 20003 - - 126.0 - 1,269.82 - 34,567,100 - 58,400,768
[java] CreateIndex - - - -
8 1 11.3 0.70 15,999,842 55,984,128
[java] MAddDocs_20000 - - - - - - - - - - - - - - - - 8
- - 20000 - - 133.2 - 1,200.86 - 32,650,116 - 58,793,984
[java] AddDoc - - - -
160000 1 137.2 1,165.97 29,533,042 57,297,208
[java] Optimize - - - - - - - - - - - - - - - - - - 8
- - - - 1 - - - 0.1 - - 68.25 - 36,543,932 - 58,793,984
[java] CloseIndex - - - -
8 1 8,000.0 0.00 34,567,100 58,089,472
[java] OpenReader - - - - - - - - - - - - - - - - - 16
- - - - 1 - - 1,333.3 - - 0.01 - 38,474,544 - 62,173,184
[java] SearchSameRdr_5000 - - - -
8 5000 2,044.0 19.57 36,504,908 59,269,120
[java] CloseReader - - - - - - - - - - - - - - - - - 16
- - - - 1 - 16,000.0 - - 0.00 - 37,595,456 - 60,862,464
[java] WarmNewRdr_50 - - - -
8 1000000 147,950.9 54.07 38,724,176 61,071,360
[java] SrchNewRdr_500 - - - - - - - - - - - - - - - - 8
- - - 500 - - 423.0 - - 9.46 - 40,299,296 - 63,610,880
[java] SrchTrvNewRdr_300 - - - -
8 335500 184,797.6 14.52 40,500,096 63,930,368
[java] SrchTrvRetNewRdr_100 - - - - - - - - - - - - - - 8
- - 209216 - 113,005.7 - - 14.81 - 44,068,892 - 66,256,896
[java] SearchSameRdr_5000_2500/sec_Par - - - -
8 5000 1,681.8 23.78 43,634,568 66,510,848
[java] WarmNewRdr_50_25/sec_Par - - - - - - - - - - - - - 8
- - 1000000 - 297,386.7 - - 26.90 - 49,373,220 - 65,134,592
[java] SrchNewRdr_50_25/sec_Par - - - -
8 50 25.5 15.69 50,939,944 65,175,552
[java] SrchTrvNewRdr_300_150/sec_Par - - - - - - - - - - - 8
- - 335500 - 181,547.6 - - 14.78 - 49,024,352 - 63,832,064
[java] SrchTrvRetNewRdr_100_50/sec_Par - - - -
8 232076 113,498.5 16.36 48,605,476 63,954,944
[java] ------------> Report sum by Prefix (MAddDocs) and Round (8
about 8 out of 160154)
[java] Operation round mrg buf cmpnd runCnt
recsPerRun rec/s elapsedSec avgUsedMem avgTotalMem
[java] MAddDocs_20000 0 10 10 true 1
20000 184.8 108.22 17,976,160 21,037,056
[java] MAddDocs_20000 - 1 100 10 true - - 1 - - 20000 -
- 250.3 - - 79.89 - 21,784,544 - 51,052,544
[java] MAddDocs_20000 2 10 100 true 1
20000 1,899.7 10.53 19,933,320 50,855,936
[java] MAddDocs_20000 - 3 100 100 true - - 1 - - 20000 -
- 3,450.1 - - 5.80 - 24,440,688 - 59,768,832
[java] MAddDocs_20000 4 10 10 false 1
20000 26.2 764.78 31,128,352 59,572,224
[java] MAddDocs_20000 - 5 100 10 false - - 1 - - 20000 -
- 122.4 - - 163.42 - 52,767,744 - 75,366,400
[java] MAddDocs_20000 6 10 100 false 1
20000 321.0 62.31 42,982,680 76,218,368
[java] MAddDocs_20000 - 7 100 100 false - - 1 - - 20000 -
- 3,378.4 - - 5.92 - 50,187,448 - 76,480,512
[java] ####################
[java] ### D O N E !!! ###
[java] ####################
BUILD SUCCESSFUL
Total time: 24 minutes 47 seconds
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Mark Miller <ma...@gmail.com>.
Hmmm ... its not less RAM - its 140 for both.
I'll share my results when its done, and double check that I'm not
missing anything - but its two fresh checkouts and identical conditions
that I can see.
2.9 took a little over 3 minutes. 2.4 took - well, I'll tell you when
its done, but its already been over 20 ...
???
Shai Erera wrote:
> Well .. the latest additions reuse a Document instance and Fields by
> default. Don't think it should make that much of a difference though.
>
> On Wed, Aug 5, 2009 at 11:00 PM, Mark Miller <markrmiller@gmail.com
> <ma...@gmail.com>> wrote:
>
> Has anything changed in benchmark that would make things
> uncomparable between 2.9 and 2.4?
>
> I don't see anything in Changes that should have that much of an
> affect ...
>
> I tried micro bench on each and 2.9 ran twice as fast.
>
> I also tried standard. Which is a crazy difference. Particularly,
> with indexing I think. Its too big of a dif to make sense ...
>
> Any thoughts?
>
> --
> - Mark
>
> http://www.lucidimagination.com
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> <ma...@lucene.apache.org>
> For additional commands, e-mail: java-dev-help@lucene.apache.org
> <ma...@lucene.apache.org>
>
>
--
- Mark
http://www.lucidimagination.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Shai Erera <se...@gmail.com>.
Well .. the latest additions reuse a Document instance and Fields by
default. Don't think it should make that much of a difference though.
On Wed, Aug 5, 2009 at 11:00 PM, Mark Miller <ma...@gmail.com> wrote:
> Has anything changed in benchmark that would make things uncomparable
> between 2.9 and 2.4?
>
> I don't see anything in Changes that should have that much of an affect ...
>
> I tried micro bench on each and 2.9 ran twice as fast.
>
> I also tried standard. Which is a crazy difference. Particularly, with
> indexing I think. Its too big of a dif to make sense ...
>
> Any thoughts?
>
> --
> - Mark
>
> http://www.lucidimagination.com
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>
>
Re: benchmark: lucene24 vs lucene29
Posted by Mark Miller <ma...@gmail.com>.
Mark Miller wrote:
> Has anything changed in benchmark that would make things uncomparable
> between 2.9 and 2.4?
>
> I don't see anything in Changes that should have that much of an
> affect ...
>
> I tried micro bench on each and 2.9 ran twice as fast.
>
> I also tried standard. Which is a crazy difference. Particularly, with
> indexing I think. Its too big of a dif to make sense ...
>
> Any thoughts?
>
Ah - we must have been giving it less ram by default in 2.4?
--
- Mark
http://www.lucidimagination.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Yonik Seeley <yo...@lucidimagination.com>.
On Wed, Aug 5, 2009 at 5:07 PM, Mark Miller<ma...@gmail.com> wrote:
> It is autocommit. Changing it to false for 2.4 brings it down to one minute
> slower than 2.9.
>
> When its on, wa is 20-30% and the cpu just barley moves. When its off, its a
> similar profile to 2.9.
>
> Theres a speed trap :)
>
> I'm on ext4.
That's unfortunate - I had thought ext4 was supposed to be better at this.
I have noticed that my ubuntu 9.04 ext4 box does a Solr "ant clean
test" slower than my vista laptop, even though it's a faster box ("ant
example" completes in 8 sec in ubuntu, 24 sec on vista).
-Yonik
http://www.lucidimagination.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Michael McCandless <lu...@mikemccandless.com>.
On Wed, Aug 5, 2009 at 5:07 PM, Mark Miller<ma...@gmail.com> wrote:
> It is autocommit. Changing it to false for 2.4 brings it down to one minute
> slower than 2.9.
>
> When its on, wa is 20-30% and the cpu just barley moves. When its off, its a
> similar profile to 2.9.
>
> Theres a speed trap :)
>
> I'm on ext4.
Sheesh that's disappointing. This makes NRT (which doesn't fsync) all
the more important...
Mike
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Mark Miller <ma...@gmail.com>.
Yonik Seeley wrote:
> On Wed, Aug 5, 2009 at 4:35 PM, Michael
> McCandless<lu...@mikemccandless.com> wrote:
>
>> Hmm -- looks like 2.9 defaulted to autoCommit=false, but that can't
>> explain such a big difference.
>>
>
> It perhaps could in conjunction with file synchronization on commit...
> and some filesystems being bad at fsync() (like ext3 which sync's
> everything on an fsync(single_file))
>
> -Yonik
> http://www.lucidimagination.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>
>
It is autocommit. Changing it to false for 2.4 brings it down to one
minute slower than 2.9.
When its on, wa is 20-30% and the cpu just barley moves. When its off,
its a similar profile to 2.9.
Theres a speed trap :)
I'm on ext4.
--
- Mark
http://www.lucidimagination.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Yonik Seeley <yo...@lucidimagination.com>.
On Wed, Aug 5, 2009 at 4:35 PM, Michael
McCandless<lu...@mikemccandless.com> wrote:
> Hmm -- looks like 2.9 defaulted to autoCommit=false, but that can't
> explain such a big difference.
It perhaps could in conjunction with file synchronization on commit...
and some filesystems being bad at fsync() (like ext3 which sync's
everything on an fsync(single_file))
-Yonik
http://www.lucidimagination.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Shai Erera <se...@gmail.com>.
Can you run the 2.4 benchmark code against a 2.9 jar? Not sure if this can
be done, but we can at least detect where's the change coming from.
On Wed, Aug 5, 2009 at 11:43 PM, Mark Miller <ma...@gmail.com> wrote:
> Its the indexing it appears. Its very weird.
>
> With 2.4, during index, CPU keeps dropping to almost 0, and wa hits 20-30%
> for long stretches. Not much CPU is being used.
>
> With 2.9, wa stays under 1% and CPU is pretty much always 100-300%.
>
> - Mark
>
>
> Shai Erera wrote:
>
>> Does it measure only indexing, or search as well? I think 2.9 does have
>> some good improvements to the search side, especially for sorting.
>>
>> Maybe it's not "one big thing" that's causing this improvement, but rather
>> the aggregation of several "smaller things"?
>>
>> On Wed, Aug 5, 2009 at 11:35 PM, Michael McCandless <
>> lucene@mikemccandless.com <ma...@mikemccandless.com>> wrote:
>>
>> Hmm -- looks like 2.9 defaulted to autoCommit=false, but that can't
>> explain such a big difference.
>>
>> Mike
>>
>> On Wed, Aug 5, 2009 at 4:19 PM, Mark Miller<markrmiller@gmail.com
>> <ma...@gmail.com>> wrote:
>> > Michael McCandless wrote:
>> >>
>> >> Was the resulting index size approximately the same?
>> >>
>> >>
>> >
>> > lucene 2.9
>> >
>> > total 24480
>> > -rw-r--r-- 1 mark mark 18548115 2009-08-05 15:46 _0.fdt
>> > -rw-r--r-- 1 mark mark 160004 2009-08-05 15:46 _0.fdx
>> > -rw-r--r-- 1 mark mark 47 2009-08-05 15:46 _5m.fnm
>> > -rw-r--r-- 1 mark mark 2850871 2009-08-05 15:46 _5m.frq
>> > -rw-r--r-- 1 mark mark 20004 2009-08-05 15:46 _5m.nrm
>> > -rw-r--r-- 1 mark mark 2419839 2009-08-05 15:46 _5m.prx
>> > -rw-r--r-- 1 mark mark 14300 2009-08-05 15:46 _5m.tii
>> > -rw-r--r-- 1 mark mark 1026607 2009-08-05 15:46 _5m.tis
>> > -rw-r--r-- 1 mark mark 264 2009-08-05 15:46 segments_2
>> > -rw-r--r-- 1 mark mark 20 2009-08-05 15:46 segments.gen
>> >
>> >
>> > lucene 2.4
>> >
>> > total 24636
>> > -rw-r--r-- 1 mark mark 18585922 2009-08-05 16:11 _5m.fdt
>> > -rw-r--r-- 1 mark mark 160004 2009-08-05 16:11 _5m.fdx
>> > -rw-r--r-- 1 mark mark 42 2009-08-05 16:11 _5m.fnm
>> > -rw-r--r-- 1 mark mark 2875277 2009-08-05 16:11 _5m.frq
>> > -rw-r--r-- 1 mark mark 100004 2009-08-05 16:11 _5m.nrm
>> > -rw-r--r-- 1 mark mark 2439839 2009-08-05 16:11 _5m.prx
>> > -rw-r--r-- 1 mark mark 14329 2009-08-05 16:11 _5m.tii
>> > -rw-r--r-- 1 mark mark 1026623 2009-08-05 16:11 _5m.tis
>> > -rw-r--r-- 1 mark mark 59 2009-08-05 16:11 segments_3
>> > -rw-r--r-- 1 mark mark 20 2009-08-05 16:11 segments.gen
>> >
>> > --
>> > - Mark
>> >
>> > http://www.lucidimagination.com
>> >
>> >
>> >
>> >
>> >
>> ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
>> <ma...@lucene.apache.org>
>> > For additional commands, e-mail: java-dev-help@lucene.apache.org
>> <ma...@lucene.apache.org>
>> >
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
>> <ma...@lucene.apache.org>
>> For additional commands, e-mail: java-dev-help@lucene.apache.org
>> <ma...@lucene.apache.org>
>>
>>
>>
>
> --
> - Mark
>
> http://www.lucidimagination.com
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>
>
Re: benchmark: lucene24 vs lucene29
Posted by Mark Miller <ma...@gmail.com>.
Its the indexing it appears. Its very weird.
With 2.4, during index, CPU keeps dropping to almost 0, and wa hits
20-30% for long stretches. Not much CPU is being used.
With 2.9, wa stays under 1% and CPU is pretty much always 100-300%.
- Mark
Shai Erera wrote:
> Does it measure only indexing, or search as well? I think 2.9 does
> have some good improvements to the search side, especially for sorting.
>
> Maybe it's not "one big thing" that's causing this improvement, but
> rather the aggregation of several "smaller things"?
>
> On Wed, Aug 5, 2009 at 11:35 PM, Michael McCandless
> <lucene@mikemccandless.com <ma...@mikemccandless.com>> wrote:
>
> Hmm -- looks like 2.9 defaulted to autoCommit=false, but that can't
> explain such a big difference.
>
> Mike
>
> On Wed, Aug 5, 2009 at 4:19 PM, Mark Miller<markrmiller@gmail.com
> <ma...@gmail.com>> wrote:
> > Michael McCandless wrote:
> >>
> >> Was the resulting index size approximately the same?
> >>
> >>
> >
> > lucene 2.9
> >
> > total 24480
> > -rw-r--r-- 1 mark mark 18548115 2009-08-05 15:46 _0.fdt
> > -rw-r--r-- 1 mark mark 160004 2009-08-05 15:46 _0.fdx
> > -rw-r--r-- 1 mark mark 47 2009-08-05 15:46 _5m.fnm
> > -rw-r--r-- 1 mark mark 2850871 2009-08-05 15:46 _5m.frq
> > -rw-r--r-- 1 mark mark 20004 2009-08-05 15:46 _5m.nrm
> > -rw-r--r-- 1 mark mark 2419839 2009-08-05 15:46 _5m.prx
> > -rw-r--r-- 1 mark mark 14300 2009-08-05 15:46 _5m.tii
> > -rw-r--r-- 1 mark mark 1026607 2009-08-05 15:46 _5m.tis
> > -rw-r--r-- 1 mark mark 264 2009-08-05 15:46 segments_2
> > -rw-r--r-- 1 mark mark 20 2009-08-05 15:46 segments.gen
> >
> >
> > lucene 2.4
> >
> > total 24636
> > -rw-r--r-- 1 mark mark 18585922 2009-08-05 16:11 _5m.fdt
> > -rw-r--r-- 1 mark mark 160004 2009-08-05 16:11 _5m.fdx
> > -rw-r--r-- 1 mark mark 42 2009-08-05 16:11 _5m.fnm
> > -rw-r--r-- 1 mark mark 2875277 2009-08-05 16:11 _5m.frq
> > -rw-r--r-- 1 mark mark 100004 2009-08-05 16:11 _5m.nrm
> > -rw-r--r-- 1 mark mark 2439839 2009-08-05 16:11 _5m.prx
> > -rw-r--r-- 1 mark mark 14329 2009-08-05 16:11 _5m.tii
> > -rw-r--r-- 1 mark mark 1026623 2009-08-05 16:11 _5m.tis
> > -rw-r--r-- 1 mark mark 59 2009-08-05 16:11 segments_3
> > -rw-r--r-- 1 mark mark 20 2009-08-05 16:11 segments.gen
> >
> > --
> > - Mark
> >
> > http://www.lucidimagination.com
> >
> >
> >
> >
> >
> ---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> <ma...@lucene.apache.org>
> > For additional commands, e-mail: java-dev-help@lucene.apache.org
> <ma...@lucene.apache.org>
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> <ma...@lucene.apache.org>
> For additional commands, e-mail: java-dev-help@lucene.apache.org
> <ma...@lucene.apache.org>
>
>
--
- Mark
http://www.lucidimagination.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Shai Erera <se...@gmail.com>.
Does it measure only indexing, or search as well? I think 2.9 does have some
good improvements to the search side, especially for sorting.
Maybe it's not "one big thing" that's causing this improvement, but rather
the aggregation of several "smaller things"?
On Wed, Aug 5, 2009 at 11:35 PM, Michael McCandless <
lucene@mikemccandless.com> wrote:
> Hmm -- looks like 2.9 defaulted to autoCommit=false, but that can't
> explain such a big difference.
>
> Mike
>
> On Wed, Aug 5, 2009 at 4:19 PM, Mark Miller<ma...@gmail.com> wrote:
> > Michael McCandless wrote:
> >>
> >> Was the resulting index size approximately the same?
> >>
> >>
> >
> > lucene 2.9
> >
> > total 24480
> > -rw-r--r-- 1 mark mark 18548115 2009-08-05 15:46 _0.fdt
> > -rw-r--r-- 1 mark mark 160004 2009-08-05 15:46 _0.fdx
> > -rw-r--r-- 1 mark mark 47 2009-08-05 15:46 _5m.fnm
> > -rw-r--r-- 1 mark mark 2850871 2009-08-05 15:46 _5m.frq
> > -rw-r--r-- 1 mark mark 20004 2009-08-05 15:46 _5m.nrm
> > -rw-r--r-- 1 mark mark 2419839 2009-08-05 15:46 _5m.prx
> > -rw-r--r-- 1 mark mark 14300 2009-08-05 15:46 _5m.tii
> > -rw-r--r-- 1 mark mark 1026607 2009-08-05 15:46 _5m.tis
> > -rw-r--r-- 1 mark mark 264 2009-08-05 15:46 segments_2
> > -rw-r--r-- 1 mark mark 20 2009-08-05 15:46 segments.gen
> >
> >
> > lucene 2.4
> >
> > total 24636
> > -rw-r--r-- 1 mark mark 18585922 2009-08-05 16:11 _5m.fdt
> > -rw-r--r-- 1 mark mark 160004 2009-08-05 16:11 _5m.fdx
> > -rw-r--r-- 1 mark mark 42 2009-08-05 16:11 _5m.fnm
> > -rw-r--r-- 1 mark mark 2875277 2009-08-05 16:11 _5m.frq
> > -rw-r--r-- 1 mark mark 100004 2009-08-05 16:11 _5m.nrm
> > -rw-r--r-- 1 mark mark 2439839 2009-08-05 16:11 _5m.prx
> > -rw-r--r-- 1 mark mark 14329 2009-08-05 16:11 _5m.tii
> > -rw-r--r-- 1 mark mark 1026623 2009-08-05 16:11 _5m.tis
> > -rw-r--r-- 1 mark mark 59 2009-08-05 16:11 segments_3
> > -rw-r--r-- 1 mark mark 20 2009-08-05 16:11 segments.gen
> >
> > --
> > - Mark
> >
> > http://www.lucidimagination.com
> >
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: java-dev-help@lucene.apache.org
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>
>
Re: benchmark: lucene24 vs lucene29
Posted by Michael McCandless <lu...@mikemccandless.com>.
Hmm -- looks like 2.9 defaulted to autoCommit=false, but that can't
explain such a big difference.
Mike
On Wed, Aug 5, 2009 at 4:19 PM, Mark Miller<ma...@gmail.com> wrote:
> Michael McCandless wrote:
>>
>> Was the resulting index size approximately the same?
>>
>>
>
> lucene 2.9
>
> total 24480
> -rw-r--r-- 1 mark mark 18548115 2009-08-05 15:46 _0.fdt
> -rw-r--r-- 1 mark mark 160004 2009-08-05 15:46 _0.fdx
> -rw-r--r-- 1 mark mark 47 2009-08-05 15:46 _5m.fnm
> -rw-r--r-- 1 mark mark 2850871 2009-08-05 15:46 _5m.frq
> -rw-r--r-- 1 mark mark 20004 2009-08-05 15:46 _5m.nrm
> -rw-r--r-- 1 mark mark 2419839 2009-08-05 15:46 _5m.prx
> -rw-r--r-- 1 mark mark 14300 2009-08-05 15:46 _5m.tii
> -rw-r--r-- 1 mark mark 1026607 2009-08-05 15:46 _5m.tis
> -rw-r--r-- 1 mark mark 264 2009-08-05 15:46 segments_2
> -rw-r--r-- 1 mark mark 20 2009-08-05 15:46 segments.gen
>
>
> lucene 2.4
>
> total 24636
> -rw-r--r-- 1 mark mark 18585922 2009-08-05 16:11 _5m.fdt
> -rw-r--r-- 1 mark mark 160004 2009-08-05 16:11 _5m.fdx
> -rw-r--r-- 1 mark mark 42 2009-08-05 16:11 _5m.fnm
> -rw-r--r-- 1 mark mark 2875277 2009-08-05 16:11 _5m.frq
> -rw-r--r-- 1 mark mark 100004 2009-08-05 16:11 _5m.nrm
> -rw-r--r-- 1 mark mark 2439839 2009-08-05 16:11 _5m.prx
> -rw-r--r-- 1 mark mark 14329 2009-08-05 16:11 _5m.tii
> -rw-r--r-- 1 mark mark 1026623 2009-08-05 16:11 _5m.tis
> -rw-r--r-- 1 mark mark 59 2009-08-05 16:11 segments_3
> -rw-r--r-- 1 mark mark 20 2009-08-05 16:11 segments.gen
>
> --
> - Mark
>
> http://www.lucidimagination.com
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Mark Miller <ma...@gmail.com>.
Michael McCandless wrote:
> Was the resulting index size approximately the same?
>
>
lucene 2.9
total 24480
-rw-r--r-- 1 mark mark 18548115 2009-08-05 15:46 _0.fdt
-rw-r--r-- 1 mark mark 160004 2009-08-05 15:46 _0.fdx
-rw-r--r-- 1 mark mark 47 2009-08-05 15:46 _5m.fnm
-rw-r--r-- 1 mark mark 2850871 2009-08-05 15:46 _5m.frq
-rw-r--r-- 1 mark mark 20004 2009-08-05 15:46 _5m.nrm
-rw-r--r-- 1 mark mark 2419839 2009-08-05 15:46 _5m.prx
-rw-r--r-- 1 mark mark 14300 2009-08-05 15:46 _5m.tii
-rw-r--r-- 1 mark mark 1026607 2009-08-05 15:46 _5m.tis
-rw-r--r-- 1 mark mark 264 2009-08-05 15:46 segments_2
-rw-r--r-- 1 mark mark 20 2009-08-05 15:46 segments.gen
lucene 2.4
total 24636
-rw-r--r-- 1 mark mark 18585922 2009-08-05 16:11 _5m.fdt
-rw-r--r-- 1 mark mark 160004 2009-08-05 16:11 _5m.fdx
-rw-r--r-- 1 mark mark 42 2009-08-05 16:11 _5m.fnm
-rw-r--r-- 1 mark mark 2875277 2009-08-05 16:11 _5m.frq
-rw-r--r-- 1 mark mark 100004 2009-08-05 16:11 _5m.nrm
-rw-r--r-- 1 mark mark 2439839 2009-08-05 16:11 _5m.prx
-rw-r--r-- 1 mark mark 14329 2009-08-05 16:11 _5m.tii
-rw-r--r-- 1 mark mark 1026623 2009-08-05 16:11 _5m.tis
-rw-r--r-- 1 mark mark 59 2009-08-05 16:11 segments_3
-rw-r--r-- 1 mark mark 20 2009-08-05 16:11 segments.gen
--
- Mark
http://www.lucidimagination.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: benchmark: lucene24 vs lucene29
Posted by Michael McCandless <lu...@mikemccandless.com>.
We didn't spend much effort speeding up indexing, I think?
Was OS's IO cache warm for both of your tests?
Was the resulting index size approximately the same?
Mike
On Wed, Aug 5, 2009 at 4:00 PM, Mark Miller<ma...@gmail.com> wrote:
> Has anything changed in benchmark that would make things uncomparable
> between 2.9 and 2.4?
>
> I don't see anything in Changes that should have that much of an affect ...
>
> I tried micro bench on each and 2.9 ran twice as fast.
>
> I also tried standard. Which is a crazy difference. Particularly, with
> indexing I think. Its too big of a dif to make sense ...
>
> Any thoughts?
>
> --
> - Mark
>
> http://www.lucidimagination.com
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org