You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "jpountz (via GitHub)" <gi...@apache.org> on 2023/08/29 21:36:14 UTC
[GitHub] [lucene] jpountz commented on pull request #12526: Speed up disjunctions by computing estimations of the score of the k-th top hit up-front.
jpountz commented on PR #12526:
URL: https://github.com/apache/lucene/pull/12526#issuecomment-1698177593
Here are results on `wikimedium10m`. `OrHighHigh` and `OrHighMed` don't get a speedup because their minimum competitive scores compute pretty quickly anyway, but `OrHighHigh` sees a major speedup:
```
TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value
AndHighLow 1452.84 (2.0%) 1410.03 (3.8%) -2.9% ( -8% - 2%) 0.017
Fuzzy1 98.38 (1.6%) 96.51 (1.1%) -1.9% ( -4% - 0%) 0.001
HighIntervalsOrdered 6.24 (5.8%) 6.15 (4.4%) -1.4% ( -11% - 9%) 0.494
OrHighHigh 61.69 (6.4%) 60.87 (5.4%) -1.3% ( -12% - 11%) 0.585
MedIntervalsOrdered 44.82 (5.1%) 44.23 (3.9%) -1.3% ( -9% - 8%) 0.476
LowIntervalsOrdered 57.23 (5.4%) 56.48 (4.0%) -1.3% ( -10% - 8%) 0.497
OrHighMed 190.42 (3.8%) 188.10 (3.8%) -1.2% ( -8% - 6%) 0.430
AndHighMed 236.92 (4.1%) 234.25 (4.1%) -1.1% ( -8% - 7%) 0.500
OrHighNotMed 425.77 (6.6%) 421.99 (5.2%) -0.9% ( -11% - 11%) 0.715
MedTerm 788.26 (7.2%) 781.68 (3.4%) -0.8% ( -10% - 10%) 0.716
OrHighNotHigh 317.53 (6.6%) 314.90 (5.5%) -0.8% ( -12% - 12%) 0.738
HighTerm 593.70 (7.6%) 589.22 (3.9%) -0.8% ( -11% - 11%) 0.760
Fuzzy2 73.16 (1.3%) 72.68 (1.3%) -0.7% ( -3% - 1%) 0.206
OrNotHighHigh 413.61 (6.0%) 411.20 (5.2%) -0.6% ( -11% - 11%) 0.798
LowPhrase 43.15 (2.9%) 42.90 (1.4%) -0.6% ( -4% - 3%) 0.526
OrNotHighMed 425.13 (4.4%) 422.86 (3.3%) -0.5% ( -7% - 7%) 0.735
HighSloppyPhrase 12.59 (4.7%) 12.53 (5.6%) -0.5% ( -10% - 10%) 0.808
LowSpanNear 28.72 (2.1%) 28.57 (2.2%) -0.5% ( -4% - 3%) 0.559
OrHighNotLow 475.44 (7.1%) 473.03 (5.2%) -0.5% ( -11% - 12%) 0.841
PKLookup 245.49 (3.5%) 244.36 (3.8%) -0.5% ( -7% - 7%) 0.759
LowSloppyPhrase 67.32 (2.7%) 67.06 (2.8%) -0.4% ( -5% - 5%) 0.730
LowTerm 1124.64 (6.8%) 1120.58 (3.5%) -0.4% ( -9% - 10%) 0.870
Wildcard 172.10 (2.7%) 171.49 (2.4%) -0.4% ( -5% - 4%) 0.735
MedPhrase 59.34 (3.1%) 59.16 (1.4%) -0.3% ( -4% - 4%) 0.765
HighTermDayOfYearSort 457.23 (1.2%) 456.10 (1.2%) -0.2% ( -2% - 2%) 0.611
MedSpanNear 29.71 (3.0%) 29.64 (2.6%) -0.2% ( -5% - 5%) 0.859
OrNotHighLow 1283.05 (2.7%) 1282.59 (1.9%) -0.0% ( -4% - 4%) 0.971
HighTermMonthSort 4728.97 (2.8%) 4729.28 (1.9%) 0.0% ( -4% - 4%) 0.995
AndHighHigh 63.31 (4.8%) 63.31 (4.8%) 0.0% ( -9% - 10%) 0.997
Prefix3 346.29 (4.3%) 346.43 (3.9%) 0.0% ( -7% - 8%) 0.980
TermDTSort 192.60 (1.1%) 192.76 (0.9%) 0.1% ( -1% - 2%) 0.830
Respell 96.59 (1.6%) 96.73 (1.3%) 0.2% ( -2% - 3%) 0.798
HighTermTitleSort 161.71 (3.7%) 162.22 (4.8%) 0.3% ( -7% - 9%) 0.860
HighTermTitleBDVSort 15.55 (3.3%) 15.61 (2.5%) 0.4% ( -5% - 6%) 0.748
HighPhrase 97.18 (4.1%) 97.75 (2.1%) 0.6% ( -5% - 7%) 0.659
HighSpanNear 6.86 (6.0%) 6.91 (6.6%) 0.8% ( -11% - 14%) 0.754
MedSloppyPhrase 38.05 (5.0%) 38.38 (4.0%) 0.9% ( -7% - 10%) 0.646
IntNRQ 94.63 (21.2%) 98.52 (21.0%) 4.1% ( -31% - 58%) 0.634
OrHighLow 430.69 (5.4%) 617.92 (4.7%) 43.5% ( 31% - 56%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org