You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "Atri Sharma (Jira)" <ji...@apache.org> on 2019/09/20 08:39:00 UTC
[jira] [Commented] (LUCENE-8978) "Max Bottom" Based Early
Termination For Concurrent Search
[ https://issues.apache.org/jira/browse/LUCENE-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934206#comment-16934206 ]
Atri Sharma commented on LUCENE-8978:
-------------------------------------
I had some issues with my earlier test runs. Fixed them now and here are the updated results:
Wikimedium10m with concurrent search:
||Task ('HighSpanNear', None)||P50 Base 18.971856||P50 Cmp 19.115405||Pct Diff 0.75664183831||P90 Base 25.394956||P90 Cmp 22.396552||Pct Diff -11.80708484||P99 Base 25.585029||P99 Cmp 22.825023||Pct Diff -10.7875820661||P999 Base 25.585029||P999 Cmp 22.825023||Pct Diff -10.7875820661||P100 Base 29.948754||P100 Cmp 22.990658||Pct Diff -23.2333405256||
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 100.813812||P50 Cmp 101.237299||Pct Diff 0.420068432687||P90 Base 112.729388||P90 Cmp 120.730533||Pct Diff 7.09765673526||P99 Base 122.198435||P99 Cmp 132.415702||Pct Diff 8.36120937228||P999 Base 122.198435||P999 Cmp 132.415702||Pct Diff 8.36120937228||P100 Base 294.000735||P100 Cmp 276.961033||Pct Diff -5.7958025173||
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 29.38945||P50 Cmp 30.619796||Pct Diff 4.18635258571||P90 Base 71.768952||P90 Cmp 80.413425||Pct Diff 12.0448644701||P99 Base 85.238118||P99 Cmp 98.349615||Pct Diff 15.3821990767||P999 Base 85.238118||P999 Cmp 98.349615||Pct Diff 15.3821990767||P100 Base 100.262364||P100 Cmp 142.551521||Pct Diff 42.1784958112||
||Task ('HighTerm', None)||P50 Base 2.238097||P50 Cmp 1.268568||Pct Diff -43.3193467486||P90 Base 3.279594||P90 Cmp 2.217695||Pct Diff -32.3789773978||P99 Base 3.833247||P99 Cmp 7.549833||Pct Diff 96.9566010226||P999 Base 3.833247||P999 Cmp 7.549833||Pct Diff 96.9566010226||P100 Base 8.530505||P100 Cmp 37.05043||Pct Diff 334.328682768||
||Task ('LowTerm', None)||P50 Base 1.543205||P50 Cmp 1.231248||Pct Diff -20.214877479||P90 Base 7.173272||P90 Cmp 2.116812||Pct Diff -70.4902867199||P99 Base 11.802009||P99 Cmp 6.056692||Pct Diff -48.6808389995||P999 Base 11.802009||P999 Cmp 6.056692||Pct Diff -48.6808389995||P100 Base 21.263545||P100 Cmp 29.650059||Pct Diff 39.4408082001||
||Task ('OrNotHighHigh', None)||P50 Base 2.995964||P50 Cmp 1.803324||Pct Diff -39.8082219947||P90 Base 3.829869||P90 Cmp 2.761644||Pct Diff -27.8919461736||P99 Base 3.835793||P99 Cmp 2.90684||Pct Diff -24.2180169785||P999 Base 3.835793||P999 Cmp 2.90684||Pct Diff -24.2180169785||P100 Base 41.140203||P100 Cmp 38.965549||Pct Diff -5.28595836049||
||Task ('MedPhrase', None)||P50 Base 2.679309||P50 Cmp 2.680824||Pct Diff 0.0565444299258||P90 Base 3.448301||P90 Cmp 4.514041||Pct Diff 30.9062346935||P99 Base 95.803532||P99 Cmp 38.188159||Pct Diff -60.1390906966||P999 Base 95.803532||P999 Cmp 38.188159||Pct Diff -60.1390906966||P100 Base 101.641901||P100 Cmp 73.856804||Pct Diff -27.3362626305||
||Task ('AndHighLow', None)||P50 Base 1.409244||P50 Cmp 1.347221||Pct Diff -4.40115409397||P90 Base 4.495005||P90 Cmp 3.099544||Pct Diff -31.044704066||P99 Base 6.043321||P99 Cmp 5.084951||Pct Diff -15.8583335222||P999 Base 6.043321||P999 Cmp 5.084951||Pct Diff -15.8583335222||P100 Base 8.454945||P100 Cmp 7.701492||Pct Diff -8.91138854244||
||Task ('MedTerm', None)||P50 Base 1.682272||P50 Cmp 1.147723||Pct Diff -31.7754203839||P90 Base 15.24221||P90 Cmp 4.303477||Pct Diff -71.7660562346||P99 Base 24.52032||P99 Cmp 5.817554||Pct Diff -76.2745592227||P999 Base 24.52032||P999 Cmp 5.817554||Pct Diff -76.2745592227||P100 Base 45.496262||P100 Cmp 20.414843||Pct Diff -55.1285268227||
||Task ('Prefix3', None)||P50 Base 1.904465||P50 Cmp 1.8418||Pct Diff -3.29042539506||P90 Base 6.631238||P90 Cmp 21.78927||Pct Diff 228.585250597||P99 Base 20.862886||P99 Cmp 164.172423||Pct Diff 686.911374582||P999 Base 20.862886||P999 Cmp 164.172423||Pct Diff 686.911374582||P100 Base 235.494494||P100 Cmp 311.228238||Pct Diff 32.1594542249||
||Task ('OrHighNotMed', None)||P50 Base 2.592121||P50 Cmp 1.741687||Pct Diff -32.8084221377||P90 Base 3.21777||P90 Cmp 2.281574||Pct Diff -29.0945592755||P99 Base 4.108258||P99 Cmp 2.356369||Pct Diff -42.6431105349||P999 Base 4.108258||P999 Cmp 2.356369||Pct Diff -42.6431105349||P100 Base 36.452029||P100 Cmp 24.359319||Pct Diff -33.1743124642||
||Task ('LowSloppyPhrase', None)||P50 Base 7.17009||P50 Cmp 6.775814||Pct Diff -5.49889889806||P90 Base 10.237824||P90 Cmp 11.639566||Pct Diff 13.6917962254||P99 Base 15.983773||P99 Cmp 11.864554||Pct Diff -25.7712556353||P999 Base 15.983773||P999 Cmp 11.864554||Pct Diff -25.7712556353||P100 Base 27.466558||P100 Cmp 15.832752||Pct Diff -42.3562573803||
||Task ('Wildcard', None)||P50 Base 3.182749||P50 Cmp 2.826948||Pct Diff -11.1790467926||P90 Base 10.75107||P90 Cmp 9.240186||Pct Diff -14.0533360865||P99 Base 143.622905||P99 Cmp 9.604664||Pct Diff -93.3125820008||P999 Base 143.622905||P999 Cmp 9.604664||Pct Diff -93.3125820008||P100 Base 356.310669||P100 Cmp 165.943325||Pct Diff -53.4273488173||
||Task ('HighSloppyPhrase', None)||P50 Base 18.930947||P50 Cmp 17.470305||Pct Diff -7.71563091904||P90 Base 29.558801||P90 Cmp 28.708357||Pct Diff -2.87712617301||P99 Base 30.502984||P99 Cmp 29.054366||Pct Diff -4.7491025796||P999 Base 30.502984||P999 Cmp 29.054366||Pct Diff -4.7491025796||P100 Base 100.576435||P100 Cmp 29.413667||Pct Diff -70.7549119235||
||Task ('HighIntervalsOrdered', None)||P50 Base 16.140269||P50 Cmp 16.695305||Pct Diff 3.43882744457||P90 Base 24.893004||P90 Cmp 24.412859||Pct Diff -1.92883510564||P99 Base 32.006548||P99 Cmp 36.016794||Pct Diff 12.5294549103||P999 Base 32.006548||P999 Cmp 36.016794||Pct Diff 12.5294549103||P100 Base 135.304631||P100 Cmp 107.165711||Pct Diff -20.7967161154||
||Task ('IntNRQ', None)||P50 Base 5.01008||P50 Cmp 5.077795||Pct Diff 1.35157522435||P90 Base 55.870017||P90 Cmp 13.879275||Pct Diff -75.1579187814||P99 Base 104.078259||P99 Cmp 113.021586||Pct Diff 8.59288681991||P999 Base 104.078259||P999 Cmp 113.021586||Pct Diff 8.59288681991||P100 Base 228.186239||P100 Cmp 120.063283||Pct Diff -47.3836443748||
||Task ('MedSpanNear', None)||P50 Base 6.044147||P50 Cmp 6.538728||Pct Diff 8.18280892242||P90 Base 27.73923||P90 Cmp 26.78976||Pct Diff -3.42284194623||P99 Base 31.186687||P99 Cmp 29.375471||Pct Diff -5.80765760723||P999 Base 31.186687||P999 Cmp 29.375471||Pct Diff -5.80765760723||P100 Base 475.296829||P100 Cmp 299.124599||Pct Diff -37.0657280358||
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.173862||P50 Cmp 0.165614||Pct Diff -4.74399236176||P90 Base 0.219035||P90 Cmp 0.275778||Pct Diff 25.9059054489||P99 Base 0.219605||P99 Cmp 0.284092||Pct Diff 29.3649962433||P999 Base 0.219605||P999 Cmp 0.284092||Pct Diff 29.3649962433||P100 Base 24.387907||P100 Cmp 23.903957||Pct Diff -1.98438512989||
||Task ('HighTermMonthSort', 'Month')||P50 Base 25.356492||P50 Cmp 26.126949||Pct Diff 3.03849996285||P90 Base 32.241495||P90 Cmp 35.329769||Pct Diff 9.57856948011||P99 Base 36.428719||P99 Cmp 39.964302||Pct Diff 9.70548264406||P999 Base 36.428719||P999 Cmp 39.964302||Pct Diff 9.70548264406||P100 Base 76.849917||P100 Cmp 70.917629||Pct Diff -7.71931607942||
||Task Respell||P50 Base 22.624837||P50 Cmp 22.886964||Pct Diff 1.15858072259||P90 Base 278.20719||P90 Cmp 85.811447||Pct Diff -69.1555610047||P99 Base 283.803815||P99 Cmp 285.948691||Pct Diff 0.755760101393||P999 Base 283.803815||P999 Cmp 285.948691||Pct Diff 0.755760101393||P100 Base 408.986758||P100 Cmp 646.591515||Pct Diff 58.0959535614||
||Task ('HighPhrase', None)||P50 Base 39.342939||P50 Cmp 18.644176||Pct Diff -52.6111254678||P90 Base 50.707655||P90 Cmp 26.184513||Pct Diff -48.3618144046||P99 Base 57.097617||P99 Cmp 26.751993||Pct Diff -53.1469185483||P999 Base 57.097617||P999 Cmp 26.751993||Pct Diff -53.1469185483||P100 Base 203.423561||P100 Cmp 180.117251||Pct Diff -11.4570356971||
||Task ('OrHighNotLow', None)||P50 Base 2.519362||P50 Cmp 1.758888||Pct Diff -30.185181804||P90 Base 6.628084||P90 Cmp 3.069032||Pct Diff -53.6965433751||P99 Base 6.819052||P99 Cmp 4.400299||Pct Diff -35.4705170161||P999 Base 6.819052||P999 Cmp 4.400299||Pct Diff -35.4705170161||P100 Base 42.230781||P100 Cmp 11.238064||Pct Diff -73.3889269062||
||Task ('LowPhrase', None)||P50 Base 1.998635||P50 Cmp 1.803893||Pct Diff -9.74375010945||P90 Base 5.928542||P90 Cmp 4.752868||Pct Diff -19.8307442201||P99 Base 11.554931||P99 Cmp 12.960246||Pct Diff 12.1620371424||P999 Base 11.554931||P999 Cmp 12.960246||Pct Diff 12.1620371424||P100 Base 30.426781||P100 Cmp 24.484238||Pct Diff -19.5306332274||
||Task ('OrHighNotHigh', None)||P50 Base 2.831417||P50 Cmp 1.333155||Pct Diff -52.9156249327||P90 Base 6.883672||P90 Cmp 2.313561||Pct Diff -66.3905979251||P99 Base 7.788618||P99 Cmp 4.554117||Pct Diff -41.5285612929||P999 Base 7.788618||P999 Cmp 4.554117||Pct Diff -41.5285612929||P100 Base 8.976584||P100 Cmp 6.332386||Pct Diff -29.4566173502||
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.174705||P50 Cmp 0.171706||Pct Diff -1.71660799634||P90 Base 0.25399||P90 Cmp 0.260638||Pct Diff 2.61742588291||P99 Base 21.042688||P99 Cmp 8.644944||Pct Diff -58.9171117302||P999 Base 21.042688||P999 Cmp 8.644944||Pct Diff -58.9171117302||P100 Base 23.388598||P100 Cmp 23.772758||Pct Diff 1.64250973915||
||Task ('Fuzzy2', None)||P50 Base 26.6262||P50 Cmp 34.349226||Pct Diff 29.0053631386||P90 Base 108.542321||P90 Cmp 57.367342||Pct Diff -47.1474891347||P99 Base 164.59635||P99 Cmp 108.404373||Pct Diff -34.1392606823||P999 Base 164.59635||P999 Cmp 108.404373||Pct Diff -34.1392606823||P100 Base 706.455337||P100 Cmp 751.645786||Pct Diff 6.39678782694||
||Task ('AndHighMed', None)||P50 Base 2.782514||P50 Cmp 2.731525||Pct Diff -1.83247954907||P90 Base 10.537516||P90 Cmp 6.382485||Pct Diff -39.4308392984||P99 Base 72.980547||P99 Cmp 8.907339||Pct Diff -87.7949133486||P999 Base 72.980547||P999 Cmp 8.907339||Pct Diff -87.7949133486||P100 Base 209.391929||P100 Cmp 65.690225||Pct Diff -68.6281007517||
||Task ('AndHighHigh', None)||P50 Base 5.160436||P50 Cmp 5.838854||Pct Diff 13.1465248285||P90 Base 14.80012||P90 Cmp 13.701921||Pct Diff -7.4202033497||P99 Base 54.506459||P99 Cmp 87.039011||Pct Diff 59.6856823886||P999 Base 54.506459||P999 Cmp 87.039011||Pct Diff 59.6856823886||P100 Base 108.419844||P100 Cmp 114.454877||Pct Diff 5.56635462416||
||Task ('MedSloppyPhrase', None)||P50 Base 13.276245||P50 Cmp 13.791899||Pct Diff 3.88403498128||P90 Base 66.651656||P90 Cmp 21.125857||Pct Diff -68.3040778462||P99 Base 117.477161||P99 Cmp 66.361111||Pct Diff -43.5114787971||P999 Base 117.477161||P999 Cmp 66.361111||Pct Diff -43.5114787971||P100 Base 144.912198||P100 Cmp 164.681974||Pct Diff 13.6425892871||
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 93.380842||P50 Cmp 92.735093||Pct Diff -0.691521929091||P90 Base 96.720704||P90 Cmp 99.407285||Pct Diff 2.77766898802||P99 Base 96.76942||P99 Cmp 100.435863||Pct Diff 3.78884465774||P999 Base 96.76942||P999 Cmp 100.435863||Pct Diff 3.78884465774||P100 Base 126.35659||P100 Cmp 125.511467||Pct Diff -0.668839670333||
||Task ('OrNotHighMed', None)||P50 Base 2.008232||P50 Cmp 1.960218||Pct Diff -2.39085922344||P90 Base 18.503889||P90 Cmp 5.723573||Pct Diff -69.0682699188||P99 Base 302.172336||P99 Cmp 204.593996||Pct Diff -32.2922810512||P999 Base 302.172336||P999 Cmp 204.593996||Pct Diff -32.2922810512||P100 Base 451.344257||P100 Cmp 294.181114||Pct Diff -34.8211239121||
||Task ('LowSpanNear', None)||P50 Base 19.967304||P50 Cmp 20.081594||Pct Diff 0.572385736202||P90 Base 25.087717||P90 Cmp 30.951829||Pct Diff 23.3744345888||P99 Base 25.701355||P99 Cmp 33.999408||Pct Diff 32.2864417071||P999 Base 25.701355||P999 Cmp 33.999408||Pct Diff 32.2864417071||P100 Base 35.304445||P100 Cmp 35.944626||Pct Diff 1.81331557542||
||Task ('OrHighLow', None)||P50 Base 3.196112||P50 Cmp 1.682768||Pct Diff -47.3495296786||P90 Base 9.367199||P90 Cmp 45.882965||Pct Diff 389.825880714||P99 Base 41.940519||P99 Cmp 126.347569||Pct Diff 201.25418572||P999 Base 41.940519||P999 Cmp 126.347569||Pct Diff 201.25418572||P100 Base 106.524356||P100 Cmp 213.443731||Pct Diff 100.370825053||
||Task PKLookup||P50 Base 10.961338||P50 Cmp 10.326765||Pct Diff -5.78919288868||P90 Base 80.746438||P90 Cmp 72.596238||Pct Diff -10.0935721771||P99 Base 183.752939||P99 Cmp 179.07915||Pct Diff -2.54351795701||P999 Base 183.752939||P999 Cmp 179.07915||Pct Diff -2.54351795701||P100 Base 283.95249||P100 Cmp 181.990793||Pct Diff -35.9080129919||
||Task ('OrHighHigh', None)||P50 Base 15.202781||P50 Cmp 16.164734||Pct Diff 6.32748047874||P90 Base 22.280623||P90 Cmp 22.964996||Pct Diff 3.07160621137||P99 Base 28.72027||P99 Cmp 81.176||Pct Diff 182.64358239||P999 Base 28.72027||P999 Cmp 81.176||Pct Diff 182.64358239||P100 Base 145.116416||P100 Cmp 413.271206||Pct Diff 184.785979003||
||Task ('OrNotHighLow', None)||P50 Base 1.423141||P50 Cmp 1.441871||Pct Diff 1.31610290196||P90 Base 3.908113||P90 Cmp 2.421889||Pct Diff -38.029197211||P99 Base 5.080778||P99 Cmp 4.055832||Pct Diff -20.1730128732||P999 Base 5.080778||P999 Cmp 4.055832||Pct Diff -20.1730128732||P100 Base 5.133711||P100 Cmp 5.39345||Pct Diff 5.0594784163||
||Task ('Fuzzy1', None)||P50 Base 18.435499||P50 Cmp 20.056537||Pct Diff 8.79302480502||P90 Base 106.048087||P90 Cmp 109.547307||Pct Diff 3.29965405222||P99 Base 185.022941||P99 Cmp 168.072828||Pct Diff -9.16108721891||P999 Base 185.022941||P999 Cmp 168.072828||Pct Diff -9.16108721891||P100 Base 200.953009||P100 Cmp 200.452265||Pct Diff -0.249184624053||
||Task ('BrowseDateTaxoFacets', None)||P50 Base 429.678395||P50 Cmp 432.655336||Pct Diff 0.692830040943||P90 Base 441.138564||P90 Cmp 470.791557||Pct Diff 6.72192263835||P99 Base 445.074599||P99 Cmp 475.335447||Pct Diff 6.79905078115||P999 Base 445.074599||P999 Cmp 475.335447||Pct Diff 6.79905078115||P100 Base 520.385966||P100 Cmp 540.567427||Pct Diff 3.87817164923||
||Task ('OrHighMed', None)||P50 Base 4.127915||P50 Cmp 4.273914||Pct Diff 3.53687030862||P90 Base 8.134325||P90 Cmp 7.147647||Pct Diff -12.1298079435||P99 Base 20.868165||P99 Cmp 16.851728||Pct Diff -19.2467186262||P999 Base 20.868165||P999 Cmp 16.851728||Pct Diff -19.2467186262||P100 Base 88.36515||P100 Cmp 70.356703||Pct Diff -20.3795806378||
QPS:
||Task||QPS baseline||StdDev baseline||QPS my_modified_version||StdDev my_modified_version||Pct diff||
|IntNRQ|195.61|26.86|189.74|30.63|{color:#FF0000}28%{color}-{color:#008000}30%{color}|
|HighTermDayOfYearSort|33.48|1.05|32.55|1.26|{color:#FF0000}9%{color}-{color:#008000}4%{color}|
|MedPhrase|384.80|18.11|376.18|22.89|{color:#FF0000}12%{color}-{color:#008000}8%{color}|
|AndHighMed|361.93|16.95|354.75|21.28|{color:#FF0000}11%{color}-{color:#008000}8%{color}|
|Wildcard|350.94|25.49|344.72|25.84|{color:#FF0000}15%{color}-{color:#008000}13%{color}|
|BrowseDayOfYearTaxoFacets|6009.22|266.20|5914.08|266.14|{color:#FF0000}9%{color}-{color:#008000}7%{color}|
|BrowseMonthTaxoFacets|6241.48|348.42|6157.94|513.42|{color:#FF0000}14%{color}-{color:#008000}13%{color}|
|AndHighHigh|207.72|10.17|205.30|10.85|{color:#FF0000}10%{color}-{color:#008000}9%{color}|
|Fuzzy2|36.37|2.97|36.11|3.52|{color:#FF0000}17%{color}-{color:#008000}18%{color}|
|BrowseDayOfYearSSDVFacets|11.47|1.78|11.41|1.79|{color:#FF0000}27%{color}-{color:#008000}36%{color}|
|BrowseDateTaxoFacets|2.31|0.03|2.31|0.02|{color:#FF0000}2%{color}-{color:#008000}2%{color}|
|Respell|44.88|1.42|45.01|1.14|{color:#FF0000}5%{color}-{color:#008000}6%{color}|
|BrowseMonthSSDVFacets|14.06|2.52|14.10|2.47|{color:#FF0000}29%{color}-{color:#008000}43%{color}|
|OrHighHigh|63.18|1.64|63.44|1.52|{color:#FF0000}4%{color}-{color:#008000}5%{color}|
|AndHighLow|764.78|42.14|768.20|58.99|{color:#FF0000}12%{color}-{color:#008000}14%{color}|
|HighTermMonthSort|38.42|2.91|38.63|2.61|{color:#FF0000}12%{color}-{color:#008000}16%{color}|
|PKLookup|93.60|2.29|94.17|2.98|{color:#FF0000}4%{color}-{color:#008000}6%{color}|
|Prefix3|590.01|46.44|593.55|45.92|{color:#FF0000}13%{color}-{color:#008000}17%{color}|
|MedSloppyPhrase|71.29|2.14|72.09|2.32|{color:#FF0000}4%{color}-{color:#008000}7%{color}|
|OrNotHighLow|809.35|41.50|824.71|52.64|{color:#FF0000}9%{color}-{color:#008000}14%{color}|
|MedSpanNear|164.18|8.81|167.48|5.37|{color:#FF0000}6%{color}-{color:#008000}11%{color}|
|HighSloppyPhrase|50.69|2.82|52.10|4.89|{color:#FF0000}11%{color}-{color:#008000}19%{color}|
|Fuzzy1|53.99|3.79|55.50|4.36|{color:#FF0000}11%{color}-{color:#008000}19%{color}|
|LowSpanNear|49.39|2.24|50.91|1.54|{color:#FF0000}4%{color}-{color:#008000}11%{color}|
|OrHighMed|237.07|9.39|245.09|7.45|{color:#FF0000}3%{color}-{color:#008000}10%{color}|
|HighSpanNear|50.02|3.13|51.90|2.96|{color:#FF0000}7%{color}-{color:#008000}16%{color}|
|LowPhrase|611.17|32.61|640.51|36.72|{color:#FF0000}6%{color}-{color:#008000}17%{color}|
|LowSloppyPhrase|135.74|3.89|142.56|6.75|{color:#FF0000}2%{color}-{color:#008000}13%{color}|
|HighIntervalsOrdered|60.29|3.88|63.70|2.32|{color:#FF0000}4%{color}-{color:#008000}17%{color}|
|OrNotHighMed|496.19|29.63|578.53|33.48|{color:#008000}3%{color}-{color:#008000}31%{color}|
|LowTerm|653.60|37.63|821.65|47.13|{color:#008000}12%{color}-{color:#008000}41%{color}|
|MedTerm|656.04|27.84|926.69|40.44|{color:#008000}29%{color}-{color:#008000}53%{color}|
|OrHighNotLow|399.76|23.22|566.34|40.56|{color:#008000}24%{color}-{color:#008000}61%{color}|
|OrNotHighHigh|340.65|17.44|528.36|24.66|{color:#008000}40%{color}-{color:#008000}71%{color}|
|OrHighNotMed|366.37|28.10|604.46|38.21|{color:#008000}43%{color}-{color:#008000}89%{color}|
|HighTerm|438.96|21.03|756.51|34.50|{color:#008000}56%{color}-{color:#008000}89%{color}|
|OrHighLow|340.01|22.05|631.66|31.12|{color:#008000}65%{color}-{color:#008000}108%{color}|
|HighPhrase|24.73|0.89|51.09|3.91|{color:#008000}84%{color}-{color:#008000}130%{color}|
|OrHighNotHigh|337.80|21.14|749.55|50.39|{color:#008000}94%{color}-{color:#008000}152%{color}|
Run with Wikimedium2m with concurrent search:
||Task ('HighSpanNear', None)||P50 Base 8.813157||P50 Cmp 8.123343||Pct Diff -7.82709306098||P90 Base 9.578886||P90 Cmp 10.519825||Pct Diff 9.82305249274||P99 Base 63.295942||P99 Cmp 12.879954||Pct Diff -79.6512168189||P999 Base 63.295942||P999 Cmp 12.879954||Pct Diff -79.6512168189||P100 Base 441.961583||P100 Cmp 398.916664||Pct Diff -9.7395159796||
||Task ('BrowseDayOfYearSSDVFacets', None)||P50 Base 25.520102||P50 Cmp 25.708815||Pct Diff 0.739468047581||P90 Base 31.369428||P90 Cmp 31.892711||Pct Diff 1.66813051229||P99 Base 47.191478||P99 Cmp 48.001516||Pct Diff 1.7164921175||P999 Base 47.191478||P999 Cmp 48.001516||Pct Diff 1.7164921175||P100 Base 199.751539||P100 Cmp 285.152603||Pct Diff 42.753645067||
||Task ('HighTermDayOfYearSort', 'DayOfYear')||P50 Base 9.256266||P50 Cmp 10.480745||Pct Diff 13.228649652||P90 Base 103.768693||P90 Cmp 54.062236||Pct Diff -47.9012075444||P99 Base 124.004027||P99 Cmp 100.174965||Pct Diff -19.216361417||P999 Base 124.004027||P999 Cmp 100.174965||Pct Diff -19.216361417||P100 Base 252.900443||P100 Cmp 270.168526||Pct Diff 6.82801611383||
||Task ('HighTerm', None)||P50 Base 2.011595||P50 Cmp 1.352258||Pct Diff -32.7768263492||P90 Base 2.912031||P90 Cmp 2.306147||Pct Diff -20.806234549||P99 Base 24.686838||P99 Cmp 28.123986||Pct Diff 13.922998158||P999 Base 24.686838||P999 Cmp 28.123986||Pct Diff 13.922998158||P100 Base 26.822225||P100 Cmp 31.580883||Pct Diff 17.7414737219||
||Task ('LowTerm', None)||P50 Base 1.178432||P50 Cmp 1.157976||Pct Diff -1.73586596426||P90 Base 41.586041||P90 Cmp 9.090624||Pct Diff -78.1402033437||P99 Base 49.374688||P99 Cmp 9.641412||Pct Diff -80.4729662292||P999 Base 49.374688||P999 Cmp 9.641412||Pct Diff -80.4729662292||P100 Base 107.195484||P100 Cmp 104.543067||Pct Diff -2.47437382717||
||Task ('AndHighLow', None)||P50 Base 1.175334||P50 Cmp 1.257495||Pct Diff 6.9904384626||P90 Base 2.445409||P90 Cmp 2.606558||Pct Diff 6.58985879254||P99 Base 4.324788||P99 Cmp 4.17237||Pct Diff -3.52428835818||P999 Base 4.324788||P999 Cmp 4.17237||Pct Diff -3.52428835818||P100 Base 7.812082||P100 Cmp 6.899342||Pct Diff -11.6836971245||
||Task ('MedTerm', None)||P50 Base 1.708915||P50 Cmp 1.266041||Pct Diff -25.915507793||P90 Base 3.175119||P90 Cmp 1.979174||Pct Diff -37.6661473161||P99 Base 3.182974||P99 Cmp 2.598911||Pct Diff -18.349600091||P999 Base 3.182974||P999 Cmp 2.598911||Pct Diff -18.349600091||P100 Base 7.557294||P100 Cmp 3.237533||Pct Diff -57.1601554736||
||Task ('Prefix3', None)||P50 Base 1.29982||P50 Cmp 1.337177||Pct Diff 2.87401332492||P90 Base 6.38432||P90 Cmp 6.367103||Pct Diff -0.269676332013||P99 Base 16.46575||P99 Cmp 35.422007||Pct Diff 115.125378437||P999 Base 16.46575||P999 Cmp 35.422007||Pct Diff 115.125378437||P100 Base 40.891181||P100 Cmp 43.82821||Pct Diff 7.18254872609||
||Task ('LowSloppyPhrase', None)||P50 Base 6.431493||P50 Cmp 5.369896||Pct Diff -16.50622958||P90 Base 13.292756||P90 Cmp 10.359546||Pct Diff -22.0662291552||P99 Base 14.74504||P99 Cmp 11.461787||Pct Diff -22.2668300662||P999 Base 14.74504||P999 Cmp 11.461787||Pct Diff -22.2668300662||P100 Base 72.746205||P100 Cmp 70.734906||Pct Diff -2.76481639145||
||Task ('Wildcard', None)||P50 Base 1.43662||P50 Cmp 1.398856||Pct Diff -2.62867007281||P90 Base 7.579543||P90 Cmp 7.291776||Pct Diff -3.79662731645||P99 Base 101.29012||P99 Cmp 92.121979||Pct Diff -9.05136749764||P999 Base 101.29012||P999 Cmp 92.121979||Pct Diff -9.05136749764||P100 Base 212.597658||P100 Cmp 213.29882||Pct Diff 0.329807019793||
||Task ('HighSloppyPhrase', None)||P50 Base 5.699683||P50 Cmp 6.198641||Pct Diff 8.75413597563||P90 Base 7.820096||P90 Cmp 7.52444||Pct Diff -3.78072085049||P99 Base 10.078942||P99 Cmp 7.993736||Pct Diff -20.6887389569||P999 Base 10.078942||P999 Cmp 7.993736||Pct Diff -20.6887389569||P100 Base 131.69683||P100 Cmp 69.521661||Pct Diff -47.210831878||
||Task ('HighIntervalsOrdered', None)||P50 Base 41.562004||P50 Cmp 44.43864||Pct Diff 6.92131207148||P90 Base 49.811002||P90 Cmp 51.517051||Pct Diff 3.42504453133||P99 Base 50.919986||P99 Cmp 51.783454||Pct Diff 1.69573495169||P999 Base 50.919986||P999 Cmp 51.783454||Pct Diff 1.69573495169||P100 Base 124.675493||P100 Cmp 124.867464||Pct Diff 0.153976531699||
||Task ('IntNRQ', None)||P50 Base 1.763593||P50 Cmp 1.84301||Pct Diff 4.50313649464||P90 Base 18.185218||P90 Cmp 17.796579||Pct Diff -2.13711488089||P99 Base 59.879538||P99 Cmp 58.382585||Pct Diff -2.49994079781||P999 Base 59.879538||P999 Cmp 58.382585||Pct Diff -2.49994079781||P100 Base 72.118167||P100 Cmp 71.901802||Pct Diff -0.300014558052||
||Task ('BrowseDayOfYearTaxoFacets', None)||P50 Base 0.132964||P50 Cmp 0.110594||Pct Diff -16.8241027647||P90 Base 0.176984||P90 Cmp 0.156555||Pct Diff -11.5428513312||P99 Base 0.186092||P99 Cmp 0.240541||Pct Diff 29.2591836296||P999 Base 0.186092||P999 Cmp 0.240541||Pct Diff 29.2591836296||P100 Base 1.234188||P100 Cmp 1.101133||Pct Diff -10.7807724593||
||Task ('BrowseMonthTaxoFacets', None)||P50 Base 0.120671||P50 Cmp 0.110937||Pct Diff -8.06656114559||P90 Base 0.181042||P90 Cmp 0.15327||Pct Diff -15.3400868307||P99 Base 13.585576||P99 Cmp 13.492223||Pct Diff -0.687147898624||P999 Base 13.585576||P999 Cmp 13.492223||Pct Diff -0.687147898624||P100 Base 17.780386||P100 Cmp 17.488324||Pct Diff -1.64260775891||
||Task ('HighTermMonthSort', 'Month')||P50 Base 7.876089||P50 Cmp 9.126057||Pct Diff 15.8704148722||P90 Base 10.061729||P90 Cmp 16.56249||Pct Diff 64.6087864223||P99 Base 11.327679||P99 Cmp 16.726095||Pct Diff 47.6568589205||P999 Base 11.327679||P999 Cmp 16.726095||Pct Diff 47.6568589205||P100 Base 14.626743||P100 Cmp 21.083184||Pct Diff 44.1413443854||
||Task Respell||P50 Base 12.666815||P50 Cmp 12.290712||Pct Diff -2.96919943964||P90 Base 127.719823||P90 Cmp 129.605893||Pct Diff 1.47672456452||P99 Base 172.140849||P99 Cmp 204.631585||Pct Diff 18.8745066547||P999 Base 172.140849||P999 Cmp 204.631585||Pct Diff 18.8745066547||P100 Base 267.965769||P100 Cmp 271.395418||Pct Diff 1.27988325255||
||Task ('HighPhrase', None)||P50 Base 3.955844||P50 Cmp 4.312118||Pct Diff 9.00627021692||P90 Base 11.932968||P90 Cmp 12.988844||Pct Diff 8.8483937944||P99 Base 57.869633||P99 Cmp 50.958381||Pct Diff -11.9427956282||P999 Base 57.869633||P999 Cmp 50.958381||Pct Diff -11.9427956282||P100 Base 159.308688||P100 Cmp 207.099636||Pct Diff 29.9989590022||
||Task ('MedPhrase', None)||P50 Base 1.509789||P50 Cmp 1.401743||Pct Diff -7.15636423368||P90 Base 3.99065||P90 Cmp 7.959375||Pct Diff 99.4505907559||P99 Base 10.255495||P99 Cmp 9.685884||Pct Diff -5.55420289318||P999 Base 10.255495||P999 Cmp 9.685884||Pct Diff -5.55420289318||P100 Base 35.104429||P100 Cmp 19.761119||Pct Diff -43.7076187737||
||Task ('LowPhrase', None)||P50 Base 2.034111||P50 Cmp 1.797256||Pct Diff -11.644153146||P90 Base 5.164741||P90 Cmp 6.12666||Pct Diff 18.6247287134||P99 Base 6.134577||P99 Cmp 7.785578||Pct Diff 26.9130373618||P999 Base 6.134577||P999 Cmp 7.785578||Pct Diff 26.9130373618||P100 Base 119.704217||P100 Cmp 73.071102||Pct Diff -38.9569525358||
||Task ('MedSpanNear', None)||P50 Base 1.624244||P50 Cmp 1.599929||Pct Diff -1.4970041447||P90 Base 3.135791||P90 Cmp 6.816385||Pct Diff 117.37370252||P99 Base 14.787226||P99 Cmp 15.847319||Pct Diff 7.1689781437||P999 Base 14.787226||P999 Cmp 15.847319||Pct Diff 7.1689781437||P100 Base 58.513403||P100 Cmp 42.06028||Pct Diff -28.118554308||
||Task ('Fuzzy2', None)||P50 Base 24.42392||P50 Cmp 21.670018||Pct Diff -11.2754299883||P90 Base 119.884834||P90 Cmp 104.942901||Pct Diff -12.4635723314||P99 Base 243.400751||P99 Cmp 105.750276||Pct Diff -56.5530198385||P999 Base 243.400751||P999 Cmp 105.750276||Pct Diff -56.5530198385||P100 Base 778.583117||P100 Cmp 834.553161||Pct Diff 7.18870506924||
||Task ('AndHighMed', None)||P50 Base 1.358098||P50 Cmp 1.339465||Pct Diff -1.371992301||P90 Base 5.609091||P90 Cmp 6.249786||Pct Diff 11.4224390369||P99 Base 11.319551||P99 Cmp 12.125497||Pct Diff 7.11994671873||P999 Base 11.319551||P999 Cmp 12.125497||Pct Diff 7.11994671873||P100 Base 18.877632||P100 Cmp 19.212408||Pct Diff 1.77340039259||
||Task ('AndHighHigh', None)||P50 Base 2.184449||P50 Cmp 1.821678||Pct Diff -16.606979609||P90 Base 11.381647||P90 Cmp 14.089114||Pct Diff 23.7880071311||P99 Base 16.217725||P99 Cmp 24.813664||Pct Diff 53.0033589791||P999 Base 16.217725||P999 Cmp 24.813664||Pct Diff 53.0033589791||P100 Base 78.350548||P100 Cmp 69.636808||Pct Diff -11.121479329||
||Task ('MedSloppyPhrase', None)||P50 Base 3.976319||P50 Cmp 3.840908||Pct Diff -3.40543603267||P90 Base 11.635151||P90 Cmp 5.471669||Pct Diff -52.9729437976||P99 Base 40.329324||P99 Cmp 12.591182||Pct Diff -68.7790898751||P999 Base 40.329324||P999 Cmp 12.591182||Pct Diff -68.7790898751||P100 Base 53.395788||P100 Cmp 77.379705||Pct Diff 44.917245158||
||Task ('BrowseMonthSSDVFacets', None)||P50 Base 23.655945||P50 Cmp 23.594373||Pct Diff -0.26028129504||P90 Base 24.654877||P90 Cmp 27.782082||Pct Diff 12.6839205079||P99 Base 42.1597||P99 Cmp 45.571178||Pct Diff 8.09179856593||P999 Base 42.1597||P999 Cmp 45.571178||Pct Diff 8.09179856593||P100 Base 81.179751||P100 Cmp 79.151185||Pct Diff -2.49885713495||
||Task ('LowSpanNear', None)||P50 Base 1.635838||P50 Cmp 1.583422||Pct Diff -3.20422926965||P90 Base 2.22724||P90 Cmp 1.915652||Pct Diff -13.9898708716||P99 Base 2.430474||P99 Cmp 2.915627||Pct Diff 19.9612503569||P999 Base 2.430474||P999 Cmp 2.915627||Pct Diff 19.9612503569||P100 Base 5.30635||P100 Cmp 5.950495||Pct Diff 12.1391351871||
||Task ('OrHighLow', None)||P50 Base 2.460173||P50 Cmp 1.580869||Pct Diff -35.7415515088||P90 Base 4.157541||P90 Cmp 6.689259||Pct Diff 60.8946009191||P99 Base 4.210433||P99 Cmp 7.051428||Pct Diff 67.4751266675||P999 Base 4.210433||P999 Cmp 7.051428||Pct Diff 67.4751266675||P100 Base 35.64555||P100 Cmp 35.677192||Pct Diff 0.0887684437468||
||Task PKLookup||P50 Base 8.758861||P50 Cmp 8.963258||Pct Diff 2.33360250836||P90 Base 72.762364||P90 Cmp 11.850024||Pct Diff -83.7140750402||P99 Base 249.586286||P99 Cmp 55.412309||Pct Diff -77.7983358429||P999 Base 249.586286||P999 Cmp 55.412309||Pct Diff -77.7983358429||P100 Base 289.773601||P100 Cmp 239.77105||Pct Diff -17.2557302761||
||Task ('OrHighHigh', None)||P50 Base 4.311043||P50 Cmp 5.657138||Pct Diff 31.2243464053||P90 Base 12.038243||P90 Cmp 32.801629||Pct Diff 172.478541927||P99 Base 29.549851||P99 Cmp 49.223917||Pct Diff 66.5792392659||P999 Base 29.549851||P999 Cmp 49.223917||Pct Diff 66.5792392659||P100 Base 114.887852||P100 Cmp 163.752464||Pct Diff 42.5324445965||
||Task ('Fuzzy1', None)||P50 Base 12.119345||P50 Cmp 11.915585||Pct Diff -1.68127898001||P90 Base 32.879032||P90 Cmp 74.053052||Pct Diff 125.228808439||P99 Base 64.835785||P99 Cmp 76.170727||Pct Diff 17.4825399276||P999 Base 64.835785||P999 Cmp 76.170727||Pct Diff 17.4825399276||P100 Base 67.30084||P100 Cmp 193.730038||Pct Diff 187.856790495||
||Task ('BrowseDateTaxoFacets', None)||P50 Base 81.977097||P50 Cmp 83.168023||Pct Diff 1.45275454192||P90 Base 85.492791||P90 Cmp 86.264531||Pct Diff 0.902695994566||P99 Base 86.187931||P99 Cmp 86.302465||Pct Diff 0.132888675562||P999 Base 86.187931||P999 Cmp 86.302465||Pct Diff 0.132888675562||P100 Base 199.23214||P100 Cmp 203.608695||Pct Diff 2.19671133382||
||Task ('OrHighMed', None)||P50 Base 2.317957||P50 Cmp 2.296451||Pct Diff -0.927799782308||P90 Base 4.418174||P90 Cmp 9.962049||Pct Diff 125.478874304||P99 Base 8.427864||P99 Cmp 36.240266||Pct Diff 330.005348924||P999 Base 8.427864||P999 Cmp 36.240266||Pct Diff 330.005348924||P100 Base 356.200849||P100 Cmp 379.720121||Pct Diff 6.60281188718||
QPS:
||Task||QPS baseline||StdDev baseline||QPS my_modified_version||StdDev my_modified_version||Pct diff||
|IntNRQ|634.20|49.89|610.28|73.85|{color:#FF0000}21%{color}-{color:#008000}17%{color}|
|Fuzzy1|93.02|7.45|91.55|6.72|{color:#FF0000}15%{color}-{color:#008000}14%{color}|
|OrHighHigh|210.69|18.83|208.57|19.23|{color:#FF0000}17%{color}-{color:#008000}18%{color}|
|BrowseMonthTaxoFacets|8914.10|553.44|8831.09|599.95|{color:#FF0000}13%{color}-{color:#008000}12%{color}|
|HighTermMonthSort|122.28|7.07|121.27|7.54|{color:#FF0000}12%{color}-{color:#008000}11%{color}|
|HighTermDayOfYearSort|114.44|9.44|113.96|9.31|{color:#FF0000}15%{color}-{color:#008000}17%{color}|
|Wildcard|725.01|24.53|723.07|37.36|{color:#FF0000}8%{color}-{color:#008000}8%{color}|
|MedSloppyPhrase|266.76|13.46|266.24|12.45|{color:#FF0000}9%{color}-{color:#008000}10%{color}|
|BrowseDayOfYearSSDVFacets|39.12|0.33|39.07|0.34|{color:#FF0000}1%{color}-{color:#008000}1%{color}|
|LowSpanNear|630.75|19.80|630.39|18.96|{color:#FF0000}6%{color}-{color:#008000}6%{color}|
|BrowseMonthSSDVFacets|43.17|0.54|43.15|0.54|{color:#FF0000}2%{color}-{color:#008000}2%{color}|
|PKLookup|120.74|4.80|120.71|3.86|{color:#FF0000}6%{color}-{color:#008000}7%{color}|
|HighIntervalsOrdered|25.98|2.82|26.01|2.64|{color:#FF0000}18%{color}-{color:#008000}23%{color}|
|HighPhrase|273.22|11.19|273.52|14.59|{color:#FF0000}8%{color}-{color:#008000}9%{color}|
|Respell|82.32|2.83|82.82|2.22|{color:#FF0000}5%{color}-{color:#008000}6%{color}|
|Prefix3|755.12|31.75|759.80|20.51|{color:#FF0000}6%{color}-{color:#008000}7%{color}|
|MedSpanNear|671.02|25.27|676.06|27.56|{color:#FF0000}6%{color}-{color:#008000}8%{color}|
|HighSpanNear|118.46|4.26|119.38|5.62|{color:#FF0000}7%{color}-{color:#008000}9%{color}|
|LowSloppyPhrase|185.47|16.48|187.08|12.79|{color:#FF0000}13%{color}-{color:#008000}18%{color}|
|BrowseDayOfYearTaxoFacets|8713.10|644.34|8794.23|487.72|{color:#FF0000}11%{color}-{color:#008000}15%{color}|
|HighSloppyPhrase|177.33|11.39|179.01|13.07|{color:#FF0000}12%{color}-{color:#008000}15%{color}|
|BrowseDateTaxoFacets|11.77|0.47|11.90|0.46|{color:#FF0000}6%{color}-{color:#008000}9%{color}|
|AndHighMed|739.72|20.80|749.20|23.26|{color:#FF0000}4%{color}-{color:#008000}7%{color}|
|AndHighLow|838.36|31.47|855.47|38.50|{color:#FF0000}6%{color}-{color:#008000}10%{color}|
|MedPhrase|693.35|23.65|708.94|18.07|{color:#FF0000}3%{color}-{color:#008000}8%{color}|
|Fuzzy2|46.43|4.15|48.16|3.66|{color:#FF0000}12%{color}-{color:#008000}22%{color}|
|LowPhrase|519.19|17.80|551.91|17.50|{color:#008000}0%{color}-{color:#008000}13%{color}|
|OrHighMed|446.15|24.14|476.92|29.44|{color:#FF0000}4%{color}-{color:#008000}19%{color}|
|LowTerm|902.82|47.70|1015.81|66.84|{color:#008000}0%{color}-{color:#008000}26%{color}|
|AndHighHigh|496.25|15.46|574.08|20.11|{color:#008000}8%{color}-{color:#008000}23%{color}|
|MedTerm|584.69|40.68|842.87|54.96|{color:#008000}25%{color}-{color:#008000}65%{color}|
|HighTerm|515.25|34.37|775.63|44.06|{color:#008000}33%{color}-{color:#008000}70%{color}|
|OrHighLow|388.97|27.41|688.27|37.64|{color:#008000}56%{color}-{color:#008000}100%{color}|
> "Max Bottom" Based Early Termination For Concurrent Search
> ----------------------------------------------------------
>
> Key: LUCENE-8978
> URL: https://issues.apache.org/jira/browse/LUCENE-8978
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Atri Sharma
> Assignee: Atri Sharma
> Priority: Major
> Time Spent: 5h 50m
> Remaining Estimate: 0h
>
> When running a search concurrently, collectors which have collected the number of hits requested locally i.e. their local priority queue is full can then globally publish their bottom hit's score, and other collectors can then use that score as the filter. If multiple collectors have full priority queues, the maximum of all bottom scores will be considered as the global bottom score.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org