You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by GitBox <gi...@apache.org> on 2020/06/02 12:45:12 UTC

[GitHub] [lucene-solr] jpountz commented on pull request #1543: LUCENE-9378: Disable compression on binary values whose length is less than 32.

jpountz commented on pull request #1543:
URL: https://github.com/apache/lucene-solr/pull/1543#issuecomment-637517914


   Here are updated results where the baseline is master with Mark's commit that enabled compression of binary doc values is reverted, and the patch is this pull request. The bottleneck is now reading the lengths of all values in a given block.
   
   ```
                       TaskQPS baseline      StdDev   QPS patch      StdDev                Pct diff
       HighTermTitleBDVSort       28.91      (2.7%)       15.31      (7.4%)  -47.0% ( -55% -  -37%)
           HighSloppyPhrase        6.45      (7.6%)        6.35      (9.1%)   -1.6% ( -16% -   16%)
               OrHighNotLow     1260.60      (3.7%)     1243.30      (3.5%)   -1.4% (  -8% -    6%)
            MedSloppyPhrase       34.45      (4.5%)       34.07      (5.4%)   -1.1% ( -10% -    9%)
      HighTermDayOfYearSort       28.14      (8.4%)       27.84      (9.6%)   -1.1% ( -17% -   18%)
      BrowseMonthSSDVFacets       16.96     (11.7%)       16.81     (11.9%)   -0.9% ( -21% -   25%)
       HighIntervalsOrdered       28.80      (2.7%)       28.55      (2.6%)   -0.8% (  -6% -    4%)
                    Prefix3      100.23     (10.4%)       99.45      (9.4%)   -0.8% ( -18% -   21%)
   BrowseDayOfYearSSDVFacets       15.44      (8.3%)       15.34      (9.6%)   -0.6% ( -17% -   18%)
              OrHighNotHigh     1306.26      (2.5%)     1299.19      (1.9%)   -0.5% (  -4% -    4%)
              OrNotHighHigh     1389.86      (2.4%)     1382.43      (2.5%)   -0.5% (  -5% -    4%)
                 AndHighLow      843.27      (3.3%)      839.05      (3.3%)   -0.5% (  -6% -    6%)
            LowSloppyPhrase      151.10      (3.7%)      150.35      (4.0%)   -0.5% (  -7% -    7%)
               OrHighNotMed     1336.61      (4.0%)     1331.42      (2.4%)   -0.4% (  -6% -    6%)
                  MedPhrase      244.05      (2.4%)      243.17      (2.0%)   -0.4% (  -4% -    4%)
                    MedTerm     3342.61      (4.1%)     3332.82      (3.9%)   -0.3% (  -7% -    8%)
                    LowTerm     2724.03      (4.5%)     2719.60      (4.6%)   -0.2% (  -8% -    9%)
               HighSpanNear       20.82      (4.0%)       20.79      (3.7%)   -0.2% (  -7% -    7%)
               OrNotHighMed     1638.22      (3.8%)     1637.84      (2.8%)   -0.0% (  -6% -    6%)
                     IntNRQ      193.31      (1.4%)      193.40      (1.4%)    0.0% (  -2% -    2%)
                    Respell      224.18      (2.2%)      224.43      (2.7%)    0.1% (  -4% -    5%)
                 AndHighMed      334.41      (3.7%)      334.91      (3.0%)    0.2% (  -6% -    7%)
                LowSpanNear      184.23      (3.8%)      184.53      (3.3%)    0.2% (  -6% -    7%)
          HighTermMonthSort       76.33      (7.7%)       76.48      (8.5%)    0.2% ( -14% -   17%)
                  OrHighLow      765.34      (3.5%)      767.25      (2.9%)    0.2% (  -5% -    6%)
                   HighTerm     2321.04      (4.8%)     2327.02      (3.9%)    0.3% (  -8% -    9%)
                 HighPhrase      198.93      (3.2%)      199.50      (2.1%)    0.3% (  -4% -    5%)
                 OrHighHigh       42.13      (5.8%)       42.26      (5.3%)    0.3% ( -10% -   12%)
                AndHighHigh       95.83      (3.2%)       96.18      (3.2%)    0.4% (  -5% -    6%)
                MedSpanNear       44.19      (4.1%)       44.37      (4.0%)    0.4% (  -7% -    8%)
                     Fuzzy1      222.24      (7.0%)      223.30      (7.1%)    0.5% ( -12% -   15%)
                  OrHighMed       93.32      (4.4%)       93.80      (4.3%)    0.5% (  -7% -    9%)
                  LowPhrase       27.51      (3.5%)       27.68      (2.4%)    0.6% (  -5% -    6%)
               OrNotHighLow     1277.07      (3.6%)     1285.51      (3.4%)    0.7% (  -6% -    7%)
                   PKLookup      244.71      (4.6%)      246.90      (4.6%)    0.9% (  -7% -   10%)
                     Fuzzy2      120.37      (6.5%)      122.37      (6.3%)    1.7% ( -10% -   15%)
                   Wildcard      486.28     (21.6%)      505.80     (23.1%)    4.0% ( -33% -   62%)
   BrowseDayOfYearTaxoFacets        3.62      (2.6%)        6.52     (19.4%)   80.4% (  56% -  105%)
       BrowseDateTaxoFacets        3.62      (2.8%)        6.56     (19.6%)   81.3% (  57% -  106%)
      BrowseMonthTaxoFacets        3.89      (3.1%)        7.74     (16.8%)   99.2% (  76% -  122%)
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org