You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Adrien Grand <jp...@gmail.com> on 2019/05/10 09:14:42 UTC
Re: significant lucene benchmark regression: JDK11?
The Russia polygon seems to be something else? It slowed down on April
12th and then a bit more on April 20th while you only switched to
OpenJDK11 on April 23th?
However some other slowdowns seem to happen at the same time as the
switch to OpenJDK 11 and haven't been addressed by the change of
garbage collector such as sorting tasks ( see e.g.
https://home.apache.org/~mikemccand/lucenebench/TermDTSort.html).
On Tue, Apr 30, 2019 at 3:30 PM Michael McCandless
<lu...@mikemccandless.com> wrote:
>
> Hi Team,
>
> OK I fixed nightly bench to specify ParallelGC for everything, and indeed that recovered many of the losses -- G1 sure is costly. I added annotations to the charts too.
>
> But some things still have losses, e.g. Russia Polygon filter is looking bad: https://home.apache.org/~mikemccand/geobench.html#search-polyRussia
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Mon, Apr 29, 2019 at 1:48 PM Michael McCandless <lu...@mikemccandless.com> wrote:
>>
>> OK I'll make this change soon and reply back.
>>
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
>>
>> On Fri, Apr 26, 2019 at 10:17 AM David Smiley <da...@gmail.com> wrote:
>>>
>>> +1 to choose the Parallel Collector temporarily as Uwe suggests so we can see distinct effects of the separate changes.
>>>
>>> I suppose the benchmarks should continue to prefer the default JVM settings, as it is how users will consume Lucene.
>>>
>>> ~ David Smiley
>>> Apache Lucene/Solr Search Developer
>>> http://www.linkedin.com/in/davidwsmiley
>>>
>>>
>>> On Thu, Apr 25, 2019 at 6:03 PM Uwe Schindler <uw...@thetaphi.de> wrote:
>>>>
>>>> Maybe do this temporary, to not have 2 changes at the same time.
>>>>
>>>> Uwe
>>>>
>>>> Am April 25, 2019 9:48:35 PM UTC schrieb Michael McCandless <lu...@mikemccandless.com>:
>>>>>
>>>>> Yeah I'm just using the JDK's default in the nightly benchmarks.
>>>>>
>>>>> Should I override back to the parallel collector?
>>>>>
>>>>> Mike McCandless
>>>>>
>>>>> http://blog.mikemccandless.com
>>>>>
>>>>>
>>>>> On Thu, Apr 25, 2019 at 5:44 PM Uwe Schindler <uw...@thetaphi.de> wrote:
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I am not sure how Mike's benchmarks are setup and if he chooses a specific garbage collector.
>>>>>>
>>>>>> Java 8 defaults to ParallelGC, Java 11 defaults to G1, which may slow down up to 10% as it is not optimized for throughput.
>>>>>>
>>>>>> So to compare you gave to be specific in your GC choices.
>>>>>>
>>>>>> Uwe
>>>>>>
>>>>>> Am April 25, 2019 5:57:16 PM UTC schrieb Nicholas Knize <nk...@gmail.com>:
>>>>>>>
>>>>>>> Earlier this week I noticed a significant across the board performance regression on the nightly geo benchmarks. It appears this regression can also be seen on other lucene benchmarks and appears to correspond to the upgrade to JDK 11.
>>>>>>>
>>>>>>> Any thoughts?
>>>>>>>
>>>>>>> Nicholas Knize, Ph.D., GISP
>>>>>>> Geospatial Software Guy | Elasticsearch
>>>>>>> Apache Lucene PMC Member and Committer
>>>>>>> nknize@apache.org
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Uwe Schindler
>>>>>> Achterdiek 19, 28357 Bremen
>>>>>> https://www.thetaphi.de
>>>>
>>>>
>>>> --
>>>> Uwe Schindler
>>>> Achterdiek 19, 28357 Bremen
>>>> https://www.thetaphi.de
--
Adrien
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: significant lucene benchmark regression: JDK11?
Posted by Michael McCandless <lu...@mikemccandless.com>.
Yeah there are definitely more slowdowns still happening besides the GC
issue!
Mike McCandless
http://blog.mikemccandless.com
On Fri, May 10, 2019 at 2:15 AM Adrien Grand <jp...@gmail.com> wrote:
> The Russia polygon seems to be something else? It slowed down on April
> 12th and then a bit more on April 20th while you only switched to
> OpenJDK11 on April 23th?
>
> However some other slowdowns seem to happen at the same time as the
> switch to OpenJDK 11 and haven't been addressed by the change of
> garbage collector such as sorting tasks ( see e.g.
> https://home.apache.org/~mikemccand/lucenebench/TermDTSort.html).
>
> On Tue, Apr 30, 2019 at 3:30 PM Michael McCandless
> <lu...@mikemccandless.com> wrote:
> >
> > Hi Team,
> >
> > OK I fixed nightly bench to specify ParallelGC for everything, and
> indeed that recovered many of the losses -- G1 sure is costly. I added
> annotations to the charts too.
> >
> > But some things still have losses, e.g. Russia Polygon filter is looking
> bad: https://home.apache.org/~mikemccand/geobench.html#search-polyRussia
> >
> > Mike McCandless
> >
> > http://blog.mikemccandless.com
> >
> >
> > On Mon, Apr 29, 2019 at 1:48 PM Michael McCandless <
> lucene@mikemccandless.com> wrote:
> >>
> >> OK I'll make this change soon and reply back.
> >>
> >> Mike McCandless
> >>
> >> http://blog.mikemccandless.com
> >>
> >>
> >> On Fri, Apr 26, 2019 at 10:17 AM David Smiley <da...@gmail.com>
> wrote:
> >>>
> >>> +1 to choose the Parallel Collector temporarily as Uwe suggests so we
> can see distinct effects of the separate changes.
> >>>
> >>> I suppose the benchmarks should continue to prefer the default JVM
> settings, as it is how users will consume Lucene.
> >>>
> >>> ~ David Smiley
> >>> Apache Lucene/Solr Search Developer
> >>> http://www.linkedin.com/in/davidwsmiley
> >>>
> >>>
> >>> On Thu, Apr 25, 2019 at 6:03 PM Uwe Schindler <uw...@thetaphi.de> wrote:
> >>>>
> >>>> Maybe do this temporary, to not have 2 changes at the same time.
> >>>>
> >>>> Uwe
> >>>>
> >>>> Am April 25, 2019 9:48:35 PM UTC schrieb Michael McCandless <
> lucene@mikemccandless.com>:
> >>>>>
> >>>>> Yeah I'm just using the JDK's default in the nightly benchmarks.
> >>>>>
> >>>>> Should I override back to the parallel collector?
> >>>>>
> >>>>> Mike McCandless
> >>>>>
> >>>>> http://blog.mikemccandless.com
> >>>>>
> >>>>>
> >>>>> On Thu, Apr 25, 2019 at 5:44 PM Uwe Schindler <uw...@thetaphi.de>
> wrote:
> >>>>>>
> >>>>>> Hi,
> >>>>>>
> >>>>>> I am not sure how Mike's benchmarks are setup and if he chooses a
> specific garbage collector.
> >>>>>>
> >>>>>> Java 8 defaults to ParallelGC, Java 11 defaults to G1, which may
> slow down up to 10% as it is not optimized for throughput.
> >>>>>>
> >>>>>> So to compare you gave to be specific in your GC choices.
> >>>>>>
> >>>>>> Uwe
> >>>>>>
> >>>>>> Am April 25, 2019 5:57:16 PM UTC schrieb Nicholas Knize <
> nknize@gmail.com>:
> >>>>>>>
> >>>>>>> Earlier this week I noticed a significant across the board
> performance regression on the nightly geo benchmarks. It appears this
> regression can also be seen on other lucene benchmarks and appears to
> correspond to the upgrade to JDK 11.
> >>>>>>>
> >>>>>>> Any thoughts?
> >>>>>>>
> >>>>>>> Nicholas Knize, Ph.D., GISP
> >>>>>>> Geospatial Software Guy | Elasticsearch
> >>>>>>> Apache Lucene PMC Member and Committer
> >>>>>>> nknize@apache.org
> >>>>>>
> >>>>>>
> >>>>>> --
> >>>>>> Uwe Schindler
> >>>>>> Achterdiek 19, 28357 Bremen
> >>>>>> https://www.thetaphi.de
> >>>>
> >>>>
> >>>> --
> >>>> Uwe Schindler
> >>>> Achterdiek 19, 28357 Bremen
> >>>> https://www.thetaphi.de
>
>
>
> --
> Adrien
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>