You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Bruno Roustant <br...@gmail.com> on 2020/07/02 10:29:13 UTC

Re: 8.6 release

Here are the draft release notes.
I tried to keep them concise, but please tell me if I miss something
important.

Solr 8.6.0 Release Highlights:

   - Health Check:
   HealthCheckHandler can now require that all cores are healthy before
   returning OK.
   - Zookeeper read API:
   A read API at /api/cluster/zk/* to fetch raw ZK data and view contents
   of a ZK directory.
   - Admin UI:
   New panel with security info in admin UI's dashboard.
   - Streaming Expression:
   Percentiles and standard deviation aggregations added to stats, facet
   and time series.
   Streaming expressions added to /export handler.
   Drill Streaming Expression for efficient and accurate high cardinality
   aggregation.
   - Cross-Collection Join Queries:
   Join queries can now work cross-collection, even when shared or when
   spanning nodes.

Lucene 8.6.0 Release Highlights:

   - API change in:
   SimpleFSDireectory, IndexWriterConfig, MergeScheduler, SortFields,
   SimpleBindings, QueryVisitor, DocValues, CodecUtil.
   - New:
   IndexWriter merge-on-commit feature to selectively merge small segments
   on commit, subject to a configurable timeout, to improve search performance
   by reducing the number of small segments for searching.
   Grouping by range based on DoubleValueSource and LongValueSource.
   - Optimizations:
   BKD trees and index, DoubleValuesSource/QueryValueSource,
   UsageTrackingQueryingCachingPolicy, FST, Geometry queries,
   Points, UniformSplit
   - Others:
   Ukrainian analyzer, checksums verification, resource leaks fixes




Le mar. 30 juin 2020 à 19:38, Bruno Roustant <br...@gmail.com> a
écrit :

> Erick:
> AFAIK yes from now on a commit in branch_8x will not go to 8.6 branch.
>
> Le mar. 30 juin 2020 à 17:59, Erick Erickson <er...@gmail.com> a
> écrit :
>
>> Bruno:
>>
>> Just to double check, anything committed to branch_8x from here on won’t
>> affect the 8.6 release unless explicitly backported, correct?
>>
>> I may be close to upgrading Zookeeper to 3.6.1, and very much do NOT want
>> it in the 8.6 release as it should bake longer than 2 weeks even…
>>
>> Thanks for managing this release!
>>
>> Erick
>>
>> > On Jun 30, 2020, at 11:34 AM, Bruno Roustant <br...@gmail.com>
>> wrote:
>> >
>> > For the RC, I prefer to let the latest and greatest commits to bake a
>> week rather than only 2 days. Some of them have important impact and were
>> added very recently.
>> > So I plan a RC on July 7, if the smoke tester is fixed before that time.
>> >
>> > Bruno
>> >
>> > Le mar. 30 juin 2020 à 16:48, Uwe Schindler <uw...@thetaphi.de> a écrit :
>> > Hi,
>> >
>> >
>> >
>> > I enabled builds for 8.6 on Policeman Jenkins:
>> >
>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/
>> >
>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/
>> >
>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/
>> >
>> >
>> >
>> > Uwe
>> >
>> >
>> >
>> > -----
>> >
>> > Uwe Schindler
>> >
>> > Achterdiek 19, D-28357 Bremen
>> >
>> > https://www.thetaphi.de
>> >
>> > eMail: uwe@thetaphi.de
>> >
>> >
>> >
>> > From: Bruno Roustant <br...@gmail.com>
>> > Sent: Tuesday, June 30, 2020 3:02 PM
>> > To: dev@lucene.apache.org
>> > Subject: Re: 8.6 release
>> >
>> >
>> >
>> > [new branch]      0a1f68fafd6711304bbd7372567a359bcf36aab4 -> branch_8_6
>> >
>> >
>> > Le mar. 30 juin 2020 à 14:59, Bruno Roustant <br...@gmail.com>
>> a écrit :
>> >
>> > I'm creating the branch_8_6 with the release wizard.
>> >
>> >
>> >
>> > Le mar. 30 juin 2020 à 12:37, Ishan Chattopadhyaya <
>> ichattopadhyaya@gmail.com> a écrit :
>> >
>> > This is done and merged. Thanks.
>> >
>> >
>> >
>> > On Tue, Jun 30, 2020 at 11:52 AM Ishan Chattopadhyaya <
>> ichattopadhyaya@gmail.com> wrote:
>> >
>> > Hi Bruno,
>> >
>> > I'd like to get SOLR-14599 in. It is for the package manager CLI
>> support for cluster level (core container) level plugins. I think it is
>> important to have this in 8.6 for two reasons:
>> >
>> >
>> >
>> > (a) it will unblock Marcus Eagan/Ke Zhenxu who are working on a new
>> Solr UI package and would like to have their package released for early
>> feedback
>> >
>> > (b) Earlier we can release this, more feedback we can get before this
>> is released in 9.0.
>> >
>> > (c) This is an isolated change to the CLI for the package manager
>> (experimental), so very low risk to stability of the release.
>> >
>> >
>> >
>> > I should be done with this issue by eod today. In case you have no
>> objection, I would like to merge this issue after you cut the branch today
>> (and before you spin the RC).
>> >
>> >
>> >
>> > Regards,
>> >
>> > Ishan
>> >
>> >
>> >
>> > On Tue, Jun 30, 2020 at 6:20 AM Joel Bernstein <jo...@gmail.com>
>> wrote:
>> >
>> > Hi Bruno,
>> >
>> >
>> >
>> > Andrzej and I decided that SOLR-14537 is headed to master to bake for a
>> while and won't make it into the 8.6 release. So please feel free to cut
>> the branch when ready.
>> >
>> >
>> >
>> >
>> >
>> > Joel Bernstein
>> >
>> > http://joelsolr.blogspot.com/
>> >
>> >
>> >
>> >
>> >
>> > On Mon, Jun 29, 2020 at 6:13 AM Andrzej Białecki <ab...@getopt.org> wrote:
>> >
>> > I wold like to include SOLR-14537 in 8.6 (it’s already tagged), the
>> patch is ready and I’m just waiting for Joel to finish performance testing.
>> >
>> >
>> >
>> >
>> > On 27 Jun 2020, at 04:59, Tomás Fernández Löbbe <to...@gmail.com>
>> wrote:
>> >
>> >
>> >
>> > I tagged SOLR-14590 for 8.6, The PR is ready for review and I plan to
>> merge it soon
>> >
>> >
>> >
>> > On Fri, Jun 26, 2020 at 12:54 PM Andrzej Białecki <ab...@getopt.org>
>> wrote:
>> >
>> > Jan,
>> >
>> >
>> >
>> > I just removed SOLR-14182 from 8.6, this needs proper back-compat shims
>> and testing, and I don’t have enough time to get it done properly for 8.6.
>> >
>> >
>> >
>> >
>> > On 26 Jun 2020, at 13:37, Jan Høydahl <ja...@cominvent.com> wrote:
>> >
>> >
>> >
>> > Unresolved Solr issues tagged with 8.6:
>> >
>> >
>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6
>> >
>> >
>> >
>> > SOLR-14593   Package store API to disable file upload over HTTP
>>           Blocker
>> >
>> > SOLR-14580   CloudSolrClient cannot be initialized using 'zkHosts'
>> builder       Blocker
>> >
>> > SOLR-14516   NPE during Realtime GET
>>          Major
>> >
>> > SOLR-14502   increase bin/solr's post kill sleep
>>          Minor
>> >
>> > SOLR-14398   package store PUT should be idempotent
>>           Trivial
>> >
>> > SOLR-14311   Shared schema should not have access to core level
>> classes          Major
>> >
>> > SOLR-14182   Move metric reporters config from solr.xml to ZK cluster
>> properties Major
>> >
>> > SOLR-14066   Deprecate DIH
>>          Blocker
>> >
>> > SOLR-14022   Deprecate CDCR from Solr in 8.x
>>          Blocker
>> >
>> >
>> >
>> > Plus two private JIRA issues.
>> >
>> >
>> >
>> > Jan
>> >
>> >
>> >
>> > 26. jun. 2020 kl. 12:06 skrev Bruno Roustant <bruno.roustant@gmail.com
>> >:
>> >
>> >
>> >
>> > So the plan is to cut the release branch on next Tuesday June 30th. If
>> you anticipate a problem with the date, please reply.
>> >
>> >
>> >
>> > Is there any JIRA issue that must be committed before the release is
>> made and that has not already the appropriate "Fix Version"?
>> >
>> >
>> >
>> > Currently there 3 unresolved issues flagged as Fix Version = 8.6:
>> >
>> > Add tests for corruptions caused by byte flips LUCENE-9356
>> >
>> > Fix linefiledocs compression or replace in tests LUCENE-9191
>> >
>> > Can we merge small segments during refresh, for faster searching?
>> LUCENE-8962
>> >
>> >
>> >
>> >
>> >
>> > Le mer. 24 juin 2020 à 21:05, David Smiley <da...@gmail.com>
>> a écrit :
>> >
>> > Thanks starting this discussion, Cassandra.
>> >
>> >
>> >
>> > I reviewed the issues I was involved with and I don't quite see
>> something worth noting.
>> >
>> >
>> >
>> > I plan to add a note about a change in defaults within
>> UnifiedHighlighter that could be a significant perf regression.  This
>> wasn't introduced in 8.6 but introduced in 8.5 and it's significant enough
>> to bring attention to.  I could add it in 8.5's section but then add a
>> short pointer to it in 8.6.
>> >
>> >
>> >
>> > ~ David
>> >
>> >
>> >
>> >
>> >
>> > On Wed, Jun 24, 2020 at 2:52 PM Cassandra Targett <
>> casstargett@gmail.com> wrote:
>> >
>> > I started looking at the Ref Guide for 8.6 to get it ready, and notice
>> there are no Upgrade Notes in `solr-upgrade-notes.adoc` for 8.6. Is it
>> really true that none are needed at all?
>> >
>> > I’ll add what I usually do about new features/changes that maybe
>> wouldn’t normally make the old Upgrade Notes section, I just find it
>> surprising that there weren’t any devs who thought any of the 100 or so
>> Solr changes warrant any user caveats.
>> >
>> > On Jun 17, 2020, 12:27 PM -0500, Tomás Fernández Löbbe <
>> tomasflobbe@gmail.com>, wrote:
>> >
>> >
>> > +1. Thanks Bruno
>> >
>> >
>> >
>> > On Wed, Jun 17, 2020 at 6:22 AM Mike Drob <md...@apache.org> wrote:
>> >
>> > +1
>> >
>> >
>> >
>> > The release wizard python script should be sufficient for everything.
>> If you run into any issues with it, let me know, I used it for 8.5.2 and
>> think I understand it pretty well.
>> >
>> >
>> >
>> > On Tue, Jun 16, 2020 at 8:31 AM Bruno Roustant <
>> bruno.roustant@gmail.com> wrote:
>> >
>> > Hi all,
>> >
>> > It’s been a while since we released Lucene/Solr 8.5.
>> >
>> > I’d like to volunteer to be a release manager for an 8.6 release. If
>> there's agreement, then I plan to cut the release branch two weeks today,
>> on June 30th, and then to build the first RC two days later.
>> >
>> >
>> >
>> > This will be my first time as release manager so I'll probably need
>> some guidance. Currently I have two resource links on this subject:
>> >
>> > https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo
>> >
>> >
>> https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy
>> >
>> > If you have more, please share with me.
>> >
>> >
>> >
>> > Bruno
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>>

Re: 8.6 release

Posted by Ishan Chattopadhyaya <ic...@gmail.com>.
Unless others object, lets add the following to Solr:

Search:
* Support for BlockMax WAND
Package manager:
* Support for cluster level (CoreContainer level) plugins

On Thu, Jul 2, 2020 at 3:59 PM Bruno Roustant <br...@gmail.com>
wrote:

> Here are the draft release notes.
> I tried to keep them concise, but please tell me if I miss something
> important.
>
> Solr 8.6.0 Release Highlights:
>
>    - Health Check:
>    HealthCheckHandler can now require that all cores are healthy before
>    returning OK.
>    - Zookeeper read API:
>    A read API at /api/cluster/zk/* to fetch raw ZK data and view contents
>    of a ZK directory.
>    - Admin UI:
>    New panel with security info in admin UI's dashboard.
>    - Streaming Expression:
>    Percentiles and standard deviation aggregations added to stats, facet
>    and time series.
>    Streaming expressions added to /export handler.
>    Drill Streaming Expression for efficient and accurate high cardinality
>    aggregation.
>    - Cross-Collection Join Queries:
>    Join queries can now work cross-collection, even when shared or when
>    spanning nodes.
>
> Lucene 8.6.0 Release Highlights:
>
>    - API change in:
>    SimpleFSDireectory, IndexWriterConfig, MergeScheduler, SortFields,
>    SimpleBindings, QueryVisitor, DocValues, CodecUtil.
>    - New:
>    IndexWriter merge-on-commit feature to selectively merge small
>    segments on commit, subject to a configurable timeout, to improve search
>    performance by reducing the number of small segments for searching.
>    Grouping by range based on DoubleValueSource and LongValueSource.
>    - Optimizations:
>    BKD trees and index, DoubleValuesSource/QueryValueSource,
>    UsageTrackingQueryingCachingPolicy, FST, Geometry queries,
>    Points, UniformSplit
>    - Others:
>    Ukrainian analyzer, checksums verification, resource leaks fixes
>
>
>
>
> Le mar. 30 juin 2020 à 19:38, Bruno Roustant <br...@gmail.com> a
> écrit :
>
>> Erick:
>> AFAIK yes from now on a commit in branch_8x will not go to 8.6 branch.
>>
>> Le mar. 30 juin 2020 à 17:59, Erick Erickson <er...@gmail.com> a
>> écrit :
>>
>>> Bruno:
>>>
>>> Just to double check, anything committed to branch_8x from here on won’t
>>> affect the 8.6 release unless explicitly backported, correct?
>>>
>>> I may be close to upgrading Zookeeper to 3.6.1, and very much do NOT
>>> want it in the 8.6 release as it should bake longer than 2 weeks even…
>>>
>>> Thanks for managing this release!
>>>
>>> Erick
>>>
>>> > On Jun 30, 2020, at 11:34 AM, Bruno Roustant <br...@gmail.com>
>>> wrote:
>>> >
>>> > For the RC, I prefer to let the latest and greatest commits to bake a
>>> week rather than only 2 days. Some of them have important impact and were
>>> added very recently.
>>> > So I plan a RC on July 7, if the smoke tester is fixed before that
>>> time.
>>> >
>>> > Bruno
>>> >
>>> > Le mar. 30 juin 2020 à 16:48, Uwe Schindler <uw...@thetaphi.de> a écrit
>>> :
>>> > Hi,
>>> >
>>> >
>>> >
>>> > I enabled builds for 8.6 on Policeman Jenkins:
>>> >
>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/
>>> >
>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/
>>> >
>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/
>>> >
>>> >
>>> >
>>> > Uwe
>>> >
>>> >
>>> >
>>> > -----
>>> >
>>> > Uwe Schindler
>>> >
>>> > Achterdiek 19, D-28357 Bremen
>>> >
>>> > https://www.thetaphi.de
>>> >
>>> > eMail: uwe@thetaphi.de
>>> >
>>> >
>>> >
>>> > From: Bruno Roustant <br...@gmail.com>
>>> > Sent: Tuesday, June 30, 2020 3:02 PM
>>> > To: dev@lucene.apache.org
>>> > Subject: Re: 8.6 release
>>> >
>>> >
>>> >
>>> > [new branch]      0a1f68fafd6711304bbd7372567a359bcf36aab4 ->
>>> branch_8_6
>>> >
>>> >
>>> > Le mar. 30 juin 2020 à 14:59, Bruno Roustant <br...@gmail.com>
>>> a écrit :
>>> >
>>> > I'm creating the branch_8_6 with the release wizard.
>>> >
>>> >
>>> >
>>> > Le mar. 30 juin 2020 à 12:37, Ishan Chattopadhyaya <
>>> ichattopadhyaya@gmail.com> a écrit :
>>> >
>>> > This is done and merged. Thanks.
>>> >
>>> >
>>> >
>>> > On Tue, Jun 30, 2020 at 11:52 AM Ishan Chattopadhyaya <
>>> ichattopadhyaya@gmail.com> wrote:
>>> >
>>> > Hi Bruno,
>>> >
>>> > I'd like to get SOLR-14599 in. It is for the package manager CLI
>>> support for cluster level (core container) level plugins. I think it is
>>> important to have this in 8.6 for two reasons:
>>> >
>>> >
>>> >
>>> > (a) it will unblock Marcus Eagan/Ke Zhenxu who are working on a new
>>> Solr UI package and would like to have their package released for early
>>> feedback
>>> >
>>> > (b) Earlier we can release this, more feedback we can get before this
>>> is released in 9.0.
>>> >
>>> > (c) This is an isolated change to the CLI for the package manager
>>> (experimental), so very low risk to stability of the release.
>>> >
>>> >
>>> >
>>> > I should be done with this issue by eod today. In case you have no
>>> objection, I would like to merge this issue after you cut the branch today
>>> (and before you spin the RC).
>>> >
>>> >
>>> >
>>> > Regards,
>>> >
>>> > Ishan
>>> >
>>> >
>>> >
>>> > On Tue, Jun 30, 2020 at 6:20 AM Joel Bernstein <jo...@gmail.com>
>>> wrote:
>>> >
>>> > Hi Bruno,
>>> >
>>> >
>>> >
>>> > Andrzej and I decided that SOLR-14537 is headed to master to bake for
>>> a while and won't make it into the 8.6 release. So please feel free to cut
>>> the branch when ready.
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > Joel Bernstein
>>> >
>>> > http://joelsolr.blogspot.com/
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Mon, Jun 29, 2020 at 6:13 AM Andrzej Białecki <ab...@getopt.org>
>>> wrote:
>>> >
>>> > I wold like to include SOLR-14537 in 8.6 (it’s already tagged), the
>>> patch is ready and I’m just waiting for Joel to finish performance testing.
>>> >
>>> >
>>> >
>>> >
>>> > On 27 Jun 2020, at 04:59, Tomás Fernández Löbbe <to...@gmail.com>
>>> wrote:
>>> >
>>> >
>>> >
>>> > I tagged SOLR-14590 for 8.6, The PR is ready for review and I plan to
>>> merge it soon
>>> >
>>> >
>>> >
>>> > On Fri, Jun 26, 2020 at 12:54 PM Andrzej Białecki <ab...@getopt.org>
>>> wrote:
>>> >
>>> > Jan,
>>> >
>>> >
>>> >
>>> > I just removed SOLR-14182 from 8.6, this needs proper back-compat
>>> shims and testing, and I don’t have enough time to get it done properly for
>>> 8.6.
>>> >
>>> >
>>> >
>>> >
>>> > On 26 Jun 2020, at 13:37, Jan Høydahl <ja...@cominvent.com> wrote:
>>> >
>>> >
>>> >
>>> > Unresolved Solr issues tagged with 8.6:
>>> >
>>> >
>>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6
>>> >
>>> >
>>> >
>>> > SOLR-14593   Package store API to disable file upload over HTTP
>>>           Blocker
>>> >
>>> > SOLR-14580   CloudSolrClient cannot be initialized using 'zkHosts'
>>> builder       Blocker
>>> >
>>> > SOLR-14516   NPE during Realtime GET
>>>            Major
>>> >
>>> > SOLR-14502   increase bin/solr's post kill sleep
>>>            Minor
>>> >
>>> > SOLR-14398   package store PUT should be idempotent
>>>           Trivial
>>> >
>>> > SOLR-14311   Shared schema should not have access to core level
>>> classes          Major
>>> >
>>> > SOLR-14182   Move metric reporters config from solr.xml to ZK cluster
>>> properties Major
>>> >
>>> > SOLR-14066   Deprecate DIH
>>>            Blocker
>>> >
>>> > SOLR-14022   Deprecate CDCR from Solr in 8.x
>>>            Blocker
>>> >
>>> >
>>> >
>>> > Plus two private JIRA issues.
>>> >
>>> >
>>> >
>>> > Jan
>>> >
>>> >
>>> >
>>> > 26. jun. 2020 kl. 12:06 skrev Bruno Roustant <bruno.roustant@gmail.com
>>> >:
>>> >
>>> >
>>> >
>>> > So the plan is to cut the release branch on next Tuesday June 30th. If
>>> you anticipate a problem with the date, please reply.
>>> >
>>> >
>>> >
>>> > Is there any JIRA issue that must be committed before the release is
>>> made and that has not already the appropriate "Fix Version"?
>>> >
>>> >
>>> >
>>> > Currently there 3 unresolved issues flagged as Fix Version = 8.6:
>>> >
>>> > Add tests for corruptions caused by byte flips LUCENE-9356
>>> >
>>> > Fix linefiledocs compression or replace in tests LUCENE-9191
>>> >
>>> > Can we merge small segments during refresh, for faster searching?
>>> LUCENE-8962
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > Le mer. 24 juin 2020 à 21:05, David Smiley <da...@gmail.com>
>>> a écrit :
>>> >
>>> > Thanks starting this discussion, Cassandra.
>>> >
>>> >
>>> >
>>> > I reviewed the issues I was involved with and I don't quite see
>>> something worth noting.
>>> >
>>> >
>>> >
>>> > I plan to add a note about a change in defaults within
>>> UnifiedHighlighter that could be a significant perf regression.  This
>>> wasn't introduced in 8.6 but introduced in 8.5 and it's significant enough
>>> to bring attention to.  I could add it in 8.5's section but then add a
>>> short pointer to it in 8.6.
>>> >
>>> >
>>> >
>>> > ~ David
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Wed, Jun 24, 2020 at 2:52 PM Cassandra Targett <
>>> casstargett@gmail.com> wrote:
>>> >
>>> > I started looking at the Ref Guide for 8.6 to get it ready, and notice
>>> there are no Upgrade Notes in `solr-upgrade-notes.adoc` for 8.6. Is it
>>> really true that none are needed at all?
>>> >
>>> > I’ll add what I usually do about new features/changes that maybe
>>> wouldn’t normally make the old Upgrade Notes section, I just find it
>>> surprising that there weren’t any devs who thought any of the 100 or so
>>> Solr changes warrant any user caveats.
>>> >
>>> > On Jun 17, 2020, 12:27 PM -0500, Tomás Fernández Löbbe <
>>> tomasflobbe@gmail.com>, wrote:
>>> >
>>> >
>>> > +1. Thanks Bruno
>>> >
>>> >
>>> >
>>> > On Wed, Jun 17, 2020 at 6:22 AM Mike Drob <md...@apache.org> wrote:
>>> >
>>> > +1
>>> >
>>> >
>>> >
>>> > The release wizard python script should be sufficient for everything.
>>> If you run into any issues with it, let me know, I used it for 8.5.2 and
>>> think I understand it pretty well.
>>> >
>>> >
>>> >
>>> > On Tue, Jun 16, 2020 at 8:31 AM Bruno Roustant <
>>> bruno.roustant@gmail.com> wrote:
>>> >
>>> > Hi all,
>>> >
>>> > It’s been a while since we released Lucene/Solr 8.5.
>>> >
>>> > I’d like to volunteer to be a release manager for an 8.6 release. If
>>> there's agreement, then I plan to cut the release branch two weeks today,
>>> on June 30th, and then to build the first RC two days later.
>>> >
>>> >
>>> >
>>> > This will be my first time as release manager so I'll probably need
>>> some guidance. Currently I have two resource links on this subject:
>>> >
>>> > https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo
>>> >
>>> >
>>> https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy
>>> >
>>> > If you have more, please share with me.
>>> >
>>> >
>>> >
>>> > Bruno
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>
>>>

Re: 8.6 release

Posted by Jan Høydahl <ja...@cominvent.com>.
Cassandra, I fixed the refguide link, verified that I could build the guide and pushed to all three branches.

Jan

> 2. jul. 2020 kl. 17:06 skrev Jan Høydahl <ja...@cominvent.com>:
> 
> It must be the link I added then. I’ll check.
> 
> Jan
> 
>> 2. jul. 2020 kl. 16:17 skrev Cassandra Targett <casstargett@gmail.com <ma...@gmail.com>>:
>> 
>> Jan, the Ref Guide change you made broke the Ref Guide builds.
>> On Jul 2, 2020, 7:56 AM -0500, Jan Høydahl <jan.asf@cominvent.com <ma...@cominvent.com>>, wrote:
>>> I forgot to add the new ‘allowPaths’ feature to upgrade notes. Here is what I plan to commit soon: https://github.com/apache/lucene-solr/pull/1641 <https://github.com/apache/lucene-solr/pull/1641>
>>> 
>>> Jan
>>> 
>>>> 2. jul. 2020 kl. 14:18 skrev Mikhail Khludnev <mkhl@apache.org <ma...@apache.org>>:
>>>> 
>>>> Query DSL:
>>>>  * {param:ref} and {bool: {excludeTags:""}}
>>>> 
>>>> On Thu, Jul 2, 2020 at 1:29 PM Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> wrote:
>>>> Here are the draft release notes.
>>>> I tried to keep them concise, but please tell me if I miss something important.
>>>> 
>>>> Solr 8.6.0 Release Highlights:
>>>> 
>>>> Health Check:
>>>> HealthCheckHandler can now require that all cores are healthy before returning OK.
>>>> Zookeeper read API:
>>>> A read API at /api/cluster/zk/* to fetch raw ZK data and view contents of a ZK directory.
>>>> Admin UI:
>>>> New panel with security info in admin UI's dashboard.
>>>> Streaming Expression:
>>>> Percentiles and standard deviation aggregations added to stats, facet and time series.
>>>> Streaming expressions added to /export handler.
>>>> Drill Streaming Expression for efficient and accurate high cardinality aggregation.
>>>> Cross-Collection Join Queries:
>>>> Join queries can now work cross-collection, even when shared or when spanning nodes.
>>>> Lucene 8.6.0 Release Highlights:
>>>> 
>>>> API change in:
>>>> SimpleFSDireectory, IndexWriterConfig, MergeScheduler, SortFields, SimpleBindings, QueryVisitor, DocValues, CodecUtil.
>>>> New:
>>>> IndexWriter merge-on-commit feature to selectively merge small segments on commit, subject to a configurable timeout, to improve search performance by reducing the number of small segments for searching.
>>>> Grouping by range based on DoubleValueSource and LongValueSource.
>>>> Optimizations:
>>>> BKD trees and index, DoubleValuesSource/QueryValueSource, UsageTrackingQueryingCachingPolicy, FST, Geometry queries, Points, UniformSplit
>>>> Others:
>>>> Ukrainian analyzer, checksums verification, resource leaks fixes
>>>> 
>>>> 
>>>> 
>>>> Le mar. 30 juin 2020 à 19:38, Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> a écrit :
>>>> Erick:
>>>> AFAIK yes from now on a commit in branch_8x will not go to 8.6 branch.
>>>> 
>>>> Le mar. 30 juin 2020 à 17:59, Erick Erickson <erickerickson@gmail.com <ma...@gmail.com>> a écrit :
>>>> Bruno:
>>>> 
>>>> Just to double check, anything committed to branch_8x from here on won’t affect the 8.6 release unless explicitly backported, correct?
>>>> 
>>>> I may be close to upgrading Zookeeper to 3.6.1, and very much do NOT want it in the 8.6 release as it should bake longer than 2 weeks even…
>>>> 
>>>> Thanks for managing this release!
>>>> 
>>>> Erick
>>>> 
>>>> > On Jun 30, 2020, at 11:34 AM, Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> wrote:
>>>> >
>>>> > For the RC, I prefer to let the latest and greatest commits to bake a week rather than only 2 days. Some of them have important impact and were added very recently.
>>>> > So I plan a RC on July 7, if the smoke tester is fixed before that time.
>>>> >
>>>> > Bruno
>>>> >
>>>> > Le mar. 30 juin 2020 à 16:48, Uwe Schindler <uwe@thetaphi.de <ma...@thetaphi.de>> a écrit :
>>>> > Hi,
>>>> >
>>>> > 
>>>> >
>>>> > I enabled builds for 8.6 on Policeman Jenkins:
>>>> >
>>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/ <https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/>
>>>> >
>>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/ <https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/>
>>>> >
>>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/ <https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/>
>>>> >
>>>> > 
>>>> >
>>>> > Uwe
>>>> >
>>>> > 
>>>> >
>>>> > -----
>>>> >
>>>> > Uwe Schindler
>>>> >
>>>> > Achterdiek 19, D-28357 Bremen
>>>> >
>>>> > https://www.thetaphi.de <https://www.thetaphi.de/>
>>>> >
>>>> > eMail: uwe@thetaphi.de <ma...@thetaphi.de>
>>>> >
>>>> > 
>>>> >
>>>> > From: Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>>
>>>> > Sent: Tuesday, June 30, 2020 3:02 PM
>>>> > To: dev@lucene.apache.org <ma...@lucene.apache.org>
>>>> > Subject: Re: 8.6 release
>>>> >
>>>> > 
>>>> >
>>>> > [new branch]      0a1f68fafd6711304bbd7372567a359bcf36aab4 -> branch_8_6
>>>> > 
>>>> >
>>>> > Le mar. 30 juin 2020 à 14:59, Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> a écrit :
>>>> >
>>>> > I'm creating the branch_8_6 with the release wizard.
>>>> >
>>>> > 
>>>> >
>>>> > Le mar. 30 juin 2020 à 12:37, Ishan Chattopadhyaya <ichattopadhyaya@gmail.com <ma...@gmail.com>> a écrit :
>>>> >
>>>> > This is done and merged. Thanks.
>>>> >
>>>> > 
>>>> >
>>>> > On Tue, Jun 30, 2020 at 11:52 AM Ishan Chattopadhyaya <ichattopadhyaya@gmail.com <ma...@gmail.com>> wrote:
>>>> >
>>>> > Hi Bruno,
>>>> >
>>>> > I'd like to get SOLR-14599 in. It is for the package manager CLI support for cluster level (core container) level plugins. I think it is important to have this in 8.6 for two reasons:
>>>> >
>>>> > 
>>>> >
>>>> > (a) it will unblock Marcus Eagan/Ke Zhenxu who are working on a new Solr UI package and would like to have their package released for early feedback
>>>> >
>>>> > (b) Earlier we can release this, more feedback we can get before this is released in 9.0.
>>>> >
>>>> > (c) This is an isolated change to the CLI for the package manager (experimental), so very low risk to stability of the release.
>>>> >
>>>> > 
>>>> >
>>>> > I should be done with this issue by eod today. In case you have no objection, I would like to merge this issue after you cut the branch today (and before you spin the RC).
>>>> >
>>>> > 
>>>> >
>>>> > Regards,
>>>> >
>>>> > Ishan
>>>> >
>>>> > 
>>>> >
>>>> > On Tue, Jun 30, 2020 at 6:20 AM Joel Bernstein <joelsolr@gmail.com <ma...@gmail.com>> wrote:
>>>> >
>>>> > Hi Bruno,
>>>> >
>>>> > 
>>>> >
>>>> > Andrzej and I decided that SOLR-14537 is headed to master to bake for a while and won't make it into the 8.6 release. So please feel free to cut the branch when ready.
>>>> >
>>>> > 
>>>> >
>>>> >
>>>> >
>>>> > Joel Bernstein
>>>> >
>>>> > http://joelsolr.blogspot.com/ <http://joelsolr.blogspot.com/>
>>>> >
>>>> > 
>>>> >
>>>> > 
>>>> >
>>>> > On Mon, Jun 29, 2020 at 6:13 AM Andrzej Białecki <ab@getopt.org <ma...@getopt.org>> wrote:
>>>> >
>>>> > I wold like to include SOLR-14537 in 8.6 (it’s already tagged), the patch is ready and I’m just waiting for Joel to finish performance testing.
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On 27 Jun 2020, at 04:59, Tomás Fernández Löbbe <tomasflobbe@gmail.com <ma...@gmail.com>> wrote:
>>>> >
>>>> > 
>>>> >
>>>> > I tagged SOLR-14590 for 8.6, The PR is ready for review and I plan to merge it soon
>>>> >
>>>> > 
>>>> >
>>>> > On Fri, Jun 26, 2020 at 12:54 PM Andrzej Białecki <ab@getopt.org <ma...@getopt.org>> wrote:
>>>> >
>>>> > Jan,
>>>> >
>>>> > 
>>>> >
>>>> > I just removed SOLR-14182 from 8.6, this needs proper back-compat shims and testing, and I don’t have enough time to get it done properly for 8.6.
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On 26 Jun 2020, at 13:37, Jan Høydahl <jan.asf@cominvent.com <ma...@cominvent.com>> wrote:
>>>> >
>>>> > 
>>>> >
>>>> > Unresolved Solr issues tagged with 8.6:
>>>> >
>>>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6 <https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6>
>>>> >
>>>> > 
>>>> >
>>>> > SOLR-14593   Package store API to disable file upload over HTTP                  Blocker
>>>> >
>>>> > SOLR-14580   CloudSolrClient cannot be initialized using 'zkHosts' builder       Blocker
>>>> >
>>>> > SOLR-14516   NPE during Realtime GET                                             Major   
>>>> >
>>>> > SOLR-14502   increase bin/solr's post kill sleep                                 Minor   
>>>> >
>>>> > SOLR-14398   package store PUT should be idempotent                              Trivial
>>>> >
>>>> > SOLR-14311   Shared schema should not have access to core level classes          Major   
>>>> >
>>>> > SOLR-14182   Move metric reporters config from solr.xml to ZK cluster properties Major   
>>>> >
>>>> > SOLR-14066   Deprecate DIH                                                       Blocker
>>>> >
>>>> > SOLR-14022   Deprecate CDCR from Solr in 8.x                                     Blocker
>>>> >
>>>> > 
>>>> >
>>>> > Plus two private JIRA issues.
>>>> >
>>>> > 
>>>> >
>>>> > Jan
>>>> >
>>>> > 
>>>> >
>>>> > 26. jun. 2020 kl. 12:06 skrev Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>>:
>>>> >
>>>> > 
>>>> >
>>>> > So the plan is to cut the release branch on next Tuesday June 30th. If you anticipate a problem with the date, please reply.
>>>> >
>>>> > 
>>>> >
>>>> > Is there any JIRA issue that must be committed before the release is made and that has not already the appropriate "Fix Version"?
>>>> >
>>>> > 
>>>> >
>>>> > Currently there 3 unresolved issues flagged as Fix Version = 8.6:
>>>> >
>>>> > Add tests for corruptions caused by byte flips LUCENE-9356
>>>> >
>>>> > Fix linefiledocs compression or replace in tests LUCENE-9191
>>>> >
>>>> > Can we merge small segments during refresh, for faster searching? LUCENE-8962
>>>> >
>>>> > 
>>>> >
>>>> > 
>>>> >
>>>> > Le mer. 24 juin 2020 à 21:05, David Smiley <david.w.smiley@gmail.com <ma...@gmail.com>> a écrit :
>>>> >
>>>> > Thanks starting this discussion, Cassandra.
>>>> >
>>>> > 
>>>> >
>>>> > I reviewed the issues I was involved with and I don't quite see something worth noting.
>>>> >
>>>> > 
>>>> >
>>>> > I plan to add a note about a change in defaults within UnifiedHighlighter that could be a significant perf regression.  This wasn't introduced in 8.6 but introduced in 8.5 and it's significant enough to bring attention to.  I could add it in 8.5's section but then add a short pointer to it in 8.6.
>>>> >
>>>> > 
>>>> >
>>>> > ~ David
>>>> >
>>>> > 
>>>> >
>>>> > 
>>>> >
>>>> > On Wed, Jun 24, 2020 at 2:52 PM Cassandra Targett <casstargett@gmail.com <ma...@gmail.com>> wrote:
>>>> >
>>>> > I started looking at the Ref Guide for 8.6 to get it ready, and notice there are no Upgrade Notes in `solr-upgrade-notes.adoc` for 8.6. Is it really true that none are needed at all?
>>>> >
>>>> > I’ll add what I usually do about new features/changes that maybe wouldn’t normally make the old Upgrade Notes section, I just find it surprising that there weren’t any devs who thought any of the 100 or so Solr changes warrant any user caveats.
>>>> >
>>>> > On Jun 17, 2020, 12:27 PM -0500, Tomás Fernández Löbbe <tomasflobbe@gmail.com <ma...@gmail.com>>, wrote:
>>>> >
>>>> >
>>>> > +1. Thanks Bruno
>>>> >
>>>> > 
>>>> >
>>>> > On Wed, Jun 17, 2020 at 6:22 AM Mike Drob <mdrob@apache.org <ma...@apache.org>> wrote:
>>>> >
>>>> > +1
>>>> >
>>>> > 
>>>> >
>>>> > The release wizard python script should be sufficient for everything. If you run into any issues with it, let me know, I used it for 8.5.2 and think I understand it pretty well.
>>>> >
>>>> > 
>>>> >
>>>> > On Tue, Jun 16, 2020 at 8:31 AM Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> wrote:
>>>> >
>>>> > Hi all,
>>>> >
>>>> > It’s been a while since we released Lucene/Solr 8.5.
>>>> >
>>>> > I’d like to volunteer to be a release manager for an 8.6 release. If there's agreement, then I plan to cut the release branch two weeks today, on June 30th, and then to build the first RC two days later.
>>>> >
>>>> > 
>>>> >
>>>> > This will be my first time as release manager so I'll probably need some guidance. Currently I have two resource links on this subject:
>>>> >
>>>> > https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo <https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo>
>>>> >
>>>> > https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy <https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy>
>>>> >
>>>> > If you have more, please share with me.
>>>> >
>>>> > 
>>>> >
>>>> > Bruno
>>>> >
>>>> > 
>>>> >
>>>> > 
>>>> >
>>>> > 
>>>> >
>>>> 
>>>> 
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org <ma...@lucene.apache.org>
>>>> For additional commands, e-mail: dev-help@lucene.apache.org <ma...@lucene.apache.org>
>>>> 
>>>> 
>>>> 
>>>> --
>>>> Sincerely yours
>>>> Mikhail Khludnev
>>> 
> 


Re: 8.6 release

Posted by Jan Høydahl <ja...@cominvent.com>.
It must be the link I added then. I’ll check.

Jan

> 2. jul. 2020 kl. 16:17 skrev Cassandra Targett <ca...@gmail.com>:
> 
> Jan, the Ref Guide change you made broke the Ref Guide builds.
> On Jul 2, 2020, 7:56 AM -0500, Jan Høydahl <ja...@cominvent.com>, wrote:
>> I forgot to add the new ‘allowPaths’ feature to upgrade notes. Here is what I plan to commit soon: https://github.com/apache/lucene-solr/pull/1641 <https://github.com/apache/lucene-solr/pull/1641>
>> 
>> Jan
>> 
>>> 2. jul. 2020 kl. 14:18 skrev Mikhail Khludnev <mkhl@apache.org <ma...@apache.org>>:
>>> 
>>> Query DSL:
>>>  * {param:ref} and {bool: {excludeTags:""}}
>>> 
>>> On Thu, Jul 2, 2020 at 1:29 PM Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> wrote:
>>> Here are the draft release notes.
>>> I tried to keep them concise, but please tell me if I miss something important.
>>> 
>>> Solr 8.6.0 Release Highlights:
>>> 
>>> Health Check:
>>> HealthCheckHandler can now require that all cores are healthy before returning OK.
>>> Zookeeper read API:
>>> A read API at /api/cluster/zk/* to fetch raw ZK data and view contents of a ZK directory.
>>> Admin UI:
>>> New panel with security info in admin UI's dashboard.
>>> Streaming Expression:
>>> Percentiles and standard deviation aggregations added to stats, facet and time series.
>>> Streaming expressions added to /export handler.
>>> Drill Streaming Expression for efficient and accurate high cardinality aggregation.
>>> Cross-Collection Join Queries:
>>> Join queries can now work cross-collection, even when shared or when spanning nodes.
>>> Lucene 8.6.0 Release Highlights:
>>> 
>>> API change in:
>>> SimpleFSDireectory, IndexWriterConfig, MergeScheduler, SortFields, SimpleBindings, QueryVisitor, DocValues, CodecUtil.
>>> New:
>>> IndexWriter merge-on-commit feature to selectively merge small segments on commit, subject to a configurable timeout, to improve search performance by reducing the number of small segments for searching.
>>> Grouping by range based on DoubleValueSource and LongValueSource.
>>> Optimizations:
>>> BKD trees and index, DoubleValuesSource/QueryValueSource, UsageTrackingQueryingCachingPolicy, FST, Geometry queries, Points, UniformSplit
>>> Others:
>>> Ukrainian analyzer, checksums verification, resource leaks fixes
>>> 
>>> 
>>> 
>>> Le mar. 30 juin 2020 à 19:38, Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> a écrit :
>>> Erick:
>>> AFAIK yes from now on a commit in branch_8x will not go to 8.6 branch.
>>> 
>>> Le mar. 30 juin 2020 à 17:59, Erick Erickson <erickerickson@gmail.com <ma...@gmail.com>> a écrit :
>>> Bruno:
>>> 
>>> Just to double check, anything committed to branch_8x from here on won’t affect the 8.6 release unless explicitly backported, correct?
>>> 
>>> I may be close to upgrading Zookeeper to 3.6.1, and very much do NOT want it in the 8.6 release as it should bake longer than 2 weeks even…
>>> 
>>> Thanks for managing this release!
>>> 
>>> Erick
>>> 
>>> > On Jun 30, 2020, at 11:34 AM, Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> wrote:
>>> >
>>> > For the RC, I prefer to let the latest and greatest commits to bake a week rather than only 2 days. Some of them have important impact and were added very recently.
>>> > So I plan a RC on July 7, if the smoke tester is fixed before that time.
>>> >
>>> > Bruno
>>> >
>>> > Le mar. 30 juin 2020 à 16:48, Uwe Schindler <uwe@thetaphi.de <ma...@thetaphi.de>> a écrit :
>>> > Hi,
>>> >
>>> > 
>>> >
>>> > I enabled builds for 8.6 on Policeman Jenkins:
>>> >
>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/ <https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/>
>>> >
>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/ <https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/>
>>> >
>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/ <https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/>
>>> >
>>> > 
>>> >
>>> > Uwe
>>> >
>>> > 
>>> >
>>> > -----
>>> >
>>> > Uwe Schindler
>>> >
>>> > Achterdiek 19, D-28357 Bremen
>>> >
>>> > https://www.thetaphi.de <https://www.thetaphi.de/>
>>> >
>>> > eMail: uwe@thetaphi.de <ma...@thetaphi.de>
>>> >
>>> > 
>>> >
>>> > From: Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>>
>>> > Sent: Tuesday, June 30, 2020 3:02 PM
>>> > To: dev@lucene.apache.org <ma...@lucene.apache.org>
>>> > Subject: Re: 8.6 release
>>> >
>>> > 
>>> >
>>> > [new branch]      0a1f68fafd6711304bbd7372567a359bcf36aab4 -> branch_8_6
>>> > 
>>> >
>>> > Le mar. 30 juin 2020 à 14:59, Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> a écrit :
>>> >
>>> > I'm creating the branch_8_6 with the release wizard.
>>> >
>>> > 
>>> >
>>> > Le mar. 30 juin 2020 à 12:37, Ishan Chattopadhyaya <ichattopadhyaya@gmail.com <ma...@gmail.com>> a écrit :
>>> >
>>> > This is done and merged. Thanks.
>>> >
>>> > 
>>> >
>>> > On Tue, Jun 30, 2020 at 11:52 AM Ishan Chattopadhyaya <ichattopadhyaya@gmail.com <ma...@gmail.com>> wrote:
>>> >
>>> > Hi Bruno,
>>> >
>>> > I'd like to get SOLR-14599 in. It is for the package manager CLI support for cluster level (core container) level plugins. I think it is important to have this in 8.6 for two reasons:
>>> >
>>> > 
>>> >
>>> > (a) it will unblock Marcus Eagan/Ke Zhenxu who are working on a new Solr UI package and would like to have their package released for early feedback
>>> >
>>> > (b) Earlier we can release this, more feedback we can get before this is released in 9.0.
>>> >
>>> > (c) This is an isolated change to the CLI for the package manager (experimental), so very low risk to stability of the release.
>>> >
>>> > 
>>> >
>>> > I should be done with this issue by eod today. In case you have no objection, I would like to merge this issue after you cut the branch today (and before you spin the RC).
>>> >
>>> > 
>>> >
>>> > Regards,
>>> >
>>> > Ishan
>>> >
>>> > 
>>> >
>>> > On Tue, Jun 30, 2020 at 6:20 AM Joel Bernstein <joelsolr@gmail.com <ma...@gmail.com>> wrote:
>>> >
>>> > Hi Bruno,
>>> >
>>> > 
>>> >
>>> > Andrzej and I decided that SOLR-14537 is headed to master to bake for a while and won't make it into the 8.6 release. So please feel free to cut the branch when ready.
>>> >
>>> > 
>>> >
>>> >
>>> >
>>> > Joel Bernstein
>>> >
>>> > http://joelsolr.blogspot.com/ <http://joelsolr.blogspot.com/>
>>> >
>>> > 
>>> >
>>> > 
>>> >
>>> > On Mon, Jun 29, 2020 at 6:13 AM Andrzej Białecki <ab@getopt.org <ma...@getopt.org>> wrote:
>>> >
>>> > I wold like to include SOLR-14537 in 8.6 (it’s already tagged), the patch is ready and I’m just waiting for Joel to finish performance testing.
>>> >
>>> >
>>> >
>>> >
>>> > On 27 Jun 2020, at 04:59, Tomás Fernández Löbbe <tomasflobbe@gmail.com <ma...@gmail.com>> wrote:
>>> >
>>> > 
>>> >
>>> > I tagged SOLR-14590 for 8.6, The PR is ready for review and I plan to merge it soon
>>> >
>>> > 
>>> >
>>> > On Fri, Jun 26, 2020 at 12:54 PM Andrzej Białecki <ab@getopt.org <ma...@getopt.org>> wrote:
>>> >
>>> > Jan,
>>> >
>>> > 
>>> >
>>> > I just removed SOLR-14182 from 8.6, this needs proper back-compat shims and testing, and I don’t have enough time to get it done properly for 8.6.
>>> >
>>> >
>>> >
>>> >
>>> > On 26 Jun 2020, at 13:37, Jan Høydahl <jan.asf@cominvent.com <ma...@cominvent.com>> wrote:
>>> >
>>> > 
>>> >
>>> > Unresolved Solr issues tagged with 8.6:
>>> >
>>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6 <https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6>
>>> >
>>> > 
>>> >
>>> > SOLR-14593   Package store API to disable file upload over HTTP                  Blocker
>>> >
>>> > SOLR-14580   CloudSolrClient cannot be initialized using 'zkHosts' builder       Blocker
>>> >
>>> > SOLR-14516   NPE during Realtime GET                                             Major   
>>> >
>>> > SOLR-14502   increase bin/solr's post kill sleep                                 Minor   
>>> >
>>> > SOLR-14398   package store PUT should be idempotent                              Trivial
>>> >
>>> > SOLR-14311   Shared schema should not have access to core level classes          Major   
>>> >
>>> > SOLR-14182   Move metric reporters config from solr.xml to ZK cluster properties Major   
>>> >
>>> > SOLR-14066   Deprecate DIH                                                       Blocker
>>> >
>>> > SOLR-14022   Deprecate CDCR from Solr in 8.x                                     Blocker
>>> >
>>> > 
>>> >
>>> > Plus two private JIRA issues.
>>> >
>>> > 
>>> >
>>> > Jan
>>> >
>>> > 
>>> >
>>> > 26. jun. 2020 kl. 12:06 skrev Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>>:
>>> >
>>> > 
>>> >
>>> > So the plan is to cut the release branch on next Tuesday June 30th. If you anticipate a problem with the date, please reply.
>>> >
>>> > 
>>> >
>>> > Is there any JIRA issue that must be committed before the release is made and that has not already the appropriate "Fix Version"?
>>> >
>>> > 
>>> >
>>> > Currently there 3 unresolved issues flagged as Fix Version = 8.6:
>>> >
>>> > Add tests for corruptions caused by byte flips LUCENE-9356
>>> >
>>> > Fix linefiledocs compression or replace in tests LUCENE-9191
>>> >
>>> > Can we merge small segments during refresh, for faster searching? LUCENE-8962
>>> >
>>> > 
>>> >
>>> > 
>>> >
>>> > Le mer. 24 juin 2020 à 21:05, David Smiley <david.w.smiley@gmail.com <ma...@gmail.com>> a écrit :
>>> >
>>> > Thanks starting this discussion, Cassandra.
>>> >
>>> > 
>>> >
>>> > I reviewed the issues I was involved with and I don't quite see something worth noting.
>>> >
>>> > 
>>> >
>>> > I plan to add a note about a change in defaults within UnifiedHighlighter that could be a significant perf regression.  This wasn't introduced in 8.6 but introduced in 8.5 and it's significant enough to bring attention to.  I could add it in 8.5's section but then add a short pointer to it in 8.6.
>>> >
>>> > 
>>> >
>>> > ~ David
>>> >
>>> > 
>>> >
>>> > 
>>> >
>>> > On Wed, Jun 24, 2020 at 2:52 PM Cassandra Targett <casstargett@gmail.com <ma...@gmail.com>> wrote:
>>> >
>>> > I started looking at the Ref Guide for 8.6 to get it ready, and notice there are no Upgrade Notes in `solr-upgrade-notes.adoc` for 8.6. Is it really true that none are needed at all?
>>> >
>>> > I’ll add what I usually do about new features/changes that maybe wouldn’t normally make the old Upgrade Notes section, I just find it surprising that there weren’t any devs who thought any of the 100 or so Solr changes warrant any user caveats.
>>> >
>>> > On Jun 17, 2020, 12:27 PM -0500, Tomás Fernández Löbbe <tomasflobbe@gmail.com <ma...@gmail.com>>, wrote:
>>> >
>>> >
>>> > +1. Thanks Bruno
>>> >
>>> > 
>>> >
>>> > On Wed, Jun 17, 2020 at 6:22 AM Mike Drob <mdrob@apache.org <ma...@apache.org>> wrote:
>>> >
>>> > +1
>>> >
>>> > 
>>> >
>>> > The release wizard python script should be sufficient for everything. If you run into any issues with it, let me know, I used it for 8.5.2 and think I understand it pretty well.
>>> >
>>> > 
>>> >
>>> > On Tue, Jun 16, 2020 at 8:31 AM Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> wrote:
>>> >
>>> > Hi all,
>>> >
>>> > It’s been a while since we released Lucene/Solr 8.5.
>>> >
>>> > I’d like to volunteer to be a release manager for an 8.6 release. If there's agreement, then I plan to cut the release branch two weeks today, on June 30th, and then to build the first RC two days later.
>>> >
>>> > 
>>> >
>>> > This will be my first time as release manager so I'll probably need some guidance. Currently I have two resource links on this subject:
>>> >
>>> > https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo <https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo>
>>> >
>>> > https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy <https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy>
>>> >
>>> > If you have more, please share with me.
>>> >
>>> > 
>>> >
>>> > Bruno
>>> >
>>> > 
>>> >
>>> > 
>>> >
>>> > 
>>> >
>>> 
>>> 
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org <ma...@lucene.apache.org>
>>> For additional commands, e-mail: dev-help@lucene.apache.org <ma...@lucene.apache.org>
>>> 
>>> 
>>> 
>>> --
>>> Sincerely yours
>>> Mikhail Khludnev
>> 


Re: 8.6 release

Posted by Cassandra Targett <ca...@gmail.com>.
Jan, the Ref Guide change you made broke the Ref Guide builds.
On Jul 2, 2020, 7:56 AM -0500, Jan Høydahl <ja...@cominvent.com>, wrote:
> I forgot to add the new ‘allowPaths’ feature to upgrade notes. Here is what I plan to commit soon: https://github.com/apache/lucene-solr/pull/1641
>
> Jan
>
> > 2. jul. 2020 kl. 14:18 skrev Mikhail Khludnev <mk...@apache.org>:
> >
> > Query DSL:
> >  * {param:ref} and {bool: {excludeTags:""}}
> >
> > > On Thu, Jul 2, 2020 at 1:29 PM Bruno Roustant <br...@gmail.com> wrote:
> > > > Here are the draft release notes.
> > > > I tried to keep them concise, but please tell me if I miss something important.
> > > >
> > > > Solr 8.6.0 Release Highlights:
> > > >
> > > > • Health Check:
> > > > HealthCheckHandler can now require that all cores are healthy before returning OK.
> > > > • Zookeeper read API:
> > > > A read API at /api/cluster/zk/* to fetch raw ZK data and view contents of a ZK directory.
> > > > • Admin UI:
> > > > New panel with security info in admin UI's dashboard.
> > > > • Streaming Expression:
> > > > Percentiles and standard deviation aggregations added to stats, facet and time series.
> > > > Streaming expressions added to /export handler.
> > > > Drill Streaming Expression for efficient and accurate high cardinality aggregation.
> > > > • Cross-Collection Join Queries:
> > > > Join queries can now work cross-collection, even when shared or when spanning nodes.
> > > >
> > > > Lucene 8.6.0 Release Highlights:
> > > >
> > > > • API change in:
> > > > SimpleFSDireectory, IndexWriterConfig, MergeScheduler, SortFields, SimpleBindings, QueryVisitor, DocValues, CodecUtil.
> > > > • New:
> > > > IndexWriter merge-on-commit feature to selectively merge small segments on commit, subject to a configurable timeout, to improve search performance by reducing the number of small segments for searching.
> > > > Grouping by range based on DoubleValueSource and LongValueSource.
> > > > • Optimizations:
> > > > BKD trees and index, DoubleValuesSource/QueryValueSource, UsageTrackingQueryingCachingPolicy, FST, Geometry queries, Points, UniformSplit
> > > > • Others:
> > > > Ukrainian analyzer, checksums verification, resource leaks fixes
> > > >
> > > >
> > > >
> > > >
> > > > > Le mar. 30 juin 2020 à 19:38, Bruno Roustant <br...@gmail.com> a écrit :
> > > > > > Erick:
> > > > > > AFAIK yes from now on a commit in branch_8x will not go to 8.6 branch.
> > > > > >
> > > > > > > Le mar. 30 juin 2020 à 17:59, Erick Erickson <er...@gmail.com> a écrit :
> > > > > > > > Bruno:
> > > > > > > >
> > > > > > > > Just to double check, anything committed to branch_8x from here on won’t affect the 8.6 release unless explicitly backported, correct?
> > > > > > > >
> > > > > > > > I may be close to upgrading Zookeeper to 3.6.1, and very much do NOT want it in the 8.6 release as it should bake longer than 2 weeks even…
> > > > > > > >
> > > > > > > > Thanks for managing this release!
> > > > > > > >
> > > > > > > > Erick
> > > > > > > >
> > > > > > > > > On Jun 30, 2020, at 11:34 AM, Bruno Roustant <br...@gmail.com> wrote:
> > > > > > > > >
> > > > > > > > > For the RC, I prefer to let the latest and greatest commits to bake a week rather than only 2 days. Some of them have important impact and were added very recently.
> > > > > > > > > So I plan a RC on July 7, if the smoke tester is fixed before that time.
> > > > > > > > >
> > > > > > > > > Bruno
> > > > > > > > >
> > > > > > > > > Le mar. 30 juin 2020 à 16:48, Uwe Schindler <uw...@thetaphi.de> a écrit :
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I enabled builds for 8.6 on Policeman Jenkins:
> > > > > > > > >
> > > > > > > > > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/
> > > > > > > > >
> > > > > > > > > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/
> > > > > > > > >
> > > > > > > > > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Uwe
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > -----
> > > > > > > > >
> > > > > > > > > Uwe Schindler
> > > > > > > > >
> > > > > > > > > Achterdiek 19, D-28357 Bremen
> > > > > > > > >
> > > > > > > > > https://www.thetaphi.de
> > > > > > > > >
> > > > > > > > > eMail: uwe@thetaphi.de
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > From: Bruno Roustant <br...@gmail.com>
> > > > > > > > > Sent: Tuesday, June 30, 2020 3:02 PM
> > > > > > > > > To: dev@lucene.apache.org
> > > > > > > > > Subject: Re: 8.6 release
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > [new branch]      0a1f68fafd6711304bbd7372567a359bcf36aab4 -> branch_8_6
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Le mar. 30 juin 2020 à 14:59, Bruno Roustant <br...@gmail.com> a écrit :
> > > > > > > > >
> > > > > > > > > I'm creating the branch_8_6 with the release wizard.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Le mar. 30 juin 2020 à 12:37, Ishan Chattopadhyaya <ic...@gmail.com> a écrit :
> > > > > > > > >
> > > > > > > > > This is done and merged. Thanks.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Tue, Jun 30, 2020 at 11:52 AM Ishan Chattopadhyaya <ic...@gmail.com> wrote:
> > > > > > > > >
> > > > > > > > > Hi Bruno,
> > > > > > > > >
> > > > > > > > > I'd like to get SOLR-14599 in. It is for the package manager CLI support for cluster level (core container) level plugins. I think it is important to have this in 8.6 for two reasons:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > (a) it will unblock Marcus Eagan/Ke Zhenxu who are working on a new Solr UI package and would like to have their package released for early feedback
> > > > > > > > >
> > > > > > > > > (b) Earlier we can release this, more feedback we can get before this is released in 9.0.
> > > > > > > > >
> > > > > > > > > (c) This is an isolated change to the CLI for the package manager (experimental), so very low risk to stability of the release.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I should be done with this issue by eod today. In case you have no objection, I would like to merge this issue after you cut the branch today (and before you spin the RC).
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Regards,
> > > > > > > > >
> > > > > > > > > Ishan
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Tue, Jun 30, 2020 at 6:20 AM Joel Bernstein <jo...@gmail.com> wrote:
> > > > > > > > >
> > > > > > > > > Hi Bruno,
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Andrzej and I decided that SOLR-14537 is headed to master to bake for a while and won't make it into the 8.6 release. So please feel free to cut the branch when ready.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Joel Bernstein
> > > > > > > > >
> > > > > > > > > http://joelsolr.blogspot.com/
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Mon, Jun 29, 2020 at 6:13 AM Andrzej Białecki <ab...@getopt.org> wrote:
> > > > > > > > >
> > > > > > > > > I wold like to include SOLR-14537 in 8.6 (it’s already tagged), the patch is ready and I’m just waiting for Joel to finish performance testing.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On 27 Jun 2020, at 04:59, Tomás Fernández Löbbe <to...@gmail.com> wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I tagged SOLR-14590 for 8.6, The PR is ready for review and I plan to merge it soon
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Fri, Jun 26, 2020 at 12:54 PM Andrzej Białecki <ab...@getopt.org> wrote:
> > > > > > > > >
> > > > > > > > > Jan,
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I just removed SOLR-14182 from 8.6, this needs proper back-compat shims and testing, and I don’t have enough time to get it done properly for 8.6.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On 26 Jun 2020, at 13:37, Jan Høydahl <ja...@cominvent.com> wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Unresolved Solr issues tagged with 8.6:
> > > > > > > > >
> > > > > > > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > SOLR-14593   Package store API to disable file upload over HTTP                  Blocker
> > > > > > > > >
> > > > > > > > > SOLR-14580   CloudSolrClient cannot be initialized using 'zkHosts' builder       Blocker
> > > > > > > > >
> > > > > > > > > SOLR-14516   NPE during Realtime GET                                             Major
> > > > > > > > >
> > > > > > > > > SOLR-14502   increase bin/solr's post kill sleep                                 Minor
> > > > > > > > >
> > > > > > > > > SOLR-14398   package store PUT should be idempotent                              Trivial
> > > > > > > > >
> > > > > > > > > SOLR-14311   Shared schema should not have access to core level classes          Major
> > > > > > > > >
> > > > > > > > > SOLR-14182   Move metric reporters config from solr.xml to ZK cluster properties Major
> > > > > > > > >
> > > > > > > > > SOLR-14066   Deprecate DIH                                                       Blocker
> > > > > > > > >
> > > > > > > > > SOLR-14022   Deprecate CDCR from Solr in 8.x                                     Blocker
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Plus two private JIRA issues.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Jan
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > 26. jun. 2020 kl. 12:06 skrev Bruno Roustant <br...@gmail.com>:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > So the plan is to cut the release branch on next Tuesday June 30th. If you anticipate a problem with the date, please reply.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Is there any JIRA issue that must be committed before the release is made and that has not already the appropriate "Fix Version"?
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Currently there 3 unresolved issues flagged as Fix Version = 8.6:
> > > > > > > > >
> > > > > > > > > Add tests for corruptions caused by byte flips LUCENE-9356
> > > > > > > > >
> > > > > > > > > Fix linefiledocs compression or replace in tests LUCENE-9191
> > > > > > > > >
> > > > > > > > > Can we merge small segments during refresh, for faster searching? LUCENE-8962
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Le mer. 24 juin 2020 à 21:05, David Smiley <da...@gmail.com> a écrit :
> > > > > > > > >
> > > > > > > > > Thanks starting this discussion, Cassandra.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I reviewed the issues I was involved with and I don't quite see something worth noting.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I plan to add a note about a change in defaults within UnifiedHighlighter that could be a significant perf regression.  This wasn't introduced in 8.6 but introduced in 8.5 and it's significant enough to bring attention to.  I could add it in 8.5's section but then add a short pointer to it in 8.6.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > ~ David
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Wed, Jun 24, 2020 at 2:52 PM Cassandra Targett <ca...@gmail.com> wrote:
> > > > > > > > >
> > > > > > > > > I started looking at the Ref Guide for 8.6 to get it ready, and notice there are no Upgrade Notes in `solr-upgrade-notes.adoc` for 8.6. Is it really true that none are needed at all?
> > > > > > > > >
> > > > > > > > > I’ll add what I usually do about new features/changes that maybe wouldn’t normally make the old Upgrade Notes section, I just find it surprising that there weren’t any devs who thought any of the 100 or so Solr changes warrant any user caveats.
> > > > > > > > >
> > > > > > > > > On Jun 17, 2020, 12:27 PM -0500, Tomás Fernández Löbbe <to...@gmail.com>, wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > +1. Thanks Bruno
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Wed, Jun 17, 2020 at 6:22 AM Mike Drob <md...@apache.org> wrote:
> > > > > > > > >
> > > > > > > > > +1
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > The release wizard python script should be sufficient for everything. If you run into any issues with it, let me know, I used it for 8.5.2 and think I understand it pretty well.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Tue, Jun 16, 2020 at 8:31 AM Bruno Roustant <br...@gmail.com> wrote:
> > > > > > > > >
> > > > > > > > > Hi all,
> > > > > > > > >
> > > > > > > > > It’s been a while since we released Lucene/Solr 8.5.
> > > > > > > > >
> > > > > > > > > I’d like to volunteer to be a release manager for an 8.6 release. If there's agreement, then I plan to cut the release branch two weeks today, on June 30th, and then to build the first RC two days later.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > This will be my first time as release manager so I'll probably need some guidance. Currently I have two resource links on this subject:
> > > > > > > > >
> > > > > > > > > https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo
> > > > > > > > >
> > > > > > > > > https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy
> > > > > > > > >
> > > > > > > > > If you have more, please share with me.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Bruno
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > ---------------------------------------------------------------------
> > > > > > > > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > > > > > > For additional commands, e-mail: dev-help@lucene.apache.org
> > > > > > > >
> >
> >
> > --
> > Sincerely yours
> > Mikhail Khludnev
>

Re: 8.6 release

Posted by David Smiley <da...@gmail.com>.
Is this email thread the only place we are editing the highlights or is
there a Confluence page?  I'd rather fix a typo than tell you to fix your
typo :-)
~ David


On Thu, Jul 2, 2020 at 8:56 AM Jan Høydahl <ja...@cominvent.com> wrote:

> I forgot to add the new ‘allowPaths’ feature to upgrade notes. Here is
> what I plan to commit soon:
> https://github.com/apache/lucene-solr/pull/1641
>
> Jan
>
> 2. jul. 2020 kl. 14:18 skrev Mikhail Khludnev <mk...@apache.org>:
>
> Query DSL:
>  * {param:ref} and {bool: {excludeTags:""}}
>
> On Thu, Jul 2, 2020 at 1:29 PM Bruno Roustant <br...@gmail.com>
> wrote:
>
>> Here are the draft release notes.
>> I tried to keep them concise, but please tell me if I miss something
>> important.
>>
>> Solr 8.6.0 Release Highlights:
>>
>>    - Health Check:
>>    HealthCheckHandler can now require that all cores are healthy before
>>    returning OK.
>>    - Zookeeper read API:
>>    A read API at /api/cluster/zk/* to fetch raw ZK data and view
>>    contents of a ZK directory.
>>    - Admin UI:
>>    New panel with security info in admin UI's dashboard.
>>    - Streaming Expression:
>>    Percentiles and standard deviation aggregations added to stats, facet
>>    and time series.
>>    Streaming expressions added to /export handler.
>>    Drill Streaming Expression for efficient and accurate high
>>    cardinality aggregation.
>>    - Cross-Collection Join Queries:
>>    Join queries can now work cross-collection, even when shared or when
>>    spanning nodes.
>>
>> Lucene 8.6.0 Release Highlights:
>>
>>    - API change in:
>>    SimpleFSDireectory, IndexWriterConfig, MergeScheduler, SortFields,
>>    SimpleBindings, QueryVisitor, DocValues, CodecUtil.
>>    - New:
>>    IndexWriter merge-on-commit feature to selectively merge small
>>    segments on commit, subject to a configurable timeout, to improve search
>>    performance by reducing the number of small segments for searching.
>>    Grouping by range based on DoubleValueSource and LongValueSource.
>>    - Optimizations:
>>    BKD trees and index, DoubleValuesSource/QueryValueSource,
>>    UsageTrackingQueryingCachingPolicy, FST, Geometry queries,
>>    Points, UniformSplit
>>    - Others:
>>    Ukrainian analyzer, checksums verification, resource leaks fixes
>>
>>
>>
>>
>> Le mar. 30 juin 2020 à 19:38, Bruno Roustant <br...@gmail.com>
>> a écrit :
>>
>>> Erick:
>>> AFAIK yes from now on a commit in branch_8x will not go to 8.6 branch.
>>>
>>> Le mar. 30 juin 2020 à 17:59, Erick Erickson <er...@gmail.com>
>>> a écrit :
>>>
>>>> Bruno:
>>>>
>>>> Just to double check, anything committed to branch_8x from here on
>>>> won’t affect the 8.6 release unless explicitly backported, correct?
>>>>
>>>> I may be close to upgrading Zookeeper to 3.6.1, and very much do NOT
>>>> want it in the 8.6 release as it should bake longer than 2 weeks even…
>>>>
>>>> Thanks for managing this release!
>>>>
>>>> Erick
>>>>
>>>> > On Jun 30, 2020, at 11:34 AM, Bruno Roustant <
>>>> bruno.roustant@gmail.com> wrote:
>>>> >
>>>> > For the RC, I prefer to let the latest and greatest commits to bake a
>>>> week rather than only 2 days. Some of them have important impact and were
>>>> added very recently.
>>>> > So I plan a RC on July 7, if the smoke tester is fixed before that
>>>> time.
>>>> >
>>>> > Bruno
>>>> >
>>>> > Le mar. 30 juin 2020 à 16:48, Uwe Schindler <uw...@thetaphi.de> a
>>>> écrit :
>>>> > Hi,
>>>> >
>>>> >
>>>> >
>>>> > I enabled builds for 8.6 on Policeman Jenkins:
>>>> >
>>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/
>>>> >
>>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/
>>>> >
>>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/
>>>> >
>>>> >
>>>> >
>>>> > Uwe
>>>> >
>>>> >
>>>> >
>>>> > -----
>>>> >
>>>> > Uwe Schindler
>>>> >
>>>> > Achterdiek 19, D-28357 Bremen
>>>> >
>>>> > https://www.thetaphi.de
>>>> >
>>>> > eMail: uwe@thetaphi.de
>>>> >
>>>> >
>>>> >
>>>> > From: Bruno Roustant <br...@gmail.com>
>>>> > Sent: Tuesday, June 30, 2020 3:02 PM
>>>> > To: dev@lucene.apache.org
>>>> > Subject: Re: 8.6 release
>>>> >
>>>> >
>>>> >
>>>> > [new branch]      0a1f68fafd6711304bbd7372567a359bcf36aab4 ->
>>>> branch_8_6
>>>> >
>>>> >
>>>> > Le mar. 30 juin 2020 à 14:59, Bruno Roustant <
>>>> bruno.roustant@gmail.com> a écrit :
>>>> >
>>>> > I'm creating the branch_8_6 with the release wizard.
>>>> >
>>>> >
>>>> >
>>>> > Le mar. 30 juin 2020 à 12:37, Ishan Chattopadhyaya <
>>>> ichattopadhyaya@gmail.com> a écrit :
>>>> >
>>>> > This is done and merged. Thanks.
>>>> >
>>>> >
>>>> >
>>>> > On Tue, Jun 30, 2020 at 11:52 AM Ishan Chattopadhyaya <
>>>> ichattopadhyaya@gmail.com> wrote:
>>>> >
>>>> > Hi Bruno,
>>>> >
>>>> > I'd like to get SOLR-14599 in. It is for the package manager CLI
>>>> support for cluster level (core container) level plugins. I think it is
>>>> important to have this in 8.6 for two reasons:
>>>> >
>>>> >
>>>> >
>>>> > (a) it will unblock Marcus Eagan/Ke Zhenxu who are working on a new
>>>> Solr UI package and would like to have their package released for early
>>>> feedback
>>>> >
>>>> > (b) Earlier we can release this, more feedback we can get before this
>>>> is released in 9.0.
>>>> >
>>>> > (c) This is an isolated change to the CLI for the package manager
>>>> (experimental), so very low risk to stability of the release.
>>>> >
>>>> >
>>>> >
>>>> > I should be done with this issue by eod today. In case you have no
>>>> objection, I would like to merge this issue after you cut the branch today
>>>> (and before you spin the RC).
>>>> >
>>>> >
>>>> >
>>>> > Regards,
>>>> >
>>>> > Ishan
>>>> >
>>>> >
>>>> >
>>>> > On Tue, Jun 30, 2020 at 6:20 AM Joel Bernstein <jo...@gmail.com>
>>>> wrote:
>>>> >
>>>> > Hi Bruno,
>>>> >
>>>> >
>>>> >
>>>> > Andrzej and I decided that SOLR-14537 is headed to master to bake for
>>>> a while and won't make it into the 8.6 release. So please feel free to cut
>>>> the branch when ready.
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > Joel Bernstein
>>>> >
>>>> > http://joelsolr.blogspot.com/
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On Mon, Jun 29, 2020 at 6:13 AM Andrzej Białecki <ab...@getopt.org>
>>>> wrote:
>>>> >
>>>> > I wold like to include SOLR-14537 in 8.6 (it’s already tagged), the
>>>> patch is ready and I’m just waiting for Joel to finish performance testing.
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On 27 Jun 2020, at 04:59, Tomás Fernández Löbbe <
>>>> tomasflobbe@gmail.com> wrote:
>>>> >
>>>> >
>>>> >
>>>> > I tagged SOLR-14590 for 8.6, The PR is ready for review and I plan to
>>>> merge it soon
>>>> >
>>>> >
>>>> >
>>>> > On Fri, Jun 26, 2020 at 12:54 PM Andrzej Białecki <ab...@getopt.org>
>>>> wrote:
>>>> >
>>>> > Jan,
>>>> >
>>>> >
>>>> >
>>>> > I just removed SOLR-14182 from 8.6, this needs proper back-compat
>>>> shims and testing, and I don’t have enough time to get it done properly for
>>>> 8.6.
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On 26 Jun 2020, at 13:37, Jan Høydahl <ja...@cominvent.com> wrote:
>>>> >
>>>> >
>>>> >
>>>> > Unresolved Solr issues tagged with 8.6:
>>>> >
>>>> >
>>>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6
>>>> >
>>>> >
>>>> >
>>>> > SOLR-14593   Package store API to disable file upload over HTTP
>>>>             Blocker
>>>> >
>>>> > SOLR-14580   CloudSolrClient cannot be initialized using 'zkHosts'
>>>> builder       Blocker
>>>> >
>>>> > SOLR-14516   NPE during Realtime GET
>>>>            Major
>>>> >
>>>> > SOLR-14502   increase bin/solr's post kill sleep
>>>>            Minor
>>>> >
>>>> > SOLR-14398   package store PUT should be idempotent
>>>>             Trivial
>>>> >
>>>> > SOLR-14311   Shared schema should not have access to core level
>>>> classes          Major
>>>> >
>>>> > SOLR-14182   Move metric reporters config from solr.xml to ZK cluster
>>>> properties Major
>>>> >
>>>> > SOLR-14066   Deprecate DIH
>>>>            Blocker
>>>> >
>>>> > SOLR-14022   Deprecate CDCR from Solr in 8.x
>>>>            Blocker
>>>> >
>>>> >
>>>> >
>>>> > Plus two private JIRA issues.
>>>> >
>>>> >
>>>> >
>>>> > Jan
>>>> >
>>>> >
>>>> >
>>>> > 26. jun. 2020 kl. 12:06 skrev Bruno Roustant <
>>>> bruno.roustant@gmail.com>:
>>>> >
>>>> >
>>>> >
>>>> > So the plan is to cut the release branch on next Tuesday June 30th.
>>>> If you anticipate a problem with the date, please reply.
>>>> >
>>>> >
>>>> >
>>>> > Is there any JIRA issue that must be committed before the release is
>>>> made and that has not already the appropriate "Fix Version"?
>>>> >
>>>> >
>>>> >
>>>> > Currently there 3 unresolved issues flagged as Fix Version = 8.6:
>>>> >
>>>> > Add tests for corruptions caused by byte flips LUCENE-9356
>>>> >
>>>> > Fix linefiledocs compression or replace in tests LUCENE-9191
>>>> >
>>>> > Can we merge small segments during refresh, for faster searching?
>>>> LUCENE-8962
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > Le mer. 24 juin 2020 à 21:05, David Smiley <da...@gmail.com>
>>>> a écrit :
>>>> >
>>>> > Thanks starting this discussion, Cassandra.
>>>> >
>>>> >
>>>> >
>>>> > I reviewed the issues I was involved with and I don't quite see
>>>> something worth noting.
>>>> >
>>>> >
>>>> >
>>>> > I plan to add a note about a change in defaults within
>>>> UnifiedHighlighter that could be a significant perf regression.  This
>>>> wasn't introduced in 8.6 but introduced in 8.5 and it's significant enough
>>>> to bring attention to.  I could add it in 8.5's section but then add a
>>>> short pointer to it in 8.6.
>>>> >
>>>> >
>>>> >
>>>> > ~ David
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On Wed, Jun 24, 2020 at 2:52 PM Cassandra Targett <
>>>> casstargett@gmail.com> wrote:
>>>> >
>>>> > I started looking at the Ref Guide for 8.6 to get it ready, and
>>>> notice there are no Upgrade Notes in `solr-upgrade-notes.adoc` for 8.6. Is
>>>> it really true that none are needed at all?
>>>> >
>>>> > I’ll add what I usually do about new features/changes that maybe
>>>> wouldn’t normally make the old Upgrade Notes section, I just find it
>>>> surprising that there weren’t any devs who thought any of the 100 or so
>>>> Solr changes warrant any user caveats.
>>>> >
>>>> > On Jun 17, 2020, 12:27 PM -0500, Tomás Fernández Löbbe <
>>>> tomasflobbe@gmail.com>, wrote:
>>>> >
>>>> >
>>>> > +1. Thanks Bruno
>>>> >
>>>> >
>>>> >
>>>> > On Wed, Jun 17, 2020 at 6:22 AM Mike Drob <md...@apache.org> wrote:
>>>> >
>>>> > +1
>>>> >
>>>> >
>>>> >
>>>> > The release wizard python script should be sufficient for everything.
>>>> If you run into any issues with it, let me know, I used it for 8.5.2 and
>>>> think I understand it pretty well.
>>>> >
>>>> >
>>>> >
>>>> > On Tue, Jun 16, 2020 at 8:31 AM Bruno Roustant <
>>>> bruno.roustant@gmail.com> wrote:
>>>> >
>>>> > Hi all,
>>>> >
>>>> > It’s been a while since we released Lucene/Solr 8.5.
>>>> >
>>>> > I’d like to volunteer to be a release manager for an 8.6 release. If
>>>> there's agreement, then I plan to cut the release branch two weeks today,
>>>> on June 30th, and then to build the first RC two days later.
>>>> >
>>>> >
>>>> >
>>>> > This will be my first time as release manager so I'll probably need
>>>> some guidance. Currently I have two resource links on this subject:
>>>> >
>>>> > https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo
>>>> >
>>>> >
>>>> https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy
>>>> >
>>>> > If you have more, please share with me.
>>>> >
>>>> >
>>>> >
>>>> > Bruno
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>>
>>>>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>
>

Re: 8.6 release

Posted by Jan Høydahl <ja...@cominvent.com>.
I forgot to add the new ‘allowPaths’ feature to upgrade notes. Here is what I plan to commit soon: https://github.com/apache/lucene-solr/pull/1641

Jan

> 2. jul. 2020 kl. 14:18 skrev Mikhail Khludnev <mk...@apache.org>:
> 
> Query DSL:
>  * {param:ref} and {bool: {excludeTags:""}}
> 
> On Thu, Jul 2, 2020 at 1:29 PM Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> wrote:
> Here are the draft release notes.
> I tried to keep them concise, but please tell me if I miss something important.
> 
> Solr 8.6.0 Release Highlights:
> 
> Health Check:
> HealthCheckHandler can now require that all cores are healthy before returning OK.
> Zookeeper read API:
> A read API at /api/cluster/zk/* to fetch raw ZK data and view contents of a ZK directory.
> Admin UI:
> New panel with security info in admin UI's dashboard.
> Streaming Expression:
> Percentiles and standard deviation aggregations added to stats, facet and time series.
> Streaming expressions added to /export handler.
> Drill Streaming Expression for efficient and accurate high cardinality aggregation.
> Cross-Collection Join Queries:
> Join queries can now work cross-collection, even when shared or when spanning nodes.
> Lucene 8.6.0 Release Highlights:
> 
> API change in:
> SimpleFSDireectory, IndexWriterConfig, MergeScheduler, SortFields, SimpleBindings, QueryVisitor, DocValues, CodecUtil.
> New:
> IndexWriter merge-on-commit feature to selectively merge small segments on commit, subject to a configurable timeout, to improve search performance by reducing the number of small segments for searching.
> Grouping by range based on DoubleValueSource and LongValueSource.
> Optimizations:
> BKD trees and index, DoubleValuesSource/QueryValueSource, UsageTrackingQueryingCachingPolicy, FST, Geometry queries, Points, UniformSplit
> Others:
> Ukrainian analyzer, checksums verification, resource leaks fixes
> 
> 
> 
> Le mar. 30 juin 2020 à 19:38, Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> a écrit :
> Erick:
> AFAIK yes from now on a commit in branch_8x will not go to 8.6 branch.
> 
> Le mar. 30 juin 2020 à 17:59, Erick Erickson <erickerickson@gmail.com <ma...@gmail.com>> a écrit :
> Bruno:
> 
> Just to double check, anything committed to branch_8x from here on won’t affect the 8.6 release unless explicitly backported, correct?
> 
> I may be close to upgrading Zookeeper to 3.6.1, and very much do NOT want it in the 8.6 release as it should bake longer than 2 weeks even…
> 
> Thanks for managing this release!
> 
> Erick
> 
> > On Jun 30, 2020, at 11:34 AM, Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> wrote:
> > 
> > For the RC, I prefer to let the latest and greatest commits to bake a week rather than only 2 days. Some of them have important impact and were added very recently.
> > So I plan a RC on July 7, if the smoke tester is fixed before that time.
> > 
> > Bruno
> > 
> > Le mar. 30 juin 2020 à 16:48, Uwe Schindler <uwe@thetaphi.de <ma...@thetaphi.de>> a écrit :
> > Hi,
> > 
> >  
> > 
> > I enabled builds for 8.6 on Policeman Jenkins:
> > 
> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/ <https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/>
> > 
> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/ <https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/>
> > 
> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/ <https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/>
> > 
> >  
> > 
> > Uwe
> > 
> >  
> > 
> > -----
> > 
> > Uwe Schindler
> > 
> > Achterdiek 19, D-28357 Bremen
> > 
> > https://www.thetaphi.de <https://www.thetaphi.de/>
> > 
> > eMail: uwe@thetaphi.de <ma...@thetaphi.de>
> > 
> >  
> > 
> > From: Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> 
> > Sent: Tuesday, June 30, 2020 3:02 PM
> > To: dev@lucene.apache.org <ma...@lucene.apache.org>
> > Subject: Re: 8.6 release
> > 
> >  
> > 
> > [new branch]      0a1f68fafd6711304bbd7372567a359bcf36aab4 -> branch_8_6
> >  
> > 
> > Le mar. 30 juin 2020 à 14:59, Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> a écrit :
> > 
> > I'm creating the branch_8_6 with the release wizard.
> > 
> >  
> > 
> > Le mar. 30 juin 2020 à 12:37, Ishan Chattopadhyaya <ichattopadhyaya@gmail.com <ma...@gmail.com>> a écrit :
> > 
> > This is done and merged. Thanks.
> > 
> >  
> > 
> > On Tue, Jun 30, 2020 at 11:52 AM Ishan Chattopadhyaya <ichattopadhyaya@gmail.com <ma...@gmail.com>> wrote:
> > 
> > Hi Bruno,
> > 
> > I'd like to get SOLR-14599 in. It is for the package manager CLI support for cluster level (core container) level plugins. I think it is important to have this in 8.6 for two reasons:
> > 
> >  
> > 
> > (a) it will unblock Marcus Eagan/Ke Zhenxu who are working on a new Solr UI package and would like to have their package released for early feedback
> > 
> > (b) Earlier we can release this, more feedback we can get before this is released in 9.0.
> > 
> > (c) This is an isolated change to the CLI for the package manager (experimental), so very low risk to stability of the release.
> > 
> >  
> > 
> > I should be done with this issue by eod today. In case you have no objection, I would like to merge this issue after you cut the branch today (and before you spin the RC).
> > 
> >  
> > 
> > Regards,
> > 
> > Ishan
> > 
> >  
> > 
> > On Tue, Jun 30, 2020 at 6:20 AM Joel Bernstein <joelsolr@gmail.com <ma...@gmail.com>> wrote:
> > 
> > Hi Bruno,
> > 
> >  
> > 
> > Andrzej and I decided that SOLR-14537 is headed to master to bake for a while and won't make it into the 8.6 release. So please feel free to cut the branch when ready.
> > 
> >  
> > 
> > 
> > 
> > Joel Bernstein
> > 
> > http://joelsolr.blogspot.com/ <http://joelsolr.blogspot.com/>
> > 
> >  
> > 
> >  
> > 
> > On Mon, Jun 29, 2020 at 6:13 AM Andrzej Białecki <ab@getopt.org <ma...@getopt.org>> wrote:
> > 
> > I wold like to include SOLR-14537 in 8.6 (it’s already tagged), the patch is ready and I’m just waiting for Joel to finish performance testing.
> > 
> > 
> > 
> > 
> > On 27 Jun 2020, at 04:59, Tomás Fernández Löbbe <tomasflobbe@gmail.com <ma...@gmail.com>> wrote:
> > 
> >  
> > 
> > I tagged SOLR-14590 for 8.6, The PR is ready for review and I plan to merge it soon 
> > 
> >  
> > 
> > On Fri, Jun 26, 2020 at 12:54 PM Andrzej Białecki <ab@getopt.org <ma...@getopt.org>> wrote:
> > 
> > Jan,
> > 
> >  
> > 
> > I just removed SOLR-14182 from 8.6, this needs proper back-compat shims and testing, and I don’t have enough time to get it done properly for 8.6.
> > 
> > 
> > 
> > 
> > On 26 Jun 2020, at 13:37, Jan Høydahl <jan.asf@cominvent.com <ma...@cominvent.com>> wrote:
> > 
> >  
> > 
> > Unresolved Solr issues tagged with 8.6:
> > 
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6 <https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6> 
> > 
> >  
> > 
> > SOLR-14593   Package store API to disable file upload over HTTP                  Blocker 
> > 
> > SOLR-14580   CloudSolrClient cannot be initialized using 'zkHosts' builder       Blocker 
> > 
> > SOLR-14516   NPE during Realtime GET                                             Major   
> > 
> > SOLR-14502   increase bin/solr's post kill sleep                                 Minor   
> > 
> > SOLR-14398   package store PUT should be idempotent                              Trivial 
> > 
> > SOLR-14311   Shared schema should not have access to core level classes          Major   
> > 
> > SOLR-14182   Move metric reporters config from solr.xml to ZK cluster properties Major   
> > 
> > SOLR-14066   Deprecate DIH                                                       Blocker 
> > 
> > SOLR-14022   Deprecate CDCR from Solr in 8.x                                     Blocker 
> > 
> >  
> > 
> > Plus two private JIRA issues.
> > 
> >  
> > 
> > Jan
> > 
> >  
> > 
> > 26. jun. 2020 kl. 12:06 skrev Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>>:
> > 
> >  
> > 
> > So the plan is to cut the release branch on next Tuesday June 30th. If you anticipate a problem with the date, please reply.
> > 
> >  
> > 
> > Is there any JIRA issue that must be committed before the release is made and that has not already the appropriate "Fix Version"?
> > 
> >  
> > 
> > Currently there 3 unresolved issues flagged as Fix Version = 8.6:
> > 
> > Add tests for corruptions caused by byte flips LUCENE-9356
> > 
> > Fix linefiledocs compression or replace in tests LUCENE-9191
> > 
> > Can we merge small segments during refresh, for faster searching? LUCENE-8962
> > 
> >  
> > 
> >  
> > 
> > Le mer. 24 juin 2020 à 21:05, David Smiley <david.w.smiley@gmail.com <ma...@gmail.com>> a écrit :
> > 
> > Thanks starting this discussion, Cassandra.
> > 
> >  
> > 
> > I reviewed the issues I was involved with and I don't quite see something worth noting.
> > 
> >  
> > 
> > I plan to add a note about a change in defaults within UnifiedHighlighter that could be a significant perf regression.  This wasn't introduced in 8.6 but introduced in 8.5 and it's significant enough to bring attention to.  I could add it in 8.5's section but then add a short pointer to it in 8.6.
> > 
> >  
> > 
> > ~ David
> > 
> >  
> > 
> >  
> > 
> > On Wed, Jun 24, 2020 at 2:52 PM Cassandra Targett <casstargett@gmail.com <ma...@gmail.com>> wrote:
> > 
> > I started looking at the Ref Guide for 8.6 to get it ready, and notice there are no Upgrade Notes in `solr-upgrade-notes.adoc` for 8.6. Is it really true that none are needed at all?
> > 
> > I’ll add what I usually do about new features/changes that maybe wouldn’t normally make the old Upgrade Notes section, I just find it surprising that there weren’t any devs who thought any of the 100 or so Solr changes warrant any user caveats.
> > 
> > On Jun 17, 2020, 12:27 PM -0500, Tomás Fernández Löbbe <tomasflobbe@gmail.com <ma...@gmail.com>>, wrote:
> > 
> > 
> > +1. Thanks Bruno
> > 
> >  
> > 
> > On Wed, Jun 17, 2020 at 6:22 AM Mike Drob <mdrob@apache.org <ma...@apache.org>> wrote:
> > 
> > +1
> > 
> >  
> > 
> > The release wizard python script should be sufficient for everything. If you run into any issues with it, let me know, I used it for 8.5.2 and think I understand it pretty well. 
> > 
> >  
> > 
> > On Tue, Jun 16, 2020 at 8:31 AM Bruno Roustant <bruno.roustant@gmail.com <ma...@gmail.com>> wrote:
> > 
> > Hi all,
> > 
> > It’s been a while since we released Lucene/Solr 8.5.
> > 
> > I’d like to volunteer to be a release manager for an 8.6 release. If there's agreement, then I plan to cut the release branch two weeks today, on June 30th, and then to build the first RC two days later.
> > 
> >  
> > 
> > This will be my first time as release manager so I'll probably need some guidance. Currently I have two resource links on this subject:
> > 
> > https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo <https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo>
> > 
> > https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy <https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy>
> > 
> > If you have more, please share with me.
> > 
> >  
> > 
> > Bruno
> > 
> >  
> > 
> >  
> > 
> >  
> > 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org <ma...@lucene.apache.org>
> For additional commands, e-mail: dev-help@lucene.apache.org <ma...@lucene.apache.org>
> 
> 
> 
> -- 
> Sincerely yours
> Mikhail Khludnev


Re: 8.6 release

Posted by Mikhail Khludnev <mk...@apache.org>.
Query DSL:
 * {param:ref} and {bool: {excludeTags:""}}

On Thu, Jul 2, 2020 at 1:29 PM Bruno Roustant <br...@gmail.com>
wrote:

> Here are the draft release notes.
> I tried to keep them concise, but please tell me if I miss something
> important.
>
> Solr 8.6.0 Release Highlights:
>
>    - Health Check:
>    HealthCheckHandler can now require that all cores are healthy before
>    returning OK.
>    - Zookeeper read API:
>    A read API at /api/cluster/zk/* to fetch raw ZK data and view contents
>    of a ZK directory.
>    - Admin UI:
>    New panel with security info in admin UI's dashboard.
>    - Streaming Expression:
>    Percentiles and standard deviation aggregations added to stats, facet
>    and time series.
>    Streaming expressions added to /export handler.
>    Drill Streaming Expression for efficient and accurate high cardinality
>    aggregation.
>    - Cross-Collection Join Queries:
>    Join queries can now work cross-collection, even when shared or when
>    spanning nodes.
>
> Lucene 8.6.0 Release Highlights:
>
>    - API change in:
>    SimpleFSDireectory, IndexWriterConfig, MergeScheduler, SortFields,
>    SimpleBindings, QueryVisitor, DocValues, CodecUtil.
>    - New:
>    IndexWriter merge-on-commit feature to selectively merge small
>    segments on commit, subject to a configurable timeout, to improve search
>    performance by reducing the number of small segments for searching.
>    Grouping by range based on DoubleValueSource and LongValueSource.
>    - Optimizations:
>    BKD trees and index, DoubleValuesSource/QueryValueSource,
>    UsageTrackingQueryingCachingPolicy, FST, Geometry queries,
>    Points, UniformSplit
>    - Others:
>    Ukrainian analyzer, checksums verification, resource leaks fixes
>
>
>
>
> Le mar. 30 juin 2020 à 19:38, Bruno Roustant <br...@gmail.com> a
> écrit :
>
>> Erick:
>> AFAIK yes from now on a commit in branch_8x will not go to 8.6 branch.
>>
>> Le mar. 30 juin 2020 à 17:59, Erick Erickson <er...@gmail.com> a
>> écrit :
>>
>>> Bruno:
>>>
>>> Just to double check, anything committed to branch_8x from here on won’t
>>> affect the 8.6 release unless explicitly backported, correct?
>>>
>>> I may be close to upgrading Zookeeper to 3.6.1, and very much do NOT
>>> want it in the 8.6 release as it should bake longer than 2 weeks even…
>>>
>>> Thanks for managing this release!
>>>
>>> Erick
>>>
>>> > On Jun 30, 2020, at 11:34 AM, Bruno Roustant <br...@gmail.com>
>>> wrote:
>>> >
>>> > For the RC, I prefer to let the latest and greatest commits to bake a
>>> week rather than only 2 days. Some of them have important impact and were
>>> added very recently.
>>> > So I plan a RC on July 7, if the smoke tester is fixed before that
>>> time.
>>> >
>>> > Bruno
>>> >
>>> > Le mar. 30 juin 2020 à 16:48, Uwe Schindler <uw...@thetaphi.de> a écrit
>>> :
>>> > Hi,
>>> >
>>> >
>>> >
>>> > I enabled builds for 8.6 on Policeman Jenkins:
>>> >
>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Linux/
>>> >
>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-MacOSX/
>>> >
>>> > https://jenkins.thetaphi.de/job/Lucene-Solr-8.6-Windows/
>>> >
>>> >
>>> >
>>> > Uwe
>>> >
>>> >
>>> >
>>> > -----
>>> >
>>> > Uwe Schindler
>>> >
>>> > Achterdiek 19, D-28357 Bremen
>>> >
>>> > https://www.thetaphi.de
>>> >
>>> > eMail: uwe@thetaphi.de
>>> >
>>> >
>>> >
>>> > From: Bruno Roustant <br...@gmail.com>
>>> > Sent: Tuesday, June 30, 2020 3:02 PM
>>> > To: dev@lucene.apache.org
>>> > Subject: Re: 8.6 release
>>> >
>>> >
>>> >
>>> > [new branch]      0a1f68fafd6711304bbd7372567a359bcf36aab4 ->
>>> branch_8_6
>>> >
>>> >
>>> > Le mar. 30 juin 2020 à 14:59, Bruno Roustant <br...@gmail.com>
>>> a écrit :
>>> >
>>> > I'm creating the branch_8_6 with the release wizard.
>>> >
>>> >
>>> >
>>> > Le mar. 30 juin 2020 à 12:37, Ishan Chattopadhyaya <
>>> ichattopadhyaya@gmail.com> a écrit :
>>> >
>>> > This is done and merged. Thanks.
>>> >
>>> >
>>> >
>>> > On Tue, Jun 30, 2020 at 11:52 AM Ishan Chattopadhyaya <
>>> ichattopadhyaya@gmail.com> wrote:
>>> >
>>> > Hi Bruno,
>>> >
>>> > I'd like to get SOLR-14599 in. It is for the package manager CLI
>>> support for cluster level (core container) level plugins. I think it is
>>> important to have this in 8.6 for two reasons:
>>> >
>>> >
>>> >
>>> > (a) it will unblock Marcus Eagan/Ke Zhenxu who are working on a new
>>> Solr UI package and would like to have their package released for early
>>> feedback
>>> >
>>> > (b) Earlier we can release this, more feedback we can get before this
>>> is released in 9.0.
>>> >
>>> > (c) This is an isolated change to the CLI for the package manager
>>> (experimental), so very low risk to stability of the release.
>>> >
>>> >
>>> >
>>> > I should be done with this issue by eod today. In case you have no
>>> objection, I would like to merge this issue after you cut the branch today
>>> (and before you spin the RC).
>>> >
>>> >
>>> >
>>> > Regards,
>>> >
>>> > Ishan
>>> >
>>> >
>>> >
>>> > On Tue, Jun 30, 2020 at 6:20 AM Joel Bernstein <jo...@gmail.com>
>>> wrote:
>>> >
>>> > Hi Bruno,
>>> >
>>> >
>>> >
>>> > Andrzej and I decided that SOLR-14537 is headed to master to bake for
>>> a while and won't make it into the 8.6 release. So please feel free to cut
>>> the branch when ready.
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > Joel Bernstein
>>> >
>>> > http://joelsolr.blogspot.com/
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Mon, Jun 29, 2020 at 6:13 AM Andrzej Białecki <ab...@getopt.org>
>>> wrote:
>>> >
>>> > I wold like to include SOLR-14537 in 8.6 (it’s already tagged), the
>>> patch is ready and I’m just waiting for Joel to finish performance testing.
>>> >
>>> >
>>> >
>>> >
>>> > On 27 Jun 2020, at 04:59, Tomás Fernández Löbbe <to...@gmail.com>
>>> wrote:
>>> >
>>> >
>>> >
>>> > I tagged SOLR-14590 for 8.6, The PR is ready for review and I plan to
>>> merge it soon
>>> >
>>> >
>>> >
>>> > On Fri, Jun 26, 2020 at 12:54 PM Andrzej Białecki <ab...@getopt.org>
>>> wrote:
>>> >
>>> > Jan,
>>> >
>>> >
>>> >
>>> > I just removed SOLR-14182 from 8.6, this needs proper back-compat
>>> shims and testing, and I don’t have enough time to get it done properly for
>>> 8.6.
>>> >
>>> >
>>> >
>>> >
>>> > On 26 Jun 2020, at 13:37, Jan Høydahl <ja...@cominvent.com> wrote:
>>> >
>>> >
>>> >
>>> > Unresolved Solr issues tagged with 8.6:
>>> >
>>> >
>>> https://issues.apache.org/jira/issues/?jql=project%20%3D%20SOLR%20AND%20resolution%20%3D%20Unresolved%20AND%20fixVersion%20%3D%208.6
>>> >
>>> >
>>> >
>>> > SOLR-14593   Package store API to disable file upload over HTTP
>>>           Blocker
>>> >
>>> > SOLR-14580   CloudSolrClient cannot be initialized using 'zkHosts'
>>> builder       Blocker
>>> >
>>> > SOLR-14516   NPE during Realtime GET
>>>            Major
>>> >
>>> > SOLR-14502   increase bin/solr's post kill sleep
>>>            Minor
>>> >
>>> > SOLR-14398   package store PUT should be idempotent
>>>           Trivial
>>> >
>>> > SOLR-14311   Shared schema should not have access to core level
>>> classes          Major
>>> >
>>> > SOLR-14182   Move metric reporters config from solr.xml to ZK cluster
>>> properties Major
>>> >
>>> > SOLR-14066   Deprecate DIH
>>>            Blocker
>>> >
>>> > SOLR-14022   Deprecate CDCR from Solr in 8.x
>>>            Blocker
>>> >
>>> >
>>> >
>>> > Plus two private JIRA issues.
>>> >
>>> >
>>> >
>>> > Jan
>>> >
>>> >
>>> >
>>> > 26. jun. 2020 kl. 12:06 skrev Bruno Roustant <bruno.roustant@gmail.com
>>> >:
>>> >
>>> >
>>> >
>>> > So the plan is to cut the release branch on next Tuesday June 30th. If
>>> you anticipate a problem with the date, please reply.
>>> >
>>> >
>>> >
>>> > Is there any JIRA issue that must be committed before the release is
>>> made and that has not already the appropriate "Fix Version"?
>>> >
>>> >
>>> >
>>> > Currently there 3 unresolved issues flagged as Fix Version = 8.6:
>>> >
>>> > Add tests for corruptions caused by byte flips LUCENE-9356
>>> >
>>> > Fix linefiledocs compression or replace in tests LUCENE-9191
>>> >
>>> > Can we merge small segments during refresh, for faster searching?
>>> LUCENE-8962
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > Le mer. 24 juin 2020 à 21:05, David Smiley <da...@gmail.com>
>>> a écrit :
>>> >
>>> > Thanks starting this discussion, Cassandra.
>>> >
>>> >
>>> >
>>> > I reviewed the issues I was involved with and I don't quite see
>>> something worth noting.
>>> >
>>> >
>>> >
>>> > I plan to add a note about a change in defaults within
>>> UnifiedHighlighter that could be a significant perf regression.  This
>>> wasn't introduced in 8.6 but introduced in 8.5 and it's significant enough
>>> to bring attention to.  I could add it in 8.5's section but then add a
>>> short pointer to it in 8.6.
>>> >
>>> >
>>> >
>>> > ~ David
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Wed, Jun 24, 2020 at 2:52 PM Cassandra Targett <
>>> casstargett@gmail.com> wrote:
>>> >
>>> > I started looking at the Ref Guide for 8.6 to get it ready, and notice
>>> there are no Upgrade Notes in `solr-upgrade-notes.adoc` for 8.6. Is it
>>> really true that none are needed at all?
>>> >
>>> > I’ll add what I usually do about new features/changes that maybe
>>> wouldn’t normally make the old Upgrade Notes section, I just find it
>>> surprising that there weren’t any devs who thought any of the 100 or so
>>> Solr changes warrant any user caveats.
>>> >
>>> > On Jun 17, 2020, 12:27 PM -0500, Tomás Fernández Löbbe <
>>> tomasflobbe@gmail.com>, wrote:
>>> >
>>> >
>>> > +1. Thanks Bruno
>>> >
>>> >
>>> >
>>> > On Wed, Jun 17, 2020 at 6:22 AM Mike Drob <md...@apache.org> wrote:
>>> >
>>> > +1
>>> >
>>> >
>>> >
>>> > The release wizard python script should be sufficient for everything.
>>> If you run into any issues with it, let me know, I used it for 8.5.2 and
>>> think I understand it pretty well.
>>> >
>>> >
>>> >
>>> > On Tue, Jun 16, 2020 at 8:31 AM Bruno Roustant <
>>> bruno.roustant@gmail.com> wrote:
>>> >
>>> > Hi all,
>>> >
>>> > It’s been a while since we released Lucene/Solr 8.5.
>>> >
>>> > I’d like to volunteer to be a release manager for an 8.6 release. If
>>> there's agreement, then I plan to cut the release branch two weeks today,
>>> on June 30th, and then to build the first RC two days later.
>>> >
>>> >
>>> >
>>> > This will be my first time as release manager so I'll probably need
>>> some guidance. Currently I have two resource links on this subject:
>>> >
>>> > https://cwiki.apache.org/confluence/display/LUCENE/ReleaseTodo
>>> >
>>> >
>>> https://github.com/apache/lucene-solr/tree/master/dev-tools/scripts#releasewizardpy
>>> >
>>> > If you have more, please share with me.
>>> >
>>> >
>>> >
>>> > Bruno
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>
>>>

-- 
Sincerely yours
Mikhail Khludnev