You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Adrien Grand <jp...@gmail.com> on 2023/06/09 16:07:24 UTC
Lucene 9.7 release
Hello all,
There is some good stuff that is scheduled for 9.7 already, I found the
following changes in the changelog that look especially interesting:
- Concurrent query rewrites for vector queries.
- Speedups to vector indexing/search via integration of the Panama vector
API.
- Reduced overhead of soft deletes.
- Support for update by query.
I propose we start the process for a 9.7 release, and I volunteer to be the
release manager. I suggest the following schedule:
- Feature freeze on June 16th, one week from now. This is when the 9.7
branch will be cut.
- Open a vote on June 21st, which we'll possibly delay if blockers get
identified.
--
Adrien
Re: Lucene 9.7 release
Posted by Michael Wechner <mi...@wyona.com>.
Thank you very much, Adrien!
Am 09.06.23 um 18:20 schrieb Tomás Fernández Löbbe:
> +1
> Thanks Adrien
>
> On Fri, Jun 9, 2023 at 9:19 AM Michael McCandless
> <lu...@mikemccandless.com> wrote:
>
> +1, thanks Adrien!
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Fri, Jun 9, 2023 at 12:11 PM Patrick Zhai <zh...@gmail.com>
> wrote:
>
> +1, thank you Adrien!
>
> On Fri, Jun 9, 2023, 09:08 Adrien Grand <jp...@gmail.com> wrote:
>
> Hello all,
>
> There is some good stuff that is scheduled for 9.7
> already, I found the following changes in the changelog
> that look especially interesting:
> - Concurrent query rewrites for vector queries.
> - Speedups to vector indexing/search via integration of
> the Panama vector API.
> - Reduced overhead of soft deletes.
> - Support for update by query.
>
> I propose we start the process for a 9.7 release, and I
> volunteer to be the release manager. I suggest the
> following schedule:
> - Feature freeze on June 16th, one week from now. This is
> when the 9.7 branch will be cut.
> - Open a vote on June 21st, which we'll possibly delay if
> blockers get identified.
>
> --
> Adrien
>
Re: Lucene 9.7 release
Posted by Ignacio Vera <iv...@gmail.com>.
+1
On Fri, Jun 9, 2023 at 6:20 PM Tomás Fernández Löbbe <to...@gmail.com>
wrote:
> +1
> Thanks Adrien
>
> On Fri, Jun 9, 2023 at 9:19 AM Michael McCandless <
> lucene@mikemccandless.com> wrote:
>
>> +1, thanks Adrien!
>>
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
>>
>> On Fri, Jun 9, 2023 at 12:11 PM Patrick Zhai <zh...@gmail.com> wrote:
>>
>>> +1, thank you Adrien!
>>>
>>> On Fri, Jun 9, 2023, 09:08 Adrien Grand <jp...@gmail.com> wrote:
>>>
>>>> Hello all,
>>>>
>>>> There is some good stuff that is scheduled for 9.7 already, I found the
>>>> following changes in the changelog that look especially interesting:
>>>> - Concurrent query rewrites for vector queries.
>>>> - Speedups to vector indexing/search via integration of the Panama
>>>> vector API.
>>>> - Reduced overhead of soft deletes.
>>>> - Support for update by query.
>>>>
>>>> I propose we start the process for a 9.7 release, and I volunteer to be
>>>> the release manager. I suggest the following schedule:
>>>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>>>> branch will be cut.
>>>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>>>> identified.
>>>>
>>>> --
>>>> Adrien
>>>>
>>>
Re: Lucene 9.7 release
Posted by Tomás Fernández Löbbe <to...@gmail.com>.
+1
Thanks Adrien
On Fri, Jun 9, 2023 at 9:19 AM Michael McCandless <lu...@mikemccandless.com>
wrote:
> +1, thanks Adrien!
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Fri, Jun 9, 2023 at 12:11 PM Patrick Zhai <zh...@gmail.com> wrote:
>
>> +1, thank you Adrien!
>>
>> On Fri, Jun 9, 2023, 09:08 Adrien Grand <jp...@gmail.com> wrote:
>>
>>> Hello all,
>>>
>>> There is some good stuff that is scheduled for 9.7 already, I found the
>>> following changes in the changelog that look especially interesting:
>>> - Concurrent query rewrites for vector queries.
>>> - Speedups to vector indexing/search via integration of the Panama
>>> vector API.
>>> - Reduced overhead of soft deletes.
>>> - Support for update by query.
>>>
>>> I propose we start the process for a 9.7 release, and I volunteer to be
>>> the release manager. I suggest the following schedule:
>>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>>> branch will be cut.
>>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>>> identified.
>>>
>>> --
>>> Adrien
>>>
>>
Re: Lucene 9.7 release
Posted by Michael McCandless <lu...@mikemccandless.com>.
+1, thanks Adrien!
Mike McCandless
http://blog.mikemccandless.com
On Fri, Jun 9, 2023 at 12:11 PM Patrick Zhai <zh...@gmail.com> wrote:
> +1, thank you Adrien!
>
> On Fri, Jun 9, 2023, 09:08 Adrien Grand <jp...@gmail.com> wrote:
>
>> Hello all,
>>
>> There is some good stuff that is scheduled for 9.7 already, I found the
>> following changes in the changelog that look especially interesting:
>> - Concurrent query rewrites for vector queries.
>> - Speedups to vector indexing/search via integration of the Panama
>> vector API.
>> - Reduced overhead of soft deletes.
>> - Support for update by query.
>>
>> I propose we start the process for a 9.7 release, and I volunteer to be
>> the release manager. I suggest the following schedule:
>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>> branch will be cut.
>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>> identified.
>>
>> --
>> Adrien
>>
>
Re: Lucene 9.7 release
Posted by Patrick Zhai <zh...@gmail.com>.
+1, thank you Adrien!
On Fri, Jun 9, 2023, 09:08 Adrien Grand <jp...@gmail.com> wrote:
> Hello all,
>
> There is some good stuff that is scheduled for 9.7 already, I found the
> following changes in the changelog that look especially interesting:
> - Concurrent query rewrites for vector queries.
> - Speedups to vector indexing/search via integration of the Panama vector
> API.
> - Reduced overhead of soft deletes.
> - Support for update by query.
>
> I propose we start the process for a 9.7 release, and I volunteer to be
> the release manager. I suggest the following schedule:
> - Feature freeze on June 16th, one week from now. This is when the 9.7
> branch will be cut.
> - Open a vote on June 21st, which we'll possibly delay if blockers get
> identified.
>
> --
> Adrien
>
Re: Lucene 9.7 release
Posted by Alessandro Benedetti <a....@sease.io>.
Friday should be doable, thanks!
it's true it's a new feature, the only reason is "urgent" is because it's
half of the work we needed to bring this to Solr and we wuld prefer to not
lose traction over there (and have to wait much longer).
Not a blocker by any means!
But I hope we bring it in :)
--------------------------
*Alessandro Benedetti*
Director @ Sease Ltd.
*Apache Lucene/Solr Committer*
*Apache Solr PMC Member*
e-mail: a.benedetti@sease.io
*Sease* - Information Retrieval Applied
Consulting | Training | Open Source
Website: Sease.io <http://sease.io/>
LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter
<https://twitter.com/seaseltd> | Youtube
<https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github
<https://github.com/seaseltd>
On Mon, 12 Jun 2023 at 17:59, Adrien Grand <jp...@gmail.com> wrote:
> Hi Alessandro,
>
> It's ok to merge changes before feature freeze, currently planned for
> Friday. From a quick look, this is a new feature rather than a bug fix, so
> if it's not ready by Friday it could wait until the next minor?
>
> On Mon, Jun 12, 2023 at 6:15 PM Alessandro Benedetti <a....@sease.io>
> wrote:
>
>> Hi,
>> we are finalizing https://github.com/apache/lucene/pull/12253, we got
>> some last-minute valuable review comments and we would like to apply the
>> suggestions and bring them in 9.x .
>> Cheers
>> --------------------------
>> *Alessandro Benedetti*
>> Director @ Sease Ltd.
>> *Apache Lucene/Solr Committer*
>> *Apache Solr PMC Member*
>>
>> e-mail: a.benedetti@sease.io
>>
>>
>> *Sease* - Information Retrieval Applied
>> Consulting | Training | Open Source
>>
>> Website: Sease.io <http://sease.io/>
>> LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter
>> <https://twitter.com/seaseltd> | Youtube
>> <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github
>> <https://github.com/seaseltd>
>>
>>
>> On Fri, 9 Jun 2023 at 23:53, Uwe Schindler <uw...@thetaphi.de> wrote:
>>
>>> Hi,
>>>
>>> BTW, there was a slight change in APIJARs caused by this API change:
>>> https://github.com/openjdk/jdk/commit/5fc9b5787dc4d7f00d2c59288bc8d840fdf5b495
>>> (this does not affect our code, but it was done 3 weeks ago). I hope
>>> something like this won't happen. I updated the PR, no code changes needed
>>> as those methods were not used by Lucene.
>>>
>>> I'd like to update the APIJARS again shortly before the feature branch
>>> is created.
>>>
>>> Uwe
>>> Am 09.06.2023 um 23:10 schrieb Uwe Schindler:
>>>
>>> Let me merge and backport the java 21 map PR first. It has all new
>>> source directories and APIJAR files.
>>>
>>> For safety I will regenerate the 21 APIJAR with newest jdk build. Fyi,
>>> to regenerate you need to have an environment variable with jdk21 as
>>> autoprovisioning doesn't work.
>>>
>>> After that we can copy-paste the vector impl to the main/java21 folder
>>> and add vector classes to it.
>>>
>>> Uwe
>>>
>>>
>>> Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty
>>> <ch...@elastic.co.INVALID>
>>> <ch...@elastic.co.INVALID>:
>>>
>>>> Hi,
>>>>
>>>> On 9 Jun 2023, at 17:19, Uwe Schindler <uw...@thetaphi.de>
>>>> <uw...@thetaphi.de> wrote:
>>>>
>>>> Hi,
>>>>
>>>> if possible I would like to get the Java 21 changes (MemorySegments and
>>>> Vector) into the release. I'd like to ask Chris who has better knowledge
>>>> how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to
>>>> wait that time.
>>>>
>>>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not.
>>>> From my understanding the final phases have started, so API changes are
>>>> unlikely. If there are bug fixes they won't affect public APIs or the
>>>> incubator module, right?
>>>>
>>>> Your understanding is correct. I do not expect any API changes at this
>>>> point.
>>>>
>>>> The MMapDir changes are already tested all the time, vector API needs
>>>> the forward port to 21.
>>>>
>>>> We are also doing some early testing with JDK 21 EA, and it would be
>>>> great to get the 21-version of Panama VectorUtils in. I can help get this
>>>> done.
>>>>
>>>> Uwe, what has been done so far? If nothing, as that is still the case
>>>> tomorrow, I can start on it.
>>>>
>>>> -Chris.
>>>>
>>>> Uwe
>>>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>>>
>>>> Hello all,
>>>>
>>>> There is some good stuff that is scheduled for 9.7 already, I found the
>>>> following changes in the changelog that look especially interesting:
>>>> - Concurrent query rewrites for vector queries.
>>>> - Speedups to vector indexing/search via integration of the Panama
>>>> vector API.
>>>> - Reduced overhead of soft deletes.
>>>> - Support for update by query.
>>>>
>>>> I propose we start the process for a 9.7 release, and I volunteer to be
>>>> the release manager. I suggest the following schedule:
>>>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>>>> branch will be cut.
>>>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>>>> identified.
>>>>
>>>> --
>>>> Adrien
>>>>
>>>> --
>>>> Uwe Schindler
>>>> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
>>>> eMail: uwe@thetaphi.de
>>>>
>>>>
>>>> --
>>> Uwe Schindler
>>> Achterdiek 19, 28357 Bremen
>>> https://www.thetaphi.de
>>>
>>> --
>>> Uwe Schindler
>>> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
>>> eMail: uwe@thetaphi.de
>>>
>>>
>
> --
> Adrien
>
Re: Lucene 9.7 release
Posted by Adrien Grand <jp...@gmail.com>.
Hi Alessandro,
It's ok to merge changes before feature freeze, currently planned for
Friday. From a quick look, this is a new feature rather than a bug fix, so
if it's not ready by Friday it could wait until the next minor?
On Mon, Jun 12, 2023 at 6:15 PM Alessandro Benedetti <a....@sease.io>
wrote:
> Hi,
> we are finalizing https://github.com/apache/lucene/pull/12253, we got
> some last-minute valuable review comments and we would like to apply the
> suggestions and bring them in 9.x .
> Cheers
> --------------------------
> *Alessandro Benedetti*
> Director @ Sease Ltd.
> *Apache Lucene/Solr Committer*
> *Apache Solr PMC Member*
>
> e-mail: a.benedetti@sease.io
>
>
> *Sease* - Information Retrieval Applied
> Consulting | Training | Open Source
>
> Website: Sease.io <http://sease.io/>
> LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter
> <https://twitter.com/seaseltd> | Youtube
> <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github
> <https://github.com/seaseltd>
>
>
> On Fri, 9 Jun 2023 at 23:53, Uwe Schindler <uw...@thetaphi.de> wrote:
>
>> Hi,
>>
>> BTW, there was a slight change in APIJARs caused by this API change:
>> https://github.com/openjdk/jdk/commit/5fc9b5787dc4d7f00d2c59288bc8d840fdf5b495
>> (this does not affect our code, but it was done 3 weeks ago). I hope
>> something like this won't happen. I updated the PR, no code changes needed
>> as those methods were not used by Lucene.
>>
>> I'd like to update the APIJARS again shortly before the feature branch is
>> created.
>>
>> Uwe
>> Am 09.06.2023 um 23:10 schrieb Uwe Schindler:
>>
>> Let me merge and backport the java 21 map PR first. It has all new source
>> directories and APIJAR files.
>>
>> For safety I will regenerate the 21 APIJAR with newest jdk build. Fyi, to
>> regenerate you need to have an environment variable with jdk21 as
>> autoprovisioning doesn't work.
>>
>> After that we can copy-paste the vector impl to the main/java21 folder
>> and add vector classes to it.
>>
>> Uwe
>>
>>
>> Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty
>> <ch...@elastic.co.INVALID>
>> <ch...@elastic.co.INVALID>:
>>
>>> Hi,
>>>
>>> On 9 Jun 2023, at 17:19, Uwe Schindler <uw...@thetaphi.de>
>>> <uw...@thetaphi.de> wrote:
>>>
>>> Hi,
>>>
>>> if possible I would like to get the Java 21 changes (MemorySegments and
>>> Vector) into the release. I'd like to ask Chris who has better knowledge
>>> how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to
>>> wait that time.
>>>
>>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not.
>>> From my understanding the final phases have started, so API changes are
>>> unlikely. If there are bug fixes they won't affect public APIs or the
>>> incubator module, right?
>>>
>>> Your understanding is correct. I do not expect any API changes at this
>>> point.
>>>
>>> The MMapDir changes are already tested all the time, vector API needs
>>> the forward port to 21.
>>>
>>> We are also doing some early testing with JDK 21 EA, and it would be
>>> great to get the 21-version of Panama VectorUtils in. I can help get this
>>> done.
>>>
>>> Uwe, what has been done so far? If nothing, as that is still the case
>>> tomorrow, I can start on it.
>>>
>>> -Chris.
>>>
>>> Uwe
>>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>>
>>> Hello all,
>>>
>>> There is some good stuff that is scheduled for 9.7 already, I found the
>>> following changes in the changelog that look especially interesting:
>>> - Concurrent query rewrites for vector queries.
>>> - Speedups to vector indexing/search via integration of the Panama
>>> vector API.
>>> - Reduced overhead of soft deletes.
>>> - Support for update by query.
>>>
>>> I propose we start the process for a 9.7 release, and I volunteer to be
>>> the release manager. I suggest the following schedule:
>>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>>> branch will be cut.
>>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>>> identified.
>>>
>>> --
>>> Adrien
>>>
>>> --
>>> Uwe Schindler
>>> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
>>> eMail: uwe@thetaphi.de
>>>
>>>
>>> --
>> Uwe Schindler
>> Achterdiek 19, 28357 Bremen
>> https://www.thetaphi.de
>>
>> --
>> Uwe Schindler
>> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
>> eMail: uwe@thetaphi.de
>>
>>
--
Adrien
Re: Lucene 9.7 release
Posted by Alessandro Benedetti <a....@sease.io>.
Hi,
we are finalizing https://github.com/apache/lucene/pull/12253, we got some
last-minute valuable review comments and we would like to apply the
suggestions and bring them in 9.x .
Cheers
--------------------------
*Alessandro Benedetti*
Director @ Sease Ltd.
*Apache Lucene/Solr Committer*
*Apache Solr PMC Member*
e-mail: a.benedetti@sease.io
*Sease* - Information Retrieval Applied
Consulting | Training | Open Source
Website: Sease.io <http://sease.io/>
LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter
<https://twitter.com/seaseltd> | Youtube
<https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github
<https://github.com/seaseltd>
On Fri, 9 Jun 2023 at 23:53, Uwe Schindler <uw...@thetaphi.de> wrote:
> Hi,
>
> BTW, there was a slight change in APIJARs caused by this API change:
> https://github.com/openjdk/jdk/commit/5fc9b5787dc4d7f00d2c59288bc8d840fdf5b495
> (this does not affect our code, but it was done 3 weeks ago). I hope
> something like this won't happen. I updated the PR, no code changes needed
> as those methods were not used by Lucene.
>
> I'd like to update the APIJARS again shortly before the feature branch is
> created.
>
> Uwe
> Am 09.06.2023 um 23:10 schrieb Uwe Schindler:
>
> Let me merge and backport the java 21 map PR first. It has all new source
> directories and APIJAR files.
>
> For safety I will regenerate the 21 APIJAR with newest jdk build. Fyi, to
> regenerate you need to have an environment variable with jdk21 as
> autoprovisioning doesn't work.
>
> After that we can copy-paste the vector impl to the main/java21 folder and
> add vector classes to it.
>
> Uwe
>
>
> Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty
> <ch...@elastic.co.INVALID>
> <ch...@elastic.co.INVALID>:
>
>> Hi,
>>
>> On 9 Jun 2023, at 17:19, Uwe Schindler <uw...@thetaphi.de>
>> <uw...@thetaphi.de> wrote:
>>
>> Hi,
>>
>> if possible I would like to get the Java 21 changes (MemorySegments and
>> Vector) into the release. I'd like to ask Chris who has better knowledge
>> how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to
>> wait that time.
>>
>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not.
>> From my understanding the final phases have started, so API changes are
>> unlikely. If there are bug fixes they won't affect public APIs or the
>> incubator module, right?
>>
>> Your understanding is correct. I do not expect any API changes at this
>> point.
>>
>> The MMapDir changes are already tested all the time, vector API needs the
>> forward port to 21.
>>
>> We are also doing some early testing with JDK 21 EA, and it would be
>> great to get the 21-version of Panama VectorUtils in. I can help get this
>> done.
>>
>> Uwe, what has been done so far? If nothing, as that is still the case
>> tomorrow, I can start on it.
>>
>> -Chris.
>>
>> Uwe
>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>
>> Hello all,
>>
>> There is some good stuff that is scheduled for 9.7 already, I found the
>> following changes in the changelog that look especially interesting:
>> - Concurrent query rewrites for vector queries.
>> - Speedups to vector indexing/search via integration of the Panama
>> vector API.
>> - Reduced overhead of soft deletes.
>> - Support for update by query.
>>
>> I propose we start the process for a 9.7 release, and I volunteer to be
>> the release manager. I suggest the following schedule:
>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>> branch will be cut.
>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>> identified.
>>
>> --
>> Adrien
>>
>> --
>> Uwe Schindler
>> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
>> eMail: uwe@thetaphi.de
>>
>>
>> --
> Uwe Schindler
> Achterdiek 19, 28357 Bremen
> https://www.thetaphi.de
>
> --
> Uwe Schindler
> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>
Re: Lucene 9.7 release
Posted by Michael McCandless <lu...@mikemccandless.com>.
On Tue, Jun 13, 2023 at 6:14 AM Uwe Schindler <uw...@thetaphi.de> wrote:
> P.S.: We should update the Smoketester to accept an arbitrary number of
> alternative JDKs to run tests. Currently it is fixed to Java 11 and 17 (I
> think).
>
+1, open an issue?
Mike McCandless
http://blog.mikemccandless.com
>
Re: Lucene 9.7 release
Posted by Uwe Schindler <uw...@thetaphi.de>.
Hi,
we merged Java 21 support for both MMapDirectory and VectorUtil to main
and branch_9x.
As JDK is in Rampdown Phase 1, it is veeeeery unlikely that there will
be hard API changes till release. In fact, the Java 21 version of vector
support was working without code change, we just enabled the support
without compiling explicit Java 21 version.
To be sure: as part of the release testing I will regenerate API JARs
and do explicit testing.
Uwe
P.S.: We should update the Smoketester to accept an arbitrary number of
alternative JDKs to run tests. Currently it is fixed to Java 11 and 17
(I think).
Am 10.06.2023 um 00:53 schrieb Uwe Schindler:
>
> Hi,
>
> BTW, there was a slight change in APIJARs caused by this API change:
> https://github.com/openjdk/jdk/commit/5fc9b5787dc4d7f00d2c59288bc8d840fdf5b495
> (this does not affect our code, but it was done 3 weeks ago). I hope
> something like this won't happen. I updated the PR, no code changes
> needed as those methods were not used by Lucene.
>
> I'd like to update the APIJARS again shortly before the feature branch
> is created.
>
> Uwe
>
> Am 09.06.2023 um 23:10 schrieb Uwe Schindler:
>> Let me merge and backport the java 21 map PR first. It has all new
>> source directories and APIJAR files.
>>
>> For safety I will regenerate the 21 APIJAR with newest jdk build.
>> Fyi, to regenerate you need to have an environment variable with
>> jdk21 as autoprovisioning doesn't work.
>>
>> After that we can copy-paste the vector impl to the main/java21
>> folder and add vector classes to it.
>>
>> Uwe
>>
>>
>> Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty
>> <ch...@elastic.co.INVALID>:
>>
>> Hi,
>>
>>> On 9 Jun 2023, at 17:19, Uwe Schindler <uw...@thetaphi.de> wrote:
>>>
>>> Hi,
>>>
>>> if possible I would like to get the Java 21 changes
>>> (MemorySegments and Vector) into the release. I'd like to ask
>>> Chris who has better knowledge how to proceed. If he suggests to
>>> wait maybe a week or 2, I'd suggest to wait that time.
>>>
>>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or
>>> not. From my understanding the final phases have started, so API
>>> changes are unlikely. If there are bug fixes they won't affect
>>> public APIs or the incubator module, right?
>>>
>> Your understanding is correct. I do not expect any API changes at
>> this point.
>>>
>>> The MMapDir changes are already tested all the time, vector API
>>> needs the forward port to 21.
>>>
>> We are also doing some early testing with JDK 21 EA, and it would
>> be great to get the 21-version of Panama VectorUtils in. I can
>> help get this done.
>>
>> Uwe, what has been done so far? If nothing, as that is still the
>> case tomorrow, I can start on it.
>>
>> -Chris.
>>
>>> Uwe
>>>
>>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>>> Hello all,
>>>>
>>>> There is some good stuff that is scheduled for 9.7 already, I
>>>> found the following changes in the changelog that look
>>>> especially interesting:
>>>> - Concurrent query rewrites for vector queries.
>>>> - Speedups to vector indexing/search via integration of the
>>>> Panama vector API.
>>>> - Reduced overhead of soft deletes.
>>>> - Support for update by query.
>>>>
>>>> I propose we start the process for a 9.7 release, and I
>>>> volunteer to be the release manager. I suggest the following
>>>> schedule:
>>>> - Feature freeze on June 16th, one week from now. This is when
>>>> the 9.7 branch will be cut.
>>>> - Open a vote on June 21st, which we'll possibly delay if
>>>> blockers get identified.
>>>>
>>>> --
>>>> Adrien
>>> --
>>> Uwe Schindler
>>> Achterdiek 19, D-28357 Bremen
>>> https://www.thetaphi.de
>>> eMail:uwe@thetaphi.de
>>
>> --
>> Uwe Schindler
>> Achterdiek 19, 28357 Bremen
>> https://www.thetaphi.de
> --
> Uwe Schindler
> Achterdiek 19, D-28357 Bremen
> https://www.thetaphi.de
> eMail:uwe@thetaphi.de
--
Uwe Schindler
Achterdiek 19, D-28357 Bremen
https://www.thetaphi.de
eMail:uwe@thetaphi.de
Re: Lucene 9.7 release
Posted by Uwe Schindler <uw...@thetaphi.de>.
Hi,
BTW, there was a slight change in APIJARs caused by this API change:
https://github.com/openjdk/jdk/commit/5fc9b5787dc4d7f00d2c59288bc8d840fdf5b495
(this does not affect our code, but it was done 3 weeks ago). I hope
something like this won't happen. I updated the PR, no code changes
needed as those methods were not used by Lucene.
I'd like to update the APIJARS again shortly before the feature branch
is created.
Uwe
Am 09.06.2023 um 23:10 schrieb Uwe Schindler:
> Let me merge and backport the java 21 map PR first. It has all new
> source directories and APIJAR files.
>
> For safety I will regenerate the 21 APIJAR with newest jdk build. Fyi,
> to regenerate you need to have an environment variable with jdk21 as
> autoprovisioning doesn't work.
>
> After that we can copy-paste the vector impl to the main/java21 folder
> and add vector classes to it.
>
> Uwe
>
>
> Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty
> <ch...@elastic.co.INVALID>:
>
> Hi,
>
>> On 9 Jun 2023, at 17:19, Uwe Schindler <uw...@thetaphi.de> wrote:
>>
>> Hi,
>>
>> if possible I would like to get the Java 21 changes
>> (MemorySegments and Vector) into the release. I'd like to ask
>> Chris who has better knowledge how to proceed. If he suggests to
>> wait maybe a week or 2, I'd suggest to wait that time.
>>
>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or
>> not. From my understanding the final phases have started, so API
>> changes are unlikely. If there are bug fixes they won't affect
>> public APIs or the incubator module, right?
>>
> Your understanding is correct. I do not expect any API changes at
> this point.
>>
>> The MMapDir changes are already tested all the time, vector API
>> needs the forward port to 21.
>>
> We are also doing some early testing with JDK 21 EA, and it would
> be great to get the 21-version of Panama VectorUtils in. I can
> help get this done.
>
> Uwe, what has been done so far? If nothing, as that is still the
> case tomorrow, I can start on it.
>
> -Chris.
>
>> Uwe
>>
>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>> Hello all,
>>>
>>> There is some good stuff that is scheduled for 9.7 already, I
>>> found the following changes in the changelog that look
>>> especially interesting:
>>> - Concurrent query rewrites for vector queries.
>>> - Speedups to vector indexing/search via integration of the
>>> Panama vector API.
>>> - Reduced overhead of soft deletes.
>>> - Support for update by query.
>>>
>>> I propose we start the process for a 9.7 release, and I
>>> volunteer to be the release manager. I suggest the following
>>> schedule:
>>> - Feature freeze on June 16th, one week from now. This is when
>>> the 9.7 branch will be cut.
>>> - Open a vote on June 21st, which we'll possibly delay if
>>> blockers get identified.
>>>
>>> --
>>> Adrien
>> --
>> Uwe Schindler
>> Achterdiek 19, D-28357 Bremen
>> https://www.thetaphi.de
>> eMail:uwe@thetaphi.de
>
> --
> Uwe Schindler
> Achterdiek 19, 28357 Bremen
> https://www.thetaphi.de
--
Uwe Schindler
Achterdiek 19, D-28357 Bremen
https://www.thetaphi.de
eMail:uwe@thetaphi.de
Re: Lucene 9.7 release
Posted by Uwe Schindler <uw...@thetaphi.de>.
Let me merge and backport the java 21 map PR first. It has all new source directories and APIJAR files.
For safety I will regenerate the 21 APIJAR with newest jdk build. Fyi, to regenerate you need to have an environment variable with jdk21 as autoprovisioning doesn't work.
After that we can copy-paste the vector impl to the main/java21 folder and add vector classes to it.
Uwe
Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty <ch...@elastic.co.INVALID>:
>Hi,
>
>> On 9 Jun 2023, at 17:19, Uwe Schindler <uw...@thetaphi.de> wrote:
>>
>> Hi,
>>
>> if possible I would like to get the Java 21 changes (MemorySegments and Vector) into the release. I'd like to ask Chris who has better knowledge how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to wait that time.
>>
>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not. From my understanding the final phases have started, so API changes are unlikely. If there are bug fixes they won't affect public APIs or the incubator module, right?
>>
>Your understanding is correct. I do not expect any API changes at this point.
>> The MMapDir changes are already tested all the time, vector API needs the forward port to 21.
>>
>We are also doing some early testing with JDK 21 EA, and it would be great to get the 21-version of Panama VectorUtils in. I can help get this done.
>
>Uwe, what has been done so far? If nothing, as that is still the case tomorrow, I can start on it.
>
>-Chris.
>
>> Uwe
>>
>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>> Hello all,
>>>
>>> There is some good stuff that is scheduled for 9.7 already, I found the following changes in the changelog that look especially interesting:
>>> - Concurrent query rewrites for vector queries.
>>> - Speedups to vector indexing/search via integration of the Panama vector API.
>>> - Reduced overhead of soft deletes.
>>> - Support for update by query.
>>>
>>> I propose we start the process for a 9.7 release, and I volunteer to be the release manager. I suggest the following schedule:
>>> - Feature freeze on June 16th, one week from now. This is when the 9.7 branch will be cut.
>>> - Open a vote on June 21st, which we'll possibly delay if blockers get identified.
>>>
>>> --
>>> Adrien
>> --
>> Uwe Schindler
>> Achterdiek 19, D-28357 Bremen
>> https://www.thetaphi.de <https://www.thetaphi.de/>
>> eMail: uwe@thetaphi.de <ma...@thetaphi.de>
--
Uwe Schindler
Achterdiek 19, 28357 Bremen
https://www.thetaphi.de
Re: Lucene 9.7 release
Posted by Chris Hegarty <ch...@elastic.co.INVALID>.
Hi,
> On 9 Jun 2023, at 17:19, Uwe Schindler <uw...@thetaphi.de> wrote:
>
> Hi,
>
> if possible I would like to get the Java 21 changes (MemorySegments and Vector) into the release. I'd like to ask Chris who has better knowledge how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to wait that time.
>
> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not. From my understanding the final phases have started, so API changes are unlikely. If there are bug fixes they won't affect public APIs or the incubator module, right?
>
Your understanding is correct. I do not expect any API changes at this point.
> The MMapDir changes are already tested all the time, vector API needs the forward port to 21.
>
We are also doing some early testing with JDK 21 EA, and it would be great to get the 21-version of Panama VectorUtils in. I can help get this done.
Uwe, what has been done so far? If nothing, as that is still the case tomorrow, I can start on it.
-Chris.
> Uwe
>
> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>> Hello all,
>>
>> There is some good stuff that is scheduled for 9.7 already, I found the following changes in the changelog that look especially interesting:
>> - Concurrent query rewrites for vector queries.
>> - Speedups to vector indexing/search via integration of the Panama vector API.
>> - Reduced overhead of soft deletes.
>> - Support for update by query.
>>
>> I propose we start the process for a 9.7 release, and I volunteer to be the release manager. I suggest the following schedule:
>> - Feature freeze on June 16th, one week from now. This is when the 9.7 branch will be cut.
>> - Open a vote on June 21st, which we'll possibly delay if blockers get identified.
>>
>> --
>> Adrien
> --
> Uwe Schindler
> Achterdiek 19, D-28357 Bremen
> https://www.thetaphi.de <https://www.thetaphi.de/>
> eMail: uwe@thetaphi.de <ma...@thetaphi.de>
Re: Lucene 9.7 release
Posted by Uwe Schindler <uw...@thetaphi.de>.
Hi,
if possible I would like to get the Java 21 changes (MemorySegments and
Vector) into the release. I'd like to ask Chris who has better knowledge
how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to
wait that time.
Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not.
From my understanding the final phases have started, so API changes are
unlikely. If there are bug fixes they won't affect public APIs or the
incubator module, right?
The MMapDir changes are already tested all the time, vector API needs
the forward port to 21.
Uwe
Am 09.06.2023 um 18:07 schrieb Adrien Grand:
> Hello all,
>
> There is some good stuff that is scheduled for 9.7 already, I found
> the following changes in the changelog that look especially interesting:
> - Concurrent query rewrites for vector queries.
> - Speedups to vector indexing/search via integration of the Panama
> vector API.
> - Reduced overhead of soft deletes.
> - Support for update by query.
>
> I propose we start the process for a 9.7 release, and I volunteer to
> be the release manager. I suggest the following schedule:
> - Feature freeze on June 16th, one week from now. This is when the
> 9.7 branch will be cut.
> - Open a vote on June 21st, which we'll possibly delay if blockers
> get identified.
>
> --
> Adrien
--
Uwe Schindler
Achterdiek 19, D-28357 Bremen
https://www.thetaphi.de
eMail:uwe@thetaphi.de