You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@stormcrawler.apache.org by Tim Allison <ta...@apache.org> on 2025/03/10 17:25:31 UTC
[VOTE] Apache StormCrawler (Incubating) 3.3.0 Release Candidate 1
Hi folks,
I have posted a first release candidate for the Apache StormCrawler
(Incubating) 3.3.0 release and it is ready for testing.
* Upgrade to Storm to 2.8.0 and other dependency upgrades
* Fixed a bug in custom configuration of sitemap processing
* Fixed a bug when multiple processes attempted creation of the same
OpenSearchIndex
Thank you to everyone who contributed to this release, including all
of our users and the people who submitted bug reports,
contributed code or documentation enhancements.
The release was made using the Apache StormCrawler (Incubating)
release process, documented here:
https://github.com/apache/incubator-stormcrawler/blob/main/RELEASING.md
Source:
https://dist.apache.org/repos/dist/dev/incubator/stormcrawler/stormcrawler-3.3.0-RC1
Tag:
https://github.com/apache/incubator-stormcrawler/releases/tag/stormcrawler-3.3.0
Commit Hash:
e37e8cbe8388cc041e6fe4349223a0631be7cd4a
Maven Repo:
https://repository.apache.org/content/repositories/orgapachestormcrawler-1006
<repositories>
<repository>
<id>stormcrawler-3.3.0-rc1</id>
<name>Testing StormCrawler 3.3.0 release candidate</name>
<url>
https://repository.apache.org/content/repositories/orgapachestormcrawler-1006
</url>
</repository>
</repositories>
Preview of website:
https://stormcrawler.staged.apache.org/download/index.html
Release notes:
https://github.com/apache/incubator-stormcrawler/releases/tag/stormcrawler-3.3.0
Reminder: The up-2-date KEYS file for signature verification can be
found here: https://downloads.apache.org/incubator/stormcrawler/KEYS
Please vote on releasing these packages as Apache StormCrawler (Incubator) x.y.z
The vote is open for at least the next 72 hours.
Only votes from IPMC are binding, but everyone is welcome to check the
release candidate and vote.
The vote passes if at least three binding +1 votes are cast.
Please VOTE
[+1] go ship it
[+0] meh, don't care
[-1] stop, there is a ${showstopper}
Please include your checklist in your vote:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
Note: After this VOTE passes on our dev@ list, the VOTE will be
brought to general@ in order to get the necessary IPMC votes.
Thanks!
Tim
Here's my +1.
* I verified a clean build with Java 17
* I checked signatures
[RESULT][VOTE] Apache StormCrawler (Incubating) 3.3.0 Release Candidate 1
Posted by Tim Allison <ta...@apache.org>.
The vote has passed with 4 +1s and no -1s
Ayush Saxena (IPMC + PPMC)
Markos Volikas (PPMC)
Richard Zowalla (IPMC + PPMC)
Tim Allison (IPMC + PPMC)
I'll start the vote in the incubator shortly.
On Tue, Mar 18, 2025 at 6:37 AM Ayush Saxena <ay...@gmail.com> wrote:
>
> +1 (Binding)
>
> * Built from source [1]
> * Verified Checksums
> * Verified Signatures
> * No diff b/w git tag & src tar
> * Verified Incubating in name
> * DISCLAIMER & LICENSE file exits
> * Verified the NOTICE file [2]
>
> -Ayush
>
> [1] The README says minimum JAVA requirement as 11, but it doesn't build on
> JDK < 17, created:
> https://github.com/apache/incubator-stormcrawler/issues/1503
>
> [2] The year in NOTICE file is 2024, should bump it to 2025 in next RC,
> created:
> https://github.com/apache/incubator-stormcrawler/issues/1502
>
>
> On Sat, 15 Mar 2025 at 22:50, Markos Volikas <mv...@apache.org> wrote:
>
> > Thanks Tim,
> >
> > * Checked hashes
> > * Built from source
> > * Generated Solr archetype
> > * Ran a crawl locally with Solr 9.8.0 and Storm 2.8.0
> >
> > +1 (mvolikas PPMC)
> >
> > Markos
> >
> > On 3/13/25 10:04, Richard Zowalla wrote:
> > > - Checked hashes and signtures of the src distribution
> > > - Checked the staging page.
> > > - Checked artifacts in the staging repo
> > > - Build from source with full tests
> > > - Run a dockerized crawl with the opensearch / playwright module
> > >
> > >
> > > +1 (binding) - rzo1 (PPMC,IPMC)
> > >
> > > Minor issues:
> > >
> > > - We need to update the README to reflect that Java 17+ is required to
> > build StormCrawler.
> > > - Our auto-generated licenses suggest, that we have multiple versions of
> > Jackson in the project. This is not a blocking issue, but we should manage
> > that dependency in our root pom to ensure consistency.
> > >
> > > Thanks for preparing, Tim!
> > >
> > > Gruß
> > > Richard
> > >
> > > On 2025/03/10 17:25:31 Tim Allison wrote:
> > >> Hi folks,
> > >>
> > >> I have posted a first release candidate for the Apache StormCrawler
> > >> (Incubating) 3.3.0 release and it is ready for testing.
> > >>
> > >> * Upgrade to Storm to 2.8.0 and other dependency upgrades
> > >> * Fixed a bug in custom configuration of sitemap processing
> > >> * Fixed a bug when multiple processes attempted creation of the same
> > >> OpenSearchIndex
> > >>
> > >> Thank you to everyone who contributed to this release, including all
> > >> of our users and the people who submitted bug reports,
> > >> contributed code or documentation enhancements.
> > >>
> > >> The release was made using the Apache StormCrawler (Incubating)
> > >> release process, documented here:
> > >> https://github.com/apache/incubator-stormcrawler/blob/main/RELEASING.md
> > >>
> > >> Source:
> > >>
> > >>
> > https://dist.apache.org/repos/dist/dev/incubator/stormcrawler/stormcrawler-3.3.0-RC1
> > >>
> > >> Tag:
> > >>
> > >>
> > https://github.com/apache/incubator-stormcrawler/releases/tag/stormcrawler-3.3.0
> > >>
> > >> Commit Hash:
> > >> e37e8cbe8388cc041e6fe4349223a0631be7cd4a
> > >>
> > >> Maven Repo:
> > >>
> > >>
> > https://repository.apache.org/content/repositories/orgapachestormcrawler-1006
> > >>
> > >> <repositories>
> > >> <repository>
> > >> <id>stormcrawler-3.3.0-rc1</id>
> > >> <name>Testing StormCrawler 3.3.0 release candidate</name>
> > >> <url>
> > >>
> > https://repository.apache.org/content/repositories/orgapachestormcrawler-1006
> > >> </url>
> > >> </repository>
> > >> </repositories>
> > >>
> > >> Preview of website:
> > >>
> > >> https://stormcrawler.staged.apache.org/download/index.html
> > >>
> > >> Release notes:
> > >>
> > >>
> > https://github.com/apache/incubator-stormcrawler/releases/tag/stormcrawler-3.3.0
> > >>
> > >> Reminder: The up-2-date KEYS file for signature verification can be
> > >> found here:https://downloads.apache.org/incubator/stormcrawler/KEYS
> > >>
> > >> Please vote on releasing these packages as Apache StormCrawler
> > (Incubator) x.y.z
> > >> The vote is open for at least the next 72 hours.
> > >>
> > >> Only votes from IPMC are binding, but everyone is welcome to check the
> > >> release candidate and vote.
> > >> The vote passes if at least three binding +1 votes are cast.
> > >>
> > >> Please VOTE
> > >>
> > >> [+1] go ship it
> > >> [+0] meh, don't care
> > >> [-1] stop, there is a ${showstopper}
> > >>
> > >> Please include your checklist in your vote:
> > >>
> > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> > >>
> > >> Note: After this VOTE passes on our dev@ list, the VOTE will be
> > >> brought to general@ in order to get the necessary IPMC votes.
> > >>
> > >> Thanks!
> > >>
> > >> Tim
> > >>
> > >> Here's my +1.
> > >> * I verified a clean build with Java 17
> > >> * I checked signatures
> > >>
Re: [VOTE] Apache StormCrawler (Incubating) 3.3.0 Release Candidate 1
Posted by Ayush Saxena <ay...@gmail.com>.
+1 (Binding)
* Built from source [1]
* Verified Checksums
* Verified Signatures
* No diff b/w git tag & src tar
* Verified Incubating in name
* DISCLAIMER & LICENSE file exits
* Verified the NOTICE file [2]
-Ayush
[1] The README says minimum JAVA requirement as 11, but it doesn't build on
JDK < 17, created:
https://github.com/apache/incubator-stormcrawler/issues/1503
[2] The year in NOTICE file is 2024, should bump it to 2025 in next RC,
created:
https://github.com/apache/incubator-stormcrawler/issues/1502
On Sat, 15 Mar 2025 at 22:50, Markos Volikas <mv...@apache.org> wrote:
> Thanks Tim,
>
> * Checked hashes
> * Built from source
> * Generated Solr archetype
> * Ran a crawl locally with Solr 9.8.0 and Storm 2.8.0
>
> +1 (mvolikas PPMC)
>
> Markos
>
> On 3/13/25 10:04, Richard Zowalla wrote:
> > - Checked hashes and signtures of the src distribution
> > - Checked the staging page.
> > - Checked artifacts in the staging repo
> > - Build from source with full tests
> > - Run a dockerized crawl with the opensearch / playwright module
> >
> >
> > +1 (binding) - rzo1 (PPMC,IPMC)
> >
> > Minor issues:
> >
> > - We need to update the README to reflect that Java 17+ is required to
> build StormCrawler.
> > - Our auto-generated licenses suggest, that we have multiple versions of
> Jackson in the project. This is not a blocking issue, but we should manage
> that dependency in our root pom to ensure consistency.
> >
> > Thanks for preparing, Tim!
> >
> > Gruß
> > Richard
> >
> > On 2025/03/10 17:25:31 Tim Allison wrote:
> >> Hi folks,
> >>
> >> I have posted a first release candidate for the Apache StormCrawler
> >> (Incubating) 3.3.0 release and it is ready for testing.
> >>
> >> * Upgrade to Storm to 2.8.0 and other dependency upgrades
> >> * Fixed a bug in custom configuration of sitemap processing
> >> * Fixed a bug when multiple processes attempted creation of the same
> >> OpenSearchIndex
> >>
> >> Thank you to everyone who contributed to this release, including all
> >> of our users and the people who submitted bug reports,
> >> contributed code or documentation enhancements.
> >>
> >> The release was made using the Apache StormCrawler (Incubating)
> >> release process, documented here:
> >> https://github.com/apache/incubator-stormcrawler/blob/main/RELEASING.md
> >>
> >> Source:
> >>
> >>
> https://dist.apache.org/repos/dist/dev/incubator/stormcrawler/stormcrawler-3.3.0-RC1
> >>
> >> Tag:
> >>
> >>
> https://github.com/apache/incubator-stormcrawler/releases/tag/stormcrawler-3.3.0
> >>
> >> Commit Hash:
> >> e37e8cbe8388cc041e6fe4349223a0631be7cd4a
> >>
> >> Maven Repo:
> >>
> >>
> https://repository.apache.org/content/repositories/orgapachestormcrawler-1006
> >>
> >> <repositories>
> >> <repository>
> >> <id>stormcrawler-3.3.0-rc1</id>
> >> <name>Testing StormCrawler 3.3.0 release candidate</name>
> >> <url>
> >>
> https://repository.apache.org/content/repositories/orgapachestormcrawler-1006
> >> </url>
> >> </repository>
> >> </repositories>
> >>
> >> Preview of website:
> >>
> >> https://stormcrawler.staged.apache.org/download/index.html
> >>
> >> Release notes:
> >>
> >>
> https://github.com/apache/incubator-stormcrawler/releases/tag/stormcrawler-3.3.0
> >>
> >> Reminder: The up-2-date KEYS file for signature verification can be
> >> found here:https://downloads.apache.org/incubator/stormcrawler/KEYS
> >>
> >> Please vote on releasing these packages as Apache StormCrawler
> (Incubator) x.y.z
> >> The vote is open for at least the next 72 hours.
> >>
> >> Only votes from IPMC are binding, but everyone is welcome to check the
> >> release candidate and vote.
> >> The vote passes if at least three binding +1 votes are cast.
> >>
> >> Please VOTE
> >>
> >> [+1] go ship it
> >> [+0] meh, don't care
> >> [-1] stop, there is a ${showstopper}
> >>
> >> Please include your checklist in your vote:
> >>
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
> >>
> >> Note: After this VOTE passes on our dev@ list, the VOTE will be
> >> brought to general@ in order to get the necessary IPMC votes.
> >>
> >> Thanks!
> >>
> >> Tim
> >>
> >> Here's my +1.
> >> * I verified a clean build with Java 17
> >> * I checked signatures
> >>
Re: [VOTE] Apache StormCrawler (Incubating) 3.3.0 Release Candidate 1
Posted by Markos Volikas <mv...@apache.org>.
Thanks Tim,
* Checked hashes
* Built from source
* Generated Solr archetype
* Ran a crawl locally with Solr 9.8.0 and Storm 2.8.0
+1 (mvolikas PPMC)
Markos
On 3/13/25 10:04, Richard Zowalla wrote:
> - Checked hashes and signtures of the src distribution
> - Checked the staging page.
> - Checked artifacts in the staging repo
> - Build from source with full tests
> - Run a dockerized crawl with the opensearch / playwright module
>
>
> +1 (binding) - rzo1 (PPMC,IPMC)
>
> Minor issues:
>
> - We need to update the README to reflect that Java 17+ is required to build StormCrawler.
> - Our auto-generated licenses suggest, that we have multiple versions of Jackson in the project. This is not a blocking issue, but we should manage that dependency in our root pom to ensure consistency.
>
> Thanks for preparing, Tim!
>
> Gruß
> Richard
>
> On 2025/03/10 17:25:31 Tim Allison wrote:
>> Hi folks,
>>
>> I have posted a first release candidate for the Apache StormCrawler
>> (Incubating) 3.3.0 release and it is ready for testing.
>>
>> * Upgrade to Storm to 2.8.0 and other dependency upgrades
>> * Fixed a bug in custom configuration of sitemap processing
>> * Fixed a bug when multiple processes attempted creation of the same
>> OpenSearchIndex
>>
>> Thank you to everyone who contributed to this release, including all
>> of our users and the people who submitted bug reports,
>> contributed code or documentation enhancements.
>>
>> The release was made using the Apache StormCrawler (Incubating)
>> release process, documented here:
>> https://github.com/apache/incubator-stormcrawler/blob/main/RELEASING.md
>>
>> Source:
>>
>> https://dist.apache.org/repos/dist/dev/incubator/stormcrawler/stormcrawler-3.3.0-RC1
>>
>> Tag:
>>
>> https://github.com/apache/incubator-stormcrawler/releases/tag/stormcrawler-3.3.0
>>
>> Commit Hash:
>> e37e8cbe8388cc041e6fe4349223a0631be7cd4a
>>
>> Maven Repo:
>>
>> https://repository.apache.org/content/repositories/orgapachestormcrawler-1006
>>
>> <repositories>
>> <repository>
>> <id>stormcrawler-3.3.0-rc1</id>
>> <name>Testing StormCrawler 3.3.0 release candidate</name>
>> <url>
>> https://repository.apache.org/content/repositories/orgapachestormcrawler-1006
>> </url>
>> </repository>
>> </repositories>
>>
>> Preview of website:
>>
>> https://stormcrawler.staged.apache.org/download/index.html
>>
>> Release notes:
>>
>> https://github.com/apache/incubator-stormcrawler/releases/tag/stormcrawler-3.3.0
>>
>> Reminder: The up-2-date KEYS file for signature verification can be
>> found here:https://downloads.apache.org/incubator/stormcrawler/KEYS
>>
>> Please vote on releasing these packages as Apache StormCrawler (Incubator) x.y.z
>> The vote is open for at least the next 72 hours.
>>
>> Only votes from IPMC are binding, but everyone is welcome to check the
>> release candidate and vote.
>> The vote passes if at least three binding +1 votes are cast.
>>
>> Please VOTE
>>
>> [+1] go ship it
>> [+0] meh, don't care
>> [-1] stop, there is a ${showstopper}
>>
>> Please include your checklist in your vote:
>> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
>>
>> Note: After this VOTE passes on our dev@ list, the VOTE will be
>> brought to general@ in order to get the necessary IPMC votes.
>>
>> Thanks!
>>
>> Tim
>>
>> Here's my +1.
>> * I verified a clean build with Java 17
>> * I checked signatures
>>
Re: [VOTE] Apache StormCrawler (Incubating) 3.3.0 Release Candidate 1
Posted by Richard Zowalla <rz...@apache.org>.
- Checked hashes and signtures of the src distribution
- Checked the staging page.
- Checked artifacts in the staging repo
- Build from source with full tests
- Run a dockerized crawl with the opensearch / playwright module
+1 (binding) - rzo1 (PPMC,IPMC)
Minor issues:
- We need to update the README to reflect that Java 17+ is required to build StormCrawler.
- Our auto-generated licenses suggest, that we have multiple versions of Jackson in the project. This is not a blocking issue, but we should manage that dependency in our root pom to ensure consistency.
Thanks for preparing, Tim!
Gruß
Richard
On 2025/03/10 17:25:31 Tim Allison wrote:
> Hi folks,
>
> I have posted a first release candidate for the Apache StormCrawler
> (Incubating) 3.3.0 release and it is ready for testing.
>
> * Upgrade to Storm to 2.8.0 and other dependency upgrades
> * Fixed a bug in custom configuration of sitemap processing
> * Fixed a bug when multiple processes attempted creation of the same
> OpenSearchIndex
>
> Thank you to everyone who contributed to this release, including all
> of our users and the people who submitted bug reports,
> contributed code or documentation enhancements.
>
> The release was made using the Apache StormCrawler (Incubating)
> release process, documented here:
> https://github.com/apache/incubator-stormcrawler/blob/main/RELEASING.md
>
> Source:
>
> https://dist.apache.org/repos/dist/dev/incubator/stormcrawler/stormcrawler-3.3.0-RC1
>
> Tag:
>
> https://github.com/apache/incubator-stormcrawler/releases/tag/stormcrawler-3.3.0
>
> Commit Hash:
> e37e8cbe8388cc041e6fe4349223a0631be7cd4a
>
> Maven Repo:
>
> https://repository.apache.org/content/repositories/orgapachestormcrawler-1006
>
> <repositories>
> <repository>
> <id>stormcrawler-3.3.0-rc1</id>
> <name>Testing StormCrawler 3.3.0 release candidate</name>
> <url>
> https://repository.apache.org/content/repositories/orgapachestormcrawler-1006
> </url>
> </repository>
> </repositories>
>
> Preview of website:
>
> https://stormcrawler.staged.apache.org/download/index.html
>
> Release notes:
>
> https://github.com/apache/incubator-stormcrawler/releases/tag/stormcrawler-3.3.0
>
> Reminder: The up-2-date KEYS file for signature verification can be
> found here: https://downloads.apache.org/incubator/stormcrawler/KEYS
>
> Please vote on releasing these packages as Apache StormCrawler (Incubator) x.y.z
> The vote is open for at least the next 72 hours.
>
> Only votes from IPMC are binding, but everyone is welcome to check the
> release candidate and vote.
> The vote passes if at least three binding +1 votes are cast.
>
> Please VOTE
>
> [+1] go ship it
> [+0] meh, don't care
> [-1] stop, there is a ${showstopper}
>
> Please include your checklist in your vote:
> https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist
>
> Note: After this VOTE passes on our dev@ list, the VOTE will be
> brought to general@ in order to get the necessary IPMC votes.
>
> Thanks!
>
> Tim
>
> Here's my +1.
> * I verified a clean build with Java 17
> * I checked signatures
>