You are viewing a plain text version of this content. The canonical link for it is here.
- [PR] Emit Retry-After host back-off and block the URLFrontier queue [stormcrawler] - posted by "dpol1 (via GitHub)" <gi...@apache.org> on 2026/07/02 07:21:41 UTC, 0 replies.
- Re: [I] Send host info on a specific stream [stormcrawler] - posted by "dpol1 (via GitHub)" <gi...@apache.org> on 2026/07/02 07:30:18 UTC, 1 replies.
- [GH] (stormcrawler/990): Workflow run "Java CI with Maven" failed! - posted by GitBox <gi...@apache.org> on 2026/07/02 18:38:43 UTC, 0 replies.
- [GH] (stormcrawler/990): Workflow run "Java CI with Maven" is working again! - posted by GitBox <gi...@apache.org> on 2026/07/02 19:12:23 UTC, 0 replies.
- Re: [PR] Queue stream [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/03 07:19:33 UTC, 1 replies.
- Re: [PR] Block the URLFrontier queue on Retry-After via the queue stream [stormcrawler] - posted by "dpol1 (via GitHub)" <gi...@apache.org> on 2026/07/03 12:45:53 UTC, 9 replies.
- Re: [I] [Improvement] Add configuration to stop parsing PDFs after X pages [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/04 10:04:56 UTC, 0 replies.
- [PR] build(deps): bump langchain4j.version from 1.17.0 to 1.17.1 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/06 04:03:38 UTC, 1 replies.
- [PR] build(deps): bump opensearch.version from 2.19.5 to 2.19.6 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/06 04:03:48 UTC, 1 replies.
- [PR] build(deps): bump com.microsoft.playwright:playwright from 1.60.0 to 1.61.0 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/06 04:04:11 UTC, 1 replies.
- [PR] build(deps): bump software.amazon.awssdk:bom from 2.46.17 to 2.46.21 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/06 04:04:23 UTC, 1 replies.
- [GH] (stormcrawler/dependabot/maven/com.microsoft.playwright-playwright-1.61.0): Workflow run "Java CI with Maven" failed! - posted by GitBox <gi...@apache.org> on 2026/07/06 04:13:21 UTC, 0 replies.
- [GH] (stormcrawler/dependabot/maven/langchain4j.version-1.17.1): Workflow run "Java CI with Maven" is working again! - posted by GitBox <gi...@apache.org> on 2026/07/06 04:15:41 UTC, 0 replies.
- Re: [I] support retry-after in FetcherBolt [stormcrawler] - posted by "dpol1 (via GitHub)" <gi...@apache.org> on 2026/07/06 12:43:15 UTC, 0 replies.
- [I] Propagate robots.txt crawl-delay to URLFrontier via setDelay [stormcrawler] - posted by "dpol1 (via GitHub)" <gi...@apache.org> on 2026/07/07 14:14:30 UTC, 1 replies.
- [PR] Regenerated License file after dependency upgrades [stormcrawler] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/07/07 17:59:49 UTC, 15 replies.
- [GH] (stormcrawler/main): Workflow run "CI Main - Regenerate License" failed! - posted by GitBox <gi...@apache.org> on 2026/07/07 18:01:07 UTC, 0 replies.
- [GH] (stormcrawler/main): Workflow run "CI Main - Regenerate License" is working again! - posted by GitBox <gi...@apache.org> on 2026/07/07 18:01:13 UTC, 0 replies.
- [PR] Port QueueBolt (queue stream) to the opensearch-java module [stormcrawler] - posted by "rzo1 (via GitHub)" <gi...@apache.org> on 2026/07/07 18:06:38 UTC, 2 replies.
- [PR] Feature/store request url [stormcrawler] - posted by "lfoppiano (via GitHub)" <gi...@apache.org> on 2026/07/08 12:31:41 UTC, 0 replies.
- [PR] build(deps): bump actions/setup-java from 5.4.0 to 5.5.0 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/08 13:22:56 UTC, 1 replies.
- [PR] Adaptive back-off for rate-limited hosts via the queue stream [stormcrawler] - posted by "dpol1 (via GitHub)" <gi...@apache.org> on 2026/07/08 14:27:51 UTC, 8 replies.
- [GH] (stormcrawler/feat/1106-adaptive-host-backoff): Workflow run "Java CI with Maven" failed! - posted by GitBox <gi...@apache.org> on 2026/07/08 14:32:27 UTC, 0 replies.
- [PR] Adding Green Web Foundation to Powered By [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/09 06:43:37 UTC, 1 replies.
- [PR] Don't trigger mvn workflow for changes to the docs [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/09 07:02:40 UTC, 1 replies.
- [PR] Pluggable robot rule parser [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/09 07:54:26 UTC, 6 replies.
- [GH] (stormcrawler/pluggableRobotRuleParser): Workflow run "Java CI with Maven" failed! - posted by GitBox <gi...@apache.org> on 2026/07/09 07:55:33 UTC, 0 replies.
- [GH] (stormcrawler/pluggableRobotRuleParser): Workflow run "Java CI with Maven" is working again! - posted by GitBox <gi...@apache.org> on 2026/07/09 08:12:42 UTC, 0 replies.
- [PR] build(deps): bump langchain4j.version from 1.17.1 to 1.17.2 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/13 04:05:11 UTC, 1 replies.
- [PR] build(deps): bump junit.version from 6.1.1 to 6.1.2 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/13 04:05:30 UTC, 1 replies.
- [PR] build(deps): bump selenium.version from 4.45.0 to 4.46.0 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/13 04:05:46 UTC, 1 replies.
- [PR] build(deps): bump software.amazon.awssdk:bom from 2.46.21 to 2.47.5 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/13 04:06:18 UTC, 1 replies.
- [PR] Workaround to activate LogViewer in docker compose [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/13 09:49:58 UTC, 1 replies.
- Re: [I] Fetcher: optionally slow down fetching from hosts with repeated exceptions [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/13 12:19:49 UTC, 0 replies.
- [D] Deprecate Selenium module? [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/13 12:23:22 UTC, 2 replies.
- [D] Deprecate HTTPClient protocol implementation [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/13 12:25:14 UTC, 2 replies.
- [PR] Verbatim headers for Playwright [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/13 15:07:24 UTC, 1 replies.
- [GH] (stormcrawler/verbatimHeadersPW): Workflow run "Java CI with Maven" failed! - posted by GitBox <gi...@apache.org> on 2026/07/13 15:11:45 UTC, 0 replies.
- [GH] (stormcrawler/verbatimHeadersPW): Workflow run "Java CI with Maven" is working again! - posted by GitBox <gi...@apache.org> on 2026/07/13 15:31:33 UTC, 0 replies.
- [DISCUSS] Deprecating the Selenium module and the HTTPClient protocol implementation - posted by Richard Zowalla <rz...@apache.org> on 2026/07/13 17:48:49 UTC, 0 replies.
- [PR] [WARC] Format WARC-IP-Address header values following the WARC community recommendations [stormcrawler] - posted by "sebastian-nagel (via GitHub)" <gi...@apache.org> on 2026/07/14 11:16:33 UTC, 4 replies.
- [I] [Improvement] WARC writer: WARC-Protocol header to follow WARC field proposals [stormcrawler] - posted by "sebastian-nagel (via GitHub)" <gi...@apache.org> on 2026/07/14 12:19:32 UTC, 0 replies.
- [PR] Enforce robots.txt Crawl-delay in URLFrontier queues [stormcrawler] - posted by "dpol1 (via GitHub)" <gi...@apache.org> on 2026/07/15 12:58:04 UTC, 7 replies.
- [I] [Improvement] Document metadata to be persisted for adaptive scheduling [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/16 14:24:24 UTC, 1 replies.
- [PR] #2001 Document adaptive scheduler metadata [stormcrawler] - posted by "Yurii201811 (via GitHub)" <gi...@apache.org> on 2026/07/16 15:26:25 UTC, 5 replies.
- Feedback on Website Refresh - posted by Richard Zowalla <rz...@apache.org> on 2026/07/16 19:07:10 UTC, 4 replies.
- [PR] build(deps): bump actions/setup-java from 5.5.0 to 5.6.0 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/17 13:22:53 UTC, 1 replies.
- [PR] bugfix - max content not applied for robots.txt when redirecting [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/18 09:27:34 UTC, 1 replies.
- [PR] Fix #304: Use HTML test document instead of sitemap XML in SubDocumentsFilterTest [stormcrawler] - posted by "AsifQureshi04 (via GitHub)" <gi...@apache.org> on 2026/07/18 15:10:22 UTC, 4 replies.
- [PR] #108 Normalize misspelled HTTP headers [stormcrawler] - posted by "HarshDevelops (via GitHub)" <gi...@apache.org> on 2026/07/19 03:11:49 UTC, 3 replies.
- [PR] build(deps): bump langchain4j.version from 1.17.2 to 1.18.0 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/20 04:02:35 UTC, 1 replies.
- [PR] build(deps): bump software.amazon.awssdk:bom from 2.47.5 to 2.48.3 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/20 04:03:11 UTC, 1 replies.
- [PR] build(deps): bump actions/checkout from 7.0.0 to 7.0.1 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/21 13:23:13 UTC, 1 replies.
- Re: [I] SubDocumentsFilterTest should not use a sitemap file [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/21 13:58:54 UTC, 0 replies.
- Re: [I] Remove needsDOM() in ParseFilter [stormcrawler] - posted by "AsifQureshi04 (via GitHub)" <gi...@apache.org> on 2026/07/21 16:26:16 UTC, 1 replies.
- [PR] Resolve relative outlinks against in JSoupParserBolt [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/21 16:31:20 UTC, 1 replies.
- [PR] Allow indexer bolts to use a metadata value as the document ID [stormcrawler] - posted by "sigee (via GitHub)" <gi...@apache.org> on 2026/07/22 21:13:29 UTC, 3 replies.
- [I] Deprecate HTTPClient protocol implementation [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/23 07:03:55 UTC, 1 replies.
- [I] Deprecate Selenium module [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/23 07:04:25 UTC, 1 replies.
- [I] Upgrade to Apache Storm 3.0.0 [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/23 07:07:48 UTC, 0 replies.
- [I] Deprecate AWS CloudSearch [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/23 08:22:12 UTC, 1 replies.
- [DISCUSS] Storm 3 meets StormCrawler - posted by Richard Zowalla <rz...@apache.org> on 2026/07/23 09:57:41 UTC, 2 replies.
- [PR] Upgrade to Apache Storm 3.0.0 and Java 25 [stormcrawler] - posted by "rzo1 (via GitHub)" <gi...@apache.org> on 2026/07/23 10:42:46 UTC, 0 replies.
- [PR] Mark CloudSearch as deprecated [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/23 11:36:42 UTC, 1 replies.
- [PR] Mark Selenium module as deprecated [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/23 11:43:11 UTC, 1 replies.
- [PR] Mark HTTPClient as deprecated [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/23 14:03:12 UTC, 1 replies.
- [GH] (stormcrawler/2013): Workflow run "Java CI with Maven" failed! - posted by GitBox <gi...@apache.org> on 2026/07/23 14:04:44 UTC, 0 replies.
- [GH] (stormcrawler/2013): Workflow run "Java CI with Maven" is working again! - posted by GitBox <gi...@apache.org> on 2026/07/23 14:20:32 UTC, 0 replies.
- Release 3.7.0? - posted by Julien Nioche <ju...@digitalpebble.com> on 2026/07/24 11:25:16 UTC, 3 replies.
- [I] [Bug report] URLFilterBolt seems to emit unanchored [stormcrawler] - posted by "lfoppiano (via GitHub)" <gi...@apache.org> on 2026/07/24 20:37:57 UTC, 0 replies.
- Re: [I] [Bug report] URLFilterBolt seems to emit unanchored tuples [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/25 16:30:02 UTC, 3 replies.
- [PR] build(deps): bump software.amazon.awssdk:bom from 2.48.3 to 2.49.3 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/27 04:02:34 UTC, 1 replies.
- [PR] build(deps): bump tika.version from 3.3.1 to 3.3.2 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/27 04:02:46 UTC, 1 replies.
- [PR] build(deps): bump storm-client.version from 2.8.8 to 3.0.0 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/27 04:03:01 UTC, 3 replies.
- [PR] build(deps): bump org.apache.maven.plugins:maven-jar-plugin from 3.5.0 to 3.5.1 [stormcrawler] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/07/27 04:03:22 UTC, 1 replies.
- [GH] (stormcrawler/dependabot/maven/storm-client.version-3.0.0): Workflow run "Java CI with Maven" failed! - posted by GitBox <gi...@apache.org> on 2026/07/27 04:03:58 UTC, 0 replies.
- [GH] (stormcrawler/dependabot/maven/software.amazon.awssdk-bom-2.49.3): Workflow run "Java CI with Maven" is working again! - posted by GitBox <gi...@apache.org> on 2026/07/27 04:15:11 UTC, 0 replies.
- [I] http.agent.name is dropped from the robots.txt match set when http.robots.agents is set [stormcrawler] - posted by "rzo1 (via GitHub)" <gi...@apache.org> on 2026/07/27 11:27:38 UTC, 1 replies.
- [PR] #2026 - http.agent.name is dropped from the robots.txt match set when http.robots.agents is set [stormcrawler] - posted by "rzo1 (via GitHub)" <gi...@apache.org> on 2026/07/27 11:28:26 UTC, 1 replies.
- [PR] #2021 Fix URLFilterBolt to emit anchored tuples [stormcrawler] - posted by "lfoppiano (via GitHub)" <gi...@apache.org> on 2026/07/27 14:07:19 UTC, 1 replies.
- [PR] Upgrade to Storm 2.8.9 [stormcrawler] - posted by "dpol1 (via GitHub)" <gi...@apache.org> on 2026/07/28 11:32:03 UTC, 1 replies.
- [VOTE] Apache StormCrawler 3.7.0 Release Candidate - posted by Davide Polato <dp...@apache.org> on 2026/07/29 14:59:35 UTC, 4 replies.
- Re: [I] Indexer bolts to use value from metadata as docID [stormcrawler] - posted by "jnioche (via GitHub)" <gi...@apache.org> on 2026/07/29 16:48:45 UTC, 0 replies.
- [PR] #1998 WARC writer: WARC-Protocol header to follow WARC field proposals [stormcrawler] - posted by "sebastian-nagel (via GitHub)" <gi...@apache.org> on 2026/07/29 17:34:46 UTC, 2 replies.
- [PR] Fix typo and broken link [stormcrawler] - posted by "sebastian-nagel (via GitHub)" <gi...@apache.org> on 2026/07/31 13:23:32 UTC, 0 replies.
- [PR] Fix broken anchor in Asciidoc [stormcrawler] - posted by "sebastian-nagel (via GitHub)" <gi...@apache.org> on 2026/07/31 13:55:01 UTC, 0 replies.
- Re: [PR] Bump git-code-format-maven-plugin.version from 5.4 to 6.0 [stormcrawler] - posted by "mvolikas (via GitHub)" <gi...@apache.org> on 2026/07/31 16:37:56 UTC, 0 replies.