You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@stormcrawler.apache.org by "JaspreetSinghChahal (via GitHub)" <gi...@apache.org> on 2026/02/05 10:50:20 UTC

Re: [D] Don't index sitemap in opensearch [stormcrawler]

GitHub user JaspreetSinghChahal edited a discussion: Don't index sitemap in opensearch

In stormcrawler, I want to fetch and parse sitemaps to discover new urls but don't want to index it in opensearch.

I can't exclude it in regex as new urls won't be discovered then.

GitHub link: https://github.com/apache/stormcrawler/discussions/1803

----
This is an automatically sent email for dev@stormcrawler.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@stormcrawler.apache.org