You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@stormcrawler.apache.org by jn...@apache.org on 2026/07/27 15:55:26 UTC

(stormcrawler) branch robots-agent-name-dropped deleted (was a034ff4a)

This is an automated email from the ASF dual-hosted git repository.

jnioche pushed a change to branch robots-agent-name-dropped
in repository https://gitbox.apache.org/repos/asf/stormcrawler.git


     was a034ff4a #2026 - Always match http.agent.name against robots.txt, even when http.robots.agents is set

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.