You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by GitBox <gi...@apache.org> on 2022/01/09 12:59:15 UTC
[GitHub] [nutch-site] sebastian-nagel opened a new pull request #1: NUTCH-1999 Add /robots.txt to Nutch site
sebastian-nagel opened a new pull request #1:
URL: https://github.com/apache/nutch-site/pull/1
Adds a trivial robots.txt to the Nutch site. We can complete it later by adding a sitemap link etc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [nutch-site] lewismc commented on pull request #1: NUTCH-1999 Add /robots.txt to Nutch site
Posted by GitBox <gi...@apache.org>.
lewismc commented on pull request #1:
URL: https://github.com/apache/nutch-site/pull/1#issuecomment-1010672297
Ah @sebastian-nagel I now see why you were building the website offline. I'll try to get those issues fixed ASAP. Sorry about that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org