[jira] Commented: (INFRA-3389) Reduce exposure of nightly build documentation to search engines

["Gavin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/INFRA-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992412#comment-12992412 ] 

Gavin commented on INFRA-3389:
------------------------------

Note there already is a  robots.txt

https://hudson.apache.org/hudson/robots.txt

how long it has been there I dont know.

> Reduce exposure of nightly build documentation to search engines
> ----------------------------------------------------------------
>
>                 Key: INFRA-3389
>                 URL: https://issues.apache.org/jira/browse/INFRA-3389
>             Project: Infrastructure
>          Issue Type: Wish
>      Security Level: public(Regular issues) 
>          Components: Hudson
>            Reporter: Uwe Schindler
>            Assignee: Niklas Gustavsson
>
> If somebody searches e.g. for JavaDocs of Lucene, he will get a lot of hits, also to the nightly build documentation. In most cases this nightly build documentation is much too prominent. This may confuse users.
> Would it be possible to exclude Hudson build dirs and workspaces completely from search engines by adding a robots.txt to the root folder with "Disallow: /"?

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira