You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@infra.apache.org by "Uwe Schindler (JIRA)" <ji...@apache.org> on 2011/01/25 15:21:44 UTC

[jira] Created: (INFRA-3389) Reduce exposure of nightly build documentation to search engines

Reduce exposure of nightly build documentation to search engines
----------------------------------------------------------------

                 Key: INFRA-3389
                 URL: https://issues.apache.org/jira/browse/INFRA-3389
             Project: Infrastructure
          Issue Type: Wish
      Security Level: public (Regular issues)
          Components: Hudson
            Reporter: Uwe Schindler


If somebody searches e.g. for JavaDocs of Lucene, he will get a lot of hits, also to the nightly build documentation. In most cases this nightly build documentation is much too prominent. This may confuse users.

Would it be possible to exclude Hudson build dirs and workspaces completely from search engines by adding a robots.txt to the root folder with "Disallow: /"?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-3389) Reduce exposure of nightly build documentation to search engines

Posted by "Gavin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992420#comment-12992420 ] 

Gavin commented on INFRA-3389:
------------------------------

technically it is by both position and redirection, but not by uri, I'll see what we can do.

> Reduce exposure of nightly build documentation to search engines
> ----------------------------------------------------------------
>
>                 Key: INFRA-3389
>                 URL: https://issues.apache.org/jira/browse/INFRA-3389
>             Project: Infrastructure
>          Issue Type: Wish
>      Security Level: public(Regular issues) 
>          Components: Hudson
>            Reporter: Uwe Schindler
>            Assignee: Niklas Gustavsson
>
> If somebody searches e.g. for JavaDocs of Lucene, he will get a lot of hits, also to the nightly build documentation. In most cases this nightly build documentation is much too prominent. This may confuse users.
> Would it be possible to exclude Hudson build dirs and workspaces completely from search engines by adding a robots.txt to the root folder with "Disallow: /"?

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (INFRA-3389) Reduce exposure of nightly build documentation to search engines

Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992414#comment-12992414 ] 

Uwe Schindler commented on INFRA-3389:
--------------------------------------

A robots.txt has only any effect, if it is in the URI root folder of the web server so reachable by http://server/robots.txt. See robots specification: [http://www.robotstxt.org/robotstxt.html]

> Reduce exposure of nightly build documentation to search engines
> ----------------------------------------------------------------
>
>                 Key: INFRA-3389
>                 URL: https://issues.apache.org/jira/browse/INFRA-3389
>             Project: Infrastructure
>          Issue Type: Wish
>      Security Level: public(Regular issues) 
>          Components: Hudson
>            Reporter: Uwe Schindler
>            Assignee: Niklas Gustavsson
>
> If somebody searches e.g. for JavaDocs of Lucene, he will get a lot of hits, also to the nightly build documentation. In most cases this nightly build documentation is much too prominent. This may confuse users.
> Would it be possible to exclude Hudson build dirs and workspaces completely from search engines by adding a robots.txt to the root folder with "Disallow: /"?

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Assigned: (INFRA-3389) Reduce exposure of nightly build documentation to search engines

Posted by "Niklas Gustavsson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Niklas Gustavsson reassigned INFRA-3389:
----------------------------------------

    Assignee: Niklas Gustavsson

Agreed, looking into it.

> Reduce exposure of nightly build documentation to search engines
> ----------------------------------------------------------------
>
>                 Key: INFRA-3389
>                 URL: https://issues.apache.org/jira/browse/INFRA-3389
>             Project: Infrastructure
>          Issue Type: Wish
>      Security Level: public(Regular issues) 
>          Components: Hudson
>            Reporter: Uwe Schindler
>            Assignee: Niklas Gustavsson
>
> If somebody searches e.g. for JavaDocs of Lucene, he will get a lot of hits, also to the nightly build documentation. In most cases this nightly build documentation is much too prominent. This may confuse users.
> Would it be possible to exclude Hudson build dirs and workspaces completely from search engines by adding a robots.txt to the root folder with "Disallow: /"?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Closed: (INFRA-3389) Reduce exposure of nightly build documentation to search engines

Posted by "Niklas Gustavsson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Niklas Gustavsson closed INFRA-3389.
------------------------------------

    Resolution: Fixed

Proxy rewrite to Hudson robots.txt added

> Reduce exposure of nightly build documentation to search engines
> ----------------------------------------------------------------
>
>                 Key: INFRA-3389
>                 URL: https://issues.apache.org/jira/browse/INFRA-3389
>             Project: Infrastructure
>          Issue Type: Wish
>      Security Level: public(Regular issues) 
>          Components: Hudson
>            Reporter: Uwe Schindler
>            Assignee: Niklas Gustavsson
>
> If somebody searches e.g. for JavaDocs of Lucene, he will get a lot of hits, also to the nightly build documentation. In most cases this nightly build documentation is much too prominent. This may confuse users.
> Would it be possible to exclude Hudson build dirs and workspaces completely from search engines by adding a robots.txt to the root folder with "Disallow: /"?

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (INFRA-3389) Reduce exposure of nightly build documentation to search engines

Posted by "Gavin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992412#comment-12992412 ] 

Gavin commented on INFRA-3389:
------------------------------

Note there already is a  robots.txt

https://hudson.apache.org/hudson/robots.txt

how long it has been there I dont know.

> Reduce exposure of nightly build documentation to search engines
> ----------------------------------------------------------------
>
>                 Key: INFRA-3389
>                 URL: https://issues.apache.org/jira/browse/INFRA-3389
>             Project: Infrastructure
>          Issue Type: Wish
>      Security Level: public(Regular issues) 
>          Components: Hudson
>            Reporter: Uwe Schindler
>            Assignee: Niklas Gustavsson
>
> If somebody searches e.g. for JavaDocs of Lucene, he will get a lot of hits, also to the nightly build documentation. In most cases this nightly build documentation is much too prominent. This may confuse users.
> Would it be possible to exclude Hudson build dirs and workspaces completely from search engines by adding a robots.txt to the root folder with "Disallow: /"?

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira