You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@infra.apache.org by "Sebb (JIRA)" <ji...@apache.org> on 2011/06/20 03:05:47 UTC
[jira] [Created] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Mirrors that don't return 404 for missing files/directories
-----------------------------------------------------------
Key: INFRA-3715
URL: https://issues.apache.org/jira/browse/INFRA-3715
Project: Infrastructure
Issue Type: Bug
Security Level: public (Regular issues)
Components: Mirrors
Reporter: Sebb
There are some mirrors that don't return 404s for missing files/directories:
http://apache.xl-mirror.nl/
http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Henk Penning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070423#comment-13070423 ]
Henk Penning commented on INFRA-3715:
-------------------------------------
CPAN has this included in their requirements :
Adding any advertisements or any revenue-generating material
is strictly forbidden.
Similarly, for your public CPAN mirrors "framing" or "wrapping"
the CPAN web pages into other sites by using e.g. HTML tables
or frames is not allowed.
I think it makes sense to add the 'no framing or wrapping'
to the how-tomirror page.
See page source of http://www.cpan.org/
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Sebb (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sebb reopened INFRA-3715:
-------------------------
Re-opening because policy is not yet resolved.
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "#asfinfra IRC Bot (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070439#comment-13070439 ]
#asfinfra IRC Bot commented on INFRA-3715:
------------------------------------------
<gmcdonald> All this is getting to become nanny state maintenance headache. I relieve myself of mirror duties, good luck both of you.
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070381#comment-13070381 ]
Gavin commented on INFRA-3715:
------------------------------
Sorry, got a bit of a backlog going. We need to decide whether this is a problem for us or not.
I see 3 choices:
1. Not a problem
2. We dont allow it on all mirrors
3. We monitor it and dont allow it on mirrors that use the custom 404s to provide revenue links.
I do not agree with 1. I think policing it for 2. may be a fair bit of work ongoing.
Although the least likely I think I prefer 3 and just tell mirrors to remove custom 404s if they are using them inappropriately.
I think the 3 sites mentioned above are ok and can be left alone for now.
(This issue can therefore remain closed, but I wanted to finalise the decision.)
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Tony Stevenson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tony Stevenson closed INFRA-3715.
---------------------------------
Resolution: Invalid
Closing as there hasnt been an update in 19 days. The sites are still returning custom 404's too.
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Henk Penning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070421#comment-13070421 ]
Henk Penning commented on INFRA-3715:
-------------------------------------
If option 2 is policy, I suggest to add to the required config in the how-to-mirror page :
ErrorDocument 404 "Error 404 : Not found."
Or is there a way to 'uncustomize' a custom "ErrorDocument 404" config ?
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Tony Stevenson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13060919#comment-13060919 ]
Tony Stevenson commented on INFRA-3715:
---------------------------------------
So, can we close this a invalid?
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Sebb (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070425#comment-13070425 ]
Sebb commented on INFRA-3715:
-----------------------------
Resetting the 404 behaviour looks to be as simple as the following:
<Directory /web/docs>
ErrorDocument 404 default
</Directory>
Taken from:
http://httpd.apache.org/docs/2.1/mod/core.html#errordocument
Re: framing/wrapping: yes, that would be good as well.
There are several sites that currently wrap parts of the output in a table.
Many of these just add the table around the directory listing, and don't use it for adverts.
Not sure why they do this.
What about redirects? Should we ban these too?
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Tony Stevenson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tony Stevenson closed INFRA-3715.
---------------------------------
Resolution: Fixed
Closing as per Henk comment.
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Henk Penning (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070460#comment-13070460 ]
Henk Penning commented on INFRA-3715:
-------------------------------------
Added to how-to-mirror: 'ErrorDocument 404 default'
and a 'no frames' line.
Sebb, feel free to nag offenders ; I will not.
AFAIK, issue resolved..
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13060418#comment-13060418 ]
Gavin commented on INFRA-3715:
------------------------------
note they ALL return 404s , but are custom.
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Sebb (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070413#comment-13070413 ]
Sebb commented on INFRA-3715:
-----------------------------
I think option 2 is the best.
It's trivial to check whether missing files/dirs return a 404; this can be automated (indeed that's how I found the problems originally).
Checking whether a custom 404 is OK or not cannot be automated.
Also, it can be confusing for users.
So I suggest the policy is to not allow custom 404s in future.
If we want to allow exceptions for the 3 existing mirrors, then that could of course be done.
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (INFRA-3715) Mirrors that don't return 404 for
missing files/directories
Posted by "Sebb (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13051756#comment-13051756 ]
Sebb commented on INFRA-3715:
-----------------------------
Also
http://newverhost.com/pub/commons/
> Mirrors that don't return 404 for missing files/directories
> -----------------------------------------------------------
>
> Key: INFRA-3715
> URL: https://issues.apache.org/jira/browse/INFRA-3715
> Project: Infrastructure
> Issue Type: Bug
> Security Level: public(Regular issues)
> Components: Mirrors
> Reporter: Sebb
>
> There are some mirrors that don't return 404s for missing files/directories:
> http://apache.xl-mirror.nl/
> http://www.eng.lsu.edu/mirrors/apache/
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira