You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Ed Whittaker (JIRA)" <ji...@apache.org> on 2006/01/08 03:46:26 UTC

[jira] Updated: (NUTCH-167) Observation of directive

     [ http://issues.apache.org/jira/browse/NUTCH-167?page=all ]

Ed Whittaker updated NUTCH-167:
-------------------------------

    Component: web gui
      Version: 0.7.1

> Observation of <META NAME="ROBOTS" CONTENT="NOARCHIVE"> directive
> -----------------------------------------------------------------
>
>          Key: NUTCH-167
>          URL: http://issues.apache.org/jira/browse/NUTCH-167
>      Project: Nutch
>         Type: Improvement
>   Components: indexer, web gui
>     Versions: 0.7.1
>     Reporter: Ed Whittaker
>     Priority: Critical

>
> Though not strictly a bug, this issue is potentially serious for users of Nutch who deploy live systems who might be threatened with legal action for caching copies of copyrighted material. The major search engines all observe this directive (even though apparently it's not stanard) so there's every reason why Nutch should too.  

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira