You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Megha Bhandari <mb...@sapient.com> on 2016/04/19 10:53:38 UTC

Nutch 1.11 : meta directive noindex not honored

Hi

We are using Nutch 1.11 and are using the following meta directive

<meta name="bot-name-set-in-site-default-xml" value='noindex' />

However Nutch is still indexing the page into Solr(5.5) .

Any idea what settings are being missed over here?

Thanks for any help.

Megha