You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Tien Nguyen Manh (JIRA)" <ji...@apache.org> on 2014/01/15 17:11:25 UTC

[jira] [Created] (NUTCH-1705) Make configuration option for HtmlParser & TikaParser to extract text or title for noIndex page

Tien Nguyen Manh created NUTCH-1705:
---------------------------------------

             Summary: Make configuration option for HtmlParser & TikaParser to extract text or title for noIndex page
                 Key: NUTCH-1705
                 URL: https://issues.apache.org/jira/browse/NUTCH-1705
             Project: Nutch
          Issue Type: Improvement
            Reporter: Tien Nguyen Manh
            Priority: Minor


Currently HtmlParser and TikaParser always skip extracting text and title for noIndex page - page which have noIndex robots metatags.
But some parse-filter may still interested in text and title such as NUTCH-1661, where we may decide wether to follow a page by it's language.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)