[jira] [Updated] (NUTCH-1414) Date extraction parse filter

["Markus Jelsma (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NUTCH-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Markus Jelsma updated NUTCH-1414:
---------------------------------

    Attachment: NUTCH-1414-1.6-1.patch

Here's a first draft with unit tests and a command line test tool.

{code}bin/nutch plugin org.apache.nutch.parse.date{code}

This plugin extracts a fragment that's likely to contain the page's creation date. The fragment is then passed through a series of regular expressions that the user can configure. The extracted date candidates are then passed through a configurable list of DateFormat formats in an attempt to get a parsed date.

The date format is locale sensitive so the language provided by the language-identifier is passed as well. With it, parsing dates in various languages is possible with a single date format.

Please comment.
                
> Date extraction parse filter
> ----------------------------
>
>                 Key: NUTCH-1414
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1414
>             Project: Nutch
>          Issue Type: New Feature
>          Components: parser
>            Reporter: Markus Jelsma
>            Assignee: Markus Jelsma
>             Fix For: 1.6
>
>         Attachments: NUTCH-1414-1.6-1.patch
>
>
> Date extraction parse filter for Nutch to provide means to extract an arbitrary page date (article date) from the parse text.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira