[jira] [Commented] (NUTCH-2467) Sitemap type field can be null

["Sebastian Nagel (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NUTCH-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16271333#comment-16271333 ] 

Sebastian Nagel commented on NUTCH-2467:
----------------------------------------

Good catch. However, it's clearer to just remove the if condition ({{if(sitemap.isIndex()) {}}) which is wrong: any subsitemap needs to be processed, there is no need that's it's an index by itself.

> Sitemap type field can be null
> ------------------------------
>
>                 Key: NUTCH-2467
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2467
>             Project: Nutch
>          Issue Type: Bug
>    Affects Versions: 1.13
>            Reporter: Markus Jelsma
>            Assignee: Markus Jelsma
>             Fix For: 1.14
>
>         Attachments: NUTCH-2467.patch
>
>
> sitemap.isIndex() can return null for real sitemap indices, so there contents won't be added to the CrawlDB. Example, the indices https://www.reisenco.nl/sitemap_index.xml points to are not processed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)