[jira] [Resolved] (NUTCH-2951) Crawl datum with metadata WRITABLE_GENERATE_TIME_KEY awaits fetching forever

["Sebastian Nagel (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NUTCH-2951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sebastian Nagel resolved NUTCH-2951.
------------------------------------
    Resolution: Fixed

Fixed. Thanks again, [~Lapax]!

> Crawl datum with metadata WRITABLE_GENERATE_TIME_KEY awaits fetching forever
> ----------------------------------------------------------------------------
>
>                 Key: NUTCH-2951
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2951
>             Project: Nutch
>          Issue Type: Bug
>          Components: generator
>    Affects Versions: 1.16, 1.17, 1.18
>            Reporter: Lapadula Alessandro
>            Assignee: Sebastian Nagel
>            Priority: Minor
>             Fix For: 1.19
>
>
> When a crawl datum contains a WRITABLE_GENERATE_TIME_KEY metadata it will wait forever.
>  
> {code:java}
>       LongWritable oldGenTime = (LongWritable) crawlDatum.getMetaData()
>           .get(Nutch.WRITABLE_GENERATE_TIME_KEY);
>       if (oldGenTime != null) { // awaiting fetch & update
>         if (oldGenTime.get() + genDelay > curTime) // still wait for
>           // update
>           context.getCounter("Generator", "WAIT_FOR_UPDATE").increment(1);
>         return;
>       }{code}
> The line 
> {code:java}
> context.getCounter("Generator", "WAIT_FOR_UPDATE").increment(1); {code}
> has been introduced in version 1.16 without adding the brackets.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)