[jira] [Created] (NUTCH-2951) Crawl datum with metadata WRITABLE_GENERATE_TIME_KEY awaits fetching forever

["Lapadula Alessandro (Jira)" <ji...@apache.org>]

Lapadula Alessandro created NUTCH-2951:
------------------------------------------

             Summary: Crawl datum with metadata WRITABLE_GENERATE_TIME_KEY awaits fetching forever
                 Key: NUTCH-2951
                 URL: https://issues.apache.org/jira/browse/NUTCH-2951
             Project: Nutch
          Issue Type: Bug
          Components: generator
    Affects Versions: 1.18, 1.17, 1.16
            Reporter: Lapadula Alessandro


When a crawl datum contains a WRITABLE_GENERATE_TIME_KEY metadata it will wait forever.

 
{code:java}
      LongWritable oldGenTime = (LongWritable) crawlDatum.getMetaData()
          .get(Nutch.WRITABLE_GENERATE_TIME_KEY);
      if (oldGenTime != null) { // awaiting fetch & update
        if (oldGenTime.get() + genDelay > curTime) // still wait for
          // update
          context.getCounter("Generator", "WAIT_FOR_UPDATE").increment(1);
        return;
      }{code}
The line 
{code:java}
context.getCounter("Generator", "WAIT_FOR_UPDATE").increment(1); {code}
has been introduced in version 1.16 without adding the brackets.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)