[jira] [Resolved] (NUTCH-2992) Fetcher: always block fetch queues when exceptions threshold is reached

["Sebastian Nagel (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NUTCH-2992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sebastian Nagel resolved NUTCH-2992.
------------------------------------
    Resolution: Fixed

> Fetcher: always block fetch queues when exceptions threshold is reached
> -----------------------------------------------------------------------
>
>                 Key: NUTCH-2992
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2992
>             Project: Nutch
>          Issue Type: Bug
>          Components: fetcher
>    Affects Versions: 1.19
>            Reporter: Sebastian Nagel
>            Assignee: Sebastian Nagel
>            Priority: Major
>             Fix For: 1.20
>
>
> When the exception threshold of a fetch queue is reached (defined by {{fetcher.max.exceptions.per.queue}}, NUTCH-769), the queue must be blocked, even if it is empty at this time. Otherwise, if the queue feeder is still alive, new items may be added to the queue later on. See [FetchItemQueues.java, line 306|https://github.com/apache/nutch/blob/215993bc6fbc58c050251410d5a7b02e601d99b3/src/java/org/apache/nutch/fetcher/FetchItemQueues.java#L306] for the reason and NUTCH-2947 for a similar bug.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)