You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Sebastian Nagel (Jira)" <ji...@apache.org> on 2022/01/11 13:45:00 UTC
[jira] [Commented] (NUTCH-2924) Generate maxCount expr evaluated only once
[ https://issues.apache.org/jira/browse/NUTCH-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17472731#comment-17472731 ]
Sebastian Nagel commented on NUTCH-2924:
----------------------------------------
Hi [~markus17], see NUTCH-2455 and [PR #254|https://github.com/apache/nutch/pull/254]: it includes a scalable solution reading the HostDb only once but not into memory. Unfortunately, the PR wasn't merged - there are some things still to do.
> Generate maxCount expr evaluated only once
> ------------------------------------------
>
> Key: NUTCH-2924
> URL: https://issues.apache.org/jira/browse/NUTCH-2924
> Project: Nutch
> Issue Type: Bug
> Components: generator
> Affects Versions: 1.16
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Major
> Fix For: 1.19
>
> Attachments: NUTCH-2924-1.patch, NUTCH-2924-2.patch, NUTCH-2924-3.patch, NUTCH-2924.patch
>
>
> The generate.maxCount expression is evaluated only once in the generator's reducer, instead, it must be set once per host.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)