You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Sebastian Nagel (JIRA)" <ji...@apache.org> on 2017/09/11 10:56:00 UTC
[jira] [Resolved] (NUTCH-2409) Injector: complete command-line help
and counters
[ https://issues.apache.org/jira/browse/NUTCH-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sebastian Nagel resolved NUTCH-2409.
------------------------------------
Resolution: Fixed
Assignee: Sebastian Nagel
> Injector: complete command-line help and counters
> -------------------------------------------------
>
> Key: NUTCH-2409
> URL: https://issues.apache.org/jira/browse/NUTCH-2409
> Project: Nutch
> Issue Type: Improvement
> Components: injector
> Affects Versions: 1.13
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Trivial
> Fix For: 1.14
>
>
> See discussion in [NUTCH-2335|https://issues.apache.org/jira/browse/NUTCH-2335?focusedCommentId=16130178&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16130178]:
> - add counters for removed items from CrawlDb:
> {noformat}
> Injector: Total urls removed from CrawlDb by filters: 2
> Injector: Total urls with status gone removed from CrawlDb (db.update.purge.404): 0
> {noformat}
> - add {{-Ddb.update.purge.404=true}} to command-line help:
> {noformat}
> Usage: Injector [-D...] <crawldb> <url_dir> [-overwrite|-update] [-noFilter] [-noNormalize] [-filterNormalizeAll]
> ...
> -D... set or overwrite configuration property (property=value)
> -Ddb.update.purge.404=true
> remove URLs with status gone (404) from CrawlDb
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)