[jira] [Created] (NUTCH-2409) Injector: complete command-line help and counters

["Sebastian Nagel (JIRA)" <ji...@apache.org>]

Sebastian Nagel created NUTCH-2409:
--------------------------------------

             Summary: Injector: complete command-line help and counters
                 Key: NUTCH-2409
                 URL: https://issues.apache.org/jira/browse/NUTCH-2409
             Project: Nutch
          Issue Type: Improvement
          Components: injector
    Affects Versions: 1.13
            Reporter: Sebastian Nagel
            Priority: Trivial
             Fix For: 1.14


See discussion in [NUTCH-2335|https://issues.apache.org/jira/browse/NUTCH-2335?focusedCommentId=16130178&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16130178]:
- add counters for removed items from CrawlDb:
{noformat}
Injector: Total urls removed from CrawlDb by filters: 2
Injector: Total urls with status gone removed from CrawlDb (db.update.purge.404): 0
{noformat}
- add {{-Ddb.update.purge.404=true}} to command-line help:
{noformat}
Usage: Injector [-D...] <crawldb> <url_dir> [-overwrite|-update] [-noFilter] [-noNormalize] [-filterNormalizeAll]
...
 -D...          set or overwrite configuration property (property=value)
 -Ddb.update.purge.404=true
                remove URLs with status gone (404) from CrawlDb
{noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)