You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Hudson (Jira)" <ji...@apache.org> on 2020/08/16 21:08:01 UTC

[jira] [Commented] (NUTCH-2785) FreeGenerator: command-line option to define number of generated fetch lists

    [ https://issues.apache.org/jira/browse/NUTCH-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178602#comment-17178602 ] 

Hudson commented on NUTCH-2785:
-------------------------------

SUCCESS: Integrated in Jenkins build Nutch » Nutch-trunk #3 (See [https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/3/])
NUTCH-2785 FreeGenerator: command-line option to define number of generated fetch lists (snagel: [https://github.com/apache/nutch/commit/06b227122fac64533dd7e8912ae24ad2bac41c87])
* (edit) src/java/org/apache/nutch/tools/FreeGenerator.java


> FreeGenerator: command-line option to define number of generated fetch lists
> ----------------------------------------------------------------------------
>
>                 Key: NUTCH-2785
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2785
>             Project: Nutch
>          Issue Type: Improvement
>          Components: generator
>    Affects Versions: 1.16
>            Reporter: Sebastian Nagel
>            Assignee: Sebastian Nagel
>            Priority: Major
>             Fix For: 1.17
>
>
> While Generator allows to specify the number of generated fetch lists using the "-numFetchers" command-line option, FreeGenerator does not provide such an option. It uses the value of "mapreduce.job.maps" (2 by default), also in local mode where Generator always creates only one single fetch list.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)