You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Dan Rosher (Created) (JIRA)" <ji...@apache.org> on 2012/03/05 18:43:58 UTC

[jira] [Created] (NUTCH-1298) Pass numTasks to FetcherJob

Pass numTasks to FetcherJob
---------------------------

                 Key: NUTCH-1298
                 URL: https://issues.apache.org/jira/browse/NUTCH-1298
             Project: Nutch
          Issue Type: Improvement
          Components: fetcher
    Affects Versions: nutchgora
            Reporter: Dan Rosher
            Priority: Minor
             Fix For: nutchgora
         Attachments: NUTCH-1298.patch

Pass -numTasks N from crawler to FetcherJob

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (NUTCH-1298) Pass numTasks to FetcherJob

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/NUTCH-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13223957#comment-13223957 ] 

Hudson commented on NUTCH-1298:
-------------------------------

Integrated in Nutch-nutchgora #185 (See [https://builds.apache.org/job/Nutch-nutchgora/185/])
    NUTCH-1298 Pass numTasks to FetcherJob (Revision 1297388)

     Result = SUCCESS
ferdy : 
Files : 
* /nutch/branches/nutchgora/CHANGES.txt
* /nutch/branches/nutchgora/src/java/org/apache/nutch/crawl/Crawler.java

                
> Pass numTasks to FetcherJob
> ---------------------------
>
>                 Key: NUTCH-1298
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1298
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>    Affects Versions: nutchgora
>            Reporter: Dan Rosher
>            Priority: Minor
>             Fix For: nutchgora
>
>         Attachments: NUTCH-1298.patch
>
>
> Pass -numTasks N from crawler to FetcherJob

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (NUTCH-1298) Pass numTasks to FetcherJob

Posted by "Dan Rosher (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/NUTCH-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dan Rosher updated NUTCH-1298:
------------------------------

    Attachment: NUTCH-1298.patch
    
> Pass numTasks to FetcherJob
> ---------------------------
>
>                 Key: NUTCH-1298
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1298
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>    Affects Versions: nutchgora
>            Reporter: Dan Rosher
>            Priority: Minor
>             Fix For: nutchgora
>
>         Attachments: NUTCH-1298.patch
>
>
> Pass -numTasks N from crawler to FetcherJob

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Closed] (NUTCH-1298) Pass numTasks to FetcherJob

Posted by "Ferdy Galema (Closed) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/NUTCH-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ferdy Galema closed NUTCH-1298.
-------------------------------

    Resolution: Fixed
    
> Pass numTasks to FetcherJob
> ---------------------------
>
>                 Key: NUTCH-1298
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1298
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>    Affects Versions: nutchgora
>            Reporter: Dan Rosher
>            Priority: Minor
>             Fix For: nutchgora
>
>         Attachments: NUTCH-1298.patch
>
>
> Pass -numTasks N from crawler to FetcherJob

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (NUTCH-1298) Pass numTasks to FetcherJob

Posted by "Ferdy Galema (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/NUTCH-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13223105#comment-13223105 ] 

Ferdy Galema commented on NUTCH-1298:
-------------------------------------

I'm not certain what the status and support of the Crawler command is.. I think most are in favor of shell scripts. This is what I prefer too. I just tried the Crawler command and it seems that there are some other issues with it. For example at first sight it seems that the  Generator is not called?

Anyway, your patch addresses an issue and if the command is still used, why not commit it? I verified the patch and committed it. Thanks.
                
> Pass numTasks to FetcherJob
> ---------------------------
>
>                 Key: NUTCH-1298
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1298
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>    Affects Versions: nutchgora
>            Reporter: Dan Rosher
>            Priority: Minor
>             Fix For: nutchgora
>
>         Attachments: NUTCH-1298.patch
>
>
> Pass -numTasks N from crawler to FetcherJob

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira