You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "julien nioche (JIRA)" <ji...@apache.org> on 2009/01/15 14:34:59 UTC

[jira] Created: (NUTCH-679) Fetcher2 implementing Tool

Fetcher2 implementing Tool
--------------------------

                 Key: NUTCH-679
                 URL: https://issues.apache.org/jira/browse/NUTCH-679
             Project: Nutch
          Issue Type: Improvement
          Components: fetcher
            Reporter: julien nioche
            Priority: Minor
         Attachments: Fetcher2.Tool.patch

The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g. 
bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
instead of having to modify the *-site.xml files in conf/


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (NUTCH-679) Fetcher2 implementing Tool

Posted by "Otis Gospodnetic (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665482#action_12665482 ] 

Otis Gospodnetic commented on NUTCH-679:
----------------------------------------

I'm not sure, but committing this may mess up Todd's work on merging Fetcher and Fetcher2.


> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: julien nioche
>            Priority: Minor
>         Attachments: Fetcher2.Tool.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g. 
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (NUTCH-679) Fetcher2 implementing Tool

Posted by "Doğacan Güney (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665125#action_12665125 ] 

Doğacan Güney commented on NUTCH-679:
-------------------------------------

Looks simple enough. I am going to commit it soon if no objections.

Btw, please use 2-space tabs otherwise it messes up patches :)

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: julien nioche
>            Priority: Minor
>         Attachments: Fetcher2.Tool.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g. 
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (NUTCH-679) Fetcher2 implementing Tool

Posted by "Andrzej Bialecki (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764066#action_12764066 ] 

Andrzej Bialecki  commented on NUTCH-679:
-----------------------------------------

Fixed in rev. 823600. Thanks!

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: Julien Nioche
>            Assignee: Andrzej Bialecki 
>            Priority: Minor
>             Fix For: 1.1
>
>         Attachments: Fetcher2.Tool.patch, NUTCH-679.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g. 
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (NUTCH-679) Fetcher2 implementing Tool

Posted by "julien nioche (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665791#action_12665791 ] 

julien nioche commented on NUTCH-679:
-------------------------------------

I can send a modified version of it once Todd has finished working on the Fetchers. Same for https://issues.apache.org/jira/browse/NUTCH-658  

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: julien nioche
>            Priority: Minor
>         Attachments: Fetcher2.Tool.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g. 
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Closed: (NUTCH-679) Fetcher2 implementing Tool

Posted by "Andrzej Bialecki (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrzej Bialecki  closed NUTCH-679.
-----------------------------------

       Resolution: Fixed
    Fix Version/s: 1.1
         Assignee: Andrzej Bialecki 

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: Julien Nioche
>            Assignee: Andrzej Bialecki 
>            Priority: Minor
>             Fix For: 1.1
>
>         Attachments: Fetcher2.Tool.patch, NUTCH-679.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g. 
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (NUTCH-679) Fetcher2 implementing Tool

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764295#action_12764295 ] 

Hudson commented on NUTCH-679:
------------------------------

Integrated in Nutch-trunk #959 (See [http://hudson.zones.apache.org/hudson/job/Nutch-trunk/959/])
     Fetcher2 implementing Tool.


> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: Julien Nioche
>            Assignee: Andrzej Bialecki 
>            Priority: Minor
>             Fix For: 1.1
>
>         Attachments: Fetcher2.Tool.patch, NUTCH-679.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g. 
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (NUTCH-679) Fetcher2 implementing Tool

Posted by "julien nioche (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

julien nioche updated NUTCH-679:
--------------------------------

    Attachment: Fetcher2.Tool.patch

Patch which makes Fetcher2 implement Tool interface

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: julien nioche
>            Priority: Minor
>         Attachments: Fetcher2.Tool.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g. 
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (NUTCH-679) Fetcher2 implementing Tool

Posted by "Julien Nioche (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/NUTCH-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Julien Nioche updated NUTCH-679:
--------------------------------

    Attachment: NUTCH-679.patch

Updated version of the patch

> Fetcher2 implementing Tool
> --------------------------
>
>                 Key: NUTCH-679
>                 URL: https://issues.apache.org/jira/browse/NUTCH-679
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher
>            Reporter: Julien Nioche
>            Priority: Minor
>         Attachments: Fetcher2.Tool.patch, NUTCH-679.patch
>
>
> The patch attached makes Fetcher2 implement Tool. As a result we should be able to override parameters on the command line e.g. 
> bin/nutch fetch2 -Dfetcher.server.min.delay=1.0 -Dmapred.reduce.tasks=4 segments/20090115072836
> instead of having to modify the *-site.xml files in conf/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.