You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Ferdy Galema (JIRA)" <ji...@apache.org> on 2012/05/07 13:45:49 UTC
[jira] [Created] (NUTCH-1355) nutchgora Configure minimum
throughput for fetcher
Ferdy Galema created NUTCH-1355:
-----------------------------------
Summary: nutchgora Configure minimum throughput for fetcher
Key: NUTCH-1355
URL: https://issues.apache.org/jira/browse/NUTCH-1355
Project: Nutch
Issue Type: New Feature
Reporter: Ferdy Galema
Fix For: nutchgora
Like trunk, nutchgora should also have a feature to configure the fetcher with a minimum throughput. (See NUTCH-1067 for the work done by Markus).
It's implemented in almost the same way, except that the number of times throughput falls below threshold is measured sequentially. (The counter is reset when throughput is healthy again; this should work even better against temporary dips).
Defaults to disabled. Will commit later today if there is no objection.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1355) nutchgora Configure minimum
throughput for fetcher
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271072#comment-13271072 ]
Hudson commented on NUTCH-1355:
-------------------------------
Integrated in Nutch-nutchgora #248 (See [https://builds.apache.org/job/Nutch-nutchgora/248/])
NUTCH-1355 nutchgora Configure minimum throughput for fetcher (Revision 1335063)
Result = SUCCESS
ferdy :
Files :
* /nutch/branches/nutchgora/CHANGES.txt
* /nutch/branches/nutchgora/conf/nutch-default.xml
* /nutch/branches/nutchgora/src/java/org/apache/nutch/fetcher/FetcherReducer.java
> nutchgora Configure minimum throughput for fetcher
> --------------------------------------------------
>
> Key: NUTCH-1355
> URL: https://issues.apache.org/jira/browse/NUTCH-1355
> Project: Nutch
> Issue Type: New Feature
> Reporter: Ferdy Galema
> Fix For: nutchgora
>
> Attachments: NUTCH-1355.patch
>
>
> Like trunk, nutchgora should also have a feature to configure the fetcher with a minimum throughput. (See NUTCH-1067 for the work done by Markus).
> It's implemented in almost the same way, except that the number of times throughput falls below threshold is measured sequentially. (The counter is reset when throughput is healthy again; this should work even better against temporary dips).
> Defaults to disabled. Will commit later today if there is no objection.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (NUTCH-1355) nutchgora Configure minimum
throughput for fetcher
Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ferdy Galema updated NUTCH-1355:
--------------------------------
Attachment: NUTCH-1355.patch
> nutchgora Configure minimum throughput for fetcher
> --------------------------------------------------
>
> Key: NUTCH-1355
> URL: https://issues.apache.org/jira/browse/NUTCH-1355
> Project: Nutch
> Issue Type: New Feature
> Reporter: Ferdy Galema
> Fix For: nutchgora
>
> Attachments: NUTCH-1355.patch
>
>
> Like trunk, nutchgora should also have a feature to configure the fetcher with a minimum throughput. (See NUTCH-1067 for the work done by Markus).
> It's implemented in almost the same way, except that the number of times throughput falls below threshold is measured sequentially. (The counter is reset when throughput is healthy again; this should work even better against temporary dips).
> Defaults to disabled. Will commit later today if there is no objection.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (NUTCH-1355) nutchgora Configure minimum throughput
for fetcher
Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ferdy Galema closed NUTCH-1355.
-------------------------------
Resolution: Fixed
committed
> nutchgora Configure minimum throughput for fetcher
> --------------------------------------------------
>
> Key: NUTCH-1355
> URL: https://issues.apache.org/jira/browse/NUTCH-1355
> Project: Nutch
> Issue Type: New Feature
> Reporter: Ferdy Galema
> Fix For: nutchgora
>
> Attachments: NUTCH-1355.patch
>
>
> Like trunk, nutchgora should also have a feature to configure the fetcher with a minimum throughput. (See NUTCH-1067 for the work done by Markus).
> It's implemented in almost the same way, except that the number of times throughput falls below threshold is measured sequentially. (The counter is reset when throughput is healthy again; this should work even better against temporary dips).
> Defaults to disabled. Will commit later today if there is no objection.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira