You are viewing a plain text version of this content. The canonical link for it is here.
Posted to droids-dev@incubator.apache.org by "Thorsten Scherler (JIRA)" <ji...@apache.org> on 2009/05/07 22:58:45 UTC
[jira] Closed: (DROIDS-47) SimpleTaskQueue is very slow to init
when there is a large number of seed URLs
[ https://issues.apache.org/jira/browse/DROIDS-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thorsten Scherler closed DROIDS-47.
-----------------------------------
Resolution: Fixed
Assignee: (was: Thorsten Scherler)
Committed revision 772801.
Thanks Mingfai Ma keep up the good work.
> SimpleTaskQueue is very slow to init when there is a large number of seed URLs
> ------------------------------------------------------------------------------
>
> Key: DROIDS-47
> URL: https://issues.apache.org/jira/browse/DROIDS-47
> Project: Droids
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.01
> Reporter: Mingfai Ma
> Attachments: DROIDS-47.patch, DROIDS-47_profile-after.png, DROIDS-47_profile.png
>
>
> when i put 300,000 seeds url to CrawlingDroid with SimpleTaskQueueWithHistory and init() it, it takes an hour to complete on my Quad core server.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.