You are viewing a plain text version of this content. The canonical link for it is here.

Posted to droids-dev@incubator.apache.org by "Richard Frovarp (Commented) (JIRA)" <ji...@apache.org> on 2011/11/22 01:30:42 UTC

[jira] [Commented] (DROIDS-156) CrawlingWorker runs out of memory

    [ https://issues.apache.org/jira/browse/DROIDS-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13154811#comment-13154811 ] 

Richard Frovarp commented on DROIDS-156:
----------------------------------------

0.1.x fixed in r1204776.
                
> CrawlingWorker runs out of memory
> ---------------------------------
>
>                 Key: DROIDS-156
>                 URL: https://issues.apache.org/jira/browse/DROIDS-156
>             Project: Droids
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.0.1, 0.0.2
>            Reporter: Richard Frovarp
>
> CrawlingWorker when loading the entity can run out of memory. I discovered this when my crawler tried to pull down a 3.3GB file. This should be handled semi-gracefully.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira