You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@any23.apache.org by "Michele Mostarda (Commented) (JIRA)" <ji...@apache.org> on 2012/04/16 10:12:17 UTC
[jira] [Commented] (ANY23-75) Improve runtime of the Microdata
extractor on documents with many relations.
[ https://issues.apache.org/jira/browse/ANY23-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13254570#comment-13254570 ]
Michele Mostarda commented on ANY23-75:
---------------------------------------
I read the patch, it sounds really clear, it is an optimization to improve performances while processing detecting nested node paths. I will integrate it in a couple of days.
> Improve runtime of the Microdata extractor on documents with many relations.
> ----------------------------------------------------------------------------
>
> Key: ANY23-75
> URL: https://issues.apache.org/jira/browse/ANY23-75
> Project: Apache Any23
> Issue Type: Improvement
> Affects Versions: 0.7.0
> Reporter: Timothy Potter
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: MicrodataParser.diff
>
>
> I've been running Any23 on a big web crawler dump. I found for certain documents with a lot of Microdata relations the method MicrodataParser.getItemProps() becomes very slow. As a result, processing one document can take several minutes. An example of a problematic page can be seen here: http://dreamtime.fftunes.com/
> I'll attach a patch for the method that greatly improves the performance of this method. I was wondering if someone could have a look at it and include it in the next release if possible.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira