You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Ken Krugler (JIRA)" <ji...@apache.org> on 2011/04/13 23:36:05 UTC
[jira] [Commented] (NUTCH-944) Increase the number of elements to
look for URLs and add the ability to specify multiple attributes by
elements
[ https://issues.apache.org/jira/browse/NUTCH-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019565#comment-13019565 ]
Ken Krugler commented on NUTCH-944:
-----------------------------------
I'm curious how this relates to [TIKA-463]. Is it that this code extracts the URLs from the attributes that (as of TIKA-463) should be getting returned by Tika's HtmlParser?
Also, TIKA-463 doesn't handle "video" - is that a legit XHTML 1.0 element?
> Increase the number of elements to look for URLs and add the ability to specify multiple attributes by elements
> ---------------------------------------------------------------------------------------------------------------
>
> Key: NUTCH-944
> URL: https://issues.apache.org/jira/browse/NUTCH-944
> Project: Nutch
> Issue Type: Improvement
> Components: parser
> Environment: GNU/Linux Fedora 12
> Reporter: Jean-Francois Gingras
> Priority: Minor
> Fix For: 2.0
>
> Attachments: DOMContentUtils.java.path-1.0, DOMContentUtils.java.path-1.3
>
>
> Here a patch for DOMContentUtils.java that increase the number of elements to look for URLs. It also add the ability to specify multiple attributes by elements, for example:
> linkParams.put("frame", new LinkParams("frame", "longdesc,src", 0));
> linkParams.put("object", new LinkParams("object", "classid,codebase,data,usemap", 0));
> linkParams.put("video", new LinkParams("video", "poster,src", 0)); // HTML 5
> I have a patch for release-1.0 and branch-1.3
> I would love to hear your comments about this.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira