You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Ken Krugler (JIRA)" <ji...@apache.org> on 2011/04/13 23:36:05 UTC

[jira] [Commented] (NUTCH-944) Increase the number of elements to look for URLs and add the ability to specify multiple attributes by elements

    [ https://issues.apache.org/jira/browse/NUTCH-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019565#comment-13019565 ] 

Ken Krugler commented on NUTCH-944:
-----------------------------------

I'm curious how this relates to [TIKA-463]. Is it that this code extracts the URLs from the attributes that (as of TIKA-463) should be getting returned by Tika's HtmlParser?

Also, TIKA-463 doesn't handle "video" - is that a legit XHTML 1.0 element?


> Increase the number of elements to look for URLs and add the ability to specify multiple attributes by elements
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: NUTCH-944
>                 URL: https://issues.apache.org/jira/browse/NUTCH-944
>             Project: Nutch
>          Issue Type: Improvement
>          Components: parser
>         Environment: GNU/Linux Fedora 12
>            Reporter: Jean-Francois Gingras
>            Priority: Minor
>             Fix For: 2.0
>
>         Attachments: DOMContentUtils.java.path-1.0, DOMContentUtils.java.path-1.3
>
>
> Here a patch for DOMContentUtils.java that increase the number of elements to look for URLs. It also add the ability to specify multiple attributes by elements, for example:
> linkParams.put("frame", new LinkParams("frame", "longdesc,src", 0));
> linkParams.put("object", new LinkParams("object", "classid,codebase,data,usemap", 0));
> linkParams.put("video", new LinkParams("video", "poster,src", 0)); // HTML 5
> I have a patch for release-1.0 and branch-1.3
> I would love to hear your comments about this.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira