You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jackrabbit.apache.org by "Martin Perez (JIRA)" <ji...@apache.org> on 2005/11/29 12:44:30 UTC
[jira] Created: (JCR-281) textfilters module patch: Support for text extraction for HTML,XML and RTF files
textfilters module patch: Support for text extraction for HTML,XML and RTF files
--------------------------------------------------------------------------------
Key: JCR-281
URL: http://issues.apache.org/jira/browse/JCR-281
Project: Jackrabbit
Type: Improvement
Components: query
Reporter: Martin Perez
This patch adds text extraction support form XML, RTF and HTML files.
The unique dependency is htmlparser library for handling HTML text extraction.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
Re: [jira] Closed: (JCR-281) textfilters module patch: Support for text extraction for HTML,XML and RTF files
Posted by Martin Perez <mp...@gmail.com>.
It will be a pleasure.
I'll continue to search possible contribution areas.
On 12/2/05, Marcel Reutegger (JIRA) <ji...@apache.org> wrote:
>
> [ http://issues.apache.org/jira/browse/JCR-281?page=all ]
>
> Marcel Reutegger closed JCR-281:
> --------------------------------
>
> Resolution: Fixed
>
> Committed the modified patch with minor formating changes.
>
> Thanks for the contribution.
>
> I'd like to add you to the list of contributors. Is that ok with you
> Martin?
>
> > textfilters module patch: Support for text extraction for HTML,XML and
> RTF files
> >
> --------------------------------------------------------------------------------
> >
> > Key: JCR-281
> > URL: http://issues.apache.org/jira/browse/JCR-281
> > Project: Jackrabbit
> > Type: Improvement
> > Components: query
> > Reporter: Martin Perez
> > Attachments: patch.diff, patch.diff
> >
> > This patch adds text extraction support form XML, RTF and HTML files.
> > The unique dependency is htmlparser library for handling HTML text
> extraction.
>
> --
> This message is automatically generated by JIRA.
> -
> If you think it was sent incorrectly contact one of the administrators:
> http://issues.apache.org/jira/secure/Administrators.jspa
> -
> For more information on JIRA, see:
> http://www.atlassian.com/software/jira
>
>
[jira] Reopened: (JCR-281) textfilters module patch: Support for text extraction for HTML,XML and RTF files
Posted by "Marcel Reutegger (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/JCR-281?page=all ]
Marcel Reutegger reopened JCR-281:
----------------------------------
Hmm, that's too bad.
I'm still a bit confused what kind of libraries we may use for apache projects. Roy, is there a list of licenses that are compatible with the apache license? Just to make sure we don't spend too much time in the future for extensions that we cannot include. Thanks.
Would it be ok with you Martin, to remove the HTML filter from the patch? The XML and RTF filters are still very good contributions that I'd like to include.
> textfilters module patch: Support for text extraction for HTML,XML and RTF files
> --------------------------------------------------------------------------------
>
> Key: JCR-281
> URL: http://issues.apache.org/jira/browse/JCR-281
> Project: Jackrabbit
> Type: Improvement
> Components: query
> Reporter: Martin Perez
> Attachments: patch.diff
>
> This patch adds text extraction support form XML, RTF and HTML files.
> The unique dependency is htmlparser library for handling HTML text extraction.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Resolved: (JCR-281) textfilters module patch: Support for text extraction for HTML,XML and RTF files
Posted by "Roy T. Fielding (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/JCR-281?page=all ]
Roy T. Fielding resolved JCR-281:
---------------------------------
Resolution: Won't Fix
Thanks for the patch, but htmlparser is LGPL. We can't use it until the owners use a license
that is applicable to Java libraries.
> textfilters module patch: Support for text extraction for HTML,XML and RTF files
> --------------------------------------------------------------------------------
>
> Key: JCR-281
> URL: http://issues.apache.org/jira/browse/JCR-281
> Project: Jackrabbit
> Type: Improvement
> Components: query
> Reporter: Martin Perez
> Attachments: patch.diff
>
> This patch adds text extraction support form XML, RTF and HTML files.
> The unique dependency is htmlparser library for handling HTML text extraction.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Commented: (JCR-281) textfilters module patch: Support for text extraction for HTML,XML and RTF files
Posted by "Michael Wechner (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/JCR-281?page=comments#action_12358892 ]
Michael Wechner commented on JCR-281:
-------------------------------------
you might want to reuse the HTMK Parser from Lenya:
http://svn.apache.org/repos/asf/lenya/branches/BRANCH_1_2_X/src/java/org/apache/lenya/lucene/html/
resp.
http://svn.apache.org/repos/asf/lenya/branches/BRANCH_1_2_X/src/java/org/apache/lenya/lucene/parser/
which is under Apache license, but might need some improvement.
> textfilters module patch: Support for text extraction for HTML,XML and RTF files
> --------------------------------------------------------------------------------
>
> Key: JCR-281
> URL: http://issues.apache.org/jira/browse/JCR-281
> Project: Jackrabbit
> Type: Improvement
> Components: query
> Reporter: Martin Perez
> Attachments: patch.diff
>
> This patch adds text extraction support form XML, RTF and HTML files.
> The unique dependency is htmlparser library for handling HTML text extraction.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Commented: (JCR-281) textfilters module patch: Support for text extraction for HTML,XML and RTF files
Posted by "Martin Perez (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/JCR-281?page=comments#action_12358896 ]
Martin Perez commented on JCR-281:
----------------------------------
There is no problem, I understand what you say Roy.
I'll try to replace htmlparser with another solution. Personally, I prefer to use a third party library because it will be faster and more effective. Give some time to evaluate Neko and other alternatives.
> textfilters module patch: Support for text extraction for HTML,XML and RTF files
> --------------------------------------------------------------------------------
>
> Key: JCR-281
> URL: http://issues.apache.org/jira/browse/JCR-281
> Project: Jackrabbit
> Type: Improvement
> Components: query
> Reporter: Martin Perez
> Attachments: patch.diff
>
> This patch adds text extraction support form XML, RTF and HTML files.
> The unique dependency is htmlparser library for handling HTML text extraction.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Commented: (JCR-281) textfilters module patch: Support for text extraction for HTML,XML and RTF files
Posted by "Marcel Reutegger (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/JCR-281?page=comments#action_12358893 ]
Marcel Reutegger commented on JCR-281:
--------------------------------------
Martin, I quickly checked the web and there are some alternatives that you might want to consider for parsing html:
- javax.swing.text.html.parser.Parser (part of the 1.4 JDK)
- http://www.apache.org/~andyc/neko/doc/html/ (apache license)
> textfilters module patch: Support for text extraction for HTML,XML and RTF files
> --------------------------------------------------------------------------------
>
> Key: JCR-281
> URL: http://issues.apache.org/jira/browse/JCR-281
> Project: Jackrabbit
> Type: Improvement
> Components: query
> Reporter: Martin Perez
> Attachments: patch.diff
>
> This patch adds text extraction support form XML, RTF and HTML files.
> The unique dependency is htmlparser library for handling HTML text extraction.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Updated: (JCR-281) textfilters module patch: Support for text extraction for HTML,XML and RTF files
Posted by "Martin Perez (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/JCR-281?page=all ]
Martin Perez updated JCR-281:
-----------------------------
Attachment: patch.diff
Here is the patch.
> textfilters module patch: Support for text extraction for HTML,XML and RTF files
> --------------------------------------------------------------------------------
>
> Key: JCR-281
> URL: http://issues.apache.org/jira/browse/JCR-281
> Project: Jackrabbit
> Type: Improvement
> Components: query
> Reporter: Martin Perez
> Attachments: patch.diff
>
> This patch adds text extraction support form XML, RTF and HTML files.
> The unique dependency is htmlparser library for handling HTML text extraction.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Closed: (JCR-281) textfilters module patch: Support for text extraction for HTML,XML and RTF files
Posted by "Marcel Reutegger (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/JCR-281?page=all ]
Marcel Reutegger closed JCR-281:
--------------------------------
Resolution: Fixed
Committed the modified patch with minor formating changes.
Thanks for the contribution.
I'd like to add you to the list of contributors. Is that ok with you Martin?
> textfilters module patch: Support for text extraction for HTML,XML and RTF files
> --------------------------------------------------------------------------------
>
> Key: JCR-281
> URL: http://issues.apache.org/jira/browse/JCR-281
> Project: Jackrabbit
> Type: Improvement
> Components: query
> Reporter: Martin Perez
> Attachments: patch.diff, patch.diff
>
> This patch adds text extraction support form XML, RTF and HTML files.
> The unique dependency is htmlparser library for handling HTML text extraction.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Updated: (JCR-281) textfilters module patch: Support for text extraction for HTML,XML and RTF files
Posted by "Martin Perez (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/JCR-281?page=all ]
Martin Perez updated JCR-281:
-----------------------------
Attachment: patch.diff
I have updated the HTMLTextFilter class.
Now it uses NekoHTML (http://www.apache.org/~andyc/neko/doc/html/) parser and Xerces. Both are on iblibio so there is no need to manually download any jar.
> textfilters module patch: Support for text extraction for HTML,XML and RTF files
> --------------------------------------------------------------------------------
>
> Key: JCR-281
> URL: http://issues.apache.org/jira/browse/JCR-281
> Project: Jackrabbit
> Type: Improvement
> Components: query
> Reporter: Martin Perez
> Attachments: patch.diff, patch.diff
>
> This patch adds text extraction support form XML, RTF and HTML files.
> The unique dependency is htmlparser library for handling HTML text extraction.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira