You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by "Jukka Zitting (Commented) (JIRA)" <ji...@apache.org> on 2011/10/07 10:40:30 UTC
[jira] [Commented] (TIKA-272) Expose characters offsets information
while parsing text-based inputs.
[ https://issues.apache.org/jira/browse/TIKA-272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122625#comment-13122625 ]
Jukka Zitting commented on TIKA-272:
------------------------------------
See PDFBOX-577 for some related work in PDFBox.
> Expose characters offsets information while parsing text-based inputs.
> ----------------------------------------------------------------------
>
> Key: TIKA-272
> URL: https://issues.apache.org/jira/browse/TIKA-272
> Project: Tika
> Issue Type: New Feature
> Components: parser
> Affects Versions: 0.4
> Reporter: David Causse
> Priority: Minor
>
> It would be interesting to access actual characters offset information when parsing text-based files (I don't know if it's interesting/usable/doable for binary formats...).
> If I use tika for parsing HTML and inject parsed strings into lucene, I'm not able to tell to the lucene analyzer where is the actual character in the original input.
> If tika expose this information It will permit to use unmodified lucene analyzers behind tika and implement for example pretty highlighting in search result (see google cache view).
> With new Lucene Attribute API it could be fairly easy to provide a sort of TikaOffsetRectifierTokenFilter in lucene contrib and use a stack like tika -> unmodified lucene analyzer -> tika offset correction.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira