[jira] [Commented] (TIKA-307) Better handling of partial/truncated input data to parsers

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TIKA-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169372#comment-17169372 ] 

ASF GitHub Bot commented on TIKA-307:
-------------------------------------

jendabenda opened a new pull request #335:
URL: https://github.com/apache/tika/pull/335


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Better handling of partial/truncated input data to parsers
> ----------------------------------------------------------
>
>                 Key: TIKA-307
>                 URL: https://issues.apache.org/jira/browse/TIKA-307
>             Project: Tika
>          Issue Type: Improvement
>          Components: parser
>    Affects Versions: 0.4
>            Reporter: Kenneth William Krugler
>            Priority: Major
>
> Some parsers (e.g. ZipParser) can hang if they prematurely reach the end of the input stream.
> As a way of avoiding this issue, Jukka had suggested the following approach on the list:
> The input stream could be wrapped into a decorator that throws a tagged IOException when the given size limit has been reached. This assumes that all parsers will correctly propagate up an IOException (at the very least).
> Smarter parsers could cleanly close the emitted XHTML stream, potentially adding a metadata entry that signifies that the extracted text has been truncated.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)