You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tika.apache.org by "Ken Krugler (JIRA)" <ji...@apache.org> on 2009/10/10 16:15:31 UTC

[jira] Created: (TIKA-307) Better handling of partial/truncated input data to parsers

Better handling of partial/truncated input data to parsers
----------------------------------------------------------

                 Key: TIKA-307
                 URL: https://issues.apache.org/jira/browse/TIKA-307
             Project: Tika
          Issue Type: Improvement
          Components: parser
    Affects Versions: 0.4
            Reporter: Ken Krugler


Some parsers (e.g. ZipParser) can hang if they prematurely reach the end of the input stream.

As a way of avoiding this issue, Jukka had suggested the following approach on the list:

The input stream could be wrapped into a decorator that throws a tagged IOException when the given size limit has been reached. This assumes that all parsers will correctly propagate up an IOException (at the very least).

Smarter parsers could cleanly close the emitted XHTML stream, potentially adding a metadata entry that signifies that the extracted text has been truncated.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.