You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by "Chris A. Mattmann (JIRA)" <ji...@apache.org> on 2010/01/20 06:51:55 UTC

[jira] Resolved: (TIKA-357) Increase buffer size for meta tag sniffing

     [ https://issues.apache.org/jira/browse/TIKA-357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris A. Mattmann resolved TIKA-357.
------------------------------------

    Resolution: Fixed

- patch applied in r901068. With the other patches (TIKA-327, TIKA-366, TIKA-367), HTML detection is now a _lot_ better in Tika. Thanks to Ken Krugler for this patch!

> Increase buffer size for meta tag sniffing
> ------------------------------------------
>
>                 Key: TIKA-357
>                 URL: https://issues.apache.org/jira/browse/TIKA-357
>             Project: Tika
>          Issue Type: Improvement
>    Affects Versions: 0.5
>            Reporter: Ken Krugler
>            Assignee: Chris A. Mattmann
>            Priority: Minor
>             Fix For: 0.6
>
>         Attachments: big-preamble.html, makler.html, TIKA-357-2.patch, TIKA-357.patch
>
>
> Some web pages (such as makler.su, see attached) have lots of script data before the body of the HTML.
> When this happens, the sniffing code fails to find the charset info in the meta tag, because it currently only sniffs the first 4K.
> Bumping it to 8K would cover all of the cases that I (Ken) have seen during a test crawl.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.