You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by "david lemon (JIRA)" <ji...@apache.org> on 2012/10/03 23:29:07 UTC

[jira] [Created] (TIKA-1001) tika no longer seems to honor HTTP meta tag for arabic text in ISO-8859-6 charset

david lemon created TIKA-1001:
---------------------------------

             Summary: tika no longer seems to honor HTTP meta tag for arabic text in ISO-8859-6 charset
                 Key: TIKA-1001
                 URL: https://issues.apache.org/jira/browse/TIKA-1001
             Project: Tika
          Issue Type: Bug
          Components: parser
    Affects Versions: 1.2
            Reporter: david lemon


attached document extracts correctly in Tika 1.1
attached document extracts incorrectly in tika 1.2.

The difference appears to be that tika 1.1 honors the http meta content-type tag which specifies the charset as iso-8859-6, and correctly converts the output to UTF-8.
tika 1.2 appears to ignore the charset specified in the meta tag.

Some noodling seems to indicate that the problem is the charset.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (TIKA-1001) tika no longer seems to honor HTTP meta tag for arabic text in ISO-8859-6 charset

Posted by "david lemon (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TIKA-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

david lemon updated TIKA-1001:
------------------------------

    Description: 
attached document extracts correctly in Tika 1.1
attached document extracts incorrectly in tika 1.2.

The difference appears to be that tika 1.1 honors the http meta content-type tag which specifies the charset as iso-8859-6, and correctly converts the output to UTF-8.
tika 1.2 appears to ignore the charset specified in the meta tag.

Some noodling seems to indicate that the problem is the charset.

it doesn't matter what mode tika is used in (server, app mode, etc. even if content-type is specified with a charset, the output is still garbage).


  was:
attached document extracts correctly in Tika 1.1
attached document extracts incorrectly in tika 1.2.

The difference appears to be that tika 1.1 honors the http meta content-type tag which specifies the charset as iso-8859-6, and correctly converts the output to UTF-8.
tika 1.2 appears to ignore the charset specified in the meta tag.

Some noodling seems to indicate that the problem is the charset.


    
> tika no longer seems to honor HTTP meta tag for arabic text in ISO-8859-6 charset
> ---------------------------------------------------------------------------------
>
>                 Key: TIKA-1001
>                 URL: https://issues.apache.org/jira/browse/TIKA-1001
>             Project: Tika
>          Issue Type: Bug
>          Components: parser
>    Affects Versions: 1.2
>            Reporter: david lemon
>         Attachments: badarabic.html
>
>
> attached document extracts correctly in Tika 1.1
> attached document extracts incorrectly in tika 1.2.
> The difference appears to be that tika 1.1 honors the http meta content-type tag which specifies the charset as iso-8859-6, and correctly converts the output to UTF-8.
> tika 1.2 appears to ignore the charset specified in the meta tag.
> Some noodling seems to indicate that the problem is the charset.
> it doesn't matter what mode tika is used in (server, app mode, etc. even if content-type is specified with a charset, the output is still garbage).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (TIKA-1001) tika no longer seems to honor HTTP meta tag for arabic text in ISO-8859-6 charset

Posted by "david lemon (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TIKA-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

david lemon updated TIKA-1001:
------------------------------

    Attachment: badarabic.html

file which no longer extracts correctly
                
> tika no longer seems to honor HTTP meta tag for arabic text in ISO-8859-6 charset
> ---------------------------------------------------------------------------------
>
>                 Key: TIKA-1001
>                 URL: https://issues.apache.org/jira/browse/TIKA-1001
>             Project: Tika
>          Issue Type: Bug
>          Components: parser
>    Affects Versions: 1.2
>            Reporter: david lemon
>         Attachments: badarabic.html
>
>
> attached document extracts correctly in Tika 1.1
> attached document extracts incorrectly in tika 1.2.
> The difference appears to be that tika 1.1 honors the http meta content-type tag which specifies the charset as iso-8859-6, and correctly converts the output to UTF-8.
> tika 1.2 appears to ignore the charset specified in the meta tag.
> Some noodling seems to indicate that the problem is the charset.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira