You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Michael McCandless (Commented) (JIRA)" <ji...@apache.org> on 2012/03/29 19:56:22 UTC

[jira] [Commented] (LUCENE-3937) Workaround the XERCES-J bug in Benchmark

    [ https://issues.apache.org/jira/browse/LUCENE-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241438#comment-13241438 ] 

Michael McCandless commented on LUCENE-3937:
--------------------------------------------

LUCENE-1591 is when we first tripped on the XERCESJ-1257 bug... and the bug also happens on enwiki-20110115-pages-articles.xml.bz2 export.

Great idea to workaround Xercesj's bug by using the JVM to decode UTF8, instead of Xercesj...

I'll test this patch now!

                
> Workaround the XERCES-J bug in Benchmark
> ----------------------------------------
>
>                 Key: LUCENE-3937
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3937
>             Project: Lucene - Java
>          Issue Type: Bug
>            Reporter: Uwe Schindler
>         Attachments: LUCENE-3937.patch
>
>
> In becnhmark we have a patched version of XERCES which is hard to compile from source. When looking at the code part patched and the source of EnwikiContentSource, to simply provide the XML parser a Reader instead of InputStream, so the broken code is not triggered. This assumes, that the XML-file is always UTF-8.... If not it will no longer work (because the XML parser cannot switch encoding, if it only has a Reader).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org