[jira] [Created] (TIKA-3832) Required array length is too large when reading a PDF file

["Lakatos Gyula (Jira)" <ji...@apache.org>]

Lakatos Gyula created TIKA-3832:
-----------------------------------

             Summary: Required array length is too large when reading a PDF file
                 Key: TIKA-3832
                 URL: https://issues.apache.org/jira/browse/TIKA-3832
             Project: Tika
          Issue Type: Bug
          Components: parser
    Affects Versions: 2.4.1
            Reporter: Lakatos Gyula
         Attachments: 7581cfbf-8c1e-4154-bfbb-4e633d858d5f.pdf

I'm working on a web crawler and it got obliterated with an OutOfMemory error by a random PDF from the internet.
{code:java}
Exception in thread "main" java.lang.OutOfMemoryError: Required array length 2147483638 + 14 is too large
	at java.base/jdk.internal.util.ArraysSupport.hugeLength(ArraysSupport.java:649)
	at java.base/jdk.internal.util.ArraysSupport.newLength(ArraysSupport.java:642)
	at java.base/java.lang.AbstractStringBuilder.newCapacity(AbstractStringBuilder.java:257)
	at java.base/java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:229)
	at java.base/java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:740)
	at java.base/java.lang.StringBuffer.append(StringBuffer.java:410)
	at java.base/java.io.StringWriter.write(StringWriter.java:99)
	at org.apache.tika.sax.ToTextContentHandler.characters(ToTextContentHandler.java:108)
	at org.apache.tika.sax.ContentHandlerDecorator.characters(ContentHandlerDecorator.java:141)
	at org.apache.tika.sax.WriteOutContentHandler.characters(WriteOutContentHandler.java:160)
	at org.apache.tika.sax.ContentHandlerDecorator.characters(ContentHandlerDecorator.java:141)
	at org.apache.tika.sax.xpath.MatchingContentHandler.characters(MatchingContentHandler.java:81)
	at org.apache.tika.sax.ContentHandlerDecorator.characters(ContentHandlerDecorator.java:141)
	at org.apache.tika.sax.ContentHandlerDecorator.characters(ContentHandlerDecorator.java:141)
	at org.apache.tika.sax.SafeContentHandler.access$201(SafeContentHandler.java:47)
	at org.apache.tika.sax.SafeContentHandler.lambda$new$0(SafeContentHandler.java:57)
	at org.apache.tika.sax.SafeContentHandler.filter(SafeContentHandler.java:106)
	at org.apache.tika.sax.SafeContentHandler.characters(SafeContentHandler.java:250)
	at org.apache.tika.sax.XHTMLContentHandler.characters(XHTMLContentHandler.java:270)
	at org.apache.tika.sax.XHTMLContentHandler.characters(XHTMLContentHandler.java:295)
	at org.apache.tika.parser.pdf.AbstractPDF2XHTML.extractBookmarkText(AbstractPDF2XHTML.java:977)
	at org.apache.tika.parser.pdf.AbstractPDF2XHTML.extractBookmarkText(AbstractPDF2XHTML.java:981)
	at org.apache.tika.parser.pdf.AbstractPDF2XHTML.extractBookmarkText(AbstractPDF2XHTML.java:959)
	at org.apache.tika.parser.pdf.AbstractPDF2XHTML.endDocument(AbstractPDF2XHTML.java:907)
	at org.apache.pdfbox.text.PDFTextStripper.writeText(PDFTextStripper.java:239)
	at org.apache.tika.parser.pdf.PDF2XHTML.process(PDF2XHTML.java:108)
	at org.apache.tika.parser.pdf.PDFParser.parse(PDFParser.java:196)
	at com.example.TikaOOMExample.main(TikaOOMExample.java:31)
{code}
I reproduced the error in this repository:
[https://github.com/laxika/apache-tika-oom-reproduction|http://example.com/]

Uploaded the PDF into the attachments as well. It can be opened and read by the PDF readers I tried (Edge, Adobe, Chrome).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)