You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Benson Margulies <bi...@gmail.com> on 2014/01/07 23:51:45 UTC

oom in documentation-lint

Is there a recipe to avoid this?

-documentation-lint:
     [echo] checking for broken html...
[ivy:cachepath] downloading
http://repo1.maven.org/maven2/net/sf/jtidy/jtidy/r938/jtidy-r938.jar
...
[ivy:cachepath]
..........................................................................................................................................
(244kB)
[ivy:cachepath] .. (0kB)
[ivy:cachepath] [SUCCESSFUL ] net.sf.jtidy#jtidy;r938!jtidy.jar (383ms)
    [jtidy] Checking for broken html (such as invalid tags)...

BUILD FAILED
/Users/benson/asf/lucene-solr/build.xml:57: The following error
occurred while executing this line:
/Users/benson/asf/lucene-solr/lucene/build.xml:208: The following
error occurred while executing this line:
/Users/benson/asf/lucene-solr/lucene/build.xml:214: The following
error occurred while executing this line:
/Users/benson/asf/lucene-solr/lucene/common-build.xml:1851:
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:2271)
at java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:113)
at java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.java:93)
at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:140)
at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282)
at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:125)
at java.io.OutputStreamWriter.write(OutputStreamWriter.java:207)
at java.io.BufferedWriter.flushBuffer(BufferedWriter.java:129)
at java.io.BufferedWriter.write(BufferedWriter.java:230)
at java.io.PrintWriter.write(PrintWriter.java:456)
at java.io.PrintWriter.write(PrintWriter.java:473)
at java.io.PrintWriter.print(PrintWriter.java:603)
at java.io.PrintWriter.println(PrintWriter.java:739)
at org.w3c.tidy.Report.printMessage(Report.java:754)
at org.w3c.tidy.Report.errorSummary(Report.java:1572)
at org.w3c.tidy.Tidy.parse(Tidy.java:608)
at org.w3c.tidy.Tidy.parse(Tidy.java:263)
at org.w3c.tidy.ant.JTidyTask.processFile(JTidyTask.java:457)
at org.w3c.tidy.ant.JTidyTask.executeSet(JTidyTask.java:420)
at org.w3c.tidy.ant.JTidyTask.execute(JTidyTask.java:364)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
at org.apache.tools.ant.Task.perform(Task.java:348)
at org.apache.tools.ant.taskdefs.Sequential.execute(Sequential.java:68)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)

Total time: 3 minutes 35 seconds

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


RE: oom in documentation-lint

Posted by Uwe Schindler <uw...@thetaphi.de>.
Hi,

on 64 bit JVMs this should pass. Which JVM do you use?
On Jenkins, documentation-lint is automatically disabled, if you use a 32 bit JVM.

Uwe

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: Benson Margulies [mailto:bimargulies@gmail.com]
> Sent: Tuesday, January 07, 2014 11:52 PM
> To: dev@lucene.apache.org
> Subject: oom in documentation-lint
> 
> Is there a recipe to avoid this?
> 
> -documentation-lint:
>      [echo] checking for broken html...
> [ivy:cachepath] downloading
> http://repo1.maven.org/maven2/net/sf/jtidy/jtidy/r938/jtidy-r938.jar
> ...
> [ivy:cachepath]
> .....................................................................................................................
> .....................
> (244kB)
> [ivy:cachepath] .. (0kB)
> [ivy:cachepath] [SUCCESSFUL ] net.sf.jtidy#jtidy;r938!jtidy.jar (383ms)
>     [jtidy] Checking for broken html (such as invalid tags)...
> 
> BUILD FAILED
> /Users/benson/asf/lucene-solr/build.xml:57: The following error occurred
> while executing this line:
> /Users/benson/asf/lucene-solr/lucene/build.xml:208: The following error
> occurred while executing this line:
> /Users/benson/asf/lucene-solr/lucene/build.xml:214: The following error
> occurred while executing this line:
> /Users/benson/asf/lucene-solr/lucene/common-build.xml:1851:
> java.lang.OutOfMemoryError: Java heap space at
> java.util.Arrays.copyOf(Arrays.java:2271)
> at java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:113)
> at
> java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.jav
> a:93)
> at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:140)
> at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
> at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282)
> at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:125)
> at java.io.OutputStreamWriter.write(OutputStreamWriter.java:207)
> at java.io.BufferedWriter.flushBuffer(BufferedWriter.java:129)
> at java.io.BufferedWriter.write(BufferedWriter.java:230)
> at java.io.PrintWriter.write(PrintWriter.java:456)
> at java.io.PrintWriter.write(PrintWriter.java:473)
> at java.io.PrintWriter.print(PrintWriter.java:603)
> at java.io.PrintWriter.println(PrintWriter.java:739)
> at org.w3c.tidy.Report.printMessage(Report.java:754)
> at org.w3c.tidy.Report.errorSummary(Report.java:1572)
> at org.w3c.tidy.Tidy.parse(Tidy.java:608)
> at org.w3c.tidy.Tidy.parse(Tidy.java:263)
> at org.w3c.tidy.ant.JTidyTask.processFile(JTidyTask.java:457)
> at org.w3c.tidy.ant.JTidyTask.executeSet(JTidyTask.java:420)
> at org.w3c.tidy.ant.JTidyTask.execute(JTidyTask.java:364)
> at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
> at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> at org.apache.tools.ant.Task.perform(Task.java:348)
> at org.apache.tools.ant.taskdefs.Sequential.execute(Sequential.java:68)
> at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
> at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source) at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> 
> Total time: 3 minutes 35 seconds
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
> commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: oom in documentation-lint

Posted by Robert Muir <rc...@gmail.com>.
The jtidy-macro we use is not very efficient. It just uses the
built-in jtidytask.

I think this is a real problem, last i checked it seemed impossible to
fix without writing a custom task to integrate with jtidy.

we could either disable it, or you could try setting a large Xmx in
ANT_OPTS as a workaround, but I do think we need to fix or disable
this.

On Tue, Jan 7, 2014 at 5:51 PM, Benson Margulies <bi...@gmail.com> wrote:
> Is there a recipe to avoid this?
>
> -documentation-lint:
>      [echo] checking for broken html...
> [ivy:cachepath] downloading
> http://repo1.maven.org/maven2/net/sf/jtidy/jtidy/r938/jtidy-r938.jar
> ...
> [ivy:cachepath]
> ..........................................................................................................................................
> (244kB)
> [ivy:cachepath] .. (0kB)
> [ivy:cachepath] [SUCCESSFUL ] net.sf.jtidy#jtidy;r938!jtidy.jar (383ms)
>     [jtidy] Checking for broken html (such as invalid tags)...
>
> BUILD FAILED
> /Users/benson/asf/lucene-solr/build.xml:57: The following error
> occurred while executing this line:
> /Users/benson/asf/lucene-solr/lucene/build.xml:208: The following
> error occurred while executing this line:
> /Users/benson/asf/lucene-solr/lucene/build.xml:214: The following
> error occurred while executing this line:
> /Users/benson/asf/lucene-solr/lucene/common-build.xml:1851:
> java.lang.OutOfMemoryError: Java heap space
> at java.util.Arrays.copyOf(Arrays.java:2271)
> at java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:113)
> at java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.java:93)
> at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:140)
> at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
> at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282)
> at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:125)
> at java.io.OutputStreamWriter.write(OutputStreamWriter.java:207)
> at java.io.BufferedWriter.flushBuffer(BufferedWriter.java:129)
> at java.io.BufferedWriter.write(BufferedWriter.java:230)
> at java.io.PrintWriter.write(PrintWriter.java:456)
> at java.io.PrintWriter.write(PrintWriter.java:473)
> at java.io.PrintWriter.print(PrintWriter.java:603)
> at java.io.PrintWriter.println(PrintWriter.java:739)
> at org.w3c.tidy.Report.printMessage(Report.java:754)
> at org.w3c.tidy.Report.errorSummary(Report.java:1572)
> at org.w3c.tidy.Tidy.parse(Tidy.java:608)
> at org.w3c.tidy.Tidy.parse(Tidy.java:263)
> at org.w3c.tidy.ant.JTidyTask.processFile(JTidyTask.java:457)
> at org.w3c.tidy.ant.JTidyTask.executeSet(JTidyTask.java:420)
> at org.w3c.tidy.ant.JTidyTask.execute(JTidyTask.java:364)
> at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
> at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> at org.apache.tools.ant.Task.perform(Task.java:348)
> at org.apache.tools.ant.taskdefs.Sequential.execute(Sequential.java:68)
> at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
> at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
>
> Total time: 3 minutes 35 seconds
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org