You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@apache.org by Nicolas Liochon <nk...@gmail.com> on 2013/04/15 13:12:44 UTC

hadoop* machine: jenkins OOM, JDK 1.7 and config description

Hello,

We have a few needs related to the HBase project, mentioned in INFRA-6140.
 - We have very often (but not always) OutOfMemoryError in Jenkins. Here is
an example on the tail of this console output:
https://builds.apache.org/view/H-L/view/HBase/job/PreCommit-HBASE-Build/5310/console<https://builds.apache.org/view/H-L/view/HBase/job/PreCommit-HBASE-Build/5247/console>.
We don't have this on the builds on ubuntu* machines.
 - We would like to use the JDK 1.7 64 bits on these machine.
 - We would like to know the configuration of these machines: we run the
tests in parallel; this would help us to maximize our usage and understand
possible random test failures.

Would someone be willing to help us on this?

Thanks,

Nicolas

Re: hadoop* machine: jenkins OOM, JDK 1.7 and config description

Posted by Nicolas Liochon <nk...@gmail.com>.
Hi,

We have the same memory error on ubuntu now, see
https://builds.apache.org/job/HBase-TRUNK/4067/console.

Build step 'Invoke top-level Maven targets' marked build as failure
Archiving artifacts
Recording test results
ERROR: Failed to archive test reportshudson.util.IOException2
<http://stacktrace.jenkins-ci.org/search?query=hudson.util.IOException2>:
remote file operation failed:
/home/jenkins/jenkins-slave/workspace/HBase-TRUNK at
hudson.remoting.Channel@4f170184:ubuntu6
	at hudson.FilePath.act(FilePath.java:861)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method>
	at hudson.FilePath.act(FilePath.java:838)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method>
	at hudson.tasks.junit.JUnitParser.parse(JUnitParser.java:87)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser.parse&entity=method>
	at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:122)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.parse&entity=method>
	at hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:134)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.perform&entity=method>
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.BuildStepMonitor$1.perform&entity=method>
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:810)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.perform&entity=method>
	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:785)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps&entity=method>
	at hudson.model.Build$BuildExecution.post2(Build.java:183)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.post2&entity=method>
	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:732)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.post&entity=method>
	at hudson.model.Run.execute(Run.java:1593)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.execute&entity=method>
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.run&entity=method>
	at hudson.model.ResourceController.execute(ResourceController.java:88)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.execute&entity=method>
	at hudson.model.Executor.run(Executor.java:236)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.run&entity=method>
Caused by: java.io.IOException
<http://stacktrace.jenkins-ci.org/search?query=java.io.IOException>:
Remote call on ubuntu6 failed
	at hudson.remoting.Channel.call(Channel.java:681)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel.call&entity=method>
	at hudson.FilePath.act(FilePath.java:854)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method>
	... 13 more
Caused by: java.lang.OutOfMemoryError
<http://stacktrace.jenkins-ci.org/search?query=java.lang.OutOfMemoryError>:
Java heap space
	at java.nio.HeapCharBuffer.<init>(HeapCharBuffer.java:39)
<http://stacktrace.jenkins-ci.org/search/?query=java.nio.HeapCharBuffer.%3Cinit%3E&entity=method>
	at java.nio.CharBuffer.allocate(CharBuffer.java:312)
<http://stacktrace.jenkins-ci.org/search/?query=java.nio.CharBuffer.allocate&entity=method>
	at java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:760)
<http://stacktrace.jenkins-ci.org/search/?query=java.nio.charset.CharsetDecoder.decode&entity=method>
	at java.nio.charset.Charset.decode(Charset.java:771)
<http://stacktrace.jenkins-ci.org/search/?query=java.nio.charset.Charset.decode&entity=method>
	at hudson.tasks.junit.SuiteResult.<init>(SuiteResult.java:215)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.%3Cinit%3E&entity=method>
	at hudson.tasks.junit.SuiteResult.parseSuite(SuiteResult.java:147)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.parseSuite&entity=method>
	at hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:132)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.parse&entity=method>


Again, if someone could have a look it would be great. As far as I know, we
don't have the access rights to fix this ourselves (and it's a shared
environment, so it would be risky anyway).

All the points on hadoop* machines mentioned in the previous mail are still
open as well. Migrating our trunk build to JDK 1.7 would be nice for us.

Lastly, we've noticed some differences in config on ubuntu* machines. Are
the configs documented somewhere?

Cheers,

Nicolas (from HBase project).



On Mon, Apr 15, 2013 at 1:12 PM, Nicolas Liochon <nk...@gmail.com> wrote:

> Hello,
>
> We have a few needs related to the HBase project, mentioned in INFRA-6140.
>  - We have very often (but not always) OutOfMemoryError in Jenkins. Here
> is an example on the tail of this console output:
> https://builds.apache.org/view/H-L/view/HBase/job/PreCommit-HBASE-Build/5310/console<https://builds.apache.org/view/H-L/view/HBase/job/PreCommit-HBASE-Build/5247/console>. We don't have this on the builds on ubuntu* machines.
>  - We would like to use the JDK 1.7 64 bits on these machine.
>  - We would like to know the configuration of these machines: we run the
> tests in parallel; this would help us to maximize our usage and understand
> possible random test failures.
>
> Would someone be willing to help us on this?
>
> Thanks,
>
> Nicolas
>

Re: hadoop* machine: jenkins OOM, JDK 1.7 and config description

Posted by Nicolas Liochon <nk...@gmail.com>.
Hi,

We have the same memory error on ubuntu now, see
https://builds.apache.org/job/HBase-TRUNK/4067/console.

Build step 'Invoke top-level Maven targets' marked build as failure
Archiving artifacts
Recording test results
ERROR: Failed to archive test reportshudson.util.IOException2
<http://stacktrace.jenkins-ci.org/search?query=hudson.util.IOException2>:
remote file operation failed:
/home/jenkins/jenkins-slave/workspace/HBase-TRUNK at
hudson.remoting.Channel@4f170184:ubuntu6
	at hudson.FilePath.act(FilePath.java:861)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method>
	at hudson.FilePath.act(FilePath.java:838)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method>
	at hudson.tasks.junit.JUnitParser.parse(JUnitParser.java:87)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser.parse&entity=method>
	at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:122)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.parse&entity=method>
	at hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:134)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.perform&entity=method>
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.BuildStepMonitor$1.perform&entity=method>
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:810)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.perform&entity=method>
	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:785)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps&entity=method>
	at hudson.model.Build$BuildExecution.post2(Build.java:183)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.post2&entity=method>
	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:732)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.post&entity=method>
	at hudson.model.Run.execute(Run.java:1593)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.execute&entity=method>
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.run&entity=method>
	at hudson.model.ResourceController.execute(ResourceController.java:88)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.execute&entity=method>
	at hudson.model.Executor.run(Executor.java:236)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.run&entity=method>
Caused by: java.io.IOException
<http://stacktrace.jenkins-ci.org/search?query=java.io.IOException>:
Remote call on ubuntu6 failed
	at hudson.remoting.Channel.call(Channel.java:681)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel.call&entity=method>
	at hudson.FilePath.act(FilePath.java:854)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method>
	... 13 more
Caused by: java.lang.OutOfMemoryError
<http://stacktrace.jenkins-ci.org/search?query=java.lang.OutOfMemoryError>:
Java heap space
	at java.nio.HeapCharBuffer.<init>(HeapCharBuffer.java:39)
<http://stacktrace.jenkins-ci.org/search/?query=java.nio.HeapCharBuffer.%3Cinit%3E&entity=method>
	at java.nio.CharBuffer.allocate(CharBuffer.java:312)
<http://stacktrace.jenkins-ci.org/search/?query=java.nio.CharBuffer.allocate&entity=method>
	at java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:760)
<http://stacktrace.jenkins-ci.org/search/?query=java.nio.charset.CharsetDecoder.decode&entity=method>
	at java.nio.charset.Charset.decode(Charset.java:771)
<http://stacktrace.jenkins-ci.org/search/?query=java.nio.charset.Charset.decode&entity=method>
	at hudson.tasks.junit.SuiteResult.<init>(SuiteResult.java:215)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.%3Cinit%3E&entity=method>
	at hudson.tasks.junit.SuiteResult.parseSuite(SuiteResult.java:147)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.parseSuite&entity=method>
	at hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:132)
<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.parse&entity=method>


Again, if someone could have a look it would be great. As far as I know, we
don't have the access rights to fix this ourselves (and it's a shared
environment, so it would be risky anyway).

All the points on hadoop* machines mentioned in the previous mail are still
open as well. Migrating our trunk build to JDK 1.7 would be nice for us.

Lastly, we've noticed some differences in config on ubuntu* machines. Are
the configs documented somewhere?

Cheers,

Nicolas (from HBase project).



On Mon, Apr 15, 2013 at 1:12 PM, Nicolas Liochon <nk...@gmail.com> wrote:

> Hello,
>
> We have a few needs related to the HBase project, mentioned in INFRA-6140.
>  - We have very often (but not always) OutOfMemoryError in Jenkins. Here
> is an example on the tail of this console output:
> https://builds.apache.org/view/H-L/view/HBase/job/PreCommit-HBASE-Build/5310/console<https://builds.apache.org/view/H-L/view/HBase/job/PreCommit-HBASE-Build/5247/console>. We don't have this on the builds on ubuntu* machines.
>  - We would like to use the JDK 1.7 64 bits on these machine.
>  - We would like to know the configuration of these machines: we run the
> tests in parallel; this would help us to maximize our usage and understand
> possible random test failures.
>
> Would someone be willing to help us on this?
>
> Thanks,
>
> Nicolas
>