You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Nicolas Liochon <nk...@gmail.com> on 2013/04/08 17:19:59 UTC
Recording test results ERROR: Failed to archive test
We've got a lot of errors in precommit that seems to be due to Jenkins
needing more memory.
It seems to be a Jenkins needing more memory. It seems that we don't have
this on trunk, so it would be a difference of config between the two
environments.
Do you agree?
Who could fix this (i.e. has the access rights)?
Cheers,
Nicolas
Archiving artifacts
Recording test results ERROR: Failed to archive test reports
hudson.util.IOException2<http://stacktrace.jenkins-ci.org/search?query=hudson.util.IOException2>:
remote file operation failed:
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build at
hudson.remoting.Channel@55899539:hadoop3 at
hudson.FilePath.act(FilePath.java:861)<http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method>at
hudson.FilePath.act(FilePath.java:838)<http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method>at
hudson.tasks.junit.JUnitParser.parse(JUnitParser.java:87)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser.parse&entity=method>at
hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:122)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.parse&entity=method>at
hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:134)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.perform&entity=method>at
hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.BuildStepMonitor$1.perform&entity=method>at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:810)<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.perform&entity=method>at
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:785)<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps&entity=method>at
hudson.model.Build$BuildExecution.post2(Build.java:183)<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.post2&entity=method>at
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:732)<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.post&entity=method>at
hudson.model.Run.execute(Run.java:1593)<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.execute&entity=method>at
hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.run&entity=method>at
hudson.model.ResourceController.execute(ResourceController.java:88)<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.execute&entity=method>at
hudson.model.Executor.run(Executor.java:236)<http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.run&entity=method>Caused
by:
java.io.IOException<http://stacktrace.jenkins-ci.org/search?query=java.io.IOException>:
Remote call on hadoop3 failed at
hudson.remoting.Channel.call(Channel.java:681)<http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel.call&entity=method>at
hudson.FilePath.act(FilePath.java:854)<http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method>...
13 more Caused by:
java.lang.OutOfMemoryError<http://stacktrace.jenkins-ci.org/search?query=java.lang.OutOfMemoryError>:
Java heap space at
java.nio.HeapCharBuffer.<init>(HeapCharBuffer.java:39)<http://stacktrace.jenkins-ci.org/search/?query=java.nio.HeapCharBuffer.%3Cinit%3E&entity=method>at
java.nio.CharBuffer.allocate(CharBuffer.java:312)<http://stacktrace.jenkins-ci.org/search/?query=java.nio.CharBuffer.allocate&entity=method>at
java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:760)<http://stacktrace.jenkins-ci.org/search/?query=java.nio.charset.CharsetDecoder.decode&entity=method>at
java.nio.charset.Charset.decode(Charset.java:771)<http://stacktrace.jenkins-ci.org/search/?query=java.nio.charset.Charset.decode&entity=method>at
hudson.tasks.junit.SuiteResult.<init>(SuiteResult.java:215)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.%3Cinit%3E&entity=method>at
hudson.tasks.junit.SuiteResult.parseSuite(SuiteResult.java:147)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.parseSuite&entity=method>at
hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:132)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.parse&entity=method>at
hudson.tasks.junit.TestResult.parse(TestResult.java:267)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parse&entity=method>at
hudson.tasks.junit.TestResult.parsePossiblyEmpty(TestResult.java:223)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parsePossiblyEmpty&entity=method>at
hudson.tasks.junit.TestResult.parse(TestResult.java:158)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parse&entity=method>at
hudson.tasks.junit.TestResult.parse(TestResult.java:141)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parse&entity=method>at
hudson.tasks.junit.TestResult.<init>(TestResult.java:117)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.%3Cinit%3E&entity=method>at
hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:117)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke&entity=method>at
hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:90)<http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke&entity=method>at
hudson.FilePath$FileCallableWrapper.call(FilePath.java:2348)<http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath$FileCallableWrapper.call&entity=method>at
hudson.remoting.UserRequest.perform(UserRequest.java:118)<http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.UserRequest.perform&entity=method>at
hudson.remoting.UserRequest.perform(UserRequest.java:48)<http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.UserRequest.perform&entity=method>at
hudson.remoting.Request$2.run(Request.java:326)<http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Request$2.run&entity=method>at
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)<http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.InterceptingExecutorService$1.call&entity=method>at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)<http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.FutureTask$Sync.innerRun&entity=method>at
java.util.concurrent.FutureTask.run(FutureTask.java:138)<http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.FutureTask.run&entity=method>at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)<http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.ThreadPoolExecutor$Worker.runTask&entity=method>at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)<http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.ThreadPoolExecutor$Worker.run&entity=method>at
java.lang.Thread.run(Thread.java:662)<http://stacktrace.jenkins-ci.org/search/?query=java.lang.Thread.run&entity=method>Build
step 'Publish JUnit test result report' changed build result to
FAILURE [description-setter] Could not determine description. Finished:
FAILURE
Re: Recording test results ERROR: Failed to archive test
Posted by Andrew Purtell <ap...@apache.org>.
Right, on the EC2 jenkins I had to increase the heap size of the slave host
process itself, not our forked test JVMs.
On Mon, Apr 8, 2013 at 10:32 AM, Stack <st...@duboce.net> wrote:
> On Mon, Apr 8, 2013 at 8:29 AM, Nicolas Liochon <nk...@gmail.com> wrote:
>
> > I was under the impression that it was a hudson/jenkins stack, not a
> maven
> > one?
>
>
> Pardon me. I reread the stack trace. Yeah, this is post-maven copying of
> results so yeah a jenkins issue. What I found in the past is that some of
> our test output is massive (I downloaded the test result to take a look) or
> rather, can be massive on occasion; e.g. replication tests. IIRC, it was an
> in-memory realization of some xml report that was bringing on the OOME....
> Workaround seemed to be fixing the test producing all the output. Which
> test run was this? I can take a look since I looked in the past.
>
> Thanks N,
> St.Ack
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: Recording test results ERROR: Failed to archive test
Posted by Nicolas Liochon <nk...@gmail.com>.
It seems it's not related to the machines: on the failure above, 2 are on
hadoop2, 1 or hadoop3, and it's the only one we used recently...
On Mon, Apr 8, 2013 at 9:04 PM, Stack <st...@duboce.net> wrote:
> Just saying, 3.4G to run tests is also obnoxious. We need to fix this
> too.....
> St.Ack
>
>
> On Mon, Apr 8, 2013 at 12:02 PM, Stack <st...@duboce.net> wrote:
>
> > On Mon, Apr 8, 2013 at 10:40 AM, Nicolas Liochon <nkeywal@gmail.com
> >wrote:
> >
> >> It seems random, but frequent:
> >> https://builds.apache.org/job/PreCommit-HBASE-Build/5181/console
> >> https://builds.apache.org/job/PreCommit-HBASE-Build/5182/console
> >> https://builds.apache.org/job/PreCommit-HBASE-Build/5184/console
> >>
> >> In 4955, I have errors related to maven (it seems the last version of
> >> surefire uses more memory than before), so increasing the memory for
> maven
> >> will be useful anyway I think. But as we use a 32bits jvm on hadoop*,
> the
> >> limit is likely around 3.5Gb..
> >>
> >> Cheers,
> >>
> >
> >
> > I looked at first job. We have tests writing 10M of logs which is
> totally
> > obnoxious but probably not the root of this jenkins memory issue:
> >
> >
> > durruti:trunk stack$ find . -size +10M
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestAdmin-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestFromClientSide-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestFromClientSide3-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestMultiParallel-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.regionserver.wal.TestHLogSplitCompressed-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.TestAcidGuarantees-output.txt
> >
> >
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt
> >
> > Let me mess w/ upping the maven size but yeah, not sure how to get us
> more
> > jenkins memory. Is it always on same machines that we fail?
> > St.Ack
> >
>
Re: Recording test results ERROR: Failed to archive test
Posted by Stack <st...@duboce.net>.
Just saying, 3.4G to run tests is also obnoxious. We need to fix this
too.....
St.Ack
On Mon, Apr 8, 2013 at 12:02 PM, Stack <st...@duboce.net> wrote:
> On Mon, Apr 8, 2013 at 10:40 AM, Nicolas Liochon <nk...@gmail.com>wrote:
>
>> It seems random, but frequent:
>> https://builds.apache.org/job/PreCommit-HBASE-Build/5181/console
>> https://builds.apache.org/job/PreCommit-HBASE-Build/5182/console
>> https://builds.apache.org/job/PreCommit-HBASE-Build/5184/console
>>
>> In 4955, I have errors related to maven (it seems the last version of
>> surefire uses more memory than before), so increasing the memory for maven
>> will be useful anyway I think. But as we use a 32bits jvm on hadoop*, the
>> limit is likely around 3.5Gb..
>>
>> Cheers,
>>
>
>
> I looked at first job. We have tests writing 10M of logs which is totally
> obnoxious but probably not the root of this jenkins memory issue:
>
>
> durruti:trunk stack$ find . -size +10M
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestAdmin-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestFromClientSide-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestFromClientSide3-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestMultiParallel-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.regionserver.wal.TestHLogSplitCompressed-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.TestAcidGuarantees-output.txt
>
> ./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt
>
> Let me mess w/ upping the maven size but yeah, not sure how to get us more
> jenkins memory. Is it always on same machines that we fail?
> St.Ack
>
Re: Recording test results ERROR: Failed to archive test
Posted by Stack <st...@duboce.net>.
On Mon, Apr 8, 2013 at 10:40 AM, Nicolas Liochon <nk...@gmail.com> wrote:
> It seems random, but frequent:
> https://builds.apache.org/job/PreCommit-HBASE-Build/5181/console
> https://builds.apache.org/job/PreCommit-HBASE-Build/5182/console
> https://builds.apache.org/job/PreCommit-HBASE-Build/5184/console
>
> In 4955, I have errors related to maven (it seems the last version of
> surefire uses more memory than before), so increasing the memory for maven
> will be useful anyway I think. But as we use a 32bits jvm on hadoop*, the
> limit is likely around 3.5Gb..
>
> Cheers,
>
I looked at first job. We have tests writing 10M of logs which is totally
obnoxious but probably not the root of this jenkins memory issue:
durruti:trunk stack$ find . -size +10M
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestAdmin-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestFromClientSide-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestFromClientSide3-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestMultiParallel-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.regionserver.wal.TestHLogSplitCompressed-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.TestAcidGuarantees-output.txt
./hbase-server/target/surefire-reports/org.apache.hadoop.hbase.util.TestHBaseFsck-output.txt
Let me mess w/ upping the maven size but yeah, not sure how to get us more
jenkins memory. Is it always on same machines that we fail?
St.Ack
Re: Recording test results ERROR: Failed to archive test
Posted by Nicolas Liochon <nk...@gmail.com>.
It seems random, but frequent:
https://builds.apache.org/job/PreCommit-HBASE-Build/5181/console
https://builds.apache.org/job/PreCommit-HBASE-Build/5182/console
https://builds.apache.org/job/PreCommit-HBASE-Build/5184/console
In 4955, I have errors related to maven (it seems the last version of
surefire uses more memory than before), so increasing the memory for maven
will be useful anyway I think. But as we use a 32bits jvm on hadoop*, the
limit is likely around 3.5Gb..
Cheers,
N.
On Mon, Apr 8, 2013 at 7:32 PM, Stack <st...@duboce.net> wrote:
> On Mon, Apr 8, 2013 at 8:29 AM, Nicolas Liochon <nk...@gmail.com> wrote:
>
> > I was under the impression that it was a hudson/jenkins stack, not a
> maven
> > one?
>
>
> Pardon me. I reread the stack trace. Yeah, this is post-maven copying of
> results so yeah a jenkins issue. What I found in the past is that some of
> our test output is massive (I downloaded the test result to take a look) or
> rather, can be massive on occasion; e.g. replication tests. IIRC, it was an
> in-memory realization of some xml report that was bringing on the OOME....
> Workaround seemed to be fixing the test producing all the output. Which
> test run was this? I can take a look since I looked in the past.
>
> Thanks N,
> St.Ack
>
Re: Recording test results ERROR: Failed to archive test
Posted by Stack <st...@duboce.net>.
On Mon, Apr 8, 2013 at 8:29 AM, Nicolas Liochon <nk...@gmail.com> wrote:
> I was under the impression that it was a hudson/jenkins stack, not a maven
> one?
Pardon me. I reread the stack trace. Yeah, this is post-maven copying of
results so yeah a jenkins issue. What I found in the past is that some of
our test output is massive (I downloaded the test result to take a look) or
rather, can be massive on occasion; e.g. replication tests. IIRC, it was an
in-memory realization of some xml report that was bringing on the OOME....
Workaround seemed to be fixing the test producing all the output. Which
test run was this? I can take a look since I looked in the past.
Thanks N,
St.Ack
Re: Recording test results ERROR: Failed to archive test
Posted by Nicolas Liochon <nk...@gmail.com>.
I was under the impression that it was a hudson/jenkins stack, not a maven
one?
But it's worth trying.
On Mon, Apr 8, 2013 at 5:26 PM, Stack <st...@duboce.net> wrote:
> I took a look at the jenkins config for precommit.
>
>
> We are setting this environment variable:
>
> MAVEN_OPTS=-Xmx3G
>
> ... which should be big enough.
>
> I also see
>
> MAVEN_OPTS="-Xmx3g"
>
> in the test-patch.properties.
>
> In test-patch.sh, I see this being picked up. Should I change
> test-patch.sh so it prints out current MAVEN_OPTS?
>
> St.Ack
>
>
>
>
>
> On Mon, Apr 8, 2013 at 8:19 AM, Nicolas Liochon <nk...@gmail.com> wrote:
>
> > We've got a lot of errors in precommit that seems to be due to Jenkins
> > needing more memory.
> >
> > It seems to be a Jenkins needing more memory. It seems that we don't have
> > this on trunk, so it would be a difference of config between the two
> > environments.
> >
> > Do you agree?
> >
> > Who could fix this (i.e. has the access rights)?
> >
> > Cheers,
> >
> > Nicolas
> >
> >
> >
> > Archiving artifacts
> > Recording test results ERROR: Failed to archive test reports
> > hudson.util.IOException2<
> > http://stacktrace.jenkins-ci.org/search?query=hudson.util.IOException2>:
> > remote file operation failed:
> > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build at
> > hudson.remoting.Channel@55899539:hadoop3 at
> > hudson.FilePath.act(FilePath.java:861)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method
> > >at
> > hudson.FilePath.act(FilePath.java:838)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method
> > >at
> > hudson.tasks.junit.JUnitParser.parse(JUnitParser.java:87)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser.parse&entity=method
> > >at
> >
> hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:122)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.parse&entity=method
> > >at
> >
> >
> hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:134)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.perform&entity=method
> > >at
> > hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.BuildStepMonitor$1.perform&entity=method
> > >at
> >
> >
> hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:810)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.perform&entity=method
> > >at
> >
> >
> hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:785)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps&entity=method
> > >at
> > hudson.model.Build$BuildExecution.post2(Build.java:183)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.post2&entity=method
> > >at
> >
> >
> hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:732)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.post&entity=method
> > >at
> > hudson.model.Run.execute(Run.java:1593)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.execute&entity=method
> > >at
> > hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.run&entity=method
> > >at
> > hudson.model.ResourceController.execute(ResourceController.java:88)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.execute&entity=method
> > >at
> > hudson.model.Executor.run(Executor.java:236)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.run&entity=method
> > >Caused
> > by:
> > java.io.IOException<
> > http://stacktrace.jenkins-ci.org/search?query=java.io.IOException>:
> > Remote call on hadoop3 failed at
> > hudson.remoting.Channel.call(Channel.java:681)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel.call&entity=method
> > >at
> > hudson.FilePath.act(FilePath.java:854)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method
> > >...
> > 13 more Caused by:
> > java.lang.OutOfMemoryError<
> > http://stacktrace.jenkins-ci.org/search?query=java.lang.OutOfMemoryError
> >:
> > Java heap space at
> > java.nio.HeapCharBuffer.<init>(HeapCharBuffer.java:39)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=java.nio.HeapCharBuffer.%3Cinit%3E&entity=method
> > >at
> > java.nio.CharBuffer.allocate(CharBuffer.java:312)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=java.nio.CharBuffer.allocate&entity=method
> > >at
> > java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:760)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=java.nio.charset.CharsetDecoder.decode&entity=method
> > >at
> > java.nio.charset.Charset.decode(Charset.java:771)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=java.nio.charset.Charset.decode&entity=method
> > >at
> > hudson.tasks.junit.SuiteResult.<init>(SuiteResult.java:215)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.%3Cinit%3E&entity=method
> > >at
> > hudson.tasks.junit.SuiteResult.parseSuite(SuiteResult.java:147)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.parseSuite&entity=method
> > >at
> > hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:132)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.parse&entity=method
> > >at
> > hudson.tasks.junit.TestResult.parse(TestResult.java:267)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parse&entity=method
> > >at
> > hudson.tasks.junit.TestResult.parsePossiblyEmpty(TestResult.java:223)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parsePossiblyEmpty&entity=method
> > >at
> > hudson.tasks.junit.TestResult.parse(TestResult.java:158)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parse&entity=method
> > >at
> > hudson.tasks.junit.TestResult.parse(TestResult.java:141)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parse&entity=method
> > >at
> > hudson.tasks.junit.TestResult.<init>(TestResult.java:117)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.%3Cinit%3E&entity=method
> > >at
> >
> >
> hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:117)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke&entity=method
> > >at
> >
> >
> hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:90)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke&entity=method
> > >at
> > hudson.FilePath$FileCallableWrapper.call(FilePath.java:2348)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath$FileCallableWrapper.call&entity=method
> > >at
> > hudson.remoting.UserRequest.perform(UserRequest.java:118)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.UserRequest.perform&entity=method
> > >at
> > hudson.remoting.UserRequest.perform(UserRequest.java:48)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.UserRequest.perform&entity=method
> > >at
> > hudson.remoting.Request$2.run(Request.java:326)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Request$2.run&entity=method
> > >at
> >
> >
> hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.InterceptingExecutorService$1.call&entity=method
> > >at
> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.FutureTask$Sync.innerRun&entity=method
> > >at
> > java.util.concurrent.FutureTask.run(FutureTask.java:138)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.FutureTask.run&entity=method
> > >at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.ThreadPoolExecutor$Worker.runTask&entity=method
> > >at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.ThreadPoolExecutor$Worker.run&entity=method
> > >at
> > java.lang.Thread.run(Thread.java:662)<
> >
> http://stacktrace.jenkins-ci.org/search/?query=java.lang.Thread.run&entity=method
> > >Build
> > step 'Publish JUnit test result report' changed build result to
> > FAILURE [description-setter] Could not determine description. Finished:
> > FAILURE
> >
>
Re: Recording test results ERROR: Failed to archive test
Posted by Stack <st...@duboce.net>.
I took a look at the jenkins config for precommit.
We are setting this environment variable:
MAVEN_OPTS=-Xmx3G
... which should be big enough.
I also see
MAVEN_OPTS="-Xmx3g"
in the test-patch.properties.
In test-patch.sh, I see this being picked up. Should I change
test-patch.sh so it prints out current MAVEN_OPTS?
St.Ack
On Mon, Apr 8, 2013 at 8:19 AM, Nicolas Liochon <nk...@gmail.com> wrote:
> We've got a lot of errors in precommit that seems to be due to Jenkins
> needing more memory.
>
> It seems to be a Jenkins needing more memory. It seems that we don't have
> this on trunk, so it would be a difference of config between the two
> environments.
>
> Do you agree?
>
> Who could fix this (i.e. has the access rights)?
>
> Cheers,
>
> Nicolas
>
>
>
> Archiving artifacts
> Recording test results ERROR: Failed to archive test reports
> hudson.util.IOException2<
> http://stacktrace.jenkins-ci.org/search?query=hudson.util.IOException2>:
> remote file operation failed:
> /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build at
> hudson.remoting.Channel@55899539:hadoop3 at
> hudson.FilePath.act(FilePath.java:861)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method
> >at
> hudson.FilePath.act(FilePath.java:838)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method
> >at
> hudson.tasks.junit.JUnitParser.parse(JUnitParser.java:87)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser.parse&entity=method
> >at
> hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:122)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.parse&entity=method
> >at
>
> hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:134)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitResultArchiver.perform&entity=method
> >at
> hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.BuildStepMonitor$1.perform&entity=method
> >at
>
> hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:810)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.perform&entity=method
> >at
>
> hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:785)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps&entity=method
> >at
> hudson.model.Build$BuildExecution.post2(Build.java:183)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.post2&entity=method
> >at
>
> hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:732)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.post&entity=method
> >at
> hudson.model.Run.execute(Run.java:1593)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.execute&entity=method
> >at
> hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.run&entity=method
> >at
> hudson.model.ResourceController.execute(ResourceController.java:88)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.execute&entity=method
> >at
> hudson.model.Executor.run(Executor.java:236)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.run&entity=method
> >Caused
> by:
> java.io.IOException<
> http://stacktrace.jenkins-ci.org/search?query=java.io.IOException>:
> Remote call on hadoop3 failed at
> hudson.remoting.Channel.call(Channel.java:681)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel.call&entity=method
> >at
> hudson.FilePath.act(FilePath.java:854)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath.act&entity=method
> >...
> 13 more Caused by:
> java.lang.OutOfMemoryError<
> http://stacktrace.jenkins-ci.org/search?query=java.lang.OutOfMemoryError>:
> Java heap space at
> java.nio.HeapCharBuffer.<init>(HeapCharBuffer.java:39)<
> http://stacktrace.jenkins-ci.org/search/?query=java.nio.HeapCharBuffer.%3Cinit%3E&entity=method
> >at
> java.nio.CharBuffer.allocate(CharBuffer.java:312)<
> http://stacktrace.jenkins-ci.org/search/?query=java.nio.CharBuffer.allocate&entity=method
> >at
> java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:760)<
> http://stacktrace.jenkins-ci.org/search/?query=java.nio.charset.CharsetDecoder.decode&entity=method
> >at
> java.nio.charset.Charset.decode(Charset.java:771)<
> http://stacktrace.jenkins-ci.org/search/?query=java.nio.charset.Charset.decode&entity=method
> >at
> hudson.tasks.junit.SuiteResult.<init>(SuiteResult.java:215)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.%3Cinit%3E&entity=method
> >at
> hudson.tasks.junit.SuiteResult.parseSuite(SuiteResult.java:147)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.parseSuite&entity=method
> >at
> hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:132)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.SuiteResult.parse&entity=method
> >at
> hudson.tasks.junit.TestResult.parse(TestResult.java:267)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parse&entity=method
> >at
> hudson.tasks.junit.TestResult.parsePossiblyEmpty(TestResult.java:223)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parsePossiblyEmpty&entity=method
> >at
> hudson.tasks.junit.TestResult.parse(TestResult.java:158)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parse&entity=method
> >at
> hudson.tasks.junit.TestResult.parse(TestResult.java:141)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.parse&entity=method
> >at
> hudson.tasks.junit.TestResult.<init>(TestResult.java:117)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.TestResult.%3Cinit%3E&entity=method
> >at
>
> hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:117)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke&entity=method
> >at
>
> hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:90)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke&entity=method
> >at
> hudson.FilePath$FileCallableWrapper.call(FilePath.java:2348)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.FilePath$FileCallableWrapper.call&entity=method
> >at
> hudson.remoting.UserRequest.perform(UserRequest.java:118)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.UserRequest.perform&entity=method
> >at
> hudson.remoting.UserRequest.perform(UserRequest.java:48)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.UserRequest.perform&entity=method
> >at
> hudson.remoting.Request$2.run(Request.java:326)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Request$2.run&entity=method
> >at
>
> hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)<
> http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.InterceptingExecutorService$1.call&entity=method
> >at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)<
> http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.FutureTask$Sync.innerRun&entity=method
> >at
> java.util.concurrent.FutureTask.run(FutureTask.java:138)<
> http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.FutureTask.run&entity=method
> >at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)<
> http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.ThreadPoolExecutor$Worker.runTask&entity=method
> >at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)<
> http://stacktrace.jenkins-ci.org/search/?query=java.util.concurrent.ThreadPoolExecutor$Worker.run&entity=method
> >at
> java.lang.Thread.run(Thread.java:662)<
> http://stacktrace.jenkins-ci.org/search/?query=java.lang.Thread.run&entity=method
> >Build
> step 'Publish JUnit test result report' changed build result to
> FAILURE [description-setter] Could not determine description. Finished:
> FAILURE
>