You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@hbase.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/09/15 22:12:02 UTC
Build failed in Jenkins: HBase-1.1 #663
See <https://builds.apache.org/job/HBase-1.1/663/changes>
Changes:
[ssrungarapu] HBASE-14394 Properly close the connection after reading records from table.
------------------------------------------
[...truncated 2428 lines...]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hbase-thrift
Build step 'Invoke top-level Maven targets' marked build as failure
Performing Post build task...
Match found for :.* : True
Logical operation result is TRUE
Running script : ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l`
if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
#It seems sometimes the tests are not dying immediately. Let's give them 10s
echo "Suspicious java process found - waiting 10s to see if there are just slow to stop"
sleep 10
ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l`
if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
echo "There are $ZOMBIE_TESTS_COUNT zombie tests, they should have been killed by surefire but survived"
echo "************ BEGIN zombies jstack extract"
ZB_STACK=`jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack | grep ".test" | grep "\.java"`
jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack
echo "************ END zombies jstack extract"
JIRA_COMMENT="$JIRA_COMMENT
{color:red}-1 core zombie tests{color}. There are ${ZOMBIE_TESTS_COUNT} zombie test(s): ${ZB_STACK}"
BAD=1
jps | grep surefirebooter | cut -d ' ' -f 1 | xargs kill -9
else
echo "We're ok: there is no zombie test, but some tests took some time to stop"
fi
else
echo "We're ok: there is no zombie test"
fi
[HBase-1.1] $ /bin/bash -xe /tmp/hudson8212441844653624150.sh
++ jps
++ grep surefirebooter
++ wc -l
+ ZOMBIE_TESTS_COUNT=1
+ [[ 1 != 0 ]]
+ echo 'Suspicious java process found - waiting 10s to see if there are just slow to stop'
Suspicious java process found - waiting 10s to see if there are just slow to stop
+ sleep 10
++ jps
++ grep surefirebooter
++ wc -l
+ ZOMBIE_TESTS_COUNT=1
+ [[ 1 != 0 ]]
+ echo 'There are 1 zombie tests, they should have been killed by surefire but survived'
There are 1 zombie tests, they should have been killed by surefire but survived
+ echo '************ BEGIN zombies jstack extract'
************ BEGIN zombies jstack extract
++ jps
++ grep surefirebooter
++ cut -d ' ' -f 1
++ xargs -n 1 jstack
++ grep .test
++ grep '\.java'
+ ZB_STACK=' at org.apache.hadoop.hbase.procedure2.TestProcedureReplayOrder.testSingleStepReplayOrder(TestProcedureReplayOrder.java:97)'
+ jps
+ grep surefirebooter
+ cut -d ' ' -f 1
+ xargs -n 1 jstack
2015-09-15 20:09:27
Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.51-b03 mixed mode):
"Attach Listener" daemon prio=10 tid=0x00007fcde4001000 nid=0x222a waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Time-limited test" daemon prio=10 tid=0x00007fce3c84c000 nid=0x21c5 waiting on condition [0x00007fcdf96a2000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.hbase.procedure2.TestProcedureReplayOrder.testSingleStepReplayOrder(TestProcedureReplayOrder.java:97)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.lang.Thread.run(Thread.java:744)
"ProcedureExecutorTimeoutThread" prio=10 tid=0x00007fce3c845000 nid=0x21c4 waiting on condition [0x00007fcdf97a4000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007c8c94dd8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at org.apache.hadoop.hbase.procedure2.util.TimeoutBlockingQueue.poll(TimeoutBlockingQueue.java:106)
at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.timeoutLoop(ProcedureExecutor.java:826)
at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$500(ProcedureExecutor.java:72)
at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$3.run(ProcedureExecutor.java:485)
"ProcedureExecutor-0" prio=10 tid=0x00007fce3c843000 nid=0x21c3 waiting on condition [0x00007fce081a5000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007c8c768c0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.pushData(WALProcedureStore.java:484)
at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.update(WALProcedureStore.java:368)
at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1089)
at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:793)
at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:746)
at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:72)
at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:476)
"WALProcedureStoreSyncThread" prio=10 tid=0x00007fce3c812800 nid=0x21be waiting on condition [0x00007fce084c7000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007c8c768a8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2176)
at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.syncLoop(WALProcedureStore.java:528)
at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.access$000(WALProcedureStore.java:65)
at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore$1.run(WALProcedureStore.java:171)
"process reaper" daemon prio=10 tid=0x00007fce3c74c000 nid=0x21a0 waiting on condition [0x00007fce08500000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007c739faf0> (a java.util.concurrent.SynchronousQueue$TransferStack)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
"Service Thread" daemon prio=10 tid=0x00007fce3c291000 nid=0x219c runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" daemon prio=10 tid=0x00007fce3c28f000 nid=0x219b waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" daemon prio=10 tid=0x00007fce3c28c000 nid=0x219a waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x00007fce3c282000 nid=0x2199 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0x00007fce3c26b000 nid=0x2198 in Object.wait() [0x00007fce08fdc000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007c5a85568> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
- locked <0x00000007c5a85568> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
"Reference Handler" daemon prio=10 tid=0x00007fce3c267000 nid=0x2197 in Object.wait() [0x00007fce090dd000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007c5a850f0> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:503)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
- locked <0x00000007c5a850f0> (a java.lang.ref.Reference$Lock)
"main" prio=10 tid=0x00007fce3c00a800 nid=0x2184 waiting on condition [0x00007fce43aba000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007c9738278> (a java.util.concurrent.FutureTask)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:422)
at java.util.concurrent.FutureTask.get(FutureTask.java:199)
at org.junit.internal.runners.statements.FailOnTimeout.getResult(FailOnTimeout.java:141)
at org.junit.internal.runners.statements.FailOnTimeout.evaluate(FailOnTimeout.java:127)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:108)
at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:78)
at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54)
at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:144)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
"VM Thread" prio=10 tid=0x00007fce3c265000 nid=0x2196 runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x00007fce3c020800 nid=0x2185 runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x00007fce3c022000 nid=0x2186 runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0x00007fce3c024000 nid=0x2187 runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0x00007fce3c026000 nid=0x2188 runnable
"GC task thread#4 (ParallelGC)" prio=10 tid=0x00007fce3c027800 nid=0x2189 runnable
"GC task thread#5 (ParallelGC)" prio=10 tid=0x00007fce3c029800 nid=0x218a runnable
"GC task thread#6 (ParallelGC)" prio=10 tid=0x00007fce3c02b800 nid=0x218b runnable
"GC task thread#7 (ParallelGC)" prio=10 tid=0x00007fce3c02d800 nid=0x218d runnable
"GC task thread#8 (ParallelGC)" prio=10 tid=0x00007fce3c02f000 nid=0x218e runnable
"GC task thread#9 (ParallelGC)" prio=10 tid=0x00007fce3c031000 nid=0x218f runnable
"GC task thread#10 (ParallelGC)" prio=10 tid=0x00007fce3c033000 nid=0x2190 runnable
"GC task thread#11 (ParallelGC)" prio=10 tid=0x00007fce3c034800 nid=0x2191 runnable
"GC task thread#12 (ParallelGC)" prio=10 tid=0x00007fce3c036800 nid=0x2192 runnable
"VM Periodic Task Thread" prio=10 tid=0x00007fce3c29b800 nid=0x219d waiting on condition
JNI global references: 227
+ echo '************ END zombies jstack extract'
************ END zombies jstack extract
+ JIRA_COMMENT='
{color:red}-1 core zombie tests{color}. There are 1 zombie test(s): at org.apache.hadoop.hbase.procedure2.TestProcedureReplayOrder.testSingleStepReplayOrder(TestProcedureReplayOrder.java:97)'
+ BAD=1
+ jps
+ cut -d ' ' -f 1
+ grep surefirebooter
+ xargs kill -9
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Archiving artifacts
Sending artifact delta relative to HBase-1.1 #655
Archived 2108 artifacts
Archive block size is 32768
Received 42 blocks and 514813304 bytes
Compression is 0.3%
Took 2 min 15 sec
Recording test results
Updating HBASE-14394
Jenkins build is back to normal : HBase-1.1 #666
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/HBase-1.1/666/changes>
Build failed in Jenkins: HBase-1.1 #665
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/HBase-1.1/665/changes>
Changes:
[tedyu] HBASE-13250 chown of ExportSnapshot does not cover all path and files (He Liangliang)
------------------------------------------
[...truncated 2615 lines...]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007047047f8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
- locked <0x00000007047047f8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
"Reference Handler" daemon prio=10 tid=0x00007fb0f4267800 nid=0x747e in Object.wait() [0x00007fb09f610000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000704704410> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:503)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
- locked <0x0000000704704410> (a java.lang.ref.Reference$Lock)
"main" prio=10 tid=0x00007fb0f4009000 nid=0x746f waiting on condition [0x00007fb0fc589000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007077056d0> (a java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:236)
at org.apache.camel.impl.DefaultAsyncProcessorAwaitManager.await(DefaultAsyncProcessorAwaitManager.java:74)
at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:122)
at org.apache.camel.processor.UnitOfWorkProducer.process(UnitOfWorkProducer.java:68)
at org.apache.camel.impl.ProducerCache$2.doInProducer(ProducerCache.java:375)
at org.apache.camel.impl.ProducerCache$2.doInProducer(ProducerCache.java:343)
at org.apache.camel.impl.ProducerCache.doInProducer(ProducerCache.java:233)
at org.apache.camel.impl.ProducerCache.sendExchange(ProducerCache.java:343)
at org.apache.camel.impl.ProducerCache.send(ProducerCache.java:201)
at org.apache.camel.impl.DefaultProducerTemplate.send(DefaultProducerTemplate.java:128)
at org.apache.camel.impl.DefaultProducerTemplate.send(DefaultProducerTemplate.java:115)
at org.apache.camel.impl.DefaultProducerTemplate.request(DefaultProducerTemplate.java:297)
at org.apache.camel.component.jetty.jettyproducer.HttpJettyProducerRecipientListCustomThreadPoolTest.testRecipientList(HttpJettyProducerRecipientListCustomThreadPoolTest.java:40)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
"VM Thread" prio=10 tid=0x00007fb0f4263800 nid=0x747d runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x00007fb0f401f000 nid=0x7470 runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x00007fb0f4020800 nid=0x7471 runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0x00007fb0f4022800 nid=0x7472 runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0x00007fb0f4024800 nid=0x7473 runnable
"GC task thread#4 (ParallelGC)" prio=10 tid=0x00007fb0f4026800 nid=0x7474 runnable
"GC task thread#5 (ParallelGC)" prio=10 tid=0x00007fb0f4028000 nid=0x7475 runnable
"GC task thread#6 (ParallelGC)" prio=10 tid=0x00007fb0f402a000 nid=0x7476 runnable
"GC task thread#7 (ParallelGC)" prio=10 tid=0x00007fb0f402c000 nid=0x7477 runnable
"GC task thread#8 (ParallelGC)" prio=10 tid=0x00007fb0f402d800 nid=0x7478 runnable
"GC task thread#9 (ParallelGC)" prio=10 tid=0x00007fb0f402f800 nid=0x7479 runnable
"GC task thread#10 (ParallelGC)" prio=10 tid=0x00007fb0f4031800 nid=0x747a runnable
"GC task thread#11 (ParallelGC)" prio=10 tid=0x00007fb0f4033800 nid=0x747b runnable
"GC task thread#12 (ParallelGC)" prio=10 tid=0x00007fb0f4035000 nid=0x747c runnable
"VM Periodic Task Thread" prio=10 tid=0x00007fb0f42a4800 nid=0x7484 waiting on condition
JNI global references: 219
2015-09-16 22:03:23
Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.72-b04 mixed mode):
"Attach Listener" daemon prio=10 tid=0x00007fe5cc001000 nid=0x45d1 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Service Thread" daemon prio=10 tid=0x00007fe63429a000 nid=0x45a1 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" daemon prio=10 tid=0x00007fe634297800 nid=0x45a0 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" daemon prio=10 tid=0x00007fe634294800 nid=0x459f runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x00007fe634292800 nid=0x459e runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0x00007fe634269800 nid=0x459d in Object.wait() [0x00007fe602fee000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007047047f8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
- locked <0x00000007047047f8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
"Reference Handler" daemon prio=10 tid=0x00007fe634267800 nid=0x459c in Object.wait() [0x00007fe6030ef000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000704704410> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:503)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
- locked <0x0000000704704410> (a java.lang.ref.Reference$Lock)
"main" prio=10 tid=0x00007fe634009000 nid=0x458d runnable [0x00007fe63c4c6000]
java.lang.Thread.State: RUNNABLE
at java.lang.AbstractStringBuilder.<init>(AbstractStringBuilder.java:64)
at java.lang.StringBuilder.<init>(StringBuilder.java:85)
at java.net.URLStreamHandler.parseURL(URLStreamHandler.java:249)
at sun.net.www.protocol.file.Handler.parseURL(Handler.java:67)
at java.net.URL.<init>(URL.java:614)
at java.net.URL.<init>(URL.java:482)
at sun.misc.URLClassPath$FileLoader.getResource(URLClassPath.java:1057)
at sun.misc.URLClassPath.getResource(URLClassPath.java:199)
at java.net.URLClassLoader$1.run(URLClassLoader.java:358)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
- locked <0x00000007076d4ba8> (a java.lang.Object)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.getDeclaredConstructors0(Native Method)
at java.lang.Class.privateGetDeclaredConstructors(Class.java:2585)
at java.lang.Class.getConstructor0(Class.java:2885)
at java.lang.Class.newInstance(Class.java:350)
at org.apache.camel.util.ObjectHelper.newInstance(ObjectHelper.java:1514)
at org.apache.camel.util.ReflectionInjector.newInstance(ReflectionInjector.java:32)
at org.apache.camel.impl.DefaultInjector.newInstance(DefaultInjector.java:45)
at org.apache.camel.impl.DefaultComponentResolver.resolveComponent(DefaultComponentResolver.java:87)
at org.apache.camel.impl.DefaultCamelContext.getComponent(DefaultCamelContext.java:389)
- locked <0x0000000706dccf80> (a java.util.HashMap)
at org.apache.camel.impl.DefaultCamelContext.getComponent(DefaultCamelContext.java:376)
at org.apache.camel.impl.DefaultCamelContext.getComponent(DefaultCamelContext.java:409)
at org.apache.camel.test.junit4.CamelTestSupport.doSetUp(CamelTestSupport.java:286)
at org.apache.camel.test.junit4.CamelTestSupport.setUp(CamelTestSupport.java:217)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
"VM Thread" prio=10 tid=0x00007fe634263800 nid=0x459b runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x00007fe63401f000 nid=0x458e runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x00007fe634020800 nid=0x458f runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0x00007fe634022800 nid=0x4590 runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0x00007fe634024800 nid=0x4591 runnable
"GC task thread#4 (ParallelGC)" prio=10 tid=0x00007fe634026800 nid=0x4592 runnable
"GC task thread#5 (ParallelGC)" prio=10 tid=0x00007fe634028000 nid=0x4593 runnable
"GC task thread#6 (ParallelGC)" prio=10 tid=0x00007fe63402a000 nid=0x4594 runnable
"GC task thread#7 (ParallelGC)" prio=10 tid=0x00007fe63402c000 nid=0x4595 runnable
"GC task thread#8 (ParallelGC)" prio=10 tid=0x00007fe63402d800 nid=0x4596 runnable
"GC task thread#9 (ParallelGC)" prio=10 tid=0x00007fe63402f800 nid=0x4597 runnable
"GC task thread#10 (ParallelGC)" prio=10 tid=0x00007fe634031800 nid=0x4598 runnable
"GC task thread#11 (ParallelGC)" prio=10 tid=0x00007fe634033800 nid=0x4599 runnable
"GC task thread#12 (ParallelGC)" prio=10 tid=0x00007fe634035000 nid=0x459a runnable
"VM Periodic Task Thread" prio=10 tid=0x00007fe6342a4800 nid=0x45a2 waiting on condition
JNI global references: 194
+ echo '************ END zombies jstack extract'
************ END zombies jstack extract
+ JIRA_COMMENT='
{color:red}-1 core zombie tests{color}. There are 2 zombie test(s): at org.apache.camel.component.jetty.jettyproducer.HttpJettyProducerRecipientListCustomThreadPoolTest.testRecipientList(HttpJettyProducerRecipientListCustomThreadPoolTest.java:40)
at org.apache.camel.test.junit4.CamelTestSupport.doStopCamelContext(CamelTestSupport.java:450)
at org.apache.camel.test.junit4.CamelTestSupport.tearDown(CamelTestSupport.java:351)'
+ BAD=1
+ jps
+ grep surefirebooter
+ cut -d ' ' -f 1
+ xargs kill -9
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Archiving artifacts
Sending artifact delta relative to HBase-1.1 #655
Archived 2089 artifacts
Archive block size is 32768
Received 42 blocks and 500937350 bytes
Compression is 0.3%
Took 2 min 22 sec
Recording test results
Updating HBASE-13250
Build failed in Jenkins: HBase-1.1 #664
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/HBase-1.1/664/changes>
Changes:
[apurtell] HBASE-14400 Fix HBase RPC protection documentation
------------------------------------------
[...truncated 2183 lines...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.931 sec - in org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion
Running org.apache.hadoop.hbase.master.cleaner.TestHFileCleaner
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.984 sec - in org.apache.hadoop.hbase.master.cleaner.TestHFileCleaner
Running org.apache.hadoop.hbase.master.cleaner.TestLogsCleaner
Running org.apache.hadoop.hbase.master.cleaner.TestSnapshotFromMaster
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.146 sec - in org.apache.hadoop.hbase.master.cleaner.TestLogsCleaner
Running org.apache.hadoop.hbase.master.TestZKLessAMOnCluster
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.369 sec - in org.apache.hadoop.hbase.master.cleaner.TestSnapshotFromMaster
Running org.apache.hadoop.hbase.master.TestMasterMetrics
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.356 sec - in org.apache.hadoop.hbase.master.TestMasterMetrics
Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting
Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 69.114 sec - in org.apache.hadoop.hbase.master.TestAssignmentManager
Running org.apache.hadoop.hbase.master.TestMasterOperationsForRegionReplicas
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.452 sec - in org.apache.hadoop.hbase.master.TestMasterOperationsForRegionReplicas
Running org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 133.855 sec - in org.apache.hadoop.hbase.master.TestSplitLogManager
Running org.apache.hadoop.hbase.master.TestRegionPlacement
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.134 sec - in org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable
Running org.apache.hadoop.hbase.master.TestAssignmentListener
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.047 sec - in org.apache.hadoop.hbase.master.TestRegionPlacement
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.229 sec - in org.apache.hadoop.hbase.master.TestAssignmentListener
Running org.apache.hadoop.hbase.master.TestMasterMetricsWrapper
Running org.apache.hadoop.hbase.master.snapshot.TestSnapshotFileCache
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.587 sec - in org.apache.hadoop.hbase.master.TestMasterMetricsWrapper
Running org.apache.hadoop.hbase.master.TestMasterPriorityRpc
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.382 sec - in org.apache.hadoop.hbase.master.TestMasterPriorityRpc
Running org.apache.hadoop.hbase.snapshot.TestExportSnapshot
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.678 sec - in org.apache.hadoop.hbase.master.snapshot.TestSnapshotFileCache
Running org.apache.hadoop.hbase.snapshot.TestSnapshotClientRetries
Tests run: 21, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 165.814 sec <<< FAILURE! - in org.apache.hadoop.hbase.master.TestZKLessAMOnCluster
testMoveRegion(org.apache.hadoop.hbase.master.TestZKLessAMOnCluster) Time elapsed: 50.062 sec <<< ERROR!
org.junit.runners.model.TestTimedOutException: test timed out after 50000 milliseconds
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4168)
at org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4098)
at org.apache.hadoop.hbase.client.HBaseAdmin.disableTable(HBaseAdmin.java:1201)
at org.apache.hadoop.hbase.HBaseTestingUtility.deleteTable(HBaseTestingUtility.java:1877)
at org.apache.hadoop.hbase.master.TestAssignmentManagerOnCluster.testMoveRegion(TestAssignmentManagerOnCluster.java:427)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.lang.Thread.run(Thread.java:744)
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.994 sec - in org.apache.hadoop.hbase.snapshot.TestSnapshotClientRetries
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 176.288 sec - in org.apache.hadoop.hbase.master.TestZKLessAMOnCluster
Running org.apache.hadoop.hbase.snapshot.TestSnapshotDescriptionUtils
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.183 sec - in org.apache.hadoop.hbase.snapshot.TestSnapshotDescriptionUtils
Running org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient
Running org.apache.hadoop.hbase.snapshot.TestRestoreFlushSnapshotFromClient
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 83.389 sec - in org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient
Tests run: 18, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 238.681 sec <<< FAILURE! - in org.apache.hadoop.hbase.master.TestDistributedLogSplitting
testDisallowWritesInRecovering(org.apache.hadoop.hbase.master.TestDistributedLogSplitting) Time elapsed: 11.169 sec <<< FAILURE!
java.lang.AssertionError: No RegionInRecoveryException. Following exceptions returned=[org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=3, exceptions:
Wed Sep 16 04:04:21 UTC 2015, RpcRetryingCaller{globalStartTime=1442376261216, pause=100, retries=3}, org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: hbase:meta,,1.1588230740 is recovering; cannot take reads
at org.apache.hadoop.hbase.regionserver.HRegion.startRegionOperation(HRegion.java:7623)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2480)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2475)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2255)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2114)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:744)
Wed Sep 16 04:04:21 UTC 2015, RpcRetryingCaller{globalStartTime=1442376261216, pause=100, retries=3}, org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: hbase:meta,,1.1588230740 is recovering; cannot take reads
at org.apache.hadoop.hbase.regionserver.HRegion.startRegionOperation(HRegion.java:7623)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2480)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2475)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2255)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2114)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:744)
Wed Sep 16 04:04:22 UTC 2015, RpcRetryingCaller{globalStartTime=1442376261216, pause=100, retries=3}, org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: hbase:meta,,1.1588230740 is recovering; cannot take reads
at org.apache.hadoop.hbase.regionserver.HRegion.startRegionOperation(HRegion.java:7623)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2480)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2475)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2255)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2114)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:744)
]
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.apache.hadoop.hbase.master.TestDistributedLogSplitting.testDisallowWritesInRecovering(TestDistributedLogSplitting.java:980)
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 78.456 sec - in org.apache.hadoop.hbase.snapshot.TestRestoreFlushSnapshotFromClient
Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 497.367 sec - in org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancer
Running org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 311.377 sec - in org.apache.hadoop.hbase.snapshot.TestExportSnapshot
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 303.373 sec - in org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot
Results :
Failed tests:
TestDistributedLogSplitting.testDisallowWritesInRecovering:980 No RegionInRecoveryException. Following exceptions returned=[org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=3, exceptions:
Wed Sep 16 04:04:21 UTC 2015, RpcRetryingCaller{globalStartTime=1442376261216, pause=100, retries=3}, org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: hbase:meta,,1.1588230740 is recovering; cannot take reads
at org.apache.hadoop.hbase.regionserver.HRegion.startRegionOperation(HRegion.java:7623)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2480)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2475)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2255)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2114)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:744)
Wed Sep 16 04:04:21 UTC 2015, RpcRetryingCaller{globalStartTime=1442376261216, pause=100, retries=3}, org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: hbase:meta,,1.1588230740 is recovering; cannot take reads
at org.apache.hadoop.hbase.regionserver.HRegion.startRegionOperation(HRegion.java:7623)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2480)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2475)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2255)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2114)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:744)
Wed Sep 16 04:04:22 UTC 2015, RpcRetryingCaller{globalStartTime=1442376261216, pause=100, retries=3}, org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: org.apache.hadoop.hbase.exceptions.RegionInRecoveryException: hbase:meta,,1.1588230740 is recovering; cannot take reads
at org.apache.hadoop.hbase.regionserver.HRegion.startRegionOperation(HRegion.java:7623)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2480)
at org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:2475)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2255)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2114)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:744)
]
Flaked tests:
org.apache.hadoop.hbase.master.TestZKLessAMOnCluster.testMoveRegion(org.apache.hadoop.hbase.master.TestZKLessAMOnCluster)
Run 1: TestZKLessAMOnCluster>TestAssignmentManagerOnCluster.testMoveRegion:427 ยป TestTimedOut
Run 2: PASS
org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster.testFailedSplit(org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster)
Run 1: TestSplitTransactionOnCluster.testFailedSplit:1338 null
Run 2: PASS
Tests run: 2661, Failures: 1, Errors: 0, Skipped: 20, Flakes: 2
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache HBase ...................................... SUCCESS [4.612s]
[INFO] Apache HBase - Checkstyle ......................... SUCCESS [0.733s]
[INFO] Apache HBase - Resource Bundle .................... SUCCESS [0.217s]
[INFO] Apache HBase - Annotations ........................ SUCCESS [0.992s]
[INFO] Apache HBase - Protocol ........................... SUCCESS [12.724s]
[INFO] Apache HBase - Common ............................. SUCCESS [1:24.079s]
[INFO] Apache HBase - Procedure .......................... SUCCESS [1:12.049s]
[INFO] Apache HBase - Client ............................. SUCCESS [1:22.364s]
[INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS [7.249s]
[INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS [6.629s]
[INFO] Apache HBase - Prefix Tree ........................ SUCCESS [9.292s]
[INFO] Apache HBase - Server ............................. FAILURE [1:34:49.685s]
[INFO] Apache HBase - Testing Util ....................... SKIPPED
[INFO] Apache HBase - Thrift ............................. SKIPPED
[INFO] Apache HBase - Rest ............................... SKIPPED
[INFO] Apache HBase - Shell .............................. SKIPPED
[INFO] Apache HBase - Integration Tests .................. SKIPPED
[INFO] Apache HBase - Examples ........................... SKIPPED
[INFO] Apache HBase - Assembly ........................... SKIPPED
[INFO] Apache HBase - Shaded ............................. SKIPPED
[INFO] Apache HBase - Shaded - Client .................... SKIPPED
[INFO] Apache HBase - Shaded - Server .................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:39:32.822s
[INFO] Finished at: Wed Sep 16 04:12:06 UTC 2015
[INFO] Final Memory: 90M/628M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (secondPartTestsExecution) on project hbase-server: ExecutionException: java.lang.RuntimeException: java.lang.RuntimeException: org.apache.maven.surefire.report.ReporterException: When writing xml report stdout/stderr: /tmp/stderr5599512790107458098deferred (No such file or directory) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hbase-server
Build step 'Invoke top-level Maven targets' marked build as failure
Performing Post build task...
Match found for :.* : True
Logical operation result is TRUE
Running script : ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l`
if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
#It seems sometimes the tests are not dying immediately. Let's give them 10s
echo "Suspicious java process found - waiting 10s to see if there are just slow to stop"
sleep 10
ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l`
if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
echo "There are $ZOMBIE_TESTS_COUNT zombie tests, they should have been killed by surefire but survived"
echo "************ BEGIN zombies jstack extract"
ZB_STACK=`jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack | grep ".test" | grep "\.java"`
jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack
echo "************ END zombies jstack extract"
JIRA_COMMENT="$JIRA_COMMENT
{color:red}-1 core zombie tests{color}. There are ${ZOMBIE_TESTS_COUNT} zombie test(s): ${ZB_STACK}"
BAD=1
jps | grep surefirebooter | cut -d ' ' -f 1 | xargs kill -9
else
echo "We're ok: there is no zombie test, but some tests took some time to stop"
fi
else
echo "We're ok: there is no zombie test"
fi
[HBase-1.1] $ /bin/bash -xe /tmp/hudson6978429985893818071.sh
++ jps
++ grep surefirebooter
++ wc -l
+ ZOMBIE_TESTS_COUNT=0
+ [[ 0 != 0 ]]
+ echo 'We'\''re ok: there is no zombie test'
We're ok: there is no zombie test
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Archiving artifacts
Sending artifact delta relative to HBase-1.1 #655
Archived 2091 artifacts
Archive block size is 32768
Received 42 blocks and 509771918 bytes
Compression is 0.3%
Took 2 min 23 sec
Recording test results
Updating HBASE-14400