You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@hbase.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/09/30 03:55:50 UTC
Build failed in Jenkins: HBase-1.2 » latest1.7,Hadoop #209
See <https://builds.apache.org/job/HBase-1.2/jdk=latest1.7,label=Hadoop/209/changes>
Changes:
[stack] HBASE-14362 org.apache.hadoop.hbase.master.procedure.TestWALProcedureStoreOnHDFS is super duper flaky (Heng Chen)
[stack] HBASE-14510 Fix coprocessor handling of duplicate classes (Yerui Sun)
[stack] HBASE-14513 TestBucketCache runs obnoxious 1k threads in a unit test
------------------------------------------
[...truncated 45258 lines...]
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.392 sec - in org.apache.hadoop.hbase.TestServerSideScanMetricsFromClientSide
Running org.apache.hadoop.hbase.coprocessor.TestRegionServerObserver
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 128.361 sec - in org.apache.hadoop.hbase.regionserver.TestZKLessSplitOnCluster
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.537 sec - in org.apache.hadoop.hbase.TestRegionRebalancing
Running org.apache.hadoop.hbase.coprocessor.TestDoubleColumnInterpreter
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.167 sec - in org.apache.hadoop.hbase.coprocessor.TestRegionServerObserver
Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.186 sec - in org.apache.hadoop.hbase.coprocessor.TestDoubleColumnInterpreter
Running org.apache.hadoop.hbase.coprocessor.TestHTableWrapper
Running org.apache.hadoop.hbase.coprocessor.TestClassLoading
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.716 sec - in org.apache.hadoop.hbase.coprocessor.TestHTableWrapper
Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorEndpoint
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.759 sec - in org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorEndpoint
Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort
Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 163.597 sec - in org.apache.hadoop.hbase.regionserver.TestRemoveRegionMetrics
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.163 sec - in org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.117 sec - in org.apache.hadoop.hbase.coprocessor.TestClassLoading
Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorTableEndpoint
Running org.apache.hadoop.hbase.coprocessor.TestBigDecimalColumnInterpreter
Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.459 sec - in org.apache.hadoop.hbase.coprocessor.TestBigDecimalColumnInterpreter
Running org.apache.hadoop.hbase.coprocessor.TestOpenTableInCoprocessor
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.124 sec - in org.apache.hadoop.hbase.coprocessor.TestCoprocessorTableEndpoint
Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort
Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.511 sec - in org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.512 sec - in org.apache.hadoop.hbase.coprocessor.TestOpenTableInCoprocessor
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.863 sec - in org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort
Running org.apache.hadoop.hbase.coprocessor.TestWALObserver
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.898 sec - in org.apache.hadoop.hbase.coprocessor.TestWALObserver
Running org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint
Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove
Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.103 sec - in org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.32 sec - in org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove
Tests run: 14, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 103.731 sec - in org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.811 sec - in org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint
Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.077 sec - in org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.229 sec - in org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove
Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol
Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver
Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.554 sec - in org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol
Running org.apache.hadoop.hbase.TestMetaTableAccessorNoCluster
Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorStop
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.625 sec - in org.apache.hadoop.hbase.TestMetaTableAccessorNoCluster
Running org.apache.hadoop.hbase.coprocessor.TestBatchCoprocessorEndpoint
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.783 sec - in org.apache.hadoop.hbase.coprocessor.TestBatchCoprocessorEndpoint
Running org.apache.hadoop.hbase.client.TestHTableUtil
Running org.apache.hadoop.hbase.client.TestScannersFromClientSide
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.109 sec - in org.apache.hadoop.hbase.coprocessor.TestCoprocessorStop
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.135 sec - in org.apache.hadoop.hbase.client.TestHTableUtil
Running org.apache.hadoop.hbase.client.TestRpcControllerFactory
Running org.apache.hadoop.hbase.client.TestSnapshotFromClient
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.546 sec - in org.apache.hadoop.hbase.client.TestRpcControllerFactory
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 238.703 sec - in org.apache.hadoop.hbase.TestIOFencing
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.59 sec - in org.apache.hadoop.hbase.client.TestScannersFromClientSide
Running org.apache.hadoop.hbase.client.TestAdmin2
Running org.apache.hadoop.hbase.client.TestFromClientSide
Running org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.885 sec - in org.apache.hadoop.hbase.coprocessor.TestMasterObserver
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.052 sec - in org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout
Running org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClientWithRegionReplicas
Running org.apache.hadoop.hbase.client.TestAdmin1
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.213 sec - in org.apache.hadoop.hbase.client.TestSnapshotFromClient
Running org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 204.93 sec - in org.apache.hadoop.hbase.client.TestAdmin2
Running org.apache.hadoop.hbase.client.TestResultSizeEstimation
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.335 sec - in org.apache.hadoop.hbase.client.TestResultSizeEstimation
Running org.apache.hadoop.hbase.client.TestCloneSnapshotFromClientWithRegionReplicas
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 272.198 sec - in org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClientWithRegionReplicas
Running org.apache.hadoop.hbase.client.TestFromClientSide3
Tests run: 27, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 321.827 sec - in org.apache.hadoop.hbase.client.TestAdmin1
Tests run: 82, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 350.034 sec - in org.apache.hadoop.hbase.client.TestFromClientSide
Running org.apache.hadoop.hbase.client.TestFastFail
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.001 sec - in org.apache.hadoop.hbase.client.TestFastFail
Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool
Running org.apache.hadoop.hbase.client.TestHTableMultiplexerFlushCache
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.277 sec - in org.apache.hadoop.hbase.client.TestHTableMultiplexerFlushCache
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.439 sec - in org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool
Running org.apache.hadoop.hbase.client.TestShortCircuitConnection
Running org.apache.hadoop.hbase.client.TestClientTimeouts
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.648 sec - in org.apache.hadoop.hbase.client.TestShortCircuitConnection
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.924 sec - in org.apache.hadoop.hbase.client.TestClientTimeouts
Tests run: 82, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 351.923 sec - in org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor
Running org.apache.hadoop.hbase.client.TestMultipleTimestamps
Running org.apache.hadoop.hbase.client.TestClientPushback
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.896 sec - in org.apache.hadoop.hbase.client.TestClientPushback
Running org.apache.hadoop.hbase.client.TestHCM
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.452 sec - in org.apache.hadoop.hbase.client.TestMultipleTimestamps
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 144.313 sec - in org.apache.hadoop.hbase.client.TestFromClientSide3
Running org.apache.hadoop.hbase.client.TestScannerTimeout
Running org.apache.hadoop.hbase.client.TestCheckAndMutate
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.04 sec - in org.apache.hadoop.hbase.client.TestCheckAndMutate
Running org.apache.hadoop.hbase.client.TestMetaWithReplicas
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.996 sec - in org.apache.hadoop.hbase.client.TestScannerTimeout
Running org.apache.hadoop.hbase.client.TestSizeFailures
Running org.apache.hadoop.hbase.client.TestPutWithDelete
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.701 sec - in org.apache.hadoop.hbase.client.TestPutWithDelete
Running org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 293.454 sec - in org.apache.hadoop.hbase.client.TestCloneSnapshotFromClientWithRegionReplicas
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.359 sec - in org.apache.hadoop.hbase.client.TestSizeFailures
Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool
Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.516 sec - in org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool
Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.776 sec - in org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.004 sec - in org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool
Running org.apache.hadoop.hbase.client.TestReplicaWithCluster
Running org.apache.hadoop.hbase.client.TestSnapshotMetadata
Tests run: 21, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 186.179 sec - in org.apache.hadoop.hbase.client.TestHCM
Running org.apache.hadoop.hbase.client.TestSnapshotFromClientWithRegionReplicas
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.405 sec - in org.apache.hadoop.hbase.client.TestSnapshotMetadata
Running org.apache.hadoop.hbase.client.TestUpdateConfiguration
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.28 sec - in org.apache.hadoop.hbase.client.TestUpdateConfiguration
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 83.268 sec - in org.apache.hadoop.hbase.client.TestReplicaWithCluster
Running org.apache.hadoop.hbase.client.replication.TestReplicationAdmin
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.66 sec - in org.apache.hadoop.hbase.client.replication.TestReplicationAdmin
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 206.407 sec - in org.apache.hadoop.hbase.client.TestMetaWithReplicas
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.766 sec - in org.apache.hadoop.hbase.client.TestSnapshotFromClientWithRegionReplicas
Running org.apache.hadoop.hbase.client.TestSnapshotCloneIndependence
Running org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient
Running org.apache.hadoop.hbase.client.TestTimestampsFilter
Running org.apache.hadoop.hbase.client.replication.TestReplicationAdminWithClusters
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.732 sec - in org.apache.hadoop.hbase.client.TestTimestampsFilter
Running org.apache.hadoop.hbase.client.TestTableSnapshotScanner
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.191 sec - in org.apache.hadoop.hbase.client.replication.TestReplicationAdminWithClusters
Running org.apache.hadoop.hbase.client.TestMultiParallel
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.975 sec - in org.apache.hadoop.hbase.client.TestTableSnapshotScanner
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 263.641 sec - in org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient
Running org.apache.hadoop.hbase.client.TestFromClientSideNoCodec
Running org.apache.hadoop.hbase.client.TestClientOperationInterrupt
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.125 sec - in org.apache.hadoop.hbase.client.TestFromClientSideNoCodec
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.636 sec - in org.apache.hadoop.hbase.client.TestMultiParallel
Results :
Tests in error:
org.apache.hadoop.hbase.master.procedure.TestWALProcedureStoreOnHDFS.testWalRollOnLowReplication(org.apache.hadoop.hbase.master.procedure.TestWALProcedureStoreOnHDFS)
Run 1: TestWALProcedureStoreOnHDFS.testWalRollOnLowReplication:189 » Runtime sync abo...
Run 2: TestWALProcedureStoreOnHDFS.testWalRollOnLowReplication:189 » Runtime sync abo...
Run 3: TestWALProcedureStoreOnHDFS.testWalRollOnLowReplication:189 » Runtime sync abo...
Flaked tests:
org.apache.hadoop.hbase.master.TestAssignmentManager.testSSHTimesOutOpeningRegionTransition(org.apache.hadoop.hbase.master.TestAssignmentManager)
Run 1: TestAssignmentManager.testSSHTimesOutOpeningRegionTransition:1198->processServerShutdownHandler:757 » TestTimedOut
Run 2: PASS
Tests run: 2123, Failures: 0, Errors: 1, Skipped: 19, Flakes: 1
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache HBase ...................................... SUCCESS [1:40.838s]
[INFO] Apache HBase - Checkstyle ......................... SUCCESS [5.466s]
[INFO] Apache HBase - Resource Bundle .................... SUCCESS [0.220s]
[INFO] Apache HBase - Annotations ........................ SUCCESS [1.058s]
[INFO] Apache HBase - Protocol ........................... SUCCESS [15.710s]
[INFO] Apache HBase - Common ............................. SUCCESS [4:06.917s]
[INFO] Apache HBase - Procedure .......................... SUCCESS [1:55.892s]
[INFO] Apache HBase - Client ............................. SUCCESS [1:30.917s]
[INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS [8.243s]
[INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS [12.564s]
[INFO] Apache HBase - Prefix Tree ........................ SUCCESS [10.249s]
[INFO] Apache HBase - Server ............................. FAILURE [1:29:17.004s]
[INFO] Apache HBase - Testing Util ....................... SKIPPED
[INFO] Apache HBase - Thrift ............................. SKIPPED
[INFO] Apache HBase - Rest ............................... SKIPPED
[INFO] Apache HBase - Shell .............................. SKIPPED
[INFO] Apache HBase - Integration Tests .................. SKIPPED
[INFO] Apache HBase - Examples ........................... SKIPPED
[INFO] Apache HBase - External Block Cache ............... SKIPPED
[INFO] Apache HBase - Assembly ........................... SKIPPED
[INFO] Apache HBase - Shaded ............................. SKIPPED
[INFO] Apache HBase - Shaded - Client .................... SKIPPED
[INFO] Apache HBase - Shaded - Server .................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:39:43.418s
[INFO] Finished at: Wed Sep 30 01:53:55 UTC 2015
[INFO] Final Memory: 396M/604M
[INFO] ------------------------------------------------------------------------
Running org.apache.hadoop.hbase.client.TestReplicasClient
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (secondPartTestsExecution) on project hbase-server: ExecutionException: java.lang.RuntimeException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd <https://builds.apache.org/job/HBase-1.2/jdk=latest1.7,label=Hadoop/ws/hbase-server> && /home/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.7/jre/bin/java -enableassertions -XX:MaxDirectMemorySize=1G -Xmx2800m -XX:MaxPermSize=256m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -jar <https://builds.apache.org/job/HBase-1.2/jdk=latest1.7,label=Hadoop/ws/hbase-server/target/surefire/surefirebooter5136241795114510150.jar> <https://builds.apache.org/job/HBase-1.2/jdk=latest1.7,label=Hadoop/ws/hbase-server/target/surefire/surefire1701196032893815399tmp> <https://builds.apache.org/job/HBase-1.2/jdk=latest1.7,label=Hadoop/ws/hbase-server/target/surefire/surefire_737145438845119410389tmp>
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hbase-server
Build step 'Invoke top-level Maven targets' marked build as failure
Performing Post build task...
Match found for :.* : True
Logical operation result is TRUE
Running script : ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l`
if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
#It seems sometimes the tests are not dying immediately. Let's give them 10s
echo "Suspicious java process found - waiting 10s to see if there are just slow to stop"
sleep 10
ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l`
if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
echo "There are $ZOMBIE_TESTS_COUNT zombie tests, they should have been killed by surefire but survived"
echo "************ BEGIN zombies jstack extract"
ZB_STACK=`jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack | grep ".test" | grep "\.java"`
jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack
echo "************ END zombies jstack extract"
JIRA_COMMENT="$JIRA_COMMENT
{color:red}-1 core zombie tests{color}. There are ${ZOMBIE_TESTS_COUNT} zombie test(s): ${ZB_STACK}"
BAD=1
jps | grep surefirebooter | cut -d ' ' -f 1 | xargs kill -9
else
echo "We're ok: there is no zombie test, but some tests took some time to stop"
fi
else
echo "We're ok: there is no zombie test"
fi
[Hadoop] $ /bin/bash -xe /tmp/hudson5821175744461733512.sh
++ jps
++ grep surefirebooter
++ wc -l
+ ZOMBIE_TESTS_COUNT=4
+ [[ 4 != 0 ]]
+ echo 'Suspicious java process found - waiting 10s to see if there are just slow to stop'
Suspicious java process found - waiting 10s to see if there are just slow to stop
+ sleep 10
++ jps
++ grep surefirebooter
++ wc -l
+ ZOMBIE_TESTS_COUNT=0
+ [[ 0 != 0 ]]
+ echo 'We'\''re ok: there is no zombie test, but some tests took some time to stop'
We're ok: there is no zombie test, but some tests took some time to stop
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Archiving artifacts
Sending artifact delta relative to HBase-1.2 » latest1.7,Hadoop #101
Archived 1862 artifacts
Archive block size is 32768
Received 2 blocks and 454137242 bytes
Compression is 0.0%
Took 2 min 6 sec
Build failed in Jenkins: HBase-1.2 » latest1.7,Hadoop #210
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/HBase-1.2/jdk=latest1.7,label=Hadoop/210/changes>
Changes:
[jerryjch] HBASE-14394 Properly close the connection after reading records from table: addendum
------------------------------------------
[...truncated 46037 lines...]
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:129)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2202)
"IPC Server handler 1 on 46670" daemon prio=10 tid=0x00007ffbace2d000 nid=0x6a8b waiting on condition [0x00007ffb9560b000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007800c1cc8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:129)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2202)
"IPC Server handler 0 on 46670" daemon prio=10 tid=0x00007ffbace37000 nid=0x6a8a waiting on condition [0x00007ffb9570c000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007800c1cc8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:129)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2202)
"IPC Server listener on 46670" daemon prio=10 tid=0x00007ffbace36000 nid=0x6a89 runnable [0x00007ffb9580d000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x00000007800c1e78> (a sun.nio.ch.Util$2)
- locked <0x00000007800c1e88> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000007800c1e30> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
at org.apache.hadoop.ipc.Server$Listener.run(Server.java:754)
"IPC Server Responder" daemon prio=10 tid=0x00007ffbace33000 nid=0x6a88 runnable [0x00007ffb9590e000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x00000007800e9898> (a sun.nio.ch.Util$2)
- locked <0x00000007800e98a8> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000007800e9850> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.hadoop.ipc.Server$Responder.doRunLoop(Server.java:928)
at org.apache.hadoop.ipc.Server$Responder.run(Server.java:911)
"IPC Server idle connection scanner for port 46670" daemon prio=10 tid=0x00007ffbacdf1000 nid=0x6a7e in Object.wait() [0x00007ffb95a0f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007800eb790> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:552)
- locked <0x00000007800eb790> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:505)
"Socket Reader #1 for port 46670" prio=10 tid=0x00007ffbacdef800 nid=0x6a7d runnable [0x00007ffb95b10000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x00000007800e99b8> (a sun.nio.ch.Util$2)
- locked <0x00000007800e99c8> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000007800c1f70> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:701)
- locked <0x00000007800e98f8> (a org.apache.hadoop.ipc.Server$Listener$Reader)
at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:680)
"Timer-0" daemon prio=10 tid=0x00007ffbacd7a000 nid=0x6a76 in Object.wait() [0x00007ffb95c11000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007800eb818> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:552)
- locked <0x00000007800eb818> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:505)
"1821400465@qtp-806753455-1 - Acceptor0 SelectChannelConnector@localhost:56408" daemon prio=10 tid=0x00007ffbacd19000 nid=0x6a68 runnable [0x00007ffb95d12000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x00000007800eb968> (a sun.nio.ch.Util$2)
- locked <0x00000007800eb978> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000007800eb920> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498)
at org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192)
at org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
"413867548@qtp-806753455-0" daemon prio=10 tid=0x00007ffbacd08800 nid=0x6a67 in Object.wait() [0x00007ffb95e13000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007800eaee8> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
- locked <0x00000007800eaee8> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
"pool-1-thread-1" prio=10 tid=0x00007ffbacc16800 nid=0x6a60 waiting on condition [0x00007ffb95f14000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078011b260> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
"Timer for 'JournalNode' metrics system" daemon prio=10 tid=0x00007ffbacafa000 nid=0x69e6 in Object.wait() [0x00007ffb9643d000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000078011bc28> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:552)
- locked <0x000000078011bc28> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:505)
"Service Thread" daemon prio=10 tid=0x00007ffbac291000 nid=0x68ae runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" daemon prio=10 tid=0x00007ffbac28e800 nid=0x68ad waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" daemon prio=10 tid=0x00007ffbac28b800 nid=0x68ac waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x00007ffbac281800 nid=0x68ab runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0x00007ffbac26b000 nid=0x68a3 in Object.wait() [0x00007ffba1214000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000078015c070> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
- locked <0x000000078015c070> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
"Reference Handler" daemon prio=10 tid=0x00007ffbac267000 nid=0x68a2 in Object.wait() [0x00007ffba1315000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007801ae0f8> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:503)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
- locked <0x00000007801ae0f8> (a java.lang.ref.Reference$Lock)
"main" prio=10 tid=0x00007ffbac00a000 nid=0x688b waiting on condition [0x00007ffbb3c60000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.ipc.Client.stop(Client.java:1275)
at org.apache.hadoop.ipc.ClientCache.stopClient(ClientCache.java:113)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.close(ProtobufRpcEngine.java:281)
at org.apache.hadoop.ipc.RPC.stopProxy(RPC.java:671)
at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolTranslatorPB.close(QJournalProtocolTranslatorPB.java:91)
at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults$WrapEveryCall.answer(TestQJMWithFaults.java:469)
at org.mockito.internal.MockHandler.handle(MockHandler.java:99)
at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47)
at org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocol$$EnhancerByMockitoWithCGLIB$$3efdbd74.close(<generated>)
at org.apache.hadoop.ipc.RPC.stopProxy(RPC.java:666)
at org.apache.hadoop.hdfs.qjournal.client.IPCLoggerChannel.close(IPCLoggerChannel.java:205)
at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.close(AsyncLoggerSet.java:102)
at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.close(QuorumJournalManager.java:462)
at org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults.testRandomized(TestQJMWithFaults.java:268)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
"VM Thread" prio=10 tid=0x00007ffbac264800 nid=0x689f runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x00007ffbac020000 nid=0x6892 runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x00007ffbac022000 nid=0x6893 runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0x00007ffbac023800 nid=0x6894 runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0x00007ffbac025800 nid=0x6895 runnable
"GC task thread#4 (ParallelGC)" prio=10 tid=0x00007ffbac027800 nid=0x6896 runnable
"GC task thread#5 (ParallelGC)" prio=10 tid=0x00007ffbac029800 nid=0x6897 runnable
"GC task thread#6 (ParallelGC)" prio=10 tid=0x00007ffbac02b000 nid=0x6898 runnable
"GC task thread#7 (ParallelGC)" prio=10 tid=0x00007ffbac02d000 nid=0x6899 runnable
"GC task thread#8 (ParallelGC)" prio=10 tid=0x00007ffbac02f000 nid=0x689a runnable
"GC task thread#9 (ParallelGC)" prio=10 tid=0x00007ffbac030800 nid=0x689b runnable
"GC task thread#10 (ParallelGC)" prio=10 tid=0x00007ffbac032800 nid=0x689c runnable
"GC task thread#11 (ParallelGC)" prio=10 tid=0x00007ffbac034800 nid=0x689d runnable
"GC task thread#12 (ParallelGC)" prio=10 tid=0x00007ffbac036800 nid=0x689e runnable
"VM Periodic Task Thread" prio=10 tid=0x00007ffbac29b800 nid=0x68b0 waiting on condition
JNI global references: 183
+ echo '************ END zombies jstack extract'
************ END zombies jstack extract
+ JIRA_COMMENT='
{color:red}-1 core zombie tests{color}. There are 1 zombie test(s): at org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults.testRandomized(TestQJMWithFaults.java:239)'
+ BAD=1
+ jps
+ cut -d ' ' -f 1
+ grep surefirebooter
+ xargs kill -9
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Archiving artifacts
Sending artifact delta relative to HBase-1.2 » latest1.7,Hadoop #101
Archived 2131 artifacts
Archive block size is 32768
Received 26 blocks and 871263899 bytes
Compression is 0.1%
Took 3 min 26 sec