You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@hbase.apache.org by Stack <st...@duboce.net> on 2015/11/20 19:23:51 UTC
TestTableLockManager.testReapAllTableLocks => Re: Build failed in Jenkins: HBase-1.3 » latest1.8,Hadoop #385
Enis (or anyone):
This test came in with:
HBASE-7305. ZK based Read/Write locks for table operations
It fails rarely enough and seeminly only on 1.8.
https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.3/lastCompletedBuild/jdk=latest1.8,label=Hadoop/testReport/org.apache.hadoop.hbase.master/TestTableLockManager/testReapAllTableLocks/history/
The failure is weird though. It is not supposed to happen.
Error Message
Timed out acquiring writelock for table:table4for:zero timeout after 0 ms.
Stacktrace
org.apache.hadoop.hbase.exceptions.LockTimeoutException: Timed out
acquiring writelock for table:table4for:zero timeout after 0 ms.
at org.apache.hadoop.hbase.master.TableLockManager$ZKTableLockManager$TableLockImpl.acquire(TableLockManager.java:282)
at org.apache.hadoop.hbase.master.TestTableLockManager.testReapAllTableLocks(TestTableLockManager.java:283)
See https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.3/lastCompletedBuild/jdk=latest1.8,label=Hadoop/testReport/org.apache.hadoop.hbase.master/TestTableLockManager/testReapAllTableLocks/
Any input?
St.Ack
On Fri, Nov 20, 2015 at 6:05 AM, Apache Jenkins Server <
jenkins@builds.apache.org> wrote:
> See <
> https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/385/changes
> >
>
> Changes:
>
> [ramkrishna] HBASE-14840 Sink cluster reports data replication request as
> success
>
> ------------------------------------------
> [...truncated 45422 lines...]
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.filter.TestMultiRowRangeFilter
> Running org.apache.hadoop.hbase.filter.TestFilterWithScanLimits
> Running org.apache.hadoop.hbase.filter.TestScanRowPrefix
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.666 sec
> - in org.apache.hadoop.hbase.filter.TestFilterWithScanLimits
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.TestGlobalMemStoreSize
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.957 sec
> - in org.apache.hadoop.hbase.filter.TestScanRowPrefix
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster
> Running org.apache.hadoop.hbase.filter.TestFilterWrapper
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.025 sec
> - in org.apache.hadoop.hbase.filter.TestFilterWrapper
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.174
> sec - in org.apache.hadoop.hbase.filter.TestMultiRowRangeFilter
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.128 sec
> - in org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.384 sec
> - in org.apache.hadoop.hbase.TestGlobalMemStoreSize
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.TestNamespace
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.migration.TestUpgradeTo96
> Running org.apache.hadoop.hbase.replication.TestReplicationSource
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.507 sec
> - in org.apache.hadoop.hbase.replication.TestReplicationSource
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.647 sec
> - in org.apache.hadoop.hbase.migration.TestUpgradeTo96
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.migration.TestNamespaceUpgrade
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.149 sec
> - in org.apache.hadoop.hbase.TestNamespace
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.replication.TestPerTableCFReplication
> Running org.apache.hadoop.hbase.replication.TestReplicationWithTags
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.519 sec
> - in org.apache.hadoop.hbase.replication.TestReplicationWithTags
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.647 sec
> - in org.apache.hadoop.hbase.migration.TestNamespaceUpgrade
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication
> Running
> org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.463 sec
> - in org.apache.hadoop.hbase.replication.TestPerTableCFReplication
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.467 sec
> - in
> org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.replication.TestMasterReplication
> Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.841 sec
> - in org.apache.hadoop.hbase.replication.TestMultiSlaveReplication
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS
> Running
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationWALReaderManager
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.34 sec
> - in org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.584
> sec - in org.apache.hadoop.hbase.replication.TestReplicationSmallTests
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster
> Running
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.106 sec
> - in
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 233.352
> sec - in org.apache.hadoop.hbase.filter.TestFuzzyRowFilterEndToEnd
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.923 sec
> - in org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.75 sec
> - in
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 106.63 sec
> - in org.apache.hadoop.hbase.replication.TestMasterReplication
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint
> Running
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationKillMasterRSCompressedWithMultipleWAL
> Running
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationEndpointWithMultipleWAL
> Running
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationSyncUpToolWithMultipleWAL
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.609 sec
> - in
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationKillMasterRSCompressedWithMultipleWAL
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.697 sec
> - in
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationEndpointWithMultipleWAL
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.331 sec
> - in org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.replication.TestReplicationEndpoint
> Running org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.642 sec
> - in org.apache.hadoop.hbase.replication.TestReplicationEndpoint
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.946 sec
> - in
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationSyncUpToolWithMultipleWAL
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.508 sec
> - in org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.202
> sec - in
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> Running org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS
> Running
> org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed
> Running
> org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.259 sec
> - in org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.211 sec
> - in org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.13 sec
> - in
> org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 233.131
> sec - in
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationWALReaderManager
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.571 sec
> - in org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer
>
> Results :
>
> Tests in error:
>
> org.apache.hadoop.hbase.master.TestTableLockManager.testReapAllTableLocks(org.apache.hadoop.hbase.master.TestTableLockManager)
> Run 1: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout
> Timed out acquiri...
> Run 2: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout
> Timed out acquiri...
> Run 3: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout
> Timed out acquiri...
>
>
> Tests run: 2395, Failures: 0, Errors: 1, Skipped: 39
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache HBase ...................................... SUCCESS
> [57.514s]
> [INFO] Apache HBase - Checkstyle ......................... SUCCESS [4.781s]
> [INFO] Apache HBase - Resource Bundle .................... SUCCESS [0.166s]
> [INFO] Apache HBase - Annotations ........................ SUCCESS [1.292s]
> [INFO] Apache HBase - Protocol ........................... SUCCESS
> [18.335s]
> [INFO] Apache HBase - Common ............................. SUCCESS
> [2:08.375s]
> [INFO] Apache HBase - Procedure .......................... SUCCESS
> [2:38.599s]
> [INFO] Apache HBase - Client ............................. SUCCESS
> [1:20.977s]
> [INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS [8.319s]
> [INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS [8.133s]
> [INFO] Apache HBase - Prefix Tree ........................ SUCCESS [8.530s]
> [INFO] Apache HBase - Server ............................. FAILURE
> [1:33:07.573s]
> [INFO] Apache HBase - Testing Util ....................... SKIPPED
> [INFO] Apache HBase - Thrift ............................. SKIPPED
> [INFO] Apache HBase - Rest ............................... SKIPPED
> [INFO] Apache HBase - Shell .............................. SKIPPED
> [INFO] Apache HBase - Integration Tests .................. SKIPPED
> [INFO] Apache HBase - Examples ........................... SKIPPED
> [INFO] Apache HBase - External Block Cache ............... SKIPPED
> [INFO] Apache HBase - Assembly ........................... SKIPPED
> [INFO] Apache HBase - Shaded ............................. SKIPPED
> [INFO] Apache HBase - Shaded - Client .................... SKIPPED
> [INFO] Apache HBase - Shaded - Server .................... SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 1:41:24.229s
> [INFO] Finished at: Fri Nov 20 14:03:15 UTC 2015
> [INFO] Final Memory: 94M/667M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test
> (secondPartTestsExecution) on project hbase-server: There are test failures.
> [ERROR]
> [ERROR] Please refer to <
> https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/ws/hbase-server/target/surefire-reports>
> for the individual test results.
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :hbase-server
> Build step 'Invoke top-level Maven targets' marked build as failure
> Performing Post build task...
> Match found for :.* : True
> Logical operation result is TRUE
> Running script : # Post-build task script. TODO: Check this in and have
> all builds reference check-in.
> pwd && ls
> # NOTE!!!! The below code has been copied and pasted from
> ./dev-tools/run-test.sh
> # Do not change here without syncing there and vice-versa.
> ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> | wc -l`
> if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
> echo "Suspicious java process found - waiting 30s to see if there are
> just slow to stop"
> sleep 30
> ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> | wc -l`
> if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
> echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie
> tests{color}, they should have been killed by surefire but survived"
> jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f 1
> | xargs -n 1 jstack
> # Exit with error
> exit 1
> else
> echo "We're ok: there is no zombie test, but some tests took some time
> to stop"
> fi
> else
> echo "We're ok: there is no zombie test"
> fi
> [Hadoop] $ /bin/bash -xe /tmp/hudson3916715209187251998.sh
> + pwd
> <https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/ws/>
> + ls
> bin
> CHANGES.txt
> conf
> dev-support
> hbase-annotations
> hbase-assembly
> hbase-checkstyle
> hbase-client
> hbase-common
> hbase-examples
> hbase-external-blockcache
> hbase-hadoop2-compat
> hbase-hadoop-compat
> hbase-it
> hbase-native-client
> hbase-prefix-tree
> hbase-procedure
> hbase-protocol
> hbase-resource-bundle
> hbase-rest
> hbase-server
> hbase-shaded
> hbase-shell
> hbase-spark
> hbase-testing-util
> hbase-thrift
> LICENSE.txt
> NOTICE.txt
> pom.xml
> README.txt
> src
> target
> ++ jps -v
> ++ grep surefirebooter
> ++ grep -e -Dhbase.test
> ++ wc -l
> + ZOMBIE_TESTS_COUNT=0
> + [[ 0 != 0 ]]
> + echo 'We'\''re ok: there is no zombie test'
> We're ok: there is no zombie test
> POST BUILD TASK : SUCCESS
> END OF POST BUILD TASK : 0
> Archiving artifacts
> Recording test results
>
Re: TestTableLockManager.testReapAllTableLocks => Re: Build failed in Jenkins: HBase-1.3 » latest1.8,Hadoop #385
Posted by Enis Söztutar <en...@apache.org>.
Let me look into it.
Enis
On Fri, Nov 20, 2015 at 10:23 AM, Stack <st...@duboce.net> wrote:
> Enis (or anyone):
>
> This test came in with:
>
> HBASE-7305. ZK based Read/Write locks for table operations
>
> It fails rarely enough and seeminly only on 1.8.
>
>
> https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.3/lastCompletedBuild/jdk=latest1.8,label=Hadoop/testReport/org.apache.hadoop.hbase.master/TestTableLockManager/testReapAllTableLocks/history/
>
> The failure is weird though. It is not supposed to happen.
>
> Error Message
>
> Timed out acquiring writelock for table:table4for:zero timeout after 0 ms.
>
> Stacktrace
>
> org.apache.hadoop.hbase.exceptions.LockTimeoutException: Timed out
> acquiring writelock for table:table4for:zero timeout after 0 ms.
> at
> org.apache.hadoop.hbase.master.TableLockManager$ZKTableLockManager$TableLockImpl.acquire(TableLockManager.java:282)
> at
> org.apache.hadoop.hbase.master.TestTableLockManager.testReapAllTableLocks(TestTableLockManager.java:283)
>
>
> See
> https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.3/lastCompletedBuild/jdk=latest1.8,label=Hadoop/testReport/org.apache.hadoop.hbase.master/TestTableLockManager/testReapAllTableLocks/
>
>
> Any input?
>
>
> St.Ack
>
>
>
> On Fri, Nov 20, 2015 at 6:05 AM, Apache Jenkins Server <
> jenkins@builds.apache.org> wrote:
>
> > See <
> >
> https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/385/changes
> > >
> >
> > Changes:
> >
> > [ramkrishna] HBASE-14840 Sink cluster reports data replication request as
> > success
> >
> > ------------------------------------------
> > [...truncated 45422 lines...]
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.filter.TestMultiRowRangeFilter
> > Running org.apache.hadoop.hbase.filter.TestFilterWithScanLimits
> > Running org.apache.hadoop.hbase.filter.TestScanRowPrefix
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.666 sec
> > - in org.apache.hadoop.hbase.filter.TestFilterWithScanLimits
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.TestGlobalMemStoreSize
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.957 sec
> > - in org.apache.hadoop.hbase.filter.TestScanRowPrefix
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster
> > Running org.apache.hadoop.hbase.filter.TestFilterWrapper
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.025 sec
> > - in org.apache.hadoop.hbase.filter.TestFilterWrapper
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.174
> > sec - in org.apache.hadoop.hbase.filter.TestMultiRowRangeFilter
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.128
> sec
> > - in org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.384
> sec
> > - in org.apache.hadoop.hbase.TestGlobalMemStoreSize
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.TestNamespace
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.migration.TestUpgradeTo96
> > Running org.apache.hadoop.hbase.replication.TestReplicationSource
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.507 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationSource
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.647 sec
> > - in org.apache.hadoop.hbase.migration.TestUpgradeTo96
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.migration.TestNamespaceUpgrade
> > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.149
> sec
> > - in org.apache.hadoop.hbase.TestNamespace
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestPerTableCFReplication
> > Running org.apache.hadoop.hbase.replication.TestReplicationWithTags
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.519 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationWithTags
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.647
> sec
> > - in org.apache.hadoop.hbase.migration.TestNamespaceUpgrade
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication
> > Running
> >
> org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers
> > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.463
> sec
> > - in org.apache.hadoop.hbase.replication.TestPerTableCFReplication
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.467 sec
> > - in
> >
> org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestMasterReplication
> > Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.841
> sec
> > - in org.apache.hadoop.hbase.replication.TestMultiSlaveReplication
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS
> > Running
> >
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationWALReaderManager
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.34 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.584
> > sec - in org.apache.hadoop.hbase.replication.TestReplicationSmallTests
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running
> >
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster
> > Running
> >
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager
> > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.106 sec
> > - in
> >
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running
> > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink
> > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 233.352
> > sec - in org.apache.hadoop.hbase.filter.TestFuzzyRowFilterEndToEnd
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.923 sec
> > - in org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.75 sec
> > - in
> >
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 106.63
> sec
> > - in org.apache.hadoop.hbase.replication.TestMasterReplication
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running
> >
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint
> > Running
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationKillMasterRSCompressedWithMultipleWAL
> > Running
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationEndpointWithMultipleWAL
> > Running
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationSyncUpToolWithMultipleWAL
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.609
> sec
> > - in
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationKillMasterRSCompressedWithMultipleWAL
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.697
> sec
> > - in
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationEndpointWithMultipleWAL
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl
> > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.331 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestReplicationEndpoint
> > Running org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool
> > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.642 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationEndpoint
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.946
> sec
> > - in
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationSyncUpToolWithMultipleWAL
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl
> > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.508 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.202
> > sec - in
> >
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS
> > Running
> > org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed
> > Running
> > org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.259
> sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.211
> sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.13 sec
> > - in
> > org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed
> > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 233.131
> > sec - in
> >
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationWALReaderManager
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.571
> sec
> > - in
> org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer
> >
> > Results :
> >
> > Tests in error:
> >
> >
> org.apache.hadoop.hbase.master.TestTableLockManager.testReapAllTableLocks(org.apache.hadoop.hbase.master.TestTableLockManager)
> > Run 1: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout
> > Timed out acquiri...
> > Run 2: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout
> > Timed out acquiri...
> > Run 3: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout
> > Timed out acquiri...
> >
> >
> > Tests run: 2395, Failures: 0, Errors: 1, Skipped: 39
> >
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Apache HBase ...................................... SUCCESS
> > [57.514s]
> > [INFO] Apache HBase - Checkstyle ......................... SUCCESS
> [4.781s]
> > [INFO] Apache HBase - Resource Bundle .................... SUCCESS
> [0.166s]
> > [INFO] Apache HBase - Annotations ........................ SUCCESS
> [1.292s]
> > [INFO] Apache HBase - Protocol ........................... SUCCESS
> > [18.335s]
> > [INFO] Apache HBase - Common ............................. SUCCESS
> > [2:08.375s]
> > [INFO] Apache HBase - Procedure .......................... SUCCESS
> > [2:38.599s]
> > [INFO] Apache HBase - Client ............................. SUCCESS
> > [1:20.977s]
> > [INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS
> [8.319s]
> > [INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS
> [8.133s]
> > [INFO] Apache HBase - Prefix Tree ........................ SUCCESS
> [8.530s]
> > [INFO] Apache HBase - Server ............................. FAILURE
> > [1:33:07.573s]
> > [INFO] Apache HBase - Testing Util ....................... SKIPPED
> > [INFO] Apache HBase - Thrift ............................. SKIPPED
> > [INFO] Apache HBase - Rest ............................... SKIPPED
> > [INFO] Apache HBase - Shell .............................. SKIPPED
> > [INFO] Apache HBase - Integration Tests .................. SKIPPED
> > [INFO] Apache HBase - Examples ........................... SKIPPED
> > [INFO] Apache HBase - External Block Cache ............... SKIPPED
> > [INFO] Apache HBase - Assembly ........................... SKIPPED
> > [INFO] Apache HBase - Shaded ............................. SKIPPED
> > [INFO] Apache HBase - Shaded - Client .................... SKIPPED
> > [INFO] Apache HBase - Shaded - Server .................... SKIPPED
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD FAILURE
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 1:41:24.229s
> > [INFO] Finished at: Fri Nov 20 14:03:15 UTC 2015
> > [INFO] Final Memory: 94M/667M
> > [INFO]
> > ------------------------------------------------------------------------
> > [ERROR] Failed to execute goal
> > org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test
> > (secondPartTestsExecution) on project hbase-server: There are test
> failures.
> > [ERROR]
> > [ERROR] Please refer to <
> >
> https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/ws/hbase-server/target/surefire-reports
> >
> > for the individual test results.
> > [ERROR] -> [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> > -e switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions,
> > please read the following articles:
> > [ERROR] [Help 1]
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> > [ERROR]
> > [ERROR] After correcting the problems, you can resume the build with the
> > command
> > [ERROR] mvn <goals> -rf :hbase-server
> > Build step 'Invoke top-level Maven targets' marked build as failure
> > Performing Post build task...
> > Match found for :.* : True
> > Logical operation result is TRUE
> > Running script : # Post-build task script. TODO: Check this in and have
> > all builds reference check-in.
> > pwd && ls
> > # NOTE!!!! The below code has been copied and pasted from
> > ./dev-tools/run-test.sh
> > # Do not change here without syncing there and vice-versa.
> > ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> > | wc -l`
> > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
> > echo "Suspicious java process found - waiting 30s to see if there are
> > just slow to stop"
> > sleep 30
> > ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e
> '-Dhbase.test'
> > | wc -l`
> > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
> > echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie
> > tests{color}, they should have been killed by surefire but survived"
> > jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> > jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f
> 1
> > | xargs -n 1 jstack
> > # Exit with error
> > exit 1
> > else
> > echo "We're ok: there is no zombie test, but some tests took some time
> > to stop"
> > fi
> > else
> > echo "We're ok: there is no zombie test"
> > fi
> > [Hadoop] $ /bin/bash -xe /tmp/hudson3916715209187251998.sh
> > + pwd
> > <https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/ws/>
> > + ls
> > bin
> > CHANGES.txt
> > conf
> > dev-support
> > hbase-annotations
> > hbase-assembly
> > hbase-checkstyle
> > hbase-client
> > hbase-common
> > hbase-examples
> > hbase-external-blockcache
> > hbase-hadoop2-compat
> > hbase-hadoop-compat
> > hbase-it
> > hbase-native-client
> > hbase-prefix-tree
> > hbase-procedure
> > hbase-protocol
> > hbase-resource-bundle
> > hbase-rest
> > hbase-server
> > hbase-shaded
> > hbase-shell
> > hbase-spark
> > hbase-testing-util
> > hbase-thrift
> > LICENSE.txt
> > NOTICE.txt
> > pom.xml
> > README.txt
> > src
> > target
> > ++ jps -v
> > ++ grep surefirebooter
> > ++ grep -e -Dhbase.test
> > ++ wc -l
> > + ZOMBIE_TESTS_COUNT=0
> > + [[ 0 != 0 ]]
> > + echo 'We'\''re ok: there is no zombie test'
> > We're ok: there is no zombie test
> > POST BUILD TASK : SUCCESS
> > END OF POST BUILD TASK : 0
> > Archiving artifacts
> > Recording test results
> >
>
Re: TestTableLockManager.testReapAllTableLocks => Re: Build failed in Jenkins: HBase-1.3 » latest1.8,Hadoop #385
Posted by Enis Söztutar <en...@apache.org>.
Let me look into it.
Enis
On Fri, Nov 20, 2015 at 10:23 AM, Stack <st...@duboce.net> wrote:
> Enis (or anyone):
>
> This test came in with:
>
> HBASE-7305. ZK based Read/Write locks for table operations
>
> It fails rarely enough and seeminly only on 1.8.
>
>
> https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.3/lastCompletedBuild/jdk=latest1.8,label=Hadoop/testReport/org.apache.hadoop.hbase.master/TestTableLockManager/testReapAllTableLocks/history/
>
> The failure is weird though. It is not supposed to happen.
>
> Error Message
>
> Timed out acquiring writelock for table:table4for:zero timeout after 0 ms.
>
> Stacktrace
>
> org.apache.hadoop.hbase.exceptions.LockTimeoutException: Timed out
> acquiring writelock for table:table4for:zero timeout after 0 ms.
> at
> org.apache.hadoop.hbase.master.TableLockManager$ZKTableLockManager$TableLockImpl.acquire(TableLockManager.java:282)
> at
> org.apache.hadoop.hbase.master.TestTableLockManager.testReapAllTableLocks(TestTableLockManager.java:283)
>
>
> See
> https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.3/lastCompletedBuild/jdk=latest1.8,label=Hadoop/testReport/org.apache.hadoop.hbase.master/TestTableLockManager/testReapAllTableLocks/
>
>
> Any input?
>
>
> St.Ack
>
>
>
> On Fri, Nov 20, 2015 at 6:05 AM, Apache Jenkins Server <
> jenkins@builds.apache.org> wrote:
>
> > See <
> >
> https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/385/changes
> > >
> >
> > Changes:
> >
> > [ramkrishna] HBASE-14840 Sink cluster reports data replication request as
> > success
> >
> > ------------------------------------------
> > [...truncated 45422 lines...]
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.filter.TestMultiRowRangeFilter
> > Running org.apache.hadoop.hbase.filter.TestFilterWithScanLimits
> > Running org.apache.hadoop.hbase.filter.TestScanRowPrefix
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.666 sec
> > - in org.apache.hadoop.hbase.filter.TestFilterWithScanLimits
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.TestGlobalMemStoreSize
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.957 sec
> > - in org.apache.hadoop.hbase.filter.TestScanRowPrefix
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster
> > Running org.apache.hadoop.hbase.filter.TestFilterWrapper
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.025 sec
> > - in org.apache.hadoop.hbase.filter.TestFilterWrapper
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.174
> > sec - in org.apache.hadoop.hbase.filter.TestMultiRowRangeFilter
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.128
> sec
> > - in org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.384
> sec
> > - in org.apache.hadoop.hbase.TestGlobalMemStoreSize
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.TestNamespace
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.migration.TestUpgradeTo96
> > Running org.apache.hadoop.hbase.replication.TestReplicationSource
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.507 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationSource
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.647 sec
> > - in org.apache.hadoop.hbase.migration.TestUpgradeTo96
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.migration.TestNamespaceUpgrade
> > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.149
> sec
> > - in org.apache.hadoop.hbase.TestNamespace
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestPerTableCFReplication
> > Running org.apache.hadoop.hbase.replication.TestReplicationWithTags
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.519 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationWithTags
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.647
> sec
> > - in org.apache.hadoop.hbase.migration.TestNamespaceUpgrade
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication
> > Running
> >
> org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers
> > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.463
> sec
> > - in org.apache.hadoop.hbase.replication.TestPerTableCFReplication
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.467 sec
> > - in
> >
> org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestMasterReplication
> > Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.841
> sec
> > - in org.apache.hadoop.hbase.replication.TestMultiSlaveReplication
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS
> > Running
> >
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationWALReaderManager
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.34 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.584
> > sec - in org.apache.hadoop.hbase.replication.TestReplicationSmallTests
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running
> >
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster
> > Running
> >
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager
> > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.106 sec
> > - in
> >
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running
> > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink
> > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 233.352
> > sec - in org.apache.hadoop.hbase.filter.TestFuzzyRowFilterEndToEnd
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.923 sec
> > - in org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.75 sec
> > - in
> >
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 106.63
> sec
> > - in org.apache.hadoop.hbase.replication.TestMasterReplication
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running
> >
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint
> > Running
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationKillMasterRSCompressedWithMultipleWAL
> > Running
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationEndpointWithMultipleWAL
> > Running
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationSyncUpToolWithMultipleWAL
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.609
> sec
> > - in
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationKillMasterRSCompressedWithMultipleWAL
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.697
> sec
> > - in
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationEndpointWithMultipleWAL
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl
> > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.331 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestReplicationEndpoint
> > Running org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool
> > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.642 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationEndpoint
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.946
> sec
> > - in
> >
> org.apache.hadoop.hbase.replication.multiwal.TestReplicationSyncUpToolWithMultipleWAL
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl
> > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.508 sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.202
> > sec - in
> >
> org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > Running org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS
> > Running
> > org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed
> > Running
> > org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.259
> sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.211
> sec
> > - in org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.13 sec
> > - in
> > org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed
> > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 233.131
> > sec - in
> >
> org.apache.hadoop.hbase.replication.regionserver.TestReplicationWALReaderManager
> > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.571
> sec
> > - in
> org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer
> >
> > Results :
> >
> > Tests in error:
> >
> >
> org.apache.hadoop.hbase.master.TestTableLockManager.testReapAllTableLocks(org.apache.hadoop.hbase.master.TestTableLockManager)
> > Run 1: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout
> > Timed out acquiri...
> > Run 2: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout
> > Timed out acquiri...
> > Run 3: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout
> > Timed out acquiri...
> >
> >
> > Tests run: 2395, Failures: 0, Errors: 1, Skipped: 39
> >
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Apache HBase ...................................... SUCCESS
> > [57.514s]
> > [INFO] Apache HBase - Checkstyle ......................... SUCCESS
> [4.781s]
> > [INFO] Apache HBase - Resource Bundle .................... SUCCESS
> [0.166s]
> > [INFO] Apache HBase - Annotations ........................ SUCCESS
> [1.292s]
> > [INFO] Apache HBase - Protocol ........................... SUCCESS
> > [18.335s]
> > [INFO] Apache HBase - Common ............................. SUCCESS
> > [2:08.375s]
> > [INFO] Apache HBase - Procedure .......................... SUCCESS
> > [2:38.599s]
> > [INFO] Apache HBase - Client ............................. SUCCESS
> > [1:20.977s]
> > [INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS
> [8.319s]
> > [INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS
> [8.133s]
> > [INFO] Apache HBase - Prefix Tree ........................ SUCCESS
> [8.530s]
> > [INFO] Apache HBase - Server ............................. FAILURE
> > [1:33:07.573s]
> > [INFO] Apache HBase - Testing Util ....................... SKIPPED
> > [INFO] Apache HBase - Thrift ............................. SKIPPED
> > [INFO] Apache HBase - Rest ............................... SKIPPED
> > [INFO] Apache HBase - Shell .............................. SKIPPED
> > [INFO] Apache HBase - Integration Tests .................. SKIPPED
> > [INFO] Apache HBase - Examples ........................... SKIPPED
> > [INFO] Apache HBase - External Block Cache ............... SKIPPED
> > [INFO] Apache HBase - Assembly ........................... SKIPPED
> > [INFO] Apache HBase - Shaded ............................. SKIPPED
> > [INFO] Apache HBase - Shaded - Client .................... SKIPPED
> > [INFO] Apache HBase - Shaded - Server .................... SKIPPED
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD FAILURE
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 1:41:24.229s
> > [INFO] Finished at: Fri Nov 20 14:03:15 UTC 2015
> > [INFO] Final Memory: 94M/667M
> > [INFO]
> > ------------------------------------------------------------------------
> > [ERROR] Failed to execute goal
> > org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test
> > (secondPartTestsExecution) on project hbase-server: There are test
> failures.
> > [ERROR]
> > [ERROR] Please refer to <
> >
> https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/ws/hbase-server/target/surefire-reports
> >
> > for the individual test results.
> > [ERROR] -> [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> > -e switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions,
> > please read the following articles:
> > [ERROR] [Help 1]
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> > [ERROR]
> > [ERROR] After correcting the problems, you can resume the build with the
> > command
> > [ERROR] mvn <goals> -rf :hbase-server
> > Build step 'Invoke top-level Maven targets' marked build as failure
> > Performing Post build task...
> > Match found for :.* : True
> > Logical operation result is TRUE
> > Running script : # Post-build task script. TODO: Check this in and have
> > all builds reference check-in.
> > pwd && ls
> > # NOTE!!!! The below code has been copied and pasted from
> > ./dev-tools/run-test.sh
> > # Do not change here without syncing there and vice-versa.
> > ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> > | wc -l`
> > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
> > echo "Suspicious java process found - waiting 30s to see if there are
> > just slow to stop"
> > sleep 30
> > ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e
> '-Dhbase.test'
> > | wc -l`
> > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
> > echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie
> > tests{color}, they should have been killed by surefire but survived"
> > jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> > jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f
> 1
> > | xargs -n 1 jstack
> > # Exit with error
> > exit 1
> > else
> > echo "We're ok: there is no zombie test, but some tests took some time
> > to stop"
> > fi
> > else
> > echo "We're ok: there is no zombie test"
> > fi
> > [Hadoop] $ /bin/bash -xe /tmp/hudson3916715209187251998.sh
> > + pwd
> > <https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/ws/>
> > + ls
> > bin
> > CHANGES.txt
> > conf
> > dev-support
> > hbase-annotations
> > hbase-assembly
> > hbase-checkstyle
> > hbase-client
> > hbase-common
> > hbase-examples
> > hbase-external-blockcache
> > hbase-hadoop2-compat
> > hbase-hadoop-compat
> > hbase-it
> > hbase-native-client
> > hbase-prefix-tree
> > hbase-procedure
> > hbase-protocol
> > hbase-resource-bundle
> > hbase-rest
> > hbase-server
> > hbase-shaded
> > hbase-shell
> > hbase-spark
> > hbase-testing-util
> > hbase-thrift
> > LICENSE.txt
> > NOTICE.txt
> > pom.xml
> > README.txt
> > src
> > target
> > ++ jps -v
> > ++ grep surefirebooter
> > ++ grep -e -Dhbase.test
> > ++ wc -l
> > + ZOMBIE_TESTS_COUNT=0
> > + [[ 0 != 0 ]]
> > + echo 'We'\''re ok: there is no zombie test'
> > We're ok: there is no zombie test
> > POST BUILD TASK : SUCCESS
> > END OF POST BUILD TASK : 0
> > Archiving artifacts
> > Recording test results
> >
>