Build failed in Jenkins: HBase-1.3 » latest1.7,yahoo-not-h2 #606

[Apache Jenkins Server <je...@builds.apache.org>]

See <https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=yahoo-not-h2/606/changes>

Changes:

[eclark] HBASE-15441 Fix WAL splitting when region has moved multiple times

[antonov] HBASE-15390 Unnecessary MetaCache evictions cause elevated number of

[eclark] HBASE-15470 Add a setting for Priority queue length

------------------------------------------
[...truncated 46212 lines...]
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 796.845 sec - in org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 99.493 sec - in org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders
Running org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.66 sec - in org.apache.hadoop.hbase.io.encoding.TestBufferedDataBlockEncoder
Running org.apache.hadoop.hbase.io.encoding.TestChangingEncoding
Running org.apache.hadoop.hbase.io.TestFileLink
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 810.525 sec - in org.apache.hadoop.hbase.snapshot.TestExportSnapshot
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.521 sec - in org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.913 sec - in org.apache.hadoop.hbase.io.TestFileLink
Running org.apache.hadoop.hbase.wal.TestWALFactory
Running org.apache.hadoop.hbase.wal.TestWALFiltering
Running org.apache.hadoop.hbase.wal.TestWALReaderOnSecureWAL
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.744 sec - in org.apache.hadoop.hbase.wal.TestWALReaderOnSecureWAL
Running org.apache.hadoop.hbase.wal.TestDefaultWALProvider
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.156 sec - in org.apache.hadoop.hbase.wal.TestWALFactory
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.856 sec - in org.apache.hadoop.hbase.wal.TestDefaultWALProvider
Running org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingStrategy
Running org.apache.hadoop.hbase.wal.TestSecureWAL
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.952 sec - in org.apache.hadoop.hbase.wal.TestSecureWAL
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.224 sec - in org.apache.hadoop.hbase.wal.TestWALFiltering
Running org.apache.hadoop.hbase.wal.TestDefaultWALProviderWithHLogKey
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.719 sec - in org.apache.hadoop.hbase.wal.TestDefaultWALProviderWithHLogKey
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.857 sec - in org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingStrategy
Running org.apache.hadoop.hbase.zookeeper.TestZKLeaderManager
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.405 sec - in org.apache.hadoop.hbase.zookeeper.TestZKLeaderManager
Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperACL
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.856 sec - in org.apache.hadoop.hbase.zookeeper.TestZooKeeperACL
Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperNodeTracker
Running org.apache.hadoop.hbase.zookeeper.TestRecoverableZooKeeper
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.993 sec - in org.apache.hadoop.hbase.zookeeper.TestZooKeeperNodeTracker
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.663 sec - in org.apache.hadoop.hbase.zookeeper.TestRecoverableZooKeeper
Running org.apache.hadoop.hbase.zookeeper.TestZKTableStateManager
Running org.apache.hadoop.hbase.zookeeper.lock.TestZKInterProcessReadWriteLock
Running org.apache.hadoop.hbase.zookeeper.TestZKMulti
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.528 sec - in org.apache.hadoop.hbase.zookeeper.TestZKTableStateManager
Running org.apache.hadoop.hbase.zookeeper.TestHQuorumPeer
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.768 sec - in org.apache.hadoop.hbase.zookeeper.TestHQuorumPeer
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.29 sec - in org.apache.hadoop.hbase.zookeeper.TestZKMulti
Running org.apache.hadoop.hbase.TestIOFencing
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.598 sec - in org.apache.hadoop.hbase.zookeeper.lock.TestZKInterProcessReadWriteLock
Running org.apache.hadoop.hbase.constraint.TestConstraint
Running org.apache.hadoop.hbase.TestMovedRegionsCleaner
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.594 sec - in org.apache.hadoop.hbase.TestMovedRegionsCleaner
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 257.705 sec - in org.apache.hadoop.hbase.io.encoding.TestEncodedSeekers
Running org.apache.hadoop.hbase.backup.example.TestZooKeeperTableArchiveClient
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.614 sec - in org.apache.hadoop.hbase.constraint.TestConstraint
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.094 sec - in org.apache.hadoop.hbase.backup.example.TestZooKeeperTableArchiveClient
Running org.apache.hadoop.hbase.ipc.TestProtoBufRpc
Running org.apache.hadoop.hbase.backup.TestHFileArchiving
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.573 sec - in org.apache.hadoop.hbase.ipc.TestProtoBufRpc
Running org.apache.hadoop.hbase.ipc.TestHBaseClient
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.686 sec - in org.apache.hadoop.hbase.ipc.TestHBaseClient
Running org.apache.hadoop.hbase.TestHColumnDescriptorDefaultVersions
Running org.apache.hadoop.hbase.TestNamespace
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 251.192 sec - in org.apache.hadoop.hbase.io.encoding.TestChangingEncoding
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.088 sec - in org.apache.hadoop.hbase.TestHColumnDescriptorDefaultVersions
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 78.916 sec - in org.apache.hadoop.hbase.backup.TestHFileArchiving
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.958 sec - in org.apache.hadoop.hbase.TestNamespace

Results :

Failed tests: 
org.apache.hadoop.hbase.regionserver.TestCorruptedRegionStoreFile.testLosingFileAfterScannerInit(org.apache.hadoop.hbase.regionserver.TestCorruptedRegionStoreFile)
  Run 1: TestCorruptedRegionStoreFile.testLosingFileAfterScannerInit:186 expected one file lost: rowCount=621 lostRows=19379
  Run 2: TestCorruptedRegionStoreFile.testLosingFileAfterScannerInit:186 expected one file lost: rowCount=2062 lostRows=17938

org.apache.hadoop.hbase.regionserver.TestCorruptedRegionStoreFile.testLosingFileDuringScan(org.apache.hadoop.hbase.regionserver.TestCorruptedRegionStoreFile)
  Run 1: TestCorruptedRegionStoreFile.testLosingFileDuringScan:160 expected one file lost: rowCount=12062 lostRows=7938
  Run 2: TestCorruptedRegionStoreFile.testLosingFileDuringScan:160 expected one file lost: rowCount=4062 lostRows=15938

org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed.testFullSystemBubblesFSErrors(org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed)
  Run 1: TestFSErrorsExposed.testFullSystemBubblesFSErrors:212 Did not fail to count after removing data
  Run 2: TestFSErrorsExposed.testFullSystemBubblesFSErrors:212 Did not fail to count after removing data
  Run 3: TestFSErrorsExposed.testFullSystemBubblesFSErrors:212 Did not fail to count after removing data

org.apache.hadoop.hbase.regionserver.TestScannerRetriableFailure.testFaultyScanner(org.apache.hadoop.hbase.regionserver.TestScannerRetriableFailure)
  Run 1: TestScannerRetriableFailure.testFaultyScanner:117->checkTableRows:155 null
  Run 2: TestScannerRetriableFailure.testFaultyScanner:117->checkTableRows:155 null
  Run 3: TestScannerRetriableFailure.testFaultyScanner:117->checkTableRows:155 null

  TestVisibilityLabelsWithACL.setupBeforeClass:103 Waiting timed out after [10,000] msec
Tests in error: 
org.apache.hadoop.hbase.TestZooKeeper.testLogSplittingAfterMasterRecoveryDueToZKExpiry(org.apache.hadoop.hbase.TestZooKeeper)
  Run 1: TestZooKeeper.testLogSplittingAfterMasterRecoveryDueToZKExpiry:574 » TestTimedOut
  Run 2: TestZooKeeper.testLogSplittingAfterMasterRecoveryDueToZKExpiry:566 » TableNotFound
  Run 3: TestZooKeeper.testLogSplittingAfterMasterRecoveryDueToZKExpiry:566 » TableNotFound

  TestHCM.testOperationTimeout:315 » TestTimedOut test timed out after 10 minute...
  TestMultiParallel.testBatchWithPut:343->Object.wait:-2 » TestTimedOut test tim...
  TestMultiParallel.testFlushCommitsWithAbort:257->doTestFlushCommits:293->Object.wait:-2 » TestTimedOut
  TestScannerTimeout.test2772:149->Object.wait:461->Object.wait:-2 » TestTimedOut
  TestScannerTimeout.test3686a:191->Object.wait:461->Object.wait:-2 » TestTimedOut
org.apache.hadoop.hbase.regionserver.TestPerColumnFamilyFlush.testLogReplayWithDistributedLogSplit(org.apache.hadoop.hbase.regionserver.TestPerColumnFamilyFlush)
  Run 1: TestPerColumnFamilyFlush.testLogReplayWithDistributedLogSplit:431->doTestLogReplay:406->verifyEdit:116 » TestTimedOut
  Run 2: TestPerColumnFamilyFlush.testLogReplayWithDistributedLogSplit:431->doTestLogReplay:342 » IllegalState
  Run 3: TestPerColumnFamilyFlush.testLogReplayWithDistributedLogSplit:431->doTestLogReplay:406->verifyEdit:116 » TestTimedOut

  TestRegionReplicaFailover.testLotsOfRegionReplicas:368->Object.wait:503->Object.wait:-2 » TestTimedOut
  TestRegionReplicaFailover.testPrimaryRegionKill:199->verifyNumericRowsWithTimeout:213->Object.wait:503->Object.wait:-2 » TestTimedOut
  TestRegionReplicaFailover.testSecondaryRegionKillWhilePrimaryIsAcceptingWrites:334->verifyNumericRowsWithTimeout:213->Object.wait:503->Object.wait:-2 » TestTimedOut
  TestRegionReplicaFailover.testSecondaryRegionWithNonEmptyRegion:165->Object.wait:503->Object.wait:-2 » TestTimedOut
Flaked tests: 
org.apache.hadoop.hbase.TestFullLogReconstruction.testReconstruction(org.apache.hadoop.hbase.TestFullLogReconstruction)
  Run 1: TestFullLogReconstruction.testReconstruction:107 expected:<17576> but was:<4921>
  Run 2: TestFullLogReconstruction.testReconstruction:107 expected:<17576> but was:<11951>
  Run 3: PASS

org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster.testShouldFailSplitIfZNodeDoesNotExistDueToPrevRollBack(org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster)
  Run 1: TestSplitTransactionOnCluster.testShouldFailSplitIfZNodeDoesNotExistDueToPrevRollBack:220 not able to find a splittable region
  Run 2: PASS

org.apache.hadoop.hbase.regionserver.wal.TestSecureWALReplay.testReplayEditsAfterRegionMovedWithMultiCF(org.apache.hadoop.hbase.regionserver.wal.TestSecureWALReplay)
  Run 1: TestSecureWALReplay>TestWALReplay.testReplayEditsAfterRegionMovedWithMultiCF:258 » TableNotFound
  Run 2: PASS


Tests run: 2447, Failures: 5, Errors: 11, Skipped: 42, Flakes: 3

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache HBase ...................................... SUCCESS [50.742s]
[INFO] Apache HBase - Checkstyle ......................... SUCCESS [5.116s]
[INFO] Apache HBase - Resource Bundle .................... SUCCESS [0.218s]
[INFO] Apache HBase - Annotations ........................ SUCCESS [1.171s]
[INFO] Apache HBase - Protocol ........................... SUCCESS [17.443s]
[INFO] Apache HBase - Common ............................. SUCCESS [2:57.093s]
[INFO] Apache HBase - Procedure .......................... SUCCESS [4:32.933s]
[INFO] Apache HBase - Client ............................. SUCCESS [2:23.395s]
[INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS [13.953s]
[INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS [22.392s]
[INFO] Apache HBase - Prefix Tree ........................ SUCCESS [26.871s]
[INFO] Apache HBase - Server ............................. FAILURE [3:12:55.797s]
[INFO] Apache HBase - Testing Util ....................... SKIPPED
[INFO] Apache HBase - Thrift ............................. SKIPPED
[INFO] Apache HBase - Rest ............................... SKIPPED
[INFO] Apache HBase - Shell .............................. SKIPPED
[INFO] Apache HBase - Integration Tests .................. SKIPPED
[INFO] Apache HBase - Examples ........................... SKIPPED
[INFO] Apache HBase - External Block Cache ............... SKIPPED
[INFO] Apache HBase - Assembly ........................... SKIPPED
[INFO] Apache HBase - Shaded ............................. SKIPPED
[INFO] Apache HBase - Shaded - Client .................... SKIPPED
[INFO] Apache HBase - Shaded - Server .................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3:25:25.538s
[INFO] Finished at: Thu Mar 17 06:08:46 UTC 2016
[INFO] Final Memory: 467M/783M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (secondPartTestsExecution) on project hbase-server: ExecutionException: java.lang.RuntimeException: There was an error in the forked process
[ERROR] java.lang.ArrayIndexOutOfBoundsException: 1
[ERROR] at org.apache.maven.surefire.common.junit4.JUnit4ProviderUtil.generateFailingTests(JUnit4ProviderUtil.java:64)
[ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:151)
[ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
[ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
[ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hbase-server
Build step 'Invoke top-level Maven targets' marked build as failure
Performing Post build task...
Match found for :.* : True
Logical operation result is TRUE
Running script  : # Post-build task script. TODO: Check this in and have all builds reference check-in.
pwd && ls
# NOTE!!!! The below code has been copied and pasted from ./dev-tools/run-test.sh
# Do not change here without syncing there and vice-versa.
ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' | wc -l`
if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
 echo "Suspicious java process found - waiting 30s to see if there are just slow to stop"
 sleep 30
 ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' | wc -l`
 if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
   echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie tests{color}, they should have been killed by surefire but survived"
   jps -v | grep surefirebooter | grep -e '-Dhbase.test'
   jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f 1 | xargs -n 1 jstack
   # Exit with error
   exit 1
 else
   echo "We're ok: there is no zombie test, but some tests took some time to stop"
 fi
else
  echo "We're ok: there is no zombie test"
fi
[yahoo-not-h2] $ /bin/bash -xe /tmp/hudson3249007959719988122.sh
+ pwd
<https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=yahoo-not-h2/ws/>
+ ls
bin
CHANGES.txt
conf
dev-support
hbase-annotations
hbase-assembly
hbase-checkstyle
hbase-client
hbase-common
hbase-examples
hbase-external-blockcache
hbase-hadoop2-compat
hbase-hadoop-compat
hbase-it
hbase-native-client
hbase-prefix-tree
hbase-procedure
hbase-protocol
hbase-resource-bundle
hbase-rest
hbase-server
hbase-shaded
hbase-shell
hbase-testing-util
hbase-thrift
LICENSE.txt
NOTICE.txt
pom.xml
README.txt
src
target
++ wc -l
++ jps -v
++ grep -e -Dhbase.test
++ grep surefirebooter
+ ZOMBIE_TESTS_COUNT=6
+ [[ 6 != 0 ]]
+ echo 'Suspicious java process found - waiting 30s to see if there are just slow to stop'
Suspicious java process found - waiting 30s to see if there are just slow to stop
+ sleep 30
++ jps -v
++ grep surefirebooter
++ grep -e -Dhbase.test
++ wc -l
+ ZOMBIE_TESTS_COUNT=0
+ [[ 0 != 0 ]]
+ echo 'We'\''re ok: there is no zombie test, but some tests took some time to stop'
We're ok: there is no zombie test, but some tests took some time to stop
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Archiving artifacts
Recording test results

Jenkins build is back to normal : HBase-1.3 » latest1.7,yahoo-not-h2 #607

[Apache Jenkins Server <je...@builds.apache.org>]

See <https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=yahoo-not-h2/607/changes>