Re: Build failed in Jenkins: HBase-1.3 » latest1.7,Hadoop #385

[Stack <st...@duboce.net>]

This is another incidence of HBASE-14734 TestGenerateDelegationToken fails
with BindAddress clash I posted on issue a question about making the
incidence less likely.

St.Ack

On Fri, Nov 20, 2015 at 6:40 AM, Apache Jenkins Server <
jenkins@builds.apache.org> wrote:

> See <
> https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/385/changes
> >
>
> Changes:
>
> [ramkrishna] HBASE-14840 Sink cluster reports data replication request as
> success
>
> ------------------------------------------
> [...truncated 43954 lines...]
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 211.926
> sec - in org.apache.hadoop.hbase.mapreduce.TestMultiTableSnapshotInputFormat
> Running
> org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort
> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.685 sec
> - in org.apache.hadoop.hbase.coprocessor.TestMasterObserver
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.445 sec
> - in
> org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort
> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass
> Running
> org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorEndpoint
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.461 sec
> - in org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorEndpoint
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.958 sec
> - in org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass
> Running
> org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
> Running
> org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove
> Tests run: 14, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 109.924
> sec - in org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.444 sec
> - in
> org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.91 sec
> - in org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
> Running org.apache.hadoop.hbase.coprocessor.TestRegionServerObserver
> Running org.apache.hadoop.hbase.coprocessor.TestDoubleColumnInterpreter
> Running org.apache.hadoop.hbase.coprocessor.TestWALObserver
> Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.328 sec
> - in org.apache.hadoop.hbase.coprocessor.TestDoubleColumnInterpreter
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.696 sec
> - in org.apache.hadoop.hbase.coprocessor.TestWALObserver
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.125 sec
> - in org.apache.hadoop.hbase.coprocessor.TestRegionServerObserver
> Running
> org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort
> Running org.apache.hadoop.hbase.coprocessor.TestOpenTableInCoprocessor
> Running org.apache.hadoop.hbase.coprocessor.TestBatchCoprocessorEndpoint
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.163 sec
> - in org.apache.hadoop.hbase.coprocessor.TestBatchCoprocessorEndpoint
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.856 sec
> - in
> org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort
> Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorStop
> Running org.apache.hadoop.hbase.coprocessor.TestClassLoading
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.608 sec
> - in org.apache.hadoop.hbase.coprocessor.TestOpenTableInCoprocessor
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.888 sec
> - in org.apache.hadoop.hbase.coprocessor.TestCoprocessorStop
> Running org.apache.hadoop.hbase.TestLocalHBaseCluster
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 377.273
> sec - in org.apache.hadoop.hbase.mapreduce.TestImportTSVWithVisibilityLabels
> Running org.apache.hadoop.hbase.TestNamespace
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.605 sec
> - in org.apache.hadoop.hbase.TestLocalHBaseCluster
> Running org.apache.hadoop.hbase.TestMultiVersions
> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.152 sec
> - in org.apache.hadoop.hbase.coprocessor.TestClassLoading
> Running org.apache.hadoop.hbase.TestMetaTableAccessor
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.89 sec
> - in org.apache.hadoop.hbase.TestMultiVersions
> Running org.apache.hadoop.hbase.TestMetaTableLocator
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 596.777
> sec - in org.apache.hadoop.hbase.mapreduce.TestImportExport
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.945 sec
> - in org.apache.hadoop.hbase.TestMetaTableLocator
> Running org.apache.hadoop.hbase.trace.TestHTraceHooks
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.251 sec
> - in org.apache.hadoop.hbase.trace.TestHTraceHooks
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.713
> sec - in org.apache.hadoop.hbase.TestMetaTableAccessor
> Running org.apache.hadoop.hbase.snapshot.TestRestoreFlushSnapshotFromClient
> Running org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.405 sec
> - in org.apache.hadoop.hbase.TestNamespace
> Running org.apache.hadoop.hbase.snapshot.TestSnapshotClientRetries
> Running org.apache.hadoop.hbase.snapshot.TestExportSnapshot
> Running org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.548 sec
> - in org.apache.hadoop.hbase.snapshot.TestSnapshotClientRetries
> Running org.apache.hadoop.hbase.snapshot.TestSnapshotDescriptionUtils
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.405 sec
> - in org.apache.hadoop.hbase.snapshot.TestSnapshotDescriptionUtils
> Running org.apache.hadoop.hbase.TestMetaMigrationConvertingToPB
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.356 sec
> - in org.apache.hadoop.hbase.TestMetaMigrationConvertingToPB
> Running org.apache.hadoop.hbase.TestMovedRegionsCleaner
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.904 sec
> - in org.apache.hadoop.hbase.TestMovedRegionsCleaner
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 116.8 sec
> - in org.apache.hadoop.hbase.snapshot.TestRestoreFlushSnapshotFromClient
> Running org.apache.hadoop.hbase.quotas.TestQuotaTableUtil
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.081 sec
> - in org.apache.hadoop.hbase.quotas.TestQuotaTableUtil
> Running org.apache.hadoop.hbase.quotas.TestQuotaAdmin
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.516 sec
> - in org.apache.hadoop.hbase.quotas.TestQuotaAdmin
> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 144.532
> sec - in org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient
> Running org.apache.hadoop.hbase.util.TestIdLock
> Running org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel
> Running org.apache.hadoop.hbase.quotas.TestQuotaThrottle
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.774 sec
> - in org.apache.hadoop.hbase.util.TestIdLock
> Running org.apache.hadoop.hbase.util.TestHBaseFsck
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.666
> sec - in org.apache.hadoop.hbase.quotas.TestQuotaThrottle
> Running org.apache.hadoop.hbase.util.TestMergeTable
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 93.175 sec
> - in org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel
> Running org.apache.hadoop.hbase.util.TestFSTableDescriptors
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.248 sec
> - in org.apache.hadoop.hbase.util.TestFSTableDescriptors
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.311 sec
> - in org.apache.hadoop.hbase.util.TestMergeTable
> Running org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential
> Running org.apache.hadoop.hbase.util.TestConnectionCache
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.725 sec
> - in org.apache.hadoop.hbase.util.TestConnectionCache
> Running org.apache.hadoop.hbase.util.TestDefaultEnvironmentEdge
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.707 sec
> - in org.apache.hadoop.hbase.util.TestDefaultEnvironmentEdge
> Running org.apache.hadoop.hbase.util.TestFSVisitor
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.75 sec -
> in org.apache.hadoop.hbase.util.TestFSVisitor
> Running org.apache.hadoop.hbase.util.TestTableName
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.839 sec
> - in org.apache.hadoop.hbase.util.TestTableName
> Running org.apache.hadoop.hbase.util.TestHBaseFsckEncryption
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.501 sec
> - in org.apache.hadoop.hbase.util.TestHBaseFsckEncryption
> Running org.apache.hadoop.hbase.util.TestFSHDFSUtils
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.044 sec
> - in org.apache.hadoop.hbase.util.TestFSHDFSUtils
> Running org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.72 sec
> - in org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential
> Running org.apache.hadoop.hbase.util.TestIdReadWriteLock
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.99 sec
> - in org.apache.hadoop.hbase.util.TestIdReadWriteLock
> Running org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildOverlap
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.468 sec
> - in org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildOverlap
> Running org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildBase
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 99.068 sec
> - in org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded
> Running org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildHole
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.192 sec
> - in org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildBase
> Running org.apache.hadoop.hbase.util.TestMergeTool
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.541 sec
> - in org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildHole
> Running org.apache.hadoop.hbase.util.TestFSUtils
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.741 sec
> - in org.apache.hadoop.hbase.util.TestMergeTool
> Running org.apache.hadoop.hbase.util.TestCoprocessorScanPolicy
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.274
> sec - in org.apache.hadoop.hbase.util.TestFSUtils
> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 482.646
> sec - in org.apache.hadoop.hbase.snapshot.TestExportSnapshot
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.649 sec
> - in org.apache.hadoop.hbase.util.TestCoprocessorScanPolicy
> Running org.apache.hadoop.hbase.util.TestRegionSplitter
> Running org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingStrategy
> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 495.21 sec
> - in org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot
>
> Results :
>
> Tests in error:
>
> org.apache.hadoop.hbase.security.token.TestGenerateDelegationToken.org.apache.hadoop.hbase.security.token.TestGenerateDelegationToken
>   Run 1:
> TestGenerateDelegationToken.org.apache.hadoop.hbase.security.token.TestGenerateDelegationToken
> » Bind
>   Run 2: TestGenerateDelegationToken.tearDown:137 NullPointer
>
>
> Tests run: 2265, Failures: 0, Errors: 1, Skipped: 38
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache HBase ...................................... SUCCESS
> [1:03.293s]
> [INFO] Apache HBase - Checkstyle ......................... SUCCESS [5.750s]
> [INFO] Apache HBase - Resource Bundle .................... SUCCESS [0.332s]
> [INFO] Apache HBase - Annotations ........................ SUCCESS [1.467s]
> [INFO] Apache HBase - Protocol ........................... SUCCESS
> [21.477s]
> [INFO] Apache HBase - Common ............................. SUCCESS
> [2:31.679s]
> [INFO] Apache HBase - Procedure .......................... SUCCESS
> [2:49.471s]
> [INFO] Apache HBase - Client ............................. SUCCESS
> [1:37.488s]
> [INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS [9.190s]
> [INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS
> [11.441s]
> [INFO] Apache HBase - Prefix Tree ........................ SUCCESS
> [14.103s]
> [INFO] Apache HBase - Server ............................. FAILURE
> [2:06:37.217s]
> [INFO] Apache HBase - Testing Util ....................... SKIPPED
> [INFO] Apache HBase - Thrift ............................. SKIPPED
> [INFO] Apache HBase - Rest ............................... SKIPPED
> [INFO] Apache HBase - Shell .............................. SKIPPED
> [INFO] Apache HBase - Integration Tests .................. SKIPPED
> [INFO] Apache HBase - Examples ........................... SKIPPED
> [INFO] Apache HBase - External Block Cache ............... SKIPPED
> [INFO] Apache HBase - Assembly ........................... SKIPPED
> [INFO] Apache HBase - Shaded ............................. SKIPPED
> [INFO] Apache HBase - Shaded - Client .................... SKIPPED
> [INFO] Apache HBase - Shaded - Server .................... SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 2:16:07.307s
> [INFO] Finished at: Fri Nov 20 14:38:03 UTC 2015
> [INFO] Final Memory: 463M/622M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test
> (secondPartTestsExecution) on project hbase-server: ExecutionException:
> java.lang.RuntimeException: There was an error in the forked process
> [ERROR] java.lang.ArrayIndexOutOfBoundsException: 1
> [ERROR] at
> org.apache.maven.surefire.common.junit4.JUnit4ProviderUtil.generateFailingTests(JUnit4ProviderUtil.java:64)
> [ERROR] at
> org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:151)
> [ERROR] at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
> [ERROR] at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
> [ERROR] at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hbase-server
> Build step 'Invoke top-level Maven targets' marked build as failure
> Performing Post build task...
> Match found for :.* : True
> Logical operation result is TRUE
> Running script  : # Post-build task script. TODO: Check this in and have
> all builds reference check-in.
> pwd && ls
> # NOTE!!!! The below code has been copied and pasted from
> ./dev-tools/run-test.sh
> # Do not change here without syncing there and vice-versa.
> ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> | wc -l`
> if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
>  echo "Suspicious java process found - waiting 30s to see if there are
> just slow to stop"
>  sleep 30
>  ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> | wc -l`
>  if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
>    echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie
> tests{color}, they should have been killed by surefire but survived"
>    jps -v | grep surefirebooter | grep -e '-Dhbase.test'
>    jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f 1
> | xargs -n 1 jstack
>    # Exit with error
>    exit 1
>  else
>    echo "We're ok: there is no zombie test, but some tests took some time
> to stop"
>  fi
> else
>   echo "We're ok: there is no zombie test"
> fi
> [Hadoop] $ /bin/bash -xe /tmp/hudson356565872009225533.sh
> + pwd
> <https://builds.apache.org/job/HBase-1.3/jdk=latest1.7,label=Hadoop/ws/>
> + ls
> bin
> CHANGES.txt
> conf
> dev-support
> hbase-annotations
> hbase-assembly
> hbase-checkstyle
> hbase-client
> hbase-common
> hbase-examples
> hbase-external-blockcache
> hbase-hadoop2-compat
> hbase-hadoop-compat
> hbase-it
> hbase-native-client
> hbase-prefix-tree
> hbase-procedure
> hbase-protocol
> hbase-resource-bundle
> hbase-rest
> hbase-server
> hbase-shaded
> hbase-shell
> hbase-spark
> hbase-testing-util
> hbase-thrift
> LICENSE.txt
> NOTICE.txt
> pom.xml
> README.txt
> src
> target
> ++ jps -v
> ++ grep surefirebooter
> ++ grep -e -Dhbase.test
> ++ wc -l
> + ZOMBIE_TESTS_COUNT=3
> + [[ 3 != 0 ]]
> + echo 'Suspicious java process found - waiting 30s to see if there are
> just slow to stop'
> Suspicious java process found - waiting 30s to see if there are just slow
> to stop
> + sleep 30
> ++ jps -v
> ++ grep surefirebooter
> ++ wc -l
> ++ grep -e -Dhbase.test
> + ZOMBIE_TESTS_COUNT=0
> + [[ 0 != 0 ]]
> + echo 'We'\''re ok: there is no zombie test, but some tests took some
> time to stop'
> We're ok: there is no zombie test, but some tests took some time to stop
> POST BUILD TASK : SUCCESS
> END OF POST BUILD TASK : 0
> Archiving artifacts
> Recording test results
>