You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Stack <st...@duboce.net> on 2015/11/15 01:57:40 UTC

Re: Build failed in Jenkins: HBase-1.2 » latest1.8,Hadoop #370

This is our NN UI clashing ports with a concurrent test run. You can't turn
off HDFS UI ports. Need to fix. Also need to choose random ports if not
done already.

I filed HBASE-14814

St.Ack

On Sat, Nov 14, 2015 at 1:28 PM, Apache Jenkins Server <
jenkins@builds.apache.org> wrote:

> See <
> https://builds.apache.org/job/HBase-1.2/jdk=latest1.8,label=Hadoop/370/changes
> >
>
> Changes:
>
> [stack] HBASE-14798 NPE reporting server load causes regionserver abort;
> causes
>
> ------------------------------------------
> [...truncated 52852 lines...]
>   Run 2: TestFileLink.testHDFSLinkReadDuringDelete:190 » Bind Problem
> binding to [local...
>   Run 3: TestFileLink.testHDFSLinkReadDuringDelete:190 » Bind Problem
> binding to [local...
>
>
> org.apache.hadoop.hbase.io.TestFileLink.testHDFSLinkReadDuringRename(org.apache.hadoop.hbase.io.TestFileLink)
>   Run 1: TestFileLink.testHDFSLinkReadDuringRename:95 » Bind Problem
> binding to [localh...
>   Run 2: TestFileLink.testHDFSLinkReadDuringRename:95 » Bind Problem
> binding to [localh...
>   Run 3: TestFileLink.testHDFSLinkReadDuringRename:95 » Bind Problem
> binding to [localh...
>
>
> org.apache.hadoop.hbase.util.TestConnectionCache.testConnectionChore(org.apache.hadoop.hbase.util.TestConnectionCache)
>   Run 1: TestConnectionCache.testConnectionChore:37 » Bind Problem binding
> to [localhos...
>   Run 2: TestConnectionCache.testConnectionChore:37 » IllegalState A
> mini-cluster is al...
>   Run 3: TestConnectionCache.testConnectionChore:37 » IllegalState A
> mini-cluster is al...
>
>   TestCoprocessorScanPolicy.setUpBeforeClass:87 » Bind Problem binding to
> [local...
>
> org.apache.hadoop.hbase.util.TestFSUtils.testIsHDFS(org.apache.hadoop.hbase.util.TestFSUtils)
>   Run 1: TestFSUtils.testIsHDFS:111 » Bind Port in use: localhost:0
>   Run 2: TestFSUtils.testIsHDFS:111 » Bind Problem binding to
> [localhost:0] java.net.Bi...
>   Run 3: TestFSUtils.testIsHDFS:111 » Bind Problem binding to
> [localhost:0] java.net.Bi...
>
>
> org.apache.hadoop.hbase.util.TestFSUtils.testSetStoragePolicyDefault(org.apache.hadoop.hbase.util.TestFSUtils)
>   Run 1:
> TestFSUtils.testSetStoragePolicyDefault:369->verifyFileInDirWithStoragePolicy:346
> » Bind
>   Run 2:
> TestFSUtils.testSetStoragePolicyDefault:369->verifyFileInDirWithStoragePolicy:346
> » Bind
>   Run 3:
> TestFSUtils.testSetStoragePolicyDefault:369->verifyFileInDirWithStoragePolicy:346
> » Bind
>
>
> org.apache.hadoop.hbase.util.TestFSUtils.testSetStoragePolicyInvalid(org.apache.hadoop.hbase.util.TestFSUtils)
>   Run 1:
> TestFSUtils.testSetStoragePolicyInvalid:381->verifyFileInDirWithStoragePolicy:346
> » Bind
>   Run 2:
> TestFSUtils.testSetStoragePolicyInvalid:381->verifyFileInDirWithStoragePolicy:346
> » Bind
>   Run 3:
> TestFSUtils.testSetStoragePolicyInvalid:381->verifyFileInDirWithStoragePolicy:346
> » Bind
>
>
> org.apache.hadoop.hbase.util.TestFSUtils.testSetStoragePolicyValidButMaybeNotPresent(org.apache.hadoop.hbase.util.TestFSUtils)
>   Run 1:
> TestFSUtils.testSetStoragePolicyValidButMaybeNotPresent:375->verifyFileInDirWithStoragePolicy:346
> » Bind
>   Run 2:
> TestFSUtils.testSetStoragePolicyValidButMaybeNotPresent:375->verifyFileInDirWithStoragePolicy:346
> » Bind
>   Run 3:
> TestFSUtils.testSetStoragePolicyValidButMaybeNotPresent:375->verifyFileInDirWithStoragePolicy:346
> » Bind
>
>
> org.apache.hadoop.hbase.util.TestFSUtils.testcomputeHDFSBlocksDistribution(org.apache.hadoop.hbase.util.TestFSUtils)
>   Run 1: TestFSUtils.testcomputeHDFSBlocksDistribution:137 » Bind Problem
> binding to [l...
>   Run 2: TestFSUtils.testcomputeHDFSBlocksDistribution:137 » Bind Problem
> binding to [l...
>   Run 3: TestFSUtils.testcomputeHDFSBlocksDistribution:137 » Bind Problem
> binding to [l...
>
>
> org.apache.hadoop.hbase.util.TestMergeTool.testMergeTool(org.apache.hadoop.hbase.util.TestMergeTool)
>   Run 1: TestMergeTool.setUp:134 » Bind Problem binding to [localhost:0]
> java.net.BindE...
>   Run 2: TestMergeTool.setUp:134 » Bind Problem binding to [localhost:0]
> java.net.BindE...
>   Run 3: TestMergeTool.setUp:134 » Bind Problem binding to [localhost:0]
> java.net.BindE...
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[0](org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded)
>   Run 1:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Prob...
>   Run 2:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>   Run 3:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[1](org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded)
>   Run 1:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>   Run 2:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>   Run 3:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[2](org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded)
>   Run 1:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>   Run 2:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>   Run 3:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[3](org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded)
>   Run 1:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>   Run 2:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>   Run 3:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[4](org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded)
>   Run 1:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>   Run 2:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>   Run 3:
> TestMiniClusterLoadEncoded>TestMiniClusterLoadSequential.setUp:104 » Bind
> Port...
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel.loadTest[2](org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel)
>   Run 1:
> TestMiniClusterLoadParallel>TestMiniClusterLoadSequential.setUp:104 » Bind
> Pro...
>   Run 2:
> TestMiniClusterLoadParallel>TestMiniClusterLoadSequential.setUp:104 » Bind
> Pro...
>   Run 3:
> TestMiniClusterLoadParallel>TestMiniClusterLoadSequential.setUp:104 » Bind
> Por...
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel.loadTest[3](org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel)
>   Run 1:
> TestMiniClusterLoadParallel>TestMiniClusterLoadSequential.setUp:104 » Bind
> Pro...
>   Run 2:
> TestMiniClusterLoadParallel>TestMiniClusterLoadSequential.setUp:104 » Bind
> Por...
>   Run 3:
> TestMiniClusterLoadParallel>TestMiniClusterLoadSequential.setUp:104 » Bind
> Pro...
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[0](org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential)
>   Run 1: TestMiniClusterLoadSequential.setUp:104 » Bind Problem binding to
> [localhost:0...
>   Run 2: TestMiniClusterLoadSequential.setUp:104 » Bind Port in use:
> localhost:0
>   Run 3: TestMiniClusterLoadSequential.setUp:104 » Bind Port in use:
> localhost:0
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[1](org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential)
>   Run 1: TestMiniClusterLoadSequential.setUp:104 » Bind Port in use:
> localhost:0
>   Run 2: TestMiniClusterLoadSequential.setUp:104 » Bind Port in use:
> localhost:0
>   Run 3: TestMiniClusterLoadSequential.setUp:104 » Bind Problem binding to
> [localhost:0...
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[2](org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential)
>   Run 1: TestMiniClusterLoadSequential.setUp:104 » Bind Port in use:
> localhost:0
>   Run 2: TestMiniClusterLoadSequential.setUp:104 » Bind Port in use:
> localhost:0
>   Run 3: TestMiniClusterLoadSequential.setUp:104 » Bind Problem binding to
> [localhost:0...
>
>
> org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[3](org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential)
>   Run 1: TestMiniClusterLoadSequential.setUp:104 » Bind Port in use:
> localhost:0
>   Run 2: TestMiniClusterLoadSequential.setUp:104 » Bind Port in use:
> localhost:0
>   Run 3: TestMiniClusterLoadSequential.setUp:104 » Bind Problem binding to
> [localhost:0...
>
>   TestRegionSplitter.setup:62 » Bind Port in use: localhost:0
>
> org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildBase.testMetaRebuild(org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildBase)
>   Run 1:
> TestOfflineMetaRebuildBase>OfflineMetaRebuildTestCore.setUpBefore:97 » Bind
> Po...
>   Run 2:
> TestOfflineMetaRebuildBase>OfflineMetaRebuildTestCore.tearDownAfter:121 »
> NullPointer
>   Run 3:
> TestOfflineMetaRebuildBase>OfflineMetaRebuildTestCore.setUpBefore:97 » Bind
> Pr...
>   Run 4:
> TestOfflineMetaRebuildBase>OfflineMetaRebuildTestCore.tearDownAfter:121 »
> NullPointer
>   Run 5:
> TestOfflineMetaRebuildBase>OfflineMetaRebuildTestCore.setUpBefore:97 » Bind
> Po...
>   Run 6:
> TestOfflineMetaRebuildBase>OfflineMetaRebuildTestCore.tearDownAfter:121 »
> NullPointer
>
>
> org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildOverlap.testMetaRebuildOverlapFail(org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildOverlap)
>   Run 1:
> TestOfflineMetaRebuildOverlap>OfflineMetaRebuildTestCore.setUpBefore:97 »
> Bind
>   Run 2:
> TestOfflineMetaRebuildOverlap>OfflineMetaRebuildTestCore.tearDownAfter:121
> » NullPointer
>   Run 3:
> TestOfflineMetaRebuildOverlap>OfflineMetaRebuildTestCore.setUpBefore:97 »
> Bind
>   Run 4:
> TestOfflineMetaRebuildOverlap>OfflineMetaRebuildTestCore.tearDownAfter:121
> » NullPointer
>   Run 5:
> TestOfflineMetaRebuildOverlap>OfflineMetaRebuildTestCore.setUpBefore:97 »
> Bind
>   Run 6:
> TestOfflineMetaRebuildOverlap>OfflineMetaRebuildTestCore.tearDownAfter:121
> » NullPointer
>
>   TestBoundedRegionGroupingProvider.setUpBeforeClass:89 » Bind Problem
> binding t...
>   TestDefaultWALProvider.setUpBeforeClass:104 » Bind Problem binding to
> [localho...
>
> TestDefaultWALProviderWithHLogKey>TestDefaultWALProvider.setUpBeforeClass:104
> » Bind
>   TestWALFactory.setUpBeforeClass:139 » Bind Port in use: localhost:0
>
> org.apache.hadoop.hbase.wal.TestWALFiltering.testFlushedSequenceIdsSentToHMaster(org.apache.hadoop.hbase.wal.TestWALFiltering)
>   Run 1: TestWALFiltering.setUp:65 » Bind Port in use: localhost:0
>   Run 2: TestWALFiltering.setUp:65 » Bind Problem binding to [localhost:0]
> java.net.Bin...
>   Run 3: TestWALFiltering.setUp:65 » Bind Problem binding to [localhost:0]
> java.net.Bin...
>
> Flaked tests:
>
> org.apache.hadoop.hbase.client.TestMetaWithReplicas.testZookeeperNodesForReplicas(org.apache.hadoop.hbase.client.TestMetaWithReplicas)
>   Run 1: TestMetaWithReplicas.setup:89 » Bind Problem binding to
> [localhost:0] java.net...
>   Run 2: PASS
>
>
> Tests run: 1973, Failures: 0, Errors: 77, Skipped: 28, Flakes: 1
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache HBase ...................................... SUCCESS
> [1:07.983s]
> [INFO] Apache HBase - Checkstyle ......................... SUCCESS [5.457s]
> [INFO] Apache HBase - Resource Bundle .................... SUCCESS [0.238s]
> [INFO] Apache HBase - Annotations ........................ SUCCESS [1.164s]
> [INFO] Apache HBase - Protocol ........................... SUCCESS
> [21.031s]
> [INFO] Apache HBase - Common ............................. SUCCESS
> [2:37.880s]
> [INFO] Apache HBase - Procedure .......................... SUCCESS
> [2:36.933s]
> [INFO] Apache HBase - Client ............................. SUCCESS
> [1:24.327s]
> [INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS
> [11.533s]
> [INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS [7.730s]
> [INFO] Apache HBase - Prefix Tree ........................ SUCCESS [7.484s]
> [INFO] Apache HBase - Server ............................. FAILURE
> [1:24:53.569s]
> [INFO] Apache HBase - Testing Util ....................... SKIPPED
> [INFO] Apache HBase - Thrift ............................. SKIPPED
> [INFO] Apache HBase - Rest ............................... SKIPPED
> [INFO] Apache HBase - Shell .............................. SKIPPED
> [INFO] Apache HBase - Integration Tests .................. SKIPPED
> [INFO] Apache HBase - Examples ........................... SKIPPED
> [INFO] Apache HBase - External Block Cache ............... SKIPPED
> [INFO] Apache HBase - Assembly ........................... SKIPPED
> [INFO] Apache HBase - Shaded ............................. SKIPPED
> [INFO] Apache HBase - Shaded - Client .................... SKIPPED
> [INFO] Apache HBase - Shaded - Server .................... SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 1:33:54.781s
> [INFO] Finished at: Sat Nov 14 21:25:00 UTC 2015
> [INFO] Final Memory: 94M/766M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test
> (secondPartTestsExecution) on project hbase-server: ExecutionException:
> java.lang.RuntimeException: java.lang.RuntimeException:
> org.apache.maven.surefire.report.ReporterException: When writing xml report
> stdout/stderr: /tmp/stderr3254704887034230359deferred (No such file or
> directory) -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hbase-server
> Build step 'Invoke top-level Maven targets' marked build as failure
> Performing Post build task...
> Match found for :.* : True
> Logical operation result is TRUE
> Running script  : # Post-build task script. TODO: Check this in and have
> all builds reference check-in.
> pwd && ls
> # NOTE!!!! The below code has been copied and pasted from
> ./dev-tools/run-test.sh
> # Do not change here without syncing there and vice-versa.
> ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> | wc -l`
> if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
>  echo "Suspicious java process found - waiting 30s to see if there are
> just slow to stop"
>  sleep 30
>  ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test'
> | wc -l`
>  if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
>    echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie
> tests{color}, they should have been killed by surefire but survived"
>    jps -v | grep surefirebooter | grep -e '-Dhbase.test'
>    jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f 1
> | xargs -n 1 jstack
>    # Exit with error
>    exit 1
>  else
>    echo "We're ok: there is no zombie test, but some tests took some time
> to stop"
>  fi
> else
>   echo "We're ok: there is no zombie test"
> fi
> [Hadoop] $ /bin/bash -xe /tmp/hudson533007773005313934.sh
> + pwd
> <https://builds.apache.org/job/HBase-1.2/jdk=latest1.8,label=Hadoop/ws/>
> + ls
> bin
> CHANGES.txt
> conf
> dev-support
> hbase-annotations
> hbase-assembly
> hbase-checkstyle
> hbase-client
> hbase-common
> hbase-examples
> hbase-external-blockcache
> hbase-hadoop2-compat
> hbase-hadoop-compat
> hbase-it
> hbase-native-client
> hbase-prefix-tree
> hbase-procedure
> hbase-protocol
> hbase-resource-bundle
> hbase-rest
> hbase-server
> hbase-shaded
> hbase-shell
> hbase-spark
> hbase-testing-util
> hbase-thrift
> LICENSE.txt
> NOTICE.txt
> pom.xml
> README.txt
> src
> target
> ++ jps -v
> ++ grep surefirebooter
> ++ wc -l
> ++ grep -e -Dhbase.test
> + ZOMBIE_TESTS_COUNT=0
> + [[ 0 != 0 ]]
> + echo 'We'\''re ok: there is no zombie test'
> We're ok: there is no zombie test
> POST BUILD TASK : SUCCESS
> END OF POST BUILD TASK : 0
> Archiving artifacts
> Recording test results
>