You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2015/11/15 01:57:10 UTC
[jira] [Commented] (HBASE-14814) HDFS UI port clashes cause test
fails
[ https://issues.apache.org/jira/browse/HBASE-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005690#comment-15005690 ]
stack commented on HBASE-14814:
-------------------------------
Here is how it looks on fail:
{code}
Error Message
Port in use: localhost:0
Stacktrace
java.net.BindException: Port in use: localhost:0
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:885)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:826)
at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:693)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:583)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:751)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:735)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1407)
at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:998)
at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:869)
at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:704)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:642)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:577)
at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:533)
at org.apache.hadoop.hbase.util.TestFSUtils.testIsHDFS(TestFSUtils.java:111)
{code}
Here is rest of log:
{code}
015-11-14 21:09:09,080 ERROR [main] hdfs.MiniDFSCluster(709): IOE creating namenodes. Permissions dump:
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc/dfs/data':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc/dfs/data
permissions: ----
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc/dfs':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc/dfs
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2':
absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2
permissions: drwx
path '/home/jenkins/jenkins-slave/workspace':
absolute:/home/jenkins/jenkins-slave/workspace
permissions: drwx
path '/home/jenkins/jenkins-slave':
absolute:/home/jenkins/jenkins-slave
permissions: drwx
path '/home/jenkins':
absolute:/home/jenkins
permissions: drwx
path '/home':
absolute:/home
permissions: dr-x
path '/':
absolute:/
permissions: dr-x
{code}
It caused 76 tests to fail in a 1.2 run:
{code}
Test Result (76 failures / +76)
org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster.testOveralyOnOtherCluster
org.apache.hadoop.hbase.TestMetaTableAccessor.org.apache.hadoop.hbase.TestMetaTableAccessor
org.apache.hadoop.hbase.TestNamespace.org.apache.hadoop.hbase.TestNamespace
TEST-org.apache.hadoop.hbase.TestZooKeeper.xml.<init>
org.apache.hadoop.hbase.client.TestAdmin2.org.apache.hadoop.hbase.client.TestAdmin2
org.apache.hadoop.hbase.client.TestCheckAndMutate.org.apache.hadoop.hbase.client.TestCheckAndMutate
org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout.org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout
org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient.org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient
org.apache.hadoop.hbase.client.TestCloneSnapshotFromClientWithRegionReplicas.org.apache.hadoop.hbase.client.TestCloneSnapshotFromClientWithRegionReplicas
org.apache.hadoop.hbase.client.TestFromClientSide.org.apache.hadoop.hbase.client.TestFromClientSide
org.apache.hadoop.hbase.client.TestFromClientSide3.org.apache.hadoop.hbase.client.TestFromClientSide3
org.apache.hadoop.hbase.client.TestFromClientSideNoCodec.org.apache.hadoop.hbase.client.TestFromClientSideNoCodec
org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor.org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor
org.apache.hadoop.hbase.client.TestHCM.org.apache.hadoop.hbase.client.TestHCM
org.apache.hadoop.hbase.client.TestHTableMultiplexer.org.apache.hadoop.hbase.client.TestHTableMultiplexer
org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool.org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool
org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool.org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool
org.apache.hadoop.hbase.client.TestMetaScanner.testConcurrentMetaScannerAndCatalogJanitor
org.apache.hadoop.hbase.client.TestMetaScanner.testMetaScanner
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testHBaseFsckWithFewerMetaReplicaZnodes
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testShutdownHandling
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testMetaHTDReplicaCount
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testChangingReplicaCount
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testMetaAddressChange
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testHBaseFsckWithMetaReplicas
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testHBaseFsckWithExcessMetaReplicas
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testHBaseFsckWithFewerMetaReplicas
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testMetaLookupThreadPoolCreated
org.apache.hadoop.hbase.client.TestPutWithDelete.org.apache.hadoop.hbase.client.TestPutWithDelete
TEST-org.apache.hadoop.hbase.client.TestReplicaWithCluster.xml.<init>
org.apache.hadoop.hbase.client.TestReplicasClient.org.apache.hadoop.hbase.client.TestReplicasClient
org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient.org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient
org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClientWithRegionReplicas.org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClientWithRegionReplicas
org.apache.hadoop.hbase.client.TestRpcControllerFactory.org.apache.hadoop.hbase.client.TestRpcControllerFactory
org.apache.hadoop.hbase.client.TestScannerTimeout.org.apache.hadoop.hbase.client.TestScannerTimeout
org.apache.hadoop.hbase.client.TestScannersFromClientSide.org.apache.hadoop.hbase.client.TestScannersFromClientSide
org.apache.hadoop.hbase.client.TestSnapshotFromClient.org.apache.hadoop.hbase.client.TestSnapshotFromClient
org.apache.hadoop.hbase.client.TestSnapshotFromClientWithRegionReplicas.org.apache.hadoop.hbase.client.TestSnapshotFromClientWithRegionReplicas
org.apache.hadoop.hbase.client.TestSnapshotMetadata.org.apache.hadoop.hbase.client.TestSnapshotMetadata
org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testWithMultiRegion
org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testWithSingleRegion
org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testWithOfflineHBaseMultiRegion
org.apache.hadoop.hbase.client.TestTimestampsFilter.org.apache.hadoop.hbase.client.TestTimestampsFilter
org.apache.hadoop.hbase.client.replication.TestReplicationAdminWithClusters.org.apache.hadoop.hbase.client.replication.TestReplicationAdminWithClusters
org.apache.hadoop.hbase.filter.TestFilterWithScanLimits.org.apache.hadoop.hbase.filter.TestFilterWithScanLimits
org.apache.hadoop.hbase.filter.TestFuzzyRowAndColumnRangeFilter.org.apache.hadoop.hbase.filter.TestFuzzyRowAndColumnRangeFilter
org.apache.hadoop.hbase.filter.TestFuzzyRowFilterEndToEnd.org.apache.hadoop.hbase.filter.TestFuzzyRowFilterEndToEnd
org.apache.hadoop.hbase.io.TestFileLink.testHDFSLinkReadDuringDelete
org.apache.hadoop.hbase.io.TestFileLink.testHDFSLinkReadDuringRename
org.apache.hadoop.hbase.util.TestConnectionCache.testConnectionChore
org.apache.hadoop.hbase.util.TestCoprocessorScanPolicy.org.apache.hadoop.hbase.util.TestCoprocessorScanPolicy
org.apache.hadoop.hbase.util.TestFSUtils.testcomputeHDFSBlocksDistribution
org.apache.hadoop.hbase.util.TestFSUtils.testSetStoragePolicyValidButMaybeNotPresent
org.apache.hadoop.hbase.util.TestFSUtils.testIsHDFS
org.apache.hadoop.hbase.util.TestFSUtils.testSetStoragePolicyDefault
org.apache.hadoop.hbase.util.TestFSUtils.testSetStoragePolicyInvalid
org.apache.hadoop.hbase.util.TestMergeTool.testMergeTool
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[0]
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[1]
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[2]
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[3]
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[4]
org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel.loadTest[2]
org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel.loadTest[3]
org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[0]
org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[1]
org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[2]
org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[3]
org.apache.hadoop.hbase.util.TestRegionSplitter.org.apache.hadoop.hbase.util.TestRegionSplitter
org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildBase.testMetaRebuild
org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildOverlap.testMetaRebuildOverlapFail
org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingProvider.org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingProvider
org.apache.hadoop.hbase.wal.TestDefaultWALProvider.org.apache.hadoop.hbase.wal.TestDefaultWALProvider
org.apache.hadoop.hbase.wal.TestDefaultWALProviderWithHLogKey.org.apache.hadoop.hbase.wal.TestDefaultWALProviderWithHLogKey
org.apache.hadoop.hbase.wal.TestWALFactory.org.apache.hadoop.hbase.wal.TestWALFactory
org.apache.hadoop.hbase.wal.TestWALFiltering.testFlushedSequenceIdsSentToHMaster
{code}
Here....https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.2/370/#showFailuresLink
I could try and choose random ports for UI if not done already to make this happen less often.
> HDFS UI port clashes cause test fails
> -------------------------------------
>
> Key: HBASE-14814
> URL: https://issues.apache.org/jira/browse/HBASE-14814
> Project: HBase
> Issue Type: Sub-task
> Components: flakey, test
> Reporter: stack
> Assignee: stack
>
> In test runs, HDFS UI can clash when concurrent test runs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)