You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Sangjin Lee (JIRA)" <ji...@apache.org> on 2016/07/14 16:33:20 UTC
[jira] [Commented] (YARN-5379) TestHBaseTimelineStorage.
testWriteApplicationToHBase() fails intermittently
[ https://issues.apache.org/jira/browse/YARN-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377239#comment-15377239 ]
Sangjin Lee commented on YARN-5379:
-----------------------------------
I saw it once yesterday with YARN-5364. Then this morning I saw another with the trunk build report: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/94/
I don't believe this is related to tests running concurrently.
> TestHBaseTimelineStorage. testWriteApplicationToHBase() fails intermittently
> ----------------------------------------------------------------------------
>
> Key: YARN-5379
> URL: https://issues.apache.org/jira/browse/YARN-5379
> Project: Hadoop YARN
> Issue Type: Bug
> Components: test, timelineserver
> Affects Versions: 3.0.0-alpha1
> Reporter: Sangjin Lee
> Priority: Minor
>
> The {{TestHBaseTimelineStorage. testWriteApplicationToHBase()}} test seems to fail intermittently:
> {noformat}
> java.lang.AssertionError: null
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at org.apache.hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorage.testWriteApplicationToHBase(TestHBaseTimelineStorage.java:817)
> {noformat}
> The stdout output:
> {noformat}
> 2016-07-13 00:15:48,883 INFO [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=hconnection-0x2b7962a2 connecting to ZooKeeper ensemble=localhost:53474
> 2016-07-13 00:15:48,883 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=localhost:53474 sessionTimeout=90000 watcher=hconnection-0x2b7962a20x0, quorum=localhost:53474, baseZNode=/hbase
> 2016-07-13 00:15:48,886 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server localhost/127.0.0.1:53474. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-13 00:15:48,887 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to localhost/127.0.0.1:53474, initiating session
> 2016-07-13 00:15:48,887 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxnFactory (NIOServerCnxnFactory.java:run(197)) - Accepted socket connection from /127.0.0.1:38097
> 2016-07-13 00:15:48,887 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.ZooKeeperServer (ZooKeeperServer.java:processConnectRequest(868)) - Client attempting to establish new session at /127.0.0.1:38097
> 2016-07-13 00:15:48,896 INFO [SyncThread:0] server.ZooKeeperServer (ZooKeeperServer.java:finishSessionInit(617)) - Established session 0x155e19baa520025 with negotiated timeout 40000 for client /127.0.0.1:38097
> 2016-07-13 00:15:48,896 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server localhost/127.0.0.1:53474, sessionid = 0x155e19baa520025, negotiated timeout = 40000
> 2016-07-13 00:15:48,911 INFO [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=hconnection-0x32130e61 connecting to ZooKeeper ensemble=localhost:53474
> 2016-07-13 00:15:48,912 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=localhost:53474 sessionTimeout=90000 watcher=hconnection-0x32130e610x0, quorum=localhost:53474, baseZNode=/hbase
> 2016-07-13 00:15:48,917 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server localhost/127.0.0.1:53474. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-13 00:15:48,918 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxnFactory (NIOServerCnxnFactory.java:run(197)) - Accepted socket connection from /127.0.0.1:38098
> 2016-07-13 00:15:48,921 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to localhost/127.0.0.1:53474, initiating session
> 2016-07-13 00:15:48,921 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.ZooKeeperServer (ZooKeeperServer.java:processConnectRequest(868)) - Client attempting to establish new session at /127.0.0.1:38098
> 2016-07-13 00:15:48,929 INFO [SyncThread:0] server.ZooKeeperServer (ZooKeeperServer.java:finishSessionInit(617)) - Established session 0x155e19baa520026 with negotiated timeout 40000 for client /127.0.0.1:38098
> 2016-07-13 00:15:48,929 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server localhost/127.0.0.1:53474, sessionid = 0x155e19baa520026, negotiated timeout = 40000
> 2016-07-13 00:15:48,938 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(541)) - closing the entity table
> 2016-07-13 00:15:48,938 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(546)) - closing the app_flow table
> 2016-07-13 00:15:48,938 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(551)) - closing the application table
> 2016-07-13 00:15:48,941 INFO [RpcServer.reader=1,bindAddress=2588a1932efe,port=37493] hbase.Server (RpcServer.java:processConnectionHeader(1678)) - Connection from 172.17.0.3 port: 35467 with version info: version: "1.1.3" url: "git://diocles.local/Volumes/hbase-1.1.3RC1/hbase" revision: "72bc50f5fafeb105b2139e42bbee3d61ca724989" user: "ndimiduk" date: "Sat Jan 16 18:31:39 PST 2016" src_checksum: "72c910d76fba182fa4e3c7e048275ca3"
> 2016-07-13 00:15:48,950 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(555)) - closing the flow run table
> 2016-07-13 00:15:48,957 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(560)) - closing the flowActivityTable table
> 2016-07-13 00:15:48,957 INFO [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(565)) - closing the hbase Connection
> 2016-07-13 00:15:48,958 INFO [main] client.ConnectionManager$HConnectionImplementation (ConnectionManager.java:closeZooKeeperWatcher(1677)) - Closing zookeeper sessionid=0x155e19baa520026
> 2016-07-13 00:15:48,958 INFO [ProcessThread(sid:0 cport:-1):] server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest2Txn(494)) - Processed session termination for sessionid: 0x155e19baa520026
> 2016-07-13 00:15:48,968 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x155e19baa520026 closed
> 2016-07-13 00:15:48,968 INFO [main-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down
> 2016-07-13 00:15:48,968 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1007)) - Closed socket connection for client /127.0.0.1:38098 which had sessionid 0x155e19baa520026
> 2016-07-13 00:15:48,979 INFO [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=hconnection-0x4596f8f3 connecting to ZooKeeper ensemble=localhost:53474
> 2016-07-13 00:15:48,979 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=localhost:53474 sessionTimeout=90000 watcher=hconnection-0x4596f8f30x0, quorum=localhost:53474, baseZNode=/hbase
> 2016-07-13 00:15:48,980 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server localhost/127.0.0.1:53474. Will not attempt to authenticate using SASL (unknown error)
> 2016-07-13 00:15:48,981 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to localhost/127.0.0.1:53474, initiating session
> 2016-07-13 00:15:48,981 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxnFactory (NIOServerCnxnFactory.java:run(197)) - Accepted socket connection from /127.0.0.1:38100
> 2016-07-13 00:15:48,981 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.ZooKeeperServer (ZooKeeperServer.java:processConnectRequest(868)) - Client attempting to establish new session at /127.0.0.1:38100
> 2016-07-13 00:15:48,987 INFO [SyncThread:0] server.ZooKeeperServer (ZooKeeperServer.java:finishSessionInit(617)) - Established session 0x155e19baa520027 with negotiated timeout 40000 for client /127.0.0.1:38100
> 2016-07-13 00:15:48,988 INFO [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server localhost/127.0.0.1:53474, sessionid = 0x155e19baa520027, negotiated timeout = 40000
> 2016-07-13 00:15:48,992 INFO [RpcServer.reader=2,bindAddress=2588a1932efe,port=37493] hbase.Server (RpcServer.java:processConnectionHeader(1678)) - Connection from 172.17.0.3 port: 35470 with version info: version: "1.1.3" url: "git://diocles.local/Volumes/hbase-1.1.3RC1/hbase" revision: "72bc50f5fafeb105b2139e42bbee3d61ca724989" user: "ndimiduk" date: "Sat Jan 16 18:31:39 PST 2016" src_checksum: "72c910d76fba182fa4e3c7e048275ca3"
> 2016-07-13 00:15:49,001 INFO [RpcServer.reader=3,bindAddress=2588a1932efe,port=37493] hbase.Server (RpcServer.java:processConnectionHeader(1678)) - Connection from 172.17.0.3 port: 35472 with version info: version: "1.1.3" url: "git://diocles.local/Volumes/hbase-1.1.3RC1/hbase" revision: "72bc50f5fafeb105b2139e42bbee3d61ca724989" user: "ndimiduk" date: "Sat Jan 16 18:31:39 PST 2016" src_checksum: "72c910d76fba182fa4e3c7e048275ca3"
> 2016-07-13 00:15:49,010 INFO [main] storage.HBaseTimelineReaderImpl (HBaseTimelineReaderImpl.java:serviceStop(64)) - closing the hbase Connection
> 2016-07-13 00:15:49,010 INFO [main] client.ConnectionManager$HConnectionImplementation (ConnectionManager.java:closeZooKeeperWatcher(1677)) - Closing zookeeper sessionid=0x155e19baa520025
> 2016-07-13 00:15:49,011 INFO [ProcessThread(sid:0 cport:-1):] server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest2Txn(494)) - Processed session termination for sessionid: 0x155e19baa520025
> 2016-07-13 00:15:49,021 INFO [main] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x155e19baa520025 closed
> 2016-07-13 00:15:49,021 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1007)) - Closed socket connection for client /127.0.0.1:38097 which had sessionid 0x155e19baa520025
> 2016-07-13 00:15:49,021 INFO [main-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org