You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/10 20:19:22 UTC

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build # 306 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/306/
Java: 64bit/jdk1.6.0 -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ClusterStateUpdateTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest:     1) Thread[id=5056, name=TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[DDFAE09FACC692E1]-EventThread, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:479)         at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:455)         at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)         at org.apache.solr.cloud.ZkController.register(ZkController.java:766)         at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)         at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)         at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)         at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest: 
   1) Thread[id=5056, name=TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[DDFAE09FACC692E1]-EventThread, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:479)
        at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:455)
        at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)
        at org.apache.solr.cloud.ZkController.register(ZkController.java:766)
        at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
        at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
        at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
        at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
	at __randomizedtesting.SeedInfo.seed([DDFAE09FACC692E1]:0)




Build Log:
[...truncated 8572 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ClusterStateUpdateTest
[junit4:junit4]   2> 4 T5043 oas.SolrTestCaseJ4.setUp ###Starting testCoreRegistration
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426
[junit4:junit4]   2> 5 T5043 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6 T5044 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 7 T5044 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 7 T5044 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 7 T5044 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 8 T5044 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 8 T5044 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 107 T5043 oasc.ZkTestServer.run start zk server on port:50804
[junit4:junit4]   2> 107 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a09d9d1
[junit4:junit4]   2> 108 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 109 T5049 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 111 T5049 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 111 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50805
[junit4:junit4]   2> 112 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50805
[junit4:junit4]   2> 113 T5047 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 118 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca770000 with negotiated timeout 10000 for client /127.0.0.1:50805
[junit4:junit4]   2> 118 T5049 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca770000, negotiated timeout = 10000
[junit4:junit4]   2> 120 T5050 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a09d9d1 name:ZooKeeperConnection Watcher:127.0.0.1:50804 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 121 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 122 T5043 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 129 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca770000
[junit4:junit4]   2> 133 T5050 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 132 T5043 oaz.ZooKeeper.close Session: 0x13d55b2ca770000 closed
[junit4:junit4]   2> 144 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50805 which had sessionid 0x13d55b2ca770000
[junit4:junit4]   2> 144 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@45c0aeec
[junit4:junit4]   2> 147 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 148 T5051 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 151 T5051 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 153 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50806
[junit4:junit4]   2> 155 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50806
[junit4:junit4]   2> 158 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca770001 with negotiated timeout 10000 for client /127.0.0.1:50806
[junit4:junit4]   2> 158 T5051 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca770001, negotiated timeout = 10000
[junit4:junit4]   2> 160 T5052 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45c0aeec name:ZooKeeperConnection Watcher:127.0.0.1:50804/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 160 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 162 T5043 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 175 T5043 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 187 T5043 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 196 T5043 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 201 T5043 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 202 T5043 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 210 T5043 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 212 T5043 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 217 T5043 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 218 T5043 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 224 T5043 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 224 T5043 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 238 T5043 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 239 T5043 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 247 T5043 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 250 T5043 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 262 T5043 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 263 T5043 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 268 T5043 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 269 T5043 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 274 T5043 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 275 T5043 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 280 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca770001
[junit4:junit4]   2> 281 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50806 which had sessionid 0x13d55b2ca770001
[junit4:junit4]   2> 281 T5043 oaz.ZooKeeper.close Session: 0x13d55b2ca770001 closed
[junit4:junit4]   2> 281 T5052 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 282 T5043 oasc.ClusterStateUpdateTest.setUp ####SETUP_START testCoreRegistration
[junit4:junit4]   2> 285 T5043 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 285 T5043 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 285 T5043 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 286 T5043 oasc.CoreContainer.<init> New CoreContainer 1808408537
[junit4:junit4]   2> 287 T5043 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 287 T5043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 327 T5043 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 328 T5043 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 328 T5043 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 329 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 329 T5043 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 329 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 330 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 330 T5043 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 331 T5043 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 331 T5043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 363 T5043 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 383 T5043 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50804/solr
[junit4:junit4]   2> 384 T5043 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 384 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@214c0f5c
[junit4:junit4]   2> 386 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 386 T5053 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 387 T5053 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 388 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50807
[junit4:junit4]   2> 388 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50807
[junit4:junit4]   2> 390 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca770002 with negotiated timeout 20000 for client /127.0.0.1:50807
[junit4:junit4]   2> 390 T5053 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca770002, negotiated timeout = 20000
[junit4:junit4]   2> 390 T5054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@214c0f5c name:ZooKeeperConnection Watcher:127.0.0.1:50804 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 390 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 392 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca770002
[junit4:junit4]   2> 393 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50807 which had sessionid 0x13d55b2ca770002
[junit4:junit4]   2> 394 T5054 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 393 T5043 oaz.ZooKeeper.close Session: 0x13d55b2ca770002 closed
[junit4:junit4]   2> 394 T5043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 402 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@71e82846
[junit4:junit4]   2> 403 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 403 T5055 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 404 T5055 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 405 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50808
[junit4:junit4]   2> 405 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50808
[junit4:junit4]   2> 406 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca770003 with negotiated timeout 3000 for client /127.0.0.1:50808
[junit4:junit4]   2> 407 T5055 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca770003, negotiated timeout = 3000
[junit4:junit4]   2> 407 T5056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71e82846 name:ZooKeeperConnection Watcher:127.0.0.1:50804/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 407 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 410 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 413 T5043 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 416 T5043 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 417 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1661_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 417 T5043 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 423 T5043 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 431 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 432 T5043 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 436 T5043 oasc.Overseer.start Overseer (id=89321794006614019-127.0.0.1:1661_solr-n_0000000000) starting
[junit4:junit4]   2> 437 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 439 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 441 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 443 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 445 T5058 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 446 T5043 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 453 T5043 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 456 T5043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 463 T5057 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 465 T5059 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 465 T5059 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 466 T5059 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 467 T5059 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 469 T5059 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 470 T5059 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 471 T5059 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 551 T5059 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 648 T5059 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 650 T5059 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 674 T5059 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1481 T5059 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1491 T5059 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1495 T5059 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1516 T5059 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1521 T5059 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1526 T5059 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1528 T5059 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1528 T5059 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1528 T5059 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1530 T5059 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1530 T5059 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1530 T5059 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data1/
[junit4:junit4]   2> 1531 T5059 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b784427
[junit4:junit4]   2> 1531 T5059 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1532 T5059 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data1 forceNew: false
[junit4:junit4]   2> 1533 T5059 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data1/index/
[junit4:junit4]   2> 1533 T5059 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1533 T5059 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data1/index forceNew: false
[junit4:junit4]   2> 1536 T5059 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1a2521c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5160e707)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1536 T5059 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1537 T5059 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1540 T5059 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1540 T5059 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1541 T5059 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1541 T5059 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1542 T5059 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1542 T5059 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1543 T5059 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1543 T5059 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1544 T5059 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1544 T5059 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1546 T5059 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1546 T5059 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1547 T5059 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1547 T5059 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1548 T5059 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1548 T5059 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1549 T5059 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1550 T5059 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1550 T5059 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1551 T5059 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1551 T5059 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1552 T5059 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1552 T5059 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1553 T5059 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1554 T5059 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1554 T5059 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1559 T5059 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1562 T5059 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1564 T5059 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1566 T5059 oass.SolrIndexSearcher.<init> Opening Searcher@5ec95863 main
[junit4:junit4]   2> 1567 T5059 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1567 T5059 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1568 T5059 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1574 T5059 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1605 T5060 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ec95863 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1623 T5059 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1623 T5059 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1624 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x56 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1976 T5057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1977 T5057 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 1977 T5057 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1978 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x5e zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1992 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2629 T5059 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2630 T5059 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1661/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 2632 T5059 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 2656 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:delete cxid:0x78 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 2658 T5059 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2660 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x79 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2667 T5059 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2667 T5059 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2668 T5059 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 2669 T5059 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 2684 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x83 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3505 T5057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3518 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3561 T5059 oasc.ZkController.register We are http://127.0.0.1:1661/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 3562 T5059 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 3562 T5059 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3563 T5059 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3566 T5059 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3568 T5043 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3568 T5043 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 3569 T5043 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 3569 T5043 oasc.CoreContainer.<init> New CoreContainer 1029956301
[junit4:junit4]   2> 3570 T5043 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 3570 T5043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 3614 T5043 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 3615 T5043 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3615 T5043 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3616 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3616 T5043 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3617 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3618 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3618 T5043 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3619 T5043 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3619 T5043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 3636 T5043 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3678 T5043 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50804/solr
[junit4:junit4]   2> 3679 T5043 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3679 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@54fafd93
[junit4:junit4]   2> 3681 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3681 T5062 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3683 T5062 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 3683 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50809
[junit4:junit4]   2> 3683 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50809
[junit4:junit4]   2> 3685 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca770004 with negotiated timeout 20000 for client /127.0.0.1:50809
[junit4:junit4]   2> 3685 T5062 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca770004, negotiated timeout = 20000
[junit4:junit4]   2> 3685 T5063 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54fafd93 name:ZooKeeperConnection Watcher:127.0.0.1:50804 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3686 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3687 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca770004
[junit4:junit4]   2> 3688 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50809 which had sessionid 0x13d55b2ca770004
[junit4:junit4]   2> 3688 T5063 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3688 T5043 oaz.ZooKeeper.close Session: 0x13d55b2ca770004 closed
[junit4:junit4]   2> 3689 T5043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 3697 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@142174e5
[junit4:junit4]   2> 3699 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3699 T5064 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3700 T5064 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 3701 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50810
[junit4:junit4]   2> 3701 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50810
[junit4:junit4]   2> 3703 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca770005 with negotiated timeout 3000 for client /127.0.0.1:50810
[junit4:junit4]   2> 3703 T5064 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca770005, negotiated timeout = 3000
[junit4:junit4]   2> 3703 T5065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@142174e5 name:ZooKeeperConnection Watcher:127.0.0.1:50804/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3704 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3705 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770005 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3707 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770005 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3711 T5043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4717 T5043 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 4719 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770005 type:delete cxid:0xb zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1662_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 4720 T5043 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 4724 T5056 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4725 T5065 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4725 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4733 T5066 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 4734 T5066 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4735 T5066 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4735 T5066 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4737 T5066 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 4738 T5066 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4738 T5066 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 4807 T5066 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 4896 T5066 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4898 T5066 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4904 T5066 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5028 T5057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5029 T5057 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 5035 T5065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5036 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5683 T5066 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5693 T5066 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5697 T5066 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5731 T5066 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5737 T5066 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5742 T5066 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5744 T5066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5745 T5066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5745 T5066 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5747 T5066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5747 T5066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5748 T5066 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data2/
[junit4:junit4]   2> 5748 T5066 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b784427
[junit4:junit4]   2> 5749 T5066 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5750 T5066 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data2 forceNew: false
[junit4:junit4]   2> 5750 T5066 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data2/index/
[junit4:junit4]   2> 5750 T5066 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5751 T5066 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data2/index forceNew: false
[junit4:junit4]   2> 5752 T5066 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d69f39e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3be29ce0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5753 T5066 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5754 T5066 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5757 T5066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5757 T5066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5757 T5066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5758 T5066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5759 T5066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5759 T5066 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5759 T5066 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5760 T5066 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5761 T5066 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5762 T5066 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5763 T5066 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5763 T5066 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5764 T5066 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5764 T5066 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5765 T5066 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5765 T5066 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5766 T5066 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5767 T5066 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5767 T5066 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5768 T5066 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5769 T5066 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5770 T5066 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5770 T5066 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5771 T5066 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5772 T5066 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5772 T5066 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5777 T5066 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5780 T5066 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5782 T5066 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5784 T5066 oass.SolrIndexSearcher.<init> Opening Searcher@35af867c main
[junit4:junit4]   2> 5784 T5066 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5785 T5066 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5786 T5066 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5791 T5066 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5825 T5067 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@35af867c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5832 T5066 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5832 T5066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6546 T5057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6547 T5057 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1662_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1662/solr"}
[junit4:junit4]   2> 6548 T5057 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 6548 T5057 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6556 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6556 T5065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6838 T5066 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6839 T5066 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1662/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 6843 T5066 oasc.ZkController.register We are http://127.0.0.1:1662/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 6843 T5066 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 6844 T5066 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6844 T5066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6846 T5066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6848 T5043 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6848 T5043 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 6848 T5043 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 6849 T5043 oasc.CoreContainer.<init> New CoreContainer 1943174115
[junit4:junit4]   2> 6849 T5043 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 6849 T5043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 6902 T5043 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 6903 T5043 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6903 T5043 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 6904 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6904 T5043 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6904 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6905 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6905 T5043 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6906 T5043 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6906 T5043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 6922 T5043 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6945 T5043 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50804/solr
[junit4:junit4]   2> 6946 T5043 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6946 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f7097aa
[junit4:junit4]   2> 6948 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6948 T5069 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6950 T5069 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 6950 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50811
[junit4:junit4]   2> 6951 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50811
[junit4:junit4]   2> 6952 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca770006 with negotiated timeout 20000 for client /127.0.0.1:50811
[junit4:junit4]   2> 6952 T5069 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca770006, negotiated timeout = 20000
[junit4:junit4]   2> 6953 T5070 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f7097aa name:ZooKeeperConnection Watcher:127.0.0.1:50804 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6953 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6955 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca770006
[junit4:junit4]   2> 6956 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50811 which had sessionid 0x13d55b2ca770006
[junit4:junit4]   2> 6956 T5043 oaz.ZooKeeper.close Session: 0x13d55b2ca770006 closed
[junit4:junit4]   2> 6956 T5070 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6956 T5043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 6965 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@3755c76
[junit4:junit4]   2> 6967 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6967 T5071 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6968 T5071 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 6969 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50812
[junit4:junit4]   2> 6969 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50812
[junit4:junit4]   2> 6971 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca770007 with negotiated timeout 3000 for client /127.0.0.1:50812
[junit4:junit4]   2> 6971 T5071 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca770007, negotiated timeout = 3000
[junit4:junit4]   2> 6971 T5072 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3755c76 name:ZooKeeperConnection Watcher:127.0.0.1:50804/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6972 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6973 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770007 type:create cxid:0x1 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6974 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770007 type:create cxid:0x2 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6978 T5043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7984 T5043 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 7985 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770007 type:delete cxid:0xb zxid:0x5e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1663_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 7986 T5043 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 7989 T5065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7990 T5072 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7990 T5056 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7990 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7992 T5065 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 8015 T5073 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 8015 T5073 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 8017 T5073 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 8017 T5073 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 8019 T5073 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 8020 T5073 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 8020 T5073 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 8065 T5057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8067 T5057 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1662_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1662/solr"}
[junit4:junit4]   2> 8073 T5072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8074 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8075 T5065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8091 T5073 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 8247 T5073 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8249 T5073 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8256 T5073 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9083 T5073 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9094 T5073 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9098 T5073 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9126 T5073 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9131 T5073 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9135 T5073 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9137 T5073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 9137 T5073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 9138 T5073 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9140 T5073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 9140 T5073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 9140 T5073 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data3/
[junit4:junit4]   2> 9141 T5073 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b784427
[junit4:junit4]   2> 9141 T5073 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 9142 T5073 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data3 forceNew: false
[junit4:junit4]   2> 9143 T5073 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data3/index/
[junit4:junit4]   2> 9144 T5073 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9144 T5073 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data3/index forceNew: false
[junit4:junit4]   2> 9147 T5073 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@219b0d9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@a8d3e26)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9147 T5073 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 9149 T5073 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 9153 T5073 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9154 T5073 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 9154 T5073 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9155 T5073 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 9155 T5073 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9156 T5073 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9156 T5073 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9157 T5073 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9158 T5073 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9159 T5073 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 9171 T5073 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 9172 T5073 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9173 T5073 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 9173 T5073 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 9173 T5073 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 9174 T5073 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9175 T5073 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9175 T5073 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9176 T5073 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9177 T5073 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9177 T5073 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9178 T5073 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9179 T5073 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9180 T5073 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9181 T5073 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 9182 T5073 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 9186 T5073 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9189 T5073 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 9191 T5073 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 9194 T5073 oass.SolrIndexSearcher.<init> Opening Searcher@b908b46 main
[junit4:junit4]   2> 9194 T5073 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9195 T5073 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9195 T5073 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 9201 T5073 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 9234 T5074 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b908b46 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9245 T5073 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 9245 T5073 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9586 T5057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9588 T5057 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
[junit4:junit4]   2> 9588 T5057 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 9588 T5057 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9595 T5072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9595 T5065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9595 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10248 T5073 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 10249 T5073 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1663/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 10256 T5073 oasc.ZkController.register We are http://127.0.0.1:1663/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 10257 T5073 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 10257 T5073 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10258 T5073 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10261 T5073 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10264 T5043 oasc.ClusterStateUpdateTest.setUp ####SETUP_END testCoreRegistration
[junit4:junit4]   2> 10264 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@595aed15
[junit4:junit4]   2> 10270 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 10271 T5076 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 10274 T5076 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 10274 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50813
[junit4:junit4]   2> 10275 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50813
[junit4:junit4]   2> 10276 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca770008 with negotiated timeout 10000 for client /127.0.0.1:50813
[junit4:junit4]   2> 10276 T5076 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca770008, negotiated timeout = 10000
[junit4:junit4]   2> 10277 T5077 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@595aed15 name:ZooKeeperConnection Watcher:127.0.0.1:50804/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 10277 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 10277 T5043 oascc.SolrZkClient.makePath makePath: /collections/testcore
[junit4:junit4]   2> 10282 T5043 oascc.SolrZkClient.makePath makePath: /collections/testcore/shards
[junit4:junit4]   2> 10287 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca770008
[junit4:junit4]   2> 10288 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50813 which had sessionid 0x13d55b2ca770008
[junit4:junit4]   2> 10289 T5077 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10288 T5043 oaz.ZooKeeper.close Session: 0x13d55b2ca770008 closed
[junit4:junit4]   2> 10289 T5043 oasc.CoreContainer.create Creating SolrCore 'testcore' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore
[junit4:junit4]   2> 10290 T5043 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testcore
[junit4:junit4]   2> 10291 T5043 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 10292 T5043 oasc.ZkController.readConfigName Load collection config from:/collections/testcore
[junit4:junit4]   2> 10295 T5043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore/'
[junit4:junit4]   2> 10399 T5043 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 10526 T5043 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 10531 T5043 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 10569 T5043 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 11104 T5057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11105 T5057 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
[junit4:junit4]   2> 11111 T5065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11112 T5072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11112 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11430 T5043 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 11439 T5043 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 11443 T5043 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 11464 T5043 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 11471 T5043 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 11478 T5043 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 11480 T5043 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 11481 T5043 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 11481 T5043 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 11484 T5043 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 11484 T5043 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 11485 T5043 oasc.SolrCore.<init> [testcore] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data4/
[junit4:junit4]   2> 11486 T5043 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b784427
[junit4:junit4]   2> 11486 T5043 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 11488 T5043 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data4 forceNew: false
[junit4:junit4]   2> 11488 T5043 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data4/index/
[junit4:junit4]   2> 11489 T5043 oasc.SolrCore.initIndex WARNING [testcore] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 11490 T5043 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data4/index forceNew: false
[junit4:junit4]   2> 11492 T5043 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@104a0b6e lockFactory=org.apache.lucene.store.NativeFSLockFactory@c643347)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11493 T5043 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 11494 T5043 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 11497 T5043 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 11498 T5043 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 11499 T5043 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 11499 T5043 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 11500 T5043 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 11501 T5043 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 11502 T5043 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 11503 T5043 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 11504 T5043 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 11505 T5043 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 11506 T5043 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 11507 T5043 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 11507 T5043 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 11508 T5043 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 11508 T5043 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 11509 T5043 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 11510 T5043 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11511 T5043 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11512 T5043 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11513 T5043 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11513 T5043 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11514 T5043 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11515 T5043 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11516 T5043 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11517 T5043 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 11518 T5043 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 11523 T5043 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 11527 T5043 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 11529 T5043 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 11533 T5043 oass.SolrIndexSearcher.<init> Opening Searcher@77204318 main
[junit4:junit4]   2> 11534 T5043 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 11535 T5043 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 11536 T5043 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 11541 T5043 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 11588 T5078 oasc.SolrCore.registerSearcher [testcore] Registered new searcher Searcher@77204318 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 11597 T5043 oasc.ZkController.publish publishing core=testcore state=down
[junit4:junit4]   2> 11598 T5043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12638 T5057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12642 T5057 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 12642 T5057 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 12658 T5072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12658 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12659 T5065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13602 T5043 oasc.CoreContainer.registerCore registering core: testcore
[junit4:junit4]   2> 13603 T5043 oasc.ZkController.register Register replica - core:testcore address:http://127.0.0.1:1661/solr collection:testcore shard:shard1
[junit4:junit4]   2> 13604 T5043 oascc.SolrZkClient.makePath makePath: /collections/testcore/leader_elect/shard1/election
[junit4:junit4]   2> 13616 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:delete cxid:0x13e zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/testcore/leaders Error:KeeperErrorCode = NoNode for /solr/collections/testcore/leaders
[junit4:junit4]   2> 13617 T5043 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 13618 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x13f zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13622 T5043 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 13622 T5043 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 13623 T5043 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:1661/solr/testcore/
[junit4:junit4]   2> 13623 T5043 oascc.SolrZkClient.makePath makePath: /collections/testcore/leaders/shard1
[junit4:junit4]   2> 13632 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca770003 type:create cxid:0x149 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14177 T5057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14207 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14208 T5065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14207 T5072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14260 T5043 oasc.ZkController.register We are http://127.0.0.1:1661/solr/testcore/ and leader is http://127.0.0.1:1661/solr/testcore/
[junit4:junit4]   2> 14262 T5043 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 14264 T5043 oasc.ZkController.publish publishing core=testcore state=active
[junit4:junit4]   2> 14265 T5043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14271 T5043 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14274 T5043 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1943174115
[junit4:junit4]   2> 15731 T5057 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15734 T5057 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 15746 T5057 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:1663_solr_collection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
[junit4:junit4]   2> 15759 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15759 T5065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15759 T5072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17298 T5043 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 17300 T5043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17311 T5043 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@e97f918
[junit4:junit4]   2> 17330 T5043 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 17330 T5043 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 17331 T5043 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 17331 T5043 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 17332 T5043 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 17333 T5043 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data3
[junit4:junit4]   2> 17334 T5043 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data3
[junit4:junit4]   2> 17334 T5043 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data3/index
[junit4:junit4]   2> 17335 T5043 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data3/index
[junit4:junit4]   2> 17336 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca770007
[junit4:junit4]   2> 17338 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50812 which had sessionid 0x13d55b2ca770007
[junit4:junit4]   2> 17338 T5072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17338 T5072 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 17338 T5043 oaz.ZooKeeper.close Session: 0x13d55b2ca770007 closed
[junit4:junit4]   2> 17339 T5072 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 17339 T5072 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 17338 T5065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17340 T5056 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 17340 T5056 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 17343 T5065 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 17542 T5043 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1029956301
[junit4:junit4]   2> 17543 T5045 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13d55b2ca770005, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 17542 T5065 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 17543 T5043 oasc.CoreContainer.shutdown SEVERE  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:219)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:216)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:216)
[junit4:junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:271)
[junit4:junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:258)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController.publishAndWaitForDownStates(ZkController.java:556)
[junit4:junit4]   2> 	at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:666)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterStateUpdateTest.java:221)
[junit4:junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 17546 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50810 which had sessionid 0x13d55b2ca770005
[junit4:junit4]   2> 17547 T5043 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 17548 T5043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17550 T5043 oasc.CoreMaps.publishCoresAsDown SEVERE  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:219)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:216)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:216)
[junit4:junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:271)
[junit4:junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:258)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController.publish(ZkController.java:997)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController.publish(ZkController.java:966)
[junit4:junit4]   2> 	at org.apache.solr.core.CoreMaps.publishCoresAsDown(CoreContainer.java:1675)
[junit4:junit4]   2> 	at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:677)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterStateUpdateTest.java:221)
[junit4:junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 17555 T5043 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@141e24a3
[junit4:junit4]   2> 17558 T5043 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 17558 T5043 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 17558 T5043 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 17559 T5043 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 17559 T5043 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 17560 T5043 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data2
[junit4:junit4]   2> 17561 T5043 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data2
[junit4:junit4]   2> 17561 T5043 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data2/index
[junit4:junit4]   2> 17562 T5043 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data2/index
[junit4:junit4]   2> 17563 T5043 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 17563 T5043 oasc.SolrResourceLoader.locateSolrHome solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4:junit4]   2> 17564 T5043 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/solr/solr.xml
[junit4:junit4]   2> 17564 T5043 oasc.CoreContainer.<init> New CoreContainer 1681254689
[junit4:junit4]   2> 17565 T5043 oasc.CoreContainer$Initializer.initialize no solr.xml or solr.properties file found - using default old-style solr.xml
[junit4:junit4]   2> 17566 T5043 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'solr/'
[junit4:junit4]   2> 17566 T5043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'solr/'
[junit4:junit4]   2> 17606 T5043 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 17607 T5043 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 17607 T5043 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 17607 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 17608 T5043 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 17608 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 17608 T5043 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 17609 T5043 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 17609 T5043 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 17610 T5043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 17624 T5043 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 17644 T5043 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50804/solr
[junit4:junit4]   2> 17645 T5043 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 17646 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7ca40437
[junit4:junit4]   2> 17647 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 17647 T5079 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 17648 T5079 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 17649 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50814
[junit4:junit4]   2> 17649 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50814
[junit4:junit4]   2> 17651 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca770009 with negotiated timeout 20000 for client /127.0.0.1:50814
[junit4:junit4]   2> 17651 T5079 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca770009, negotiated timeout = 20000
[junit4:junit4]   2> 17651 T5080 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ca40437 name:ZooKeeperConnection Watcher:127.0.0.1:50804 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 17652 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 17654 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca770009
[junit4:junit4]   2> 17655 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50814 which had sessionid 0x13d55b2ca770009
[junit4:junit4]   2> 17655 T5080 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 17655 T5043 oaz.ZooKeeper.close Session: 0x13d55b2ca770009 closed
[junit4:junit4]   2> 17656 T5043 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=0&connTimeout=0
[junit4:junit4]   2> 20580 T5046 oazs.ZooKeeperServer.expire Expiring session 0x13d55b2ca770003, timeout of 3000ms exceeded
[junit4:junit4]   2> 22804 T5043 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@a9333a0
[junit4:junit4]   2> 22805 T5055 oaz.ClientCnxn$SendThread.run Client session timed out, have not heard from server in 5462ms for sessionid 0x13d55b2ca770003, closing socket connection and attempting reconnect
[junit4:junit4]   2> 22806 T5046 oazs.ZooKeeperServer.expire Expiring session 0x13d55b2ca770005, timeout of 3000ms exceeded
[junit4:junit4]   2> 22808 T5045 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13d55b2ca770003, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 22808 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca770003
[junit4:junit4]   2> 22809 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50808 which had sessionid 0x13d55b2ca770003
[junit4:junit4]   2> 22809 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca770005
[junit4:junit4]   2> 22811 T5081 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 22813 T5043 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 22816 T5081 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 22817 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50815
[junit4:junit4]   2> 22818 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50815
[junit4:junit4]   2> 22819 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca77000a with negotiated timeout 3000 for client /127.0.0.1:50815
[junit4:junit4]   2> 22819 T5081 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca77000a, negotiated timeout = 3000
[junit4:junit4]   2> 22819 T5082 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a9333a0 name:ZooKeeperConnection Watcher:127.0.0.1:50804/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 22820 T5043 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 22820 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000a type:create cxid:0x1 zxid:0x9b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 22822 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000a type:create cxid:0x2 zxid:0x9c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 22825 T5043 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 22911 T5056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71e82846 name:ZooKeeperConnection Watcher:127.0.0.1:50804/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 22912 T5056 oascc.ConnectionManager.process zkClient has disconnected
[junit4:junit4]   2> 22912 T5056 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Disconnected type None
[junit4:junit4]   2> 23833 T5043 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 23835 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000a type:delete cxid:0xb zxid:0x9d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/192.168.57.17:8983_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 23839 T5043 oascc.SolrZkClient.makePath makePath: /live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 23848 T5082 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 23857 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000a type:delete cxid:0x15 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 23860 T5043 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 23869 T5043 oasc.Overseer.start Overseer (id=89321794006614026-192.168.57.17:8983_solr-n_0000000003) starting
[junit4:junit4]   2> 23871 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000a type:create cxid:0x1a zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 23875 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000a type:create cxid:0x1b zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 23879 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000a type:create cxid:0x1c zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 23882 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000a type:create cxid:0x1d zxid:0xa5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 23886 T5084 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 23920 T5083 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 23922 T5083 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23923 T5083 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
[junit4:junit4]   2> 23923 T5085 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: solr/collection1
[junit4:junit4]   2> 23923 T5085 oasc.ZkController.createCollectionZkNode Check for collection zkNode:
[junit4:junit4]   2> 23924 T5085 oasc.CoreContainer.recordAndThrow SEVERE Unable to create core: collection1 java.lang.IllegalArgumentException: Path must not end with / character
[junit4:junit4]   2> 	at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:58)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1020)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:202)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:199)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:199)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController.createCollectionZkNode(ZkController.java:1057)
[junit4:junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromZk(CoreContainer.java:863)
[junit4:junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:957)
[junit4:junit4]   2> 	at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:580)
[junit4:junit4]   2> 	at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:575)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 23925 T5085 oasc.SolrException.log SEVERE null:org.apache.solr.common.SolrException: Unable to create core: collection1
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer.recordAndThrow(CoreContainer.java:1356)
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer.create(CoreContainer.java:965)
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:580)
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:575)
[junit4:junit4]   2> 		at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 		at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4:junit4]   2> 		at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4]   2> 		at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4:junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4:junit4]   2> 		at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 	Caused by: java.lang.IllegalArgumentException: Path must not end with / character
[junit4:junit4]   2> 		at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:58)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1020)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:202)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:199)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:199)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.createCollectionZkNode(ZkController.java:1057)
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer.createFromZk(CoreContainer.java:863)
[junit4:junit4]   2> 		at org.apache.solr.core.CoreContainer.create(CoreContainer.java:957)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 23929 T5082 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 24810 T5055 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 24812 T5055 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 24813 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50816
[junit4:junit4]   2> 24815 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to renew session 0x13d55b2ca770003 at /127.0.0.1:50816
[junit4:junit4]   2> 24815 T5045 oazs.ZooKeeperServer.finishSessionInit Invalid session 0x13d55b2ca770003 for client /127.0.0.1:50816, probably expired
[junit4:junit4]   2> 24816 T5055 oaz.ClientCnxn$SendThread.run Unable to reconnect to ZooKeeper service, session 0x13d55b2ca770003 has expired, closing socket connection
[junit4:junit4]   2> 24816 T5056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71e82846 name:ZooKeeperConnection Watcher:127.0.0.1:50804/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4:junit4]   2> 24816 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50816 which had sessionid 0x13d55b2ca770003
[junit4:junit4]   2> 24816 T5056 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4:junit4]   2> 24817 T5056 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4:junit4]   2> 24818 T5056 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50804/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@71e82846
[junit4:junit4]   2> 24818 T5056 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 24819 T5087 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:50804. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 24820 T5087 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50804, initiating session
[junit4:junit4]   2> 24820 T5045 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:50817
[junit4:junit4]   2> 24821 T5045 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:50817
[junit4:junit4]   2> 24823 T5047 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d55b2ca77000b with negotiated timeout 3000 for client /127.0.0.1:50817
[junit4:junit4]   2> 24823 T5087 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:50804, sessionid = 0x13d55b2ca77000b, negotiated timeout = 3000
[junit4:junit4]   2> 24824 T5088 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71e82846 name:ZooKeeperConnection Watcher:127.0.0.1:50804/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 24826 T5056 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 24826 T5056 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4:junit4]   2> 24826 T5056 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 24826 T5056 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 24832 T5056 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 24836 T5056 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 24836 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000b type:delete cxid:0xc zxid:0xad txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1661_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 24837 T5056 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 24840 T5082 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 24841 T5088 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 24841 T5056 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1661/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 24842 T5082 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 24845 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000b type:delete cxid:0x15 zxid:0xb0 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 24846 T5056 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 24846 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000b type:create cxid:0x16 zxid:0xb1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 24849 T5056 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=3 found=1 timeoutin=179999
[junit4:junit4]   2> 24857 T5043 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1808408537
[junit4:junit4]   2> 24919 T5058 oasc.OverseerCollectionProcessor.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 24919 T5057 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:202)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:125)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 24921 T5057 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89321794006614019-127.0.0.1:1661_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 25441 T5083 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 25444 T5083 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 25471 T5083 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:1661_solr_collection1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 25484 T5083 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:1661_solr_testcore",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 25501 T5088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 25501 T5082 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 26863 T5043 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 26864 T5043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 26868 T5043 oasc.ZkController.publish publishing core=testcore state=down
[junit4:junit4]   2> 26869 T5043 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 26873 T5056 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 26874 T5056 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 26875 T5056 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 26876 T5043 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5a06a924
[junit4:junit4]   2> 26880 T5043 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 26880 T5043 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 26881 T5043 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 26881 T5048 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d55b2ca77000b type:create cxid:0x28 zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 26882 T5043 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 26883 T5043 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 26888 T5043 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data1
[junit4:junit4]   2> 26889 T5043 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data1
[junit4:junit4]   2> 26889 T5043 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data1/index
[junit4:junit4]   2> 26890 T5043 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data1/index
[junit4:junit4]   2> 26890 T5043 oasc.SolrCore.close [testcore]  CLOSING SolrCore org.apache.solr.core.SolrCore@4aa69a85
[junit4:junit4]   2> 26904 T5043 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 26905 T5043 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 26905 T5043 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 26906 T5043 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 26906 T5043 oasc.SolrCore.closeSearcher [testcore] Closing main searcher on request.
[junit4:junit4]   2> 26907 T5043 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data4/index
[junit4:junit4]   2> 26907 T5043 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data4/index
[junit4:junit4]   2> 26908 T5043 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data4
[junit4:junit4]   2> 26908 T5043 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1362942413426/data4
[junit4:junit4]   2> 26909 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca77000b
[junit4:junit4]   2> 26910 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50817 which had sessionid 0x13d55b2ca77000b
[junit4:junit4]   2> 26910 T5082 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 26910 T5043 oaz.ZooKeeper.close Session: 0x13d55b2ca77000b closed
[junit4:junit4]   2> 26911 T5043 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1681254689
[junit4:junit4]   2> 26913 T5082 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 27036 T5083 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 27037 T5083 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 27051 T5083 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 27079 T5082 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 27918 T5083 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89321794006614026-192.168.57.17:8983_solr-n_0000000003) am no longer a leader.
[junit4:junit4]   2> 27924 T5048 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d55b2ca77000a
[junit4:junit4]   2> 27926 T5082 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 27926 T5045 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50815 which had sessionid 0x13d55b2ca77000a
[junit4:junit4]   2> 27927 T5043 oaz.ZooKeeper.close Session: 0x13d55b2ca77000a closed
[junit4:junit4]   2> 27927 T5043 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1943174115
[junit4:junit4]   2> 28215 T5088 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 28216 T5088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 28216 T5088 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 28216 T5088 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 28930 T5043 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 28931 T5043 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 28931 T5043 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 28932 T5048 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 28932 T5043 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 28937 T5047 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 28937 T5043 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 29094 T5043 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:50804 50804
[junit4:junit4]   2> 29228 T5082 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 29270 T5082 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 29270 T5082 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 29270 T5045 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 29272 T5043 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 29273 T5043 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 29274 T5043 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 29275 T5043 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 29275 T5043 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 29276 T5043 oas.SolrTestCaseJ4.tearDown ###Ending testCoreRegistration
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 29280 T5043 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 29341 T5042 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> 29580 T5046 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 49573 T5042 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 thread leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest: 
[junit4:junit4]   2> 	   1) Thread[id=5056, name=TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[DDFAE09FACC692E1]-EventThread, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4:junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	        at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:479)
[junit4:junit4]   2> 	        at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:455)
[junit4:junit4]   2> 	        at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)
[junit4:junit4]   2> 	        at org.apache.solr.cloud.ZkController.register(ZkController.java:766)
[junit4:junit4]   2> 	        at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
[junit4:junit4]   2> 	        at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 	        at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 	        at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 49574 T5042 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4:junit4]   2> 	   1) Thread[id=5056, name=TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[DDFAE09FACC692E1]-EventThread, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4:junit4]   2> 49590 T5056 oasc.ZkController.getLeader SEVERE Error getting leader from zk java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2> 	at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:479)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:455)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:766)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 
[junit4:junit4]   2> 49592 T5056 oasc.SolrException.log SEVERE Error registering SolrCore:org.apache.solr.common.SolrException: Error getting leader from zk
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:854)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.register(ZkController.java:766)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2> 		at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:479)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:455)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)
[junit4:junit4]   2> 		... 7 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 49592 T5056 oasc.ZkController.register Register replica - core:testcore address:http://127.0.0.1:1661/solr collection:testcore shard:shard1
[junit4:junit4]   2> 49593 T5056 oasc.SolrException.log SEVERE Error registering SolrCore:org.apache.solr.common.cloud.ZooKeeperException: 
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.register(ZkController.java:757)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testcore/leader_elect/shard1/election
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:202)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:199)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:199)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:92)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:86)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.setup(LeaderElector.java:278)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:923)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.register(ZkController.java:751)
[junit4:junit4]   2> 		... 6 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 49594 T5056 oascc.DefaultConnectionStrategy.reconnect Reconnected to ZooKeeper
[junit4:junit4]   2> 49594 T5056 oascc.ConnectionManager.process Connected:true
[junit4:junit4]   2> 49594 T5056 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Expired type None
[junit4:junit4]   2> 49595 T5056 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 49595 T5042 ccr.ThreadLeakControl.tryToInterruptAll All leaked threads terminated.
[junit4:junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=es_NI, timezone=Pacific/Fiji
[junit4:junit4]   2> NOTE: Mac OS X 10.8.2 x86_64/Apple Inc. 1.6.0_41 (64-bit)/cpus=2,threads=1,free=67469576,total=172937216
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SimpleFacetsTest, DistributedTermsComponentTest, SuggesterFSTTest, SuggesterWFSTTest, IndexSchemaTest, CoreAdminHandlerTest, BasicZkTest, CurrencyFieldOpenExchangeTest, FileBasedSpellCheckerTest, TestDocumentBuilder, SortByFunctionTest, TestPartialUpdateDeduplication, TestSolrIndexConfig, TestExtendedDismaxParser, TestIndexingPerformance, BasicFunctionalityTest, TestWriterPerf, PreAnalyzedFieldTest, HardAutoCommitTest, TestSolrXMLSerializer, DocValuesTest, CSVRequestHandlerTest, AnalysisAfterCoreReloadTest, SyncSliceTest, MultiTermTest, TestFiltering, TestFieldTypeCollectionResource, PolyFieldTest, TestPseudoReturnFields, SpellCheckCollatorTest, TestUtils, DOMUtilTest, TestCharFilters, LoggingHandlerTest, TestLMDirichletSimilarityFactory, UUIDFieldTest, ShardRoutingCustomTest, SolrCmdDistributorTest, TestUpdate, CircularListTest, DateFieldTest, TestSolrCoreProperties, JsonLoaderTest, TestJoin, SliceStateUpdateTest, DistributedSpellCheckComponentTest, TimeZoneUtilsTest, TestCSVResponseWriter, TestElisionMultitermQuery, PingRequestHandlerTest, ZkSolrClientTest, CopyFieldTest, TestSweetSpotSimilarityFactory, TestFieldResource, OverseerCollectionProcessorTest, RecoveryZkTest, TestIndexSearcher, MinimalSchemaTest, UpdateParamsTest, TermVectorComponentTest, TestBinaryField, NumericFieldsTest, TestCoreContainer, TestFuzzyAnalyzedSuggestions, URLClassifyProcessorTest, TestOmitPositions, SpellCheckComponentTest, TestDynamicFieldResource, HighlighterConfigTest, PrimUtilsTest, QueryElevationComponentTest, TestQuerySenderListener, OpenExchangeRatesOrgProviderTest, FastVectorHighlighterTest, DefaultValueUpdateProcessorTest, TestValueSourceCache, TestCSVLoader, PluginInfoTest, ZkCLITest, TestRangeQuery, TestSolrDiscoveryProperties, DirectUpdateHandlerTest, SolrCoreCheckLockOnStartupTest, TestSort, TestPluginEnable, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, DocValuesMultiTest, BadComponentTest, TestRemoteStreaming, TestFastOutputStream, ScriptEngineTest, RequestHandlersTest, SearchHandlerTest, TestHashPartitioner, PrimitiveFieldTypeTest, ZkControllerTest, AlternateDirectoryTest, SOLR749Test, DistributedQueryElevationComponentTest, LeaderElectionIntegrationTest, UpdateRequestProcessorFactoryTest, StatsComponentTest, FieldAnalysisRequestHandlerTest, TestJmxMonitoredMap, TestFieldCollectionResource, TestStressVersions, FieldMutatingUpdateProcessorTest, SoftAutoCommitTest, NotRequiredUniqueKeyTest, NoCacheHeaderTest, ResourceLoaderTest, IndexReaderFactoryTest, DirectSolrConnectionTest, AliasIntegrationTest, SolrCoreTest, SignatureUpdateProcessorFactoryTest, DocumentAnalysisRequestHandlerTest, MBeansHandlerTest, TestZkChroot, DocumentBuilderTest, TestFoldingMultitermQuery, TermsComponentTest, CollectionsAPIDistributedZkTest, MoreLikeThisHandlerTest, ChaosMonkeySafeLeaderTest, TestStressRecovery, TestReplicationHandler, UniqFieldsUpdateProcessorFactoryTest, BasicDistributedZkTest, BasicDistributedZk2Test, UnloadDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ClusterStateUpdateTest -Dtests.seed=DDFAE09FACC692E1 -Dtests.slow=true -Dtests.locale=es_NI -Dtests.timezone=Pacific/Fiji -Dtests.file.encoding=MacRoman
[junit4:junit4] ERROR   0.00s | ClusterStateUpdateTest (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest: 
[junit4:junit4]    >    1) Thread[id=5056, name=TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[DDFAE09FACC692E1]-EventThread, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:479)
[junit4:junit4]    >         at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:455)
[junit4:junit4]    >         at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)
[junit4:junit4]    >         at org.apache.solr.cloud.ZkController.register(ZkController.java:766)
[junit4:junit4]    >         at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
[junit4:junit4]    >         at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]    >         at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]    >         at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([DDFAE09FACC692E1]:0)
[junit4:junit4] Completed in 49.66s, 1 test, 1 error <<< FAILURES!

[...truncated 392 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:381: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:361: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:183: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:449: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1213: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:877: There were test failures: 269 suites, 1137 tests, 1 suite-level error, 18 ignored (6 assumptions)

Total time: 79 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.6.0 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure