You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/01/28 17:51:39 UTC
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 940 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/940/
1 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=1340, name=testExecutor-722-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1340, name=testExecutor-722-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:27821/et/g
at __randomizedtesting.SeedInfo.seed([3807587A7D677D55]:0)
at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:642)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:27821/et/g
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:412)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:640)
... 3 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:150)
at java.net.SocketInputStream.read(SocketInputStream.java:121)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264)
at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
... 5 more
Build Log:
[...truncated 8853 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4] 2> 0 T831 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /et/g
[junit4:junit4] 2> 6 T831 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1359390560750
[junit4:junit4] 2> 8 T831 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 8 T832 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 13 T832 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 13 T832 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 13 T832 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 14 T832 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 15 T832 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 109 T831 oasc.ZkTestServer.run start zk server on port:27805
[junit4:junit4] 2> 109 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@e2b2eed
[junit4:junit4] 2> 110 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 111 T837 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 111 T837 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 112 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27806
[junit4:junit4] 2> 114 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27806
[junit4:junit4] 2> 114 T835 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 119 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f70000 with negotiated timeout 10000 for client /140.211.11.196:27806
[junit4:junit4] 2> 119 T837 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f70000, negotiated timeout = 10000
[junit4:junit4] 2> 120 T838 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e2b2eed name:ZooKeeperConnection Watcher:127.0.0.1:27805 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 120 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 120 T831 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 125 T836 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c81fdd1f70000
[junit4:junit4] 2> 134 T838 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 134 T831 oaz.ZooKeeper.close Session: 0x13c81fdd1f70000 closed
[junit4:junit4] 2> 135 T833 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:27806 which had sessionid 0x13c81fdd1f70000
[junit4:junit4] 2> 135 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@38079b3c
[junit4:junit4] 2> 136 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 137 T839 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 137 T839 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 137 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27807
[junit4:junit4] 2> 138 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27807
[junit4:junit4] 2> 139 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f70001 with negotiated timeout 10000 for client /140.211.11.196:27807
[junit4:junit4] 2> 139 T839 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f70001, negotiated timeout = 10000
[junit4:junit4] 2> 140 T840 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38079b3c name:ZooKeeperConnection Watcher:127.0.0.1:27805/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 140 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 140 T831 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 151 T831 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 154 T831 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 157 T831 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 161 T831 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 162 T831 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 175 T831 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 176 T831 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 281 T831 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 282 T831 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 285 T831 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 286 T831 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 290 T831 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 291 T831 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 294 T831 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 295 T831 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 299 T831 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 300 T831 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 303 T831 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 304 T831 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 307 T831 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 308 T831 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 311 T836 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c81fdd1f70001
[junit4:junit4] 2> 318 T840 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 318 T833 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:27807 which had sessionid 0x13c81fdd1f70001
[junit4:junit4] 2> 318 T831 oaz.ZooKeeper.close Session: 0x13c81fdd1f70001 closed
[junit4:junit4] 2> 514 T831 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 517 T831 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:27808
[junit4:junit4] 2> 518 T831 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 518 T831 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 519 T831 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359390561062
[junit4:junit4] 2> 519 T831 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359390561062/solr.xml
[junit4:junit4] 2> 520 T831 oasc.CoreContainer.<init> New CoreContainer 2119991162
[junit4:junit4] 2> 521 T831 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359390561062/'
[junit4:junit4] 2> 521 T831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359390561062/'
[junit4:junit4] 2> 584 T831 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 585 T831 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 586 T831 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 586 T831 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 587 T831 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 588 T831 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 588 T831 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 589 T831 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 590 T831 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 591 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 621 T831 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 643 T831 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:27805/solr
[junit4:junit4] 2> 644 T831 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 644 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d937770
[junit4:junit4] 2> 645 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 646 T850 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 646 T850 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 647 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27810
[junit4:junit4] 2> 647 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27810
[junit4:junit4] 2> 649 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f70002 with negotiated timeout 20000 for client /140.211.11.196:27810
[junit4:junit4] 2> 649 T850 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f70002, negotiated timeout = 20000
[junit4:junit4] 2> 650 T851 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d937770 name:ZooKeeperConnection Watcher:127.0.0.1:27805 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 650 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 652 T836 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c81fdd1f70002
[junit4:junit4] 2> 659 T851 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 659 T833 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:27810 which had sessionid 0x13c81fdd1f70002
[junit4:junit4] 2> 659 T831 oaz.ZooKeeper.close Session: 0x13c81fdd1f70002 closed
[junit4:junit4] 2> 660 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 674 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@115f61b
[junit4:junit4] 2> 675 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 676 T852 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 676 T852 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 676 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27811
[junit4:junit4] 2> 677 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27811
[junit4:junit4] 2> 678 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f70003 with negotiated timeout 20000 for client /140.211.11.196:27811
[junit4:junit4] 2> 678 T852 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f70003, negotiated timeout = 20000
[junit4:junit4] 2> 679 T853 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@115f61b name:ZooKeeperConnection Watcher:127.0.0.1:27805/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 679 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 682 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 690 T831 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 693 T831 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:27808_et%2Fg
[junit4:junit4] 2> 694 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:27808_et%2Fg Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:27808_et%2Fg
[junit4:junit4] 2> 696 T831 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:27808_et%2Fg
[junit4:junit4] 2> 705 T831 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 722 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 731 T831 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 743 T831 oasc.Overseer.start Overseer (id=89089019789901827-127.0.0.1:27808_et%2Fg-n_0000000000) starting
[junit4:junit4] 2> 744 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 755 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 763 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 771 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 776 T855 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 777 T831 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 788 T831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 790 T854 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 795 T856 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359390561062/collection1
[junit4:junit4] 2> 796 T856 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 796 T856 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 797 T856 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 798 T856 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359390561062/collection1/'
[junit4:junit4] 2> 799 T856 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359390561062/collection1/lib/README' to classloader
[junit4:junit4] 2> 800 T856 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359390561062/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 856 T856 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 932 T856 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1033 T856 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1039 T856 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1695 T856 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1703 T856 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1706 T856 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1718 T856 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1722 T856 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1726 T856 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1727 T856 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1728 T856 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359390561062/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data/
[junit4:junit4] 2> 1728 T856 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@672ce4f6
[junit4:junit4] 2> 1729 T856 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1730 T856 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data forceNew:false
[junit4:junit4] 2> 1730 T856 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data
[junit4:junit4] 2> 1730 T856 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data/index/
[junit4:junit4] 2> 1731 T856 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1732 T856 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data/index forceNew:false
[junit4:junit4] 2> 1737 T856 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5979ea32),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1738 T856 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1738 T856 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data/index
[junit4:junit4] 2> 1738 T856 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 1740 T856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1740 T856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 1740 T856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1741 T856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 1741 T856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1741 T856 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1742 T856 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1742 T856 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1742 T856 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1743 T856 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 1743 T856 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 1743 T856 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1744 T856 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 1744 T856 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 1744 T856 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 1744 T856 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1745 T856 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1745 T856 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1745 T856 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1746 T856 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1746 T856 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1746 T856 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1747 T856 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1747 T856 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1747 T856 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 1748 T856 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 1758 T856 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1762 T856 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 1763 T856 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 1765 T856 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data
[junit4:junit4] 2> 1766 T856 oass.SolrIndexSearcher.<init> Opening Searcher@3bac9f20 main
[junit4:junit4] 2> 1767 T856 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1767 T856 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1768 T856 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 1775 T856 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 1829 T857 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3bac9f20 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1832 T856 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1833 T856 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1833 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2293 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2294 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:27808_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27808/et/g"}
[junit4:junit4] 2> 2294 T854 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2295 T854 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2295 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2315 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2847 T856 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2847 T856 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:27808/et/g collection:control_collection shard:shard1
[junit4:junit4] 2> 2848 T856 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2866 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2867 T856 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2868 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2879 T856 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2879 T856 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2879 T856 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:27808/et/g/collection1/
[junit4:junit4] 2> 2880 T856 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2880 T856 oasc.SyncStrategy.syncToMe http://127.0.0.1:27808/et/g/collection1/ has no replicas
[junit4:junit4] 2> 2880 T856 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:27808/et/g/collection1/
[junit4:junit4] 2> 2880 T856 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2887 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3824 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3846 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3863 T856 oasc.ZkController.register We are http://127.0.0.1:27808/et/g/collection1/ and leader is http://127.0.0.1:27808/et/g/collection1/
[junit4:junit4] 2> 3863 T856 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:27808/et/g
[junit4:junit4] 2> 3863 T856 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3863 T856 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3864 T856 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3867 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3867 T831 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3868 T831 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3869 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3889 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3901 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@748db41b
[junit4:junit4] 2> 3902 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3902 T858 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3902 T858 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 3903 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27812
[junit4:junit4] 2> 3903 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27812
[junit4:junit4] 2> 3905 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f70004 with negotiated timeout 10000 for client /140.211.11.196:27812
[junit4:junit4] 2> 3905 T858 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f70004, negotiated timeout = 10000
[junit4:junit4] 2> 3905 T859 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@748db41b name:ZooKeeperConnection Watcher:127.0.0.1:27805/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3906 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3907 T831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3909 T831 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4100 T831 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4103 T831 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:27813
[junit4:junit4] 2> 4104 T831 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4105 T831 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4105 T831 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359390564653
[junit4:junit4] 2> 4105 T831 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359390564653/solr.xml
[junit4:junit4] 2> 4106 T831 oasc.CoreContainer.<init> New CoreContainer 1375833662
[junit4:junit4] 2> 4107 T831 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359390564653/'
[junit4:junit4] 2> 4107 T831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359390564653/'
[junit4:junit4] 2> 4168 T831 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 4169 T831 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4169 T831 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4170 T831 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4170 T831 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4170 T831 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4171 T831 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4171 T831 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4172 T831 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4172 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4194 T831 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4214 T831 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:27805/solr
[junit4:junit4] 2> 4215 T831 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4215 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5ce1ccdd
[junit4:junit4] 2> 4216 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4217 T869 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4217 T869 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 4218 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27814
[junit4:junit4] 2> 4218 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27814
[junit4:junit4] 2> 4220 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f70005 with negotiated timeout 20000 for client /140.211.11.196:27814
[junit4:junit4] 2> 4220 T869 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f70005, negotiated timeout = 20000
[junit4:junit4] 2> 4220 T870 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ce1ccdd name:ZooKeeperConnection Watcher:127.0.0.1:27805 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4221 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4222 T836 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c81fdd1f70005
[junit4:junit4] 2> 4223 T870 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4224 T833 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:27814 which had sessionid 0x13c81fdd1f70005
[junit4:junit4] 2> 4223 T831 oaz.ZooKeeper.close Session: 0x13c81fdd1f70005 closed
[junit4:junit4] 2> 4224 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 4235 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5acf6745
[junit4:junit4] 2> 4237 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4237 T871 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4238 T871 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 4238 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27815
[junit4:junit4] 2> 4238 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27815
[junit4:junit4] 2> 4240 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f70006 with negotiated timeout 20000 for client /140.211.11.196:27815
[junit4:junit4] 2> 4240 T871 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f70006, negotiated timeout = 20000
[junit4:junit4] 2> 4240 T872 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5acf6745 name:ZooKeeperConnection Watcher:127.0.0.1:27805/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4240 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4242 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4243 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4251 T831 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:27813_et%2Fg
[junit4:junit4] 2> 4252 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:27813_et%2Fg Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:27813_et%2Fg
[junit4:junit4] 2> 4253 T831 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:27813_et%2Fg
[junit4:junit4] 2> 4256 T859 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4256 T853 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4257 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4265 T831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4273 T873 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359390564653/collection1
[junit4:junit4] 2> 4273 T873 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4274 T873 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4274 T873 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4275 T873 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359390564653/collection1/'
[junit4:junit4] 2> 4277 T873 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359390564653/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4277 T873 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359390564653/collection1/lib/README' to classloader
[junit4:junit4] 2> 4331 T873 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 4401 T873 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4502 T873 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4508 T873 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5129 T873 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5142 T873 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5146 T873 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5159 T873 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5164 T873 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5169 T873 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5170 T873 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5171 T873 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359390564653/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1/
[junit4:junit4] 2> 5171 T873 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@672ce4f6
[junit4:junit4] 2> 5172 T873 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 5173 T873 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1 forceNew:false
[junit4:junit4] 2> 5173 T873 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1
[junit4:junit4] 2> 5173 T873 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1/index/
[junit4:junit4] 2> 5174 T873 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5175 T873 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1/index forceNew:false
[junit4:junit4] 2> 5199 T873 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@512cb9d7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5200 T873 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5200 T873 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1/index
[junit4:junit4] 2> 5201 T873 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 5203 T873 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5203 T873 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 5203 T873 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5204 T873 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 5204 T873 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5205 T873 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5205 T873 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5206 T873 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5206 T873 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5207 T873 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 5207 T873 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 5208 T873 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5208 T873 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 5208 T873 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 5209 T873 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 5209 T873 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5210 T873 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5210 T873 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5211 T873 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5211 T873 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5212 T873 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5212 T873 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5213 T873 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5213 T873 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5214 T873 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 5215 T873 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 5226 T873 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5230 T873 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 5231 T873 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 5234 T873 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1
[junit4:junit4] 2> 5235 T873 oass.SolrIndexSearcher.<init> Opening Searcher@3e411cbe main
[junit4:junit4] 2> 5236 T873 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5236 T873 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5237 T873 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 5259 T873 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 5324 T874 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e411cbe main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5329 T873 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5330 T873 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 5359 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5360 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:27808_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27808/et/g"}
[junit4:junit4] 2> 5374 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:27813_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27813/et/g"}
[junit4:junit4] 2> 5375 T854 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 5375 T854 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 5397 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5397 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5397 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6332 T873 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 6332 T873 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:27813/et/g collection:collection1 shard:shard1
[junit4:junit4] 2> 6333 T873 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 6355 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70006 type:delete cxid:0x43 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 6362 T873 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 6362 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70006 type:create cxid:0x44 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6365 T873 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 6365 T873 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 6365 T873 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:27813/et/g/collection1/
[junit4:junit4] 2> 6366 T873 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 6366 T873 oasc.SyncStrategy.syncToMe http://127.0.0.1:27813/et/g/collection1/ has no replicas
[junit4:junit4] 2> 6366 T873 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:27813/et/g/collection1/
[junit4:junit4] 2> 6366 T873 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 6378 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70006 type:create cxid:0x4e zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6915 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6939 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6939 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6939 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6998 T873 oasc.ZkController.register We are http://127.0.0.1:27813/et/g/collection1/ and leader is http://127.0.0.1:27813/et/g/collection1/
[junit4:junit4] 2> 6998 T873 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:27813/et/g
[junit4:junit4] 2> 6998 T873 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 6998 T873 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 6999 T873 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7000 T873 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7001 T831 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 7002 T831 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 7002 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 7185 T831 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 7189 T831 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:27818
[junit4:junit4] 2> 7189 T831 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 7190 T831 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 7190 T831 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359390567760
[junit4:junit4] 2> 7191 T831 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359390567760/solr.xml
[junit4:junit4] 2> 7191 T831 oasc.CoreContainer.<init> New CoreContainer 1119945684
[junit4:junit4] 2> 7192 T831 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359390567760/'
[junit4:junit4] 2> 7193 T831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359390567760/'
[junit4:junit4] 2> 7248 T831 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 7249 T831 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 7249 T831 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 7250 T831 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 7250 T831 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 7250 T831 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 7251 T831 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 7251 T831 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 7252 T831 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 7252 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 7273 T831 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 7292 T831 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:27805/solr
[junit4:junit4] 2> 7293 T831 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 7293 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@35fda302
[junit4:junit4] 2> 7294 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7295 T884 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 7295 T884 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 7296 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27819
[junit4:junit4] 2> 7296 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27819
[junit4:junit4] 2> 7298 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f70007 with negotiated timeout 20000 for client /140.211.11.196:27819
[junit4:junit4] 2> 7298 T884 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f70007, negotiated timeout = 20000
[junit4:junit4] 2> 7298 T885 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35fda302 name:ZooKeeperConnection Watcher:127.0.0.1:27805 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7299 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7300 T836 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c81fdd1f70007
[junit4:junit4] 2> 7313 T885 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 7313 T833 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:27819 which had sessionid 0x13c81fdd1f70007
[junit4:junit4] 2> 7313 T831 oaz.ZooKeeper.close Session: 0x13c81fdd1f70007 closed
[junit4:junit4] 2> 7314 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 7325 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@40e78fc9
[junit4:junit4] 2> 7326 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7326 T886 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 7327 T886 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 7327 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27820
[junit4:junit4] 2> 7327 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27820
[junit4:junit4] 2> 7329 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f70008 with negotiated timeout 20000 for client /140.211.11.196:27820
[junit4:junit4] 2> 7329 T886 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f70008, negotiated timeout = 20000
[junit4:junit4] 2> 7329 T887 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40e78fc9 name:ZooKeeperConnection Watcher:127.0.0.1:27805/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7329 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7331 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7332 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70008 type:create cxid:0x2 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7333 T831 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:27818_et%2Fg
[junit4:junit4] 2> 7334 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70008 type:delete cxid:0x4 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:27818_et%2Fg Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:27818_et%2Fg
[junit4:junit4] 2> 7335 T831 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:27818_et%2Fg
[junit4:junit4] 2> 7337 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7337 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7338 T853 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 7338 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 7340 T872 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 7340 T859 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 7347 T831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 7354 T888 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359390567760/collection1
[junit4:junit4] 2> 7354 T888 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 7355 T888 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 7355 T888 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 7356 T888 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359390567760/collection1/'
[junit4:junit4] 2> 7357 T888 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359390567760/collection1/lib/README' to classloader
[junit4:junit4] 2> 7358 T888 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359390567760/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 7425 T888 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 7494 T888 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 7595 T888 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 7601 T888 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 8206 T888 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 8214 T888 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 8217 T888 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 8226 T888 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8230 T888 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8233 T888 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8234 T888 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8235 T888 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359390567760/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2/
[junit4:junit4] 2> 8235 T888 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@672ce4f6
[junit4:junit4] 2> 8235 T888 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 8236 T888 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2 forceNew:false
[junit4:junit4] 2> 8236 T888 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2
[junit4:junit4] 2> 8236 T888 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2/index/
[junit4:junit4] 2> 8237 T888 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 8237 T888 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2/index forceNew:false
[junit4:junit4] 2> 8241 T888 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@65628ead),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 8241 T888 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 8242 T888 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2/index
[junit4:junit4] 2> 8242 T888 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 8244 T888 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 8244 T888 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 8244 T888 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 8245 T888 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 8245 T888 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 8245 T888 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 8245 T888 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 8246 T888 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 8246 T888 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 8247 T888 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 8247 T888 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 8247 T888 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 8248 T888 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 8248 T888 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 8248 T888 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 8249 T888 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 8249 T888 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8249 T888 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8250 T888 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8250 T888 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8250 T888 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8251 T888 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8251 T888 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8252 T888 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8252 T888 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 8252 T888 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 8261 T888 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 8264 T888 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 8265 T888 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 8266 T888 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2
[junit4:junit4] 2> 8267 T888 oass.SolrIndexSearcher.<init> Opening Searcher@4d8ab7c3 main
[junit4:junit4] 2> 8268 T888 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 8268 T888 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 8269 T888 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 8289 T888 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 8361 T889 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4d8ab7c3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 8367 T888 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 8367 T888 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8450 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8451 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:27813_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27813/et/g"}
[junit4:junit4] 2> 8455 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:27818_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27818/et/g"}
[junit4:junit4] 2> 8455 T854 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 8455 T854 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 8468 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8468 T887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8468 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8468 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9370 T888 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 9370 T888 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:27818/et/g collection:collection1 shard:shard2
[junit4:junit4] 2> 9371 T888 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 9394 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70008 type:delete cxid:0x42 zxid:0x7c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 9395 T888 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 9396 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70008 type:create cxid:0x43 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9405 T888 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 9405 T888 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 9405 T888 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:27818/et/g/collection1/
[junit4:junit4] 2> 9406 T888 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 9406 T888 oasc.SyncStrategy.syncToMe http://127.0.0.1:27818/et/g/collection1/ has no replicas
[junit4:junit4] 2> 9406 T888 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:27818/et/g/collection1/
[junit4:junit4] 2> 9406 T888 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 9409 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f70008 type:create cxid:0x4c zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9979 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9997 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9997 T887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9997 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9997 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10031 T888 oasc.ZkController.register We are http://127.0.0.1:27818/et/g/collection1/ and leader is http://127.0.0.1:27818/et/g/collection1/
[junit4:junit4] 2> 10031 T888 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:27818/et/g
[junit4:junit4] 2> 10031 T888 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 10031 T888 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 10032 T888 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10034 T888 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10034 T831 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 10035 T831 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 10036 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 10219 T831 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 10222 T831 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:27821
[junit4:junit4] 2> 10223 T831 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 10224 T831 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 10224 T831 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359390570794
[junit4:junit4] 2> 10224 T831 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359390570794/solr.xml
[junit4:junit4] 2> 10225 T831 oasc.CoreContainer.<init> New CoreContainer 1499332677
[junit4:junit4] 2> 10226 T831 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359390570794/'
[junit4:junit4] 2> 10226 T831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359390570794/'
[junit4:junit4] 2> 10282 T831 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 10282 T831 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 10283 T831 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 10283 T831 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 10284 T831 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 10284 T831 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 10285 T831 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 10285 T831 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 10286 T831 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 10286 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 10308 T831 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 10327 T831 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:27805/solr
[junit4:junit4] 2> 10328 T831 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 10329 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@11eba813
[junit4:junit4] 2> 10330 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10330 T899 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10331 T899 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 10331 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27822
[junit4:junit4] 2> 10331 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27822
[junit4:junit4] 2> 10333 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f70009 with negotiated timeout 20000 for client /140.211.11.196:27822
[junit4:junit4] 2> 10333 T899 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f70009, negotiated timeout = 20000
[junit4:junit4] 2> 10334 T900 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11eba813 name:ZooKeeperConnection Watcher:127.0.0.1:27805 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10334 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10336 T836 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c81fdd1f70009
[junit4:junit4] 2> 10348 T900 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 10348 T833 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:27822 which had sessionid 0x13c81fdd1f70009
[junit4:junit4] 2> 10348 T831 oaz.ZooKeeper.close Session: 0x13c81fdd1f70009 closed
[junit4:junit4] 2> 10349 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 10362 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@49e084c5
[junit4:junit4] 2> 10363 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10363 T901 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10364 T901 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 10364 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27823
[junit4:junit4] 2> 10364 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27823
[junit4:junit4] 2> 10365 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f7000a with negotiated timeout 20000 for client /140.211.11.196:27823
[junit4:junit4] 2> 10366 T901 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f7000a, negotiated timeout = 20000
[junit4:junit4] 2> 10366 T902 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49e084c5 name:ZooKeeperConnection Watcher:127.0.0.1:27805/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10366 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10367 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f7000a type:create cxid:0x1 zxid:0x8d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10369 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f7000a type:create cxid:0x2 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10376 T831 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:27821_et%2Fg
[junit4:junit4] 2> 10377 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f7000a type:delete cxid:0x4 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:27821_et%2Fg Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:27821_et%2Fg
[junit4:junit4] 2> 10379 T831 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:27821_et%2Fg
[junit4:junit4] 2> 10381 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10381 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10381 T853 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10381 T887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10382 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 10389 T872 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10390 T887 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10390 T859 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10391 T831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10397 T903 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359390570794/collection1
[junit4:junit4] 2> 10398 T903 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 10398 T903 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 10398 T903 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 10400 T903 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359390570794/collection1/'
[junit4:junit4] 2> 10401 T903 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359390570794/collection1/lib/README' to classloader
[junit4:junit4] 2> 10401 T903 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359390570794/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 10453 T903 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 10523 T903 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10624 T903 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10630 T903 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 11219 T903 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 11227 T903 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 11230 T903 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 11240 T903 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 11243 T903 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 11246 T903 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11247 T903 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11248 T903 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359390570794/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/
[junit4:junit4] 2> 11248 T903 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@672ce4f6
[junit4:junit4] 2> 11249 T903 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 11249 T903 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3 forceNew:false
[junit4:junit4] 2> 11250 T903 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3
[junit4:junit4] 2> 11250 T903 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index/
[junit4:junit4] 2> 11250 T903 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 11251 T903 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index forceNew:false
[junit4:junit4] 2> 11255 T903 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7db34cf8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 11256 T903 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 11256 T903 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index
[junit4:junit4] 2> 11256 T903 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 11258 T903 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 11258 T903 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 11259 T903 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 11259 T903 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 11259 T903 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 11259 T903 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 11260 T903 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 11260 T903 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 11261 T903 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 11261 T903 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 11261 T903 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 11262 T903 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 11262 T903 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 11262 T903 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 11262 T903 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 11263 T903 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 11263 T903 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11264 T903 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11264 T903 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11264 T903 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11265 T903 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11265 T903 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11265 T903 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11266 T903 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11266 T903 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 11267 T903 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 11275 T903 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 11278 T903 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 11279 T903 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 11280 T903 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3
[junit4:junit4] 2> 11282 T903 oass.SolrIndexSearcher.<init> Opening Searcher@52218151 main
[junit4:junit4] 2> 11282 T903 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 11282 T903 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 11283 T903 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 11288 T903 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 11336 T904 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@52218151 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 11340 T903 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 11340 T903 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11509 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11510 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:27818_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27818/et/g"}
[junit4:junit4] 2> 11513 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:27821_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27821/et/g"}
[junit4:junit4] 2> 11513 T854 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11513 T854 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11525 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11525 T887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11525 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11525 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11525 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12342 T903 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 12342 T903 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:27821/et/g collection:collection1 shard:shard1
[junit4:junit4] 2> 12346 T903 oasc.ZkController.register We are http://127.0.0.1:27821/et/g/collection1/ and leader is http://127.0.0.1:27813/et/g/collection1/
[junit4:junit4] 2> 12346 T903 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:27821/et/g
[junit4:junit4] 2> 12347 T903 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 12347 T903 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C53 name=collection1 org.apache.solr.core.SolrCore@6cbae8d0 url=http://127.0.0.1:27821/et/g/collection1 node=127.0.0.1:27821_et%2Fg C53_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:27821_et%2Fg, base_url=http://127.0.0.1:27821/et/g}
[junit4:junit4] 2> 12349 T905 C53 P27821 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 12349 T903 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12350 T905 C53 P27821 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 12350 T905 C53 P27821 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 12350 T905 C53 P27821 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12350 T831 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 12351 T831 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12352 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12352 T905 C53 P27821 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12543 T831 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12548 T831 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:27825
[junit4:junit4] 2> 12549 T831 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12550 T831 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12550 T831 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359390573114
[junit4:junit4] 2> 12551 T831 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359390573114/solr.xml
[junit4:junit4] 2> 12552 T831 oasc.CoreContainer.<init> New CoreContainer 290711206
[junit4:junit4] 2> 12553 T831 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359390573114/'
[junit4:junit4] 2> 12554 T831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359390573114/'
[junit4:junit4] 2> 12621 T831 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 12622 T831 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12622 T831 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12622 T831 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12623 T831 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12623 T831 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12624 T831 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12624 T831 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12625 T831 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12625 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12651 T831 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12672 T831 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:27805/solr
[junit4:junit4] 2> 12673 T831 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12673 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7fac9d02
[junit4:junit4] 2> 12674 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12675 T915 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12675 T915 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 12675 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27827
[junit4:junit4] 2> 12676 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27827
[junit4:junit4] 2> 12678 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f7000b with negotiated timeout 20000 for client /140.211.11.196:27827
[junit4:junit4] 2> 12678 T915 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f7000b, negotiated timeout = 20000
[junit4:junit4] 2> 12678 T916 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fac9d02 name:ZooKeeperConnection Watcher:127.0.0.1:27805 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12678 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12680 T836 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13c81fdd1f7000b
[junit4:junit4] 2> 12681 T916 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12681 T833 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:27827 which had sessionid 0x13c81fdd1f7000b
[junit4:junit4] 2> 12681 T831 oaz.ZooKeeper.close Session: 0x13c81fdd1f7000b closed
[junit4:junit4] 2> 12682 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 12695 T831 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:27805/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2738cfda
[junit4:junit4] 2> 12696 T831 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12697 T917 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:27805. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12697 T917 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:27805, initiating session
[junit4:junit4] 2> 12697 T833 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27828
[junit4:junit4] 2> 12698 T833 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27828
[junit4:junit4] 2> 12699 T835 oazs.ZooKeeperServer.finishSessionInit Established session 0x13c81fdd1f7000c with negotiated timeout 20000 for client /140.211.11.196:27828
[junit4:junit4] 2> 12699 T917 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:27805, sessionid = 0x13c81fdd1f7000c, negotiated timeout = 20000
[junit4:junit4] 2> 12699 T918 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2738cfda name:ZooKeeperConnection Watcher:127.0.0.1:27805/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12700 T831 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12702 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f7000c type:create cxid:0x1 zxid:0x9f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12703 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f7000c type:create cxid:0x2 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12705 T831 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:27825_et%2Fg
[junit4:junit4] 2> 12706 T836 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13c81fdd1f7000c type:delete cxid:0x4 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:27825_et%2Fg Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:27825_et%2Fg
[junit4:junit4] 2> 12707 T831 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:27825_et%2Fg
[junit4:junit4] 2> 12710 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12710 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12710 T887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12710 T902 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 12710 T853 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 12711 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 12711 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 12712 T859 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 12712 T872 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 12712 T887 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 12714 T831 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 12721 T919 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359390573114/collection1
[junit4:junit4] 2> 12721 T919 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 12722 T919 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 12722 T919 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 12723 T919 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359390573114/collection1/'
[junit4:junit4] 2> 12725 T919 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359390573114/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 12725 T919 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359390573114/collection1/lib/README' to classloader
[junit4:junit4] 2> 12779 T919 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 12852 T919 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 12953 T919 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 12962 T919 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13041 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13042 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:27821_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27821/et/g"}
[junit4:junit4] 2> 13080 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13080 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13080 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13080 T887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13080 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13080 T918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13626 T919 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 13638 T919 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 13642 T919 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 13656 T919 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13661 T919 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13665 T919 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13666 T919 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13668 T919 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359390573114/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/
[junit4:junit4] 2> 13668 T919 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@672ce4f6
[junit4:junit4] 2> 13668 T919 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 13669 T919 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4 forceNew:false
[junit4:junit4] 2> 13670 T919 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4
[junit4:junit4] 2> 13670 T919 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index/
[junit4:junit4] 2> 13671 T919 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 13672 T919 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index forceNew:false
[junit4:junit4] 2> 13677 T919 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@72966508),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13678 T919 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13679 T919 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index
[junit4:junit4] 2> 13679 T919 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 13681 T919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 13681 T919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 13682 T919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 13682 T919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 13683 T919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 13683 T919 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 13683 T919 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 13684 T919 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 13684 T919 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 13685 T919 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 13686 T919 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 13686 T919 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 13687 T919 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 13687 T919 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 13687 T919 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 13688 T919 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 13688 T919 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13689 T919 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13689 T919 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13690 T919 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13690 T919 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13691 T919 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13692 T919 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13692 T919 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13693 T919 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 13693 T919 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 13706 T919 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 13725 T919 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 13726 T919 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 13729 T919 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4
[junit4:junit4] 2> 13731 T919 oass.SolrIndexSearcher.<init> Opening Searcher@4ea6deb8 main
[junit4:junit4] 2> 13732 T919 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 13732 T919 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 13733 T919 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 13741 T919 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 13800 T920 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4ea6deb8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 13805 T919 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 13806 T919 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14587 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14587 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:27825_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27825/et/g"}
[junit4:junit4] 2> 14588 T854 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 14588 T854 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 14625 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14626 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14625 T887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14625 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14625 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14625 T918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14808 T919 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 14808 T919 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:27825/et/g collection:collection1 shard:shard2
[junit4:junit4] 2> 14811 T919 oasc.ZkController.register We are http://127.0.0.1:27825/et/g/collection1/ and leader is http://127.0.0.1:27818/et/g/collection1/
[junit4:junit4] 2> 14812 T919 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:27825/et/g
[junit4:junit4] 2> 14812 T919 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 14812 T919 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C54 name=collection1 org.apache.solr.core.SolrCore@54753ccd url=http://127.0.0.1:27825/et/g/collection1 node=127.0.0.1:27825_et%2Fg C54_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:27825_et%2Fg, base_url=http://127.0.0.1:27825/et/g}
[junit4:junit4] 2> 14813 T921 C54 P27825 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 14813 T919 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14814 T921 C54 P27825 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 14814 T921 C54 P27825 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 14814 T921 C54 P27825 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14814 T831 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 14815 T831 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14816 T921 C54 P27825 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14816 T831 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14840 T831 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14842 T831 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 14843 T831 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C53_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:27821_et%2Fg, base_url=http://127.0.0.1:27821/et/g}
[junit4:junit4] 2> 15375 T905 C53 P27821 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:27813/et/g/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 15375 T905 C53 P27821 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:27821/et/g START replicas=[http://127.0.0.1:27813/et/g/collection1/] nUpdates=100
[junit4:junit4] 2> 15376 T905 C53 P27821 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 15376 T905 C53 P27821 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 15376 T905 C53 P27821 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 15377 T905 C53 P27821 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 15377 T905 C53 P27821 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 15377 T905 C53 P27821 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:27813/et/g/collection1/. core=collection1
[junit4:junit4] 2> 15377 T905 C53 P27821 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C55 name=collection1 org.apache.solr.core.SolrCore@68dca914 url=http://127.0.0.1:27813/et/g/collection1 node=127.0.0.1:27813_et%2Fg C55_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:27813_et%2Fg, base_url=http://127.0.0.1:27813/et/g, leader=true}
[junit4:junit4] 2> 15391 T864 C55 P27813 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 15391 T863 C55 P27813 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 15393 T864 C55 P27813 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1
[junit4:junit4] 2> 15397 T864 C55 P27813 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@512cb9d7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15397 T864 C55 P27813 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15426 T864 C55 P27813 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@512cb9d7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@512cb9d7),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15427 T864 C55 P27813 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15428 T864 C55 P27813 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1
[junit4:junit4] 2> 15429 T864 C55 P27813 oass.SolrIndexSearcher.<init> Opening Searcher@187b0f67 realtime
[junit4:junit4] 2> 15429 T864 C55 P27813 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15429 T864 C55 P27813 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 38
[junit4:junit4] 2> 15430 T905 C53 P27821 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15431 T905 C53 P27821 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 15433 T865 C55 P27813 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15433 T865 C55 P27813 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 15434 T905 C53 P27821 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 15434 T905 C53 P27821 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 15435 T905 C53 P27821 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 15437 T865 C55 P27813 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1
[junit4:junit4] 2> 15438 T865 C55 P27813 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1/index
[junit4:junit4] 2> 15438 T865 C55 P27813 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 15439 T905 C53 P27821 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 15440 T905 C53 P27821 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index.20130128092936183 forceNew:false
[junit4:junit4] 2> 15441 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3
[junit4:junit4] 2> 15441 T905 C53 P27821 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index.20130128092936183 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d73bb63) fullCopy=true
[junit4:junit4] 2> 15445 T865 C55 P27813 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 15447 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index
[junit4:junit4] 2> 15447 T905 C53 P27821 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 15448 T905 C53 P27821 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130128092936183
[junit4:junit4] 2> 15449 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3
[junit4:junit4] 2> 15450 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3
[junit4:junit4] 2> 15450 T905 C53 P27821 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index.20130128092936183
[junit4:junit4] 2> 15453 T905 C53 P27821 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index.20130128092936183 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d73bb63),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15454 T905 C53 P27821 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15455 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3
[junit4:junit4] 2> 15455 T905 C53 P27821 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 15456 T905 C53 P27821 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 15456 T905 C53 P27821 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 15457 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index.20130128092936183
[junit4:junit4] 2> 15457 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3
[junit4:junit4] 2> 15461 T905 C53 P27821 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index.20130128092936183 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d73bb63),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15461 T905 C53 P27821 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15461 T905 C53 P27821 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 15462 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3
[junit4:junit4] 2> 15462 T905 C53 P27821 oass.SolrIndexSearcher.<init> Opening Searcher@11e3104a main
[junit4:junit4] 2> 15464 T904 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11e3104a main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 15465 T904 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index
[junit4:junit4] 2> 15465 T905 C53 P27821 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 15467 T905 C53 P27821 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index.20130128092936183 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d73bb63),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index.20130128092936183 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d73bb63),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 15467 T905 C53 P27821 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 15468 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3
[junit4:junit4] 2> 15469 T905 C53 P27821 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15469 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index.20130128092936183
[junit4:junit4] 2> 15469 T905 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3/index
[junit4:junit4] 2> 15469 T905 C53 P27821 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 15469 T905 C53 P27821 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 15470 T905 C53 P27821 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 15470 T905 C53 P27821 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15478 T905 C53 P27821 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 15844 T831 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16130 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16131 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:27825_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27825/et/g"}
[junit4:junit4] 2> 16137 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:27821_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27821/et/g"}
[junit4:junit4] 2> 16150 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16150 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16150 T887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16150 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16150 T918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16150 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16846 T831 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17848 T831 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C54_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:27825_et%2Fg, base_url=http://127.0.0.1:27825/et/g}
[junit4:junit4] 2> 18845 T921 C54 P27825 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:27818/et/g/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 18845 T921 C54 P27825 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:27825/et/g START replicas=[http://127.0.0.1:27818/et/g/collection1/] nUpdates=100
[junit4:junit4] 2> 18846 T921 C54 P27825 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 18846 T921 C54 P27825 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 18846 T921 C54 P27825 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 18846 T921 C54 P27825 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 18847 T921 C54 P27825 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 18847 T921 C54 P27825 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:27818/et/g/collection1/. core=collection1
[junit4:junit4] 2> 18848 T921 C54 P27825 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18850 T831 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C56 name=collection1 org.apache.solr.core.SolrCore@2145c07f url=http://127.0.0.1:27818/et/g/collection1 node=127.0.0.1:27818_et%2Fg C56_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:27818_et%2Fg, base_url=http://127.0.0.1:27818/et/g, leader=true}
[junit4:junit4] 2> 18859 T878 C56 P27818 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 18865 T879 C56 P27818 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 18866 T879 C56 P27818 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2
[junit4:junit4] 2> 18870 T879 C56 P27818 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@65628ead),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 18871 T879 C56 P27818 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 18874 T879 C56 P27818 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@65628ead),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@65628ead),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 18875 T879 C56 P27818 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 18876 T879 C56 P27818 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2
[junit4:junit4] 2> 18876 T879 C56 P27818 oass.SolrIndexSearcher.<init> Opening Searcher@1db435e1 realtime
[junit4:junit4] 2> 18877 T879 C56 P27818 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18877 T879 C56 P27818 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 12
[junit4:junit4] 2> 18878 T921 C54 P27825 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18879 T921 C54 P27825 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 18881 T880 C56 P27818 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18881 T880 C56 P27818 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 18882 T921 C54 P27825 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 18882 T921 C54 P27825 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 18882 T921 C54 P27825 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 18885 T880 C56 P27818 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2
[junit4:junit4] 2> 18886 T880 C56 P27818 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2/index
[junit4:junit4] 2> 18887 T880 C56 P27818 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 18887 T921 C54 P27825 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 18889 T921 C54 P27825 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index.20130128092939631 forceNew:false
[junit4:junit4] 2> 18889 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4
[junit4:junit4] 2> 18890 T921 C54 P27825 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index.20130128092939631 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76f352a8) fullCopy=true
[junit4:junit4] 2> 18893 T880 C56 P27818 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 18895 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index
[junit4:junit4] 2> 18895 T921 C54 P27825 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 18896 T921 C54 P27825 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130128092939631
[junit4:junit4] 2> 18897 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4
[junit4:junit4] 2> 18897 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4
[junit4:junit4] 2> 18898 T921 C54 P27825 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index.20130128092939631
[junit4:junit4] 2> 18901 T921 C54 P27825 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index.20130128092939631 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76f352a8),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 18902 T921 C54 P27825 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 18903 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4
[junit4:junit4] 2> 18903 T921 C54 P27825 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 18903 T921 C54 P27825 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 18904 T921 C54 P27825 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 18904 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index.20130128092939631
[junit4:junit4] 2> 18905 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4
[junit4:junit4] 2> 18908 T921 C54 P27825 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index.20130128092939631 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76f352a8),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 18909 T921 C54 P27825 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 18909 T921 C54 P27825 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 18910 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4
[junit4:junit4] 2> 18910 T921 C54 P27825 oass.SolrIndexSearcher.<init> Opening Searcher@92d88e8 main
[junit4:junit4] 2> 18912 T920 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@92d88e8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 18912 T920 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index
[junit4:junit4] 2> 18913 T921 C54 P27825 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 18915 T921 C54 P27825 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index.20130128092939631 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76f352a8),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index.20130128092939631 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76f352a8),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18915 T921 C54 P27825 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18916 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4
[junit4:junit4] 2> 18917 T921 C54 P27825 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18917 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index.20130128092939631
[junit4:junit4] 2> 18917 T921 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4/index
[junit4:junit4] 2> 18917 T921 C54 P27825 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 18917 T921 C54 P27825 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 18918 T921 C54 P27825 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 18918 T921 C54 P27825 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18925 T921 C54 P27825 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19164 T854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19165 T854 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:27825_et%2Fg",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27825/et/g"}
[junit4:junit4] 2> 19179 T853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19180 T918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19180 T872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19179 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19180 T887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19179 T859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19853 T831 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19855 T831 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C57 name=collection1 org.apache.solr.core.SolrCore@53a25904 url=http://127.0.0.1:27808/et/g/collection1 node=127.0.0.1:27808_et%2Fg C57_STATE=coll:control_collection core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:27808_et%2Fg, base_url=http://127.0.0.1:27808/et/g, leader=true}
[junit4:junit4] 2> 19868 T843 C57 P27808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data
[junit4:junit4] 2> 19872 T843 C57 P27808 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5979ea32),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19873 T843 C57 P27808 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19874 T843 C57 P27808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/control/data
[junit4:junit4] 2> 19876 T843 C57 P27808 oass.SolrIndexSearcher.<init> Opening Searcher@5d59380f realtime
[junit4:junit4] 2> 19876 T843 C57 P27808 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1425424337453711360)} 0 9
[junit4:junit4] 2> 19880 T866 C55 P27813 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty1
[junit4:junit4] 2> 19886 T881 C56 P27818 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty2
[junit4:junit4] 2> C53_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:27821_et%2Fg, base_url=http://127.0.0.1:27821/et/g}
[junit4:junit4] 2> 19894 T892 C53 P27821 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty3
[junit4:junit4] 2> 19895 T892 C53 P27821 /update {update.distrib=FROMLEADER&_version_=-1425424337466294272&update.from=http://127.0.0.1:27813/et/g/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1425424337466294272)} 0 3
[junit4:junit4] 2> C54_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:27825_et%2Fg, base_url=http://127.0.0.1:27825/et/g}
[junit4:junit4] 2> 19899 T908 C54 P27825 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359390560750/jetty4
[junit4:junit4] 2> 19900 T908 C54 P27825 /update {update.distrib=FROMLEADER&_version_=-1425424337471537152&update.from=http://127.0.0.1:27818/et/g/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1425424337471537152)} 0 4
[junit4:junit4] 2> 19901 T881 C56 P27818 /update {update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1425424337471537152)} 0 17
[junit4:junit4] 2> 19902 T866 C55 P27813 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1425424337466294272)} 0 23
[junit4:junit4] 2> 19910 T843 C57 P27808 /update {wt=javabin&version=2} {add=[1 (1425424337495654400)]} 0 4
[junit4:junit4] 2> 19931 T892 C53 P27821 /update {distrib.from=http://127.0.0.1:27813/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1425424337510334464)]} 0 4
[junit4:junit4] 2> 19932 T867 C55 P27813 /update {distrib.from=http://127.0.0.1:27818/et/g/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1425424337510334464)]} 0 12
[junit4:junit4] 2> 19933 T882 C56 P27818 /update {wt=javabin&version=2} {add=[1]} 0 20
[junit4:junit4] 2> 19938 T843 C57 P27808 /update {wt=javabin&version=2} {add=[2 (1425424337527111680)]} 0 2
[junit4:junit4] 2> 19954 T908 C54 P27825 /update {distrib.from=http://127.0.0.1:27818/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1425424337535500288)]} 0 4
[junit4:junit4] 2> 19955 T881 C56 P27818 /update {distrib.from=http://127.0.0.1:27813/et/g/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1425424337535500288)]} 0 11
[junit4:junit4] 2> 19955 T866 C55 P27813 /update {wt=javabin&version=2} {add=[2]} 0 14
[junit4:junit4] 2> 19960 T843 C57 P27808 /update {wt=javabin&version=2} {add=[3 (1425424337549131776)]} 0 2
[junit4:junit4] 2> 19972 T908 C54 P27825 /update {distrib.from=http://127.0.0.1:27818/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1425424337557520384)]} 0 2
[junit4:junit4] 2> 19972 T881 C56 P27818 /update {distrib.from=http://127.0.0.1:27813/et/g/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1425424337557520384)]} 0 6
[junit4:junit4] 2> 19973 T866 C55 P27813 /update {wt=javabin&version=2} {add=[3]} 0 10
[junit4:junit4] 2> 19978 T843 C57 P27808 /update {wt=javabin&version=2} {add=[4 (1425424337568006144)]} 0 2
[junit4:junit4] 2> 19989 T892 C53 P27821 /update {distrib.from=http://127.0.0.1:27813/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1425424337575346176)]} 0 2
[junit4:junit4] 2> 19990 T867 C55 P27813 /update {distrib.from=http://127.0.0.1:27818/et/g/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1425424337575346176)]} 0 7
[junit4:junit4] 2> 19990 T882 C56 P27818 /update {wt=javabin&version=2} {add=[4]} 0 10
[junit4:junit4] 2> 19995 T843 C57 P27808 /update {wt=javabin&version=2} {add=[5 (1425424337585831936)]} 0 2
[junit4:junit4] 2> 20003 T908 C54 P27825 /update {distrib.from=http://127.0.0.1:27818/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1425424337590026240)]} 0 2
[junit4:junit4] 2> 20004 T882 C56 P27818 /update {wt=javabin&version=2} {add=[5 (1425424337590026240)]} 0 7
[junit4:junit4] 2> 20009 T843 C57 P27808 /update {wt=javabin&version=2} {add=[6 (1425424337600512000)]} 0 2
[junit4:junit4] 2> 20020 T908 C54 P27825 /update {distrib.from=http://127.0.0.1:27818/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1425424337607852032)]} 0 2
[junit4:junit4] 2> 20020 T881 C56 P27818 /update {distrib.from=http://127.0.0.1:27813/et/g/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1425424337607852032)]} 0 6
[junit4:junit4] 2> 20021 T866 C55 P27813 /update {wt=javabin&version=2} {add=[6]} 0 10
[junit4:junit4] 2> 20026 T843 C57 P27808 /update {wt=javabin&version=2} {add=[7 (1425424337618337792)]} 0 2
[junit4:junit4] 2> 20037 T908 C54 P27825 /update {distrib.from=http://127.0.0.1:27818/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1425424337625677824)]} 0 2
[junit4:junit4] 2> 20037 T881 C56 P27818 /update {distrib.from=http://127.0.0.1:27813/et/g/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1425424337625677824)]} 0 6
[junit4:junit4] 2> 20038 T866 C55 P27813 /update {wt=javabin&version=2} {add=[7]} 0 10
[junit4:junit4] 2> 20043 T843 C57 P27808 /update {wt=javabin&version=2} {add=[8 (1425424337636163584)]} 0 2
[junit4:junit4] 2> 20051 T892 C53 P27821 /update {distrib.from=http://127.0.0.1:27813/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1425424337640357888)]} 0 2
[junit4:junit4] 2> 20052 T866 C55 P27813 /update {wt=javabin&version=2} {add=[8 (1425424337640357888)]} 0 7
[junit4:junit4] 2> 20057 T843 C57 P27808 /update {wt=javabin&version=2} {add=[9 (1425424337650843648)]} 0 2
[junit4:junit4] 2> 20064 T908 C54 P27825 /update {distrib.from=http://127.0.0.1:27818/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1425424337653989376)]} 0 2
[junit4:junit4] 2> 20064 T882 C56 P27818 /update {wt=javabin&version=2} {add=[9 (1425424337653989376)]} 0 6
[junit4:junit4] 2> 20101 T843 C57 P27808 /update {wt=javabin&version=2} {add=[10 (1425424337663426560)]} 0 34
[junit4:junit4] 2> 20110 T892 C53 P27821 /update {distrib.from=http://127.0.0.1:27813/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1425424337703272448)]} 0 2
[junit4:junit4] 2> 20110 T866 C55 P27813 /update {wt=javabin&version=2} {add=[10 (1425424337703272448)]} 0 6
[junit4:junit4] 2> 20117 T843 C57 P27808 /update {wt=javabin&version=2} {add=[11 (1425424337712709632)]} 0 4
[junit4:junit4] 2> 20125 T892 C53 P27821 /update {distrib.from=http://127.0.0.1:27813/et/g/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1425424337717952512)]} 0 2
[junit4:junit4] 2> 20125 T866 C55 P27813 /update {wt=javabin&version=2} {add=[11 (1425424337717952512)]} 0 6
[junit4:junit4] 2> 20130 T843 C57 P
[...truncated too long message...]
nt.java:236)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:233)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:233)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 406967 T918 oasc.LeaderElector$1.process WARNING org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection3/leader_elect/shard2/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:236)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:233)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:233)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 406967 T918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 406967 T918 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 406967 T918 oasc.LeaderElector$1.process WARNING org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:236)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:233)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:233)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 406968 T918 oasc.LeaderElector$1.process WARNING org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:236)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:233)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:233)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 406968 T918 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene41: {n_f1=PostingsFormat(name=Asserting), foo_b=PostingsFormat(name=MockRandom), cat=PostingsFormat(name=Memory doPackFST= false), foo_d=Pulsing41(freqCutoff=4 minBlockSize=18 maxBlockSize=46), foo_f=PostingsFormat(name=MockRandom), n_tl1=PostingsFormat(name=Asserting), n_d1=PostingsFormat(name=Memory doPackFST= false), rnd_b=Pulsing41(freqCutoff=4 minBlockSize=18 maxBlockSize=46), intDefault=PostingsFormat(name=Asserting), n_td1=PostingsFormat(name=Asserting), timestamp=PostingsFormat(name=Memory doPackFST= false), id=Pulsing41(freqCutoff=4 minBlockSize=18 maxBlockSize=46), range_facet_sl=Pulsing41(freqCutoff=4 minBlockSize=18 maxBlockSize=46), range_facet_si=PostingsFormat(name=Memory doPackFST= false), oddField_s=Pulsing41(freqCutoff=4 minBlockSize=18 maxBlockSize=46), sequence_i=Pulsing41(freqCutoff=4 minBlockSize=18 maxBlockSize=46), name=Pulsing41(freqCutoff=4 minBlockSize=18 maxBlockSize=46), foo_i=PostingsFormat(name=Asserting), regex_dup_B_s=PostingsFormat(name=Memory doPackFST= false), multiDefault=PostingsFormat(name=Memory doPackFST= false), n_tf1=PostingsFormat(name=Memory doPackFST= false), n_dt1=PostingsFormat(name=Asserting), genre_s=Pulsing41(freqCutoff=4 minBlockSize=18 maxBlockSize=46), author_t=PostingsFormat(name=Asserting), n_ti1=Pulsing41(freqCutoff=4 minBlockSize=18 maxBlockSize=46), range_facet_l=PostingsFormat(name=Memory doPackFST= false), text=PostingsFormat(name=MockRandom), _version_=PostingsFormat(name=Asserting), val_i=Pulsing41(freqCutoff=4 minBlockSize=18 maxBlockSize=46), SubjectTerms_mfacet=PostingsFormat(name=Asserting), series_t=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=Memory doPackFST= false), n_tdt1=PostingsFormat(name=Asserting), regex_dup_A_s=PostingsFormat(name=MockRandom), price=PostingsFormat(name=MockRandom), other_tl1=PostingsFormat(name=Asserting), n_l1=PostingsFormat(name=Memory doPackFST= false), a_si=PostingsFormat(name=Asserting), inStock=PostingsFormat(name=MockRandom)}, sim=DefaultSimilarity, locale=ar, timezone=Etc/GMT+7
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=2,free=221928336,total=337641472
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestPerFieldSimilarity, TestFastOutputStream, JSONWriterTest, SearchHandlerTest, TestPartialUpdateDeduplication, AlternateDirectoryTest, TestStressVersions, TestJoin, TermsComponentTest, DistributedSpellCheckComponentTest, ScriptEngineTest, SampleTest, TestDefaultSimilarityFactory, TestLMDirichletSimilarityFactory, NoCacheHeaderTest, TestLazyCores, TestFuzzyAnalyzedSuggestions, SimplePostToolTest, HighlighterConfigTest, TestFastLRUCache, SpellPossibilityIteratorTest, UpdateRequestProcessorFactoryTest, SyncSliceTest, TestPseudoReturnFields, CopyFieldTest, TestExtendedDismaxParser, BinaryUpdateRequestHandlerTest, TestSystemIdResolver, TestRangeQuery, SuggesterWFSTTest, PreAnalyzedFieldTest, DistanceFunctionTest, TestAtomicUpdateErrorCases, SystemInfoHandlerTest, QueryElevationComponentTest, TestLMJelinekMercerSimilarityFactory, TestBadConfig, TestLFUCache, DistributedTermsComponentTest, TestBinaryResponseWriter, DateFieldTest, TestZkChroot, JsonLoaderTest, TestNumberUtils, BasicDistributedZkTest]
[junit4:junit4] Completed on J0 in 407.36s, 1 test, 1 error <<< FAILURES!
[...truncated 386 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:841: There were test failures: 248 suites, 1035 tests, 1 error, 23 ignored (5 assumptions)
Total time: 50 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure