You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2012/12/30 23:07:53 UTC

[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 842 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/842/

2 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([E7D277FA8C36002B]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([E7D277FA8C36002B]:0)




Build Log:
[...truncated 9279 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 0 T1010 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 5 T1010 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1356898028411
[junit4:junit4]   2> 6 T1010 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6 T1011 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 9 T1011 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 9 T1011 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 9 T1011 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 9 T1011 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 10 T1011 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 107 T1010 oasc.ZkTestServer.run start zk server on port:35386
[junit4:junit4]   2> 120 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@18498747
[junit4:junit4]   2> 121 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 121 T1016 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 122 T1016 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 122 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:31166
[junit4:junit4]   2> 123 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:31166
[junit4:junit4]   2> 123 T1014 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 149 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb800000 with negotiated timeout 10000 for client /140.211.11.196:31166
[junit4:junit4]   2> 149 T1016 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb800000, negotiated timeout = 10000
[junit4:junit4]   2> 150 T1017 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18498747 name:ZooKeeperConnection Watcher:127.0.0.1:35386 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 150 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 150 T1010 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 155 T1015 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bed6ccb800000
[junit4:junit4]   2> 158 T1017 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 158 T1010 oaz.ZooKeeper.close Session: 0x13bed6ccb800000 closed
[junit4:junit4]   2> 158 T1012 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:31166 which had sessionid 0x13bed6ccb800000
[junit4:junit4]   2> 158 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@32b53a3c
[junit4:junit4]   2> 159 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 159 T1018 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 160 T1018 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 160 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59108
[junit4:junit4]   2> 160 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59108
[junit4:junit4]   2> 162 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb800001 with negotiated timeout 10000 for client /140.211.11.196:59108
[junit4:junit4]   2> 162 T1018 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb800001, negotiated timeout = 10000
[junit4:junit4]   2> 162 T1019 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32b53a3c name:ZooKeeperConnection Watcher:127.0.0.1:35386/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 162 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 163 T1010 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 166 T1010 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 169 T1010 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 177 T1010 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 180 T1010 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 181 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 193 T1010 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 194 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 298 T1010 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 298 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 301 T1010 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 302 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 305 T1010 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 305 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 317 T1010 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 317 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 320 T1010 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 320 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 323 T1010 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 324 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 332 T1010 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 332 T1010 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 335 T1015 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bed6ccb800001
[junit4:junit4]   2> 336 T1019 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 336 T1012 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:59108 which had sessionid 0x13bed6ccb800001
[junit4:junit4]   2> 336 T1010 oaz.ZooKeeper.close Session: 0x13bed6ccb800001 closed
[junit4:junit4]   2> 469 T1010 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 473 T1010 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:47473
[junit4:junit4]   2> 474 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 474 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742
[junit4:junit4]   2> 475 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742/'
[junit4:junit4]   2> 503 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 504 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 504 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742
[junit4:junit4]   2> 504 T1010 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742/solr.xml
[junit4:junit4]   2> 505 T1010 oasc.CoreContainer.<init> New CoreContainer 503531821
[junit4:junit4]   2> 505 T1010 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742/'
[junit4:junit4]   2> 506 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742/'
[junit4:junit4]   2> 527 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 528 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 528 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 528 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 529 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 529 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 529 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 530 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 530 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 530 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 545 T1010 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 559 T1010 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:35386/solr
[junit4:junit4]   2> 560 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 560 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5c536eb6
[junit4:junit4]   2> 561 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 562 T1029 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 563 T1029 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 563 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23553
[junit4:junit4]   2> 564 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23553
[junit4:junit4]   2> 565 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb800002 with negotiated timeout 20000 for client /140.211.11.196:23553
[junit4:junit4]   2> 565 T1029 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb800002, negotiated timeout = 20000
[junit4:junit4]   2> 566 T1030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c536eb6 name:ZooKeeperConnection Watcher:127.0.0.1:35386 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 566 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 567 T1015 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bed6ccb800002
[junit4:junit4]   2> 568 T1030 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 568 T1010 oaz.ZooKeeper.close Session: 0x13bed6ccb800002 closed
[junit4:junit4]   2> 568 T1012 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:23553 which had sessionid 0x13bed6ccb800002
[junit4:junit4]   2> 569 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 577 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@71568f20
[junit4:junit4]   2> 577 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 578 T1031 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 578 T1031 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 579 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17018
[junit4:junit4]   2> 579 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17018
[junit4:junit4]   2> 580 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb800003 with negotiated timeout 20000 for client /140.211.11.196:17018
[junit4:junit4]   2> 580 T1031 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb800003, negotiated timeout = 20000
[junit4:junit4]   2> 581 T1032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71568f20 name:ZooKeeperConnection Watcher:127.0.0.1:35386/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 581 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 583 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 585 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 594 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47473_
[junit4:junit4]   2> 594 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:47473_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:47473_
[junit4:junit4]   2> 595 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47473_
[junit4:junit4]   2> 602 T1010 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 615 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 616 T1010 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 623 T1010 oasc.Overseer.start Overseer (id=88925669190270979-127.0.0.1:47473_-n_0000000000) starting
[junit4:junit4]   2> 624 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 625 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 626 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 636 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 637 T1034 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 638 T1010 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 646 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 648 T1033 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 651 T1035 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742/collection1
[junit4:junit4]   2> 652 T1035 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 652 T1035 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 652 T1035 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 654 T1035 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742/collection1/'
[junit4:junit4]   2> 655 T1035 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 656 T1035 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742/collection1/lib/README' to classloader
[junit4:junit4]   2> 709 T1035 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 784 T1035 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 885 T1035 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 892 T1035 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1370 T1035 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1378 T1035 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1381 T1035 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1393 T1035 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1397 T1035 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1401 T1035 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1402 T1035 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1403 T1035 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356898028742/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data/
[junit4:junit4]   2> 1403 T1035 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44a406e8
[junit4:junit4]   2> 1403 T1035 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1404 T1035 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data forceNew:false
[junit4:junit4]   2> 1405 T1035 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data
[junit4:junit4]   2> 1405 T1035 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data/index/
[junit4:junit4]   2> 1406 T1035 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1407 T1035 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data/index forceNew:false
[junit4:junit4]   2> 1411 T1035 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4369cceb; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1411 T1035 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1412 T1035 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data/index
[junit4:junit4]   2> 1412 T1035 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1414 T1035 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1414 T1035 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1414 T1035 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1414 T1035 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1415 T1035 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1415 T1035 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1415 T1035 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1416 T1035 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1416 T1035 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1416 T1035 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1417 T1035 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1417 T1035 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1417 T1035 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1417 T1035 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1417 T1035 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1418 T1035 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1418 T1035 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1418 T1035 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1419 T1035 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1419 T1035 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1419 T1035 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1419 T1035 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1420 T1035 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1420 T1035 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1420 T1035 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1420 T1035 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1429 T1035 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1432 T1035 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1433 T1035 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1435 T1035 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data
[junit4:junit4]   2> 1436 T1035 oass.SolrIndexSearcher.<init> Opening Searcher@4d852dd3 main
[junit4:junit4]   2> 1437 T1035 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1437 T1035 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1437 T1035 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1442 T1035 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1486 T1036 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4d852dd3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1490 T1035 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1490 T1035 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1491 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2151 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2152 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:47473_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:47473"}
[junit4:junit4]   2> 2152 T1033 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2152 T1033 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2153 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2168 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2502 T1035 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2502 T1035 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47473 collection:control_collection shard:shard1
[junit4:junit4]   2> 2503 T1035 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2564 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2615 T1035 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2616 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2618 T1035 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2619 T1035 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2619 T1035 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47473/collection1/
[junit4:junit4]   2> 2619 T1035 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2619 T1035 oasc.SyncStrategy.syncToMe http://127.0.0.1:47473/collection1/ has no replicas
[junit4:junit4]   2> 2620 T1035 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47473/collection1/
[junit4:junit4]   2> 2620 T1035 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2652 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3671 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3721 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3776 T1035 oasc.ZkController.register We are http://127.0.0.1:47473/collection1/ and leader is http://127.0.0.1:47473/collection1/
[junit4:junit4]   2> 3776 T1035 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47473
[junit4:junit4]   2> 3776 T1035 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3777 T1035 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3777 T1035 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3780 T1035 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3780 T1010 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3781 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3782 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3795 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3804 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6f55c276
[junit4:junit4]   2> 3806 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3806 T1037 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3806 T1037 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 3807 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17025
[junit4:junit4]   2> 3807 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17025
[junit4:junit4]   2> 3808 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb800004 with negotiated timeout 10000 for client /140.211.11.196:17025
[junit4:junit4]   2> 3808 T1037 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb800004, negotiated timeout = 10000
[junit4:junit4]   2> 3808 T1038 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f55c276 name:ZooKeeperConnection Watcher:127.0.0.1:35386/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3809 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3810 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3812 T1010 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3978 T1010 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3981 T1010 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:17026
[junit4:junit4]   2> 3982 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3983 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217
[junit4:junit4]   2> 3983 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217/'
[junit4:junit4]   2> 4023 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4024 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4024 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217
[junit4:junit4]   2> 4025 T1010 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217/solr.xml
[junit4:junit4]   2> 4025 T1010 oasc.CoreContainer.<init> New CoreContainer 1334478023
[junit4:junit4]   2> 4026 T1010 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217/'
[junit4:junit4]   2> 4026 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217/'
[junit4:junit4]   2> 4055 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 4056 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4056 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4056 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4057 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4057 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4058 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4058 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4059 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4059 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4078 T1010 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4097 T1010 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:35386/solr
[junit4:junit4]   2> 4098 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4098 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@286a195b
[junit4:junit4]   2> 4099 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4100 T1048 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4101 T1048 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 4101 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17027
[junit4:junit4]   2> 4102 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17027
[junit4:junit4]   2> 4104 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb800005 with negotiated timeout 20000 for client /140.211.11.196:17027
[junit4:junit4]   2> 4104 T1048 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb800005, negotiated timeout = 20000
[junit4:junit4]   2> 4104 T1049 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@286a195b name:ZooKeeperConnection Watcher:127.0.0.1:35386 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4104 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4106 T1015 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bed6ccb800005
[junit4:junit4]   2> 4117 T1049 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4118 T1012 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:17027 which had sessionid 0x13bed6ccb800005
[junit4:junit4]   2> 4117 T1010 oaz.ZooKeeper.close Session: 0x13bed6ccb800005 closed
[junit4:junit4]   2> 4118 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 4125 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@dc55158
[junit4:junit4]   2> 4126 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4126 T1050 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4127 T1050 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 4127 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17028
[junit4:junit4]   2> 4127 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17028
[junit4:junit4]   2> 4129 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb800006 with negotiated timeout 20000 for client /140.211.11.196:17028
[junit4:junit4]   2> 4129 T1050 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb800006, negotiated timeout = 20000
[junit4:junit4]   2> 4129 T1051 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dc55158 name:ZooKeeperConnection Watcher:127.0.0.1:35386/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4129 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4131 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4132 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4140 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:17026_
[junit4:junit4]   2> 4141 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:17026_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:17026_
[junit4:junit4]   2> 4142 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:17026_
[junit4:junit4]   2> 4145 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4145 T1038 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4146 T1032 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4148 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4153 T1052 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217/collection1
[junit4:junit4]   2> 4153 T1052 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4154 T1052 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4154 T1052 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4155 T1052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217/collection1/'
[junit4:junit4]   2> 4156 T1052 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217/collection1/lib/README' to classloader
[junit4:junit4]   2> 4157 T1052 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4193 T1052 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4243 T1052 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4344 T1052 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4349 T1052 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4785 T1052 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4792 T1052 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4795 T1052 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4807 T1052 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4810 T1052 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4814 T1052 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4815 T1052 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4816 T1052 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356898032217/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1/
[junit4:junit4]   2> 4816 T1052 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44a406e8
[junit4:junit4]   2> 4816 T1052 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 4817 T1052 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1 forceNew:false
[junit4:junit4]   2> 4817 T1052 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1
[junit4:junit4]   2> 4818 T1052 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1/index/
[junit4:junit4]   2> 4818 T1052 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4819 T1052 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1/index forceNew:false
[junit4:junit4]   2> 4853 T1052 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@86c0576; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4853 T1052 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 4854 T1052 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1/index
[junit4:junit4]   2> 4854 T1052 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4856 T1052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4856 T1052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4856 T1052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4857 T1052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4857 T1052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4857 T1052 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4858 T1052 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4858 T1052 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4858 T1052 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4859 T1052 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4859 T1052 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4859 T1052 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4860 T1052 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4860 T1052 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4860 T1052 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4860 T1052 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4861 T1052 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4861 T1052 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4861 T1052 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4861 T1052 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4862 T1052 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4862 T1052 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4862 T1052 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4863 T1052 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4863 T1052 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4863 T1052 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4872 T1052 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4875 T1052 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4876 T1052 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4878 T1052 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1
[junit4:junit4]   2> 4879 T1052 oass.SolrIndexSearcher.<init> Opening Searcher@3a7b058e main
[junit4:junit4]   2> 4880 T1052 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4880 T1052 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4881 T1052 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4887 T1052 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4936 T1053 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a7b058e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4940 T1052 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4941 T1052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5235 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5236 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:47473_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:47473"}
[junit4:junit4]   2> 5241 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:17026_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:17026"}
[junit4:junit4]   2> 5241 T1033 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 5241 T1033 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5251 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5251 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5251 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5943 T1052 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 5943 T1052 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:17026 collection:collection1 shard:shard1
[junit4:junit4]   2> 5944 T1052 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 5989 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800006 type:delete cxid:0x43 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 5990 T1052 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 5991 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800006 type:create cxid:0x44 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6001 T1052 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6001 T1052 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6001 T1052 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:17026/collection1/
[junit4:junit4]   2> 6001 T1052 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6002 T1052 oasc.SyncStrategy.syncToMe http://127.0.0.1:17026/collection1/ has no replicas
[junit4:junit4]   2> 6002 T1052 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:17026/collection1/
[junit4:junit4]   2> 6002 T1052 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 6006 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800006 type:create cxid:0x4e zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6764 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6794 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6794 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6794 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6839 T1052 oasc.ZkController.register We are http://127.0.0.1:17026/collection1/ and leader is http://127.0.0.1:17026/collection1/
[junit4:junit4]   2> 6839 T1052 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:17026
[junit4:junit4]   2> 6839 T1052 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6839 T1052 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6840 T1052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6842 T1052 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6842 T1010 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6843 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6844 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7011 T1010 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 7014 T1010 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:17032
[junit4:junit4]   2> 7015 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7015 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263
[junit4:junit4]   2> 7016 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263/'
[junit4:junit4]   2> 7048 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 7049 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7049 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263
[junit4:junit4]   2> 7050 T1010 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263/solr.xml
[junit4:junit4]   2> 7050 T1010 oasc.CoreContainer.<init> New CoreContainer 1791190084
[junit4:junit4]   2> 7051 T1010 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263/'
[junit4:junit4]   2> 7051 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263/'
[junit4:junit4]   2> 7076 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 7077 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7077 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 7077 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7078 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7078 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7078 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7079 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7079 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7079 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 7094 T1010 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7110 T1010 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:35386/solr
[junit4:junit4]   2> 7111 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7111 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@67315376
[junit4:junit4]   2> 7112 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7113 T1063 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7114 T1063 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 7114 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17033
[junit4:junit4]   2> 7115 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17033
[junit4:junit4]   2> 7117 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb800007 with negotiated timeout 20000 for client /140.211.11.196:17033
[junit4:junit4]   2> 7117 T1063 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb800007, negotiated timeout = 20000
[junit4:junit4]   2> 7118 T1064 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67315376 name:ZooKeeperConnection Watcher:127.0.0.1:35386 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7118 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7120 T1015 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bed6ccb800007
[junit4:junit4]   2> 7132 T1064 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7132 T1012 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:17033 which had sessionid 0x13bed6ccb800007
[junit4:junit4]   2> 7132 T1010 oaz.ZooKeeper.close Session: 0x13bed6ccb800007 closed
[junit4:junit4]   2> 7134 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 7141 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@25c3c2fa
[junit4:junit4]   2> 7142 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7142 T1065 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7143 T1065 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 7143 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17034
[junit4:junit4]   2> 7144 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17034
[junit4:junit4]   2> 7145 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb800008 with negotiated timeout 20000 for client /140.211.11.196:17034
[junit4:junit4]   2> 7145 T1065 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb800008, negotiated timeout = 20000
[junit4:junit4]   2> 7146 T1066 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@25c3c2fa name:ZooKeeperConnection Watcher:127.0.0.1:35386/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7146 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7147 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7149 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800008 type:create cxid:0x2 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7157 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:17032_
[junit4:junit4]   2> 7158 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800008 type:delete cxid:0x4 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:17032_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:17032_
[junit4:junit4]   2> 7159 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:17032_
[junit4:junit4]   2> 7162 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7162 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7162 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7163 T1032 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7164 T1038 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7165 T1051 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7166 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7172 T1067 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263/collection1
[junit4:junit4]   2> 7173 T1067 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7173 T1067 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7174 T1067 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7175 T1067 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263/collection1/'
[junit4:junit4]   2> 7176 T1067 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263/collection1/lib/README' to classloader
[junit4:junit4]   2> 7177 T1067 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7232 T1067 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 7307 T1067 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7408 T1067 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7415 T1067 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8035 T1067 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8044 T1067 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8047 T1067 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8062 T1067 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8067 T1067 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8071 T1067 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8073 T1067 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8074 T1067 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356898035263/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2/
[junit4:junit4]   2> 8074 T1067 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44a406e8
[junit4:junit4]   2> 8075 T1067 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 8075 T1067 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2 forceNew:false
[junit4:junit4]   2> 8076 T1067 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2
[junit4:junit4]   2> 8076 T1067 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2/index/
[junit4:junit4]   2> 8077 T1067 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8078 T1067 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2/index forceNew:false
[junit4:junit4]   2> 8108 T1067 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f4c5e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8109 T1067 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8109 T1067 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2/index
[junit4:junit4]   2> 8110 T1067 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8111 T1067 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8111 T1067 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8112 T1067 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8112 T1067 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8112 T1067 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8113 T1067 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8113 T1067 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8113 T1067 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8114 T1067 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8114 T1067 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8114 T1067 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8115 T1067 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8115 T1067 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8115 T1067 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8115 T1067 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8116 T1067 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8116 T1067 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8116 T1067 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8117 T1067 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8117 T1067 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8117 T1067 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8118 T1067 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8118 T1067 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8118 T1067 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8119 T1067 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8119 T1067 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8127 T1067 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8131 T1067 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8132 T1067 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8134 T1067 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2
[junit4:junit4]   2> 8135 T1067 oass.SolrIndexSearcher.<init> Opening Searcher@15d4a8b8 main
[junit4:junit4]   2> 8136 T1067 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8136 T1067 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8137 T1067 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8142 T1067 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8190 T1068 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15d4a8b8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8192 T1067 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8192 T1067 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8300 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8301 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:17026_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:17026"}
[junit4:junit4]   2> 8308 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:17032_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:17032"}
[junit4:junit4]   2> 8308 T1033 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 8309 T1033 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 8320 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8320 T1066 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8320 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8320 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9195 T1067 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 9195 T1067 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:17032 collection:collection1 shard:shard2
[junit4:junit4]   2> 9196 T1067 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 9239 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800008 type:delete cxid:0x42 zxid:0x7c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 9240 T1067 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 9241 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800008 type:create cxid:0x43 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9252 T1067 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 9252 T1067 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 9253 T1067 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:17032/collection1/
[junit4:junit4]   2> 9253 T1067 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 9253 T1067 oasc.SyncStrategy.syncToMe http://127.0.0.1:17032/collection1/ has no replicas
[junit4:junit4]   2> 9253 T1067 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:17032/collection1/
[junit4:junit4]   2> 9254 T1067 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 9258 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb800008 type:create cxid:0x4c zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9835 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9888 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9888 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9888 T1066 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9888 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9923 T1067 oasc.ZkController.register We are http://127.0.0.1:17032/collection1/ and leader is http://127.0.0.1:17032/collection1/
[junit4:junit4]   2> 9923 T1067 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:17032
[junit4:junit4]   2> 9923 T1067 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 9924 T1067 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9924 T1067 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9926 T1067 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9927 T1010 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4]   2> 9927 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9928 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 10139 T1010 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 10144 T1010 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:17042
[junit4:junit4]   2> 10145 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 10146 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343
[junit4:junit4]   2> 10147 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343/'
[junit4:junit4]   2> 10212 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 10213 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 10214 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343
[junit4:junit4]   2> 10215 T1010 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343/solr.xml
[junit4:junit4]   2> 10215 T1010 oasc.CoreContainer.<init> New CoreContainer 1582570941
[junit4:junit4]   2> 10216 T1010 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343/'
[junit4:junit4]   2> 10217 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343/'
[junit4:junit4]   2> 10264 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 10265 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 10266 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 10267 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 10267 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 10268 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 10269 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 10270 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 10270 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 10271 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 10304 T1010 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 10334 T1010 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:35386/solr
[junit4:junit4]   2> 10335 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 10336 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@65e8dc1a
[junit4:junit4]   2> 10338 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 10338 T1078 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 10340 T1078 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 10340 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17043
[junit4:junit4]   2> 10340 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17043
[junit4:junit4]   2> 10343 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb800009 with negotiated timeout 20000 for client /140.211.11.196:17043
[junit4:junit4]   2> 10343 T1078 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb800009, negotiated timeout = 20000
[junit4:junit4]   2> 10343 T1079 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65e8dc1a name:ZooKeeperConnection Watcher:127.0.0.1:35386 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 10344 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 10346 T1015 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bed6ccb800009
[junit4:junit4]   2> 10356 T1079 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 10356 T1010 oaz.ZooKeeper.close Session: 0x13bed6ccb800009 closed
[junit4:junit4]   2> 10356 T1012 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:17043 which had sessionid 0x13bed6ccb800009
[junit4:junit4]   2> 10357 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 10368 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@725a7f5e
[junit4:junit4]   2> 10369 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 10370 T1080 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 10370 T1080 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 10370 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17044
[junit4:junit4]   2> 10371 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17044
[junit4:junit4]   2> 10373 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb80000a with negotiated timeout 20000 for client /140.211.11.196:17044
[junit4:junit4]   2> 10373 T1080 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb80000a, negotiated timeout = 20000
[junit4:junit4]   2> 10373 T1081 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@725a7f5e name:ZooKeeperConnection Watcher:127.0.0.1:35386/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 10373 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 10375 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb80000a type:create cxid:0x1 zxid:0x8d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10377 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb80000a type:create cxid:0x2 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10378 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:17042_
[junit4:junit4]   2> 10379 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb80000a type:delete cxid:0x4 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:17042_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:17042_
[junit4:junit4]   2> 10388 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:17042_
[junit4:junit4]   2> 10390 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10390 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10390 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10391 T1066 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 10392 T1066 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10394 T1051 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 10394 T1038 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 10394 T1032 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 10395 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 10402 T1082 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343/collection1
[junit4:junit4]   2> 10402 T1082 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 10403 T1082 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 10403 T1082 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 10405 T1082 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343/collection1/'
[junit4:junit4]   2> 10406 T1082 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343/collection1/lib/README' to classloader
[junit4:junit4]   2> 10407 T1082 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 10477 T1082 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 10547 T1082 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 10648 T1082 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 10654 T1082 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 11264 T1082 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 11276 T1082 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 11280 T1082 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 11304 T1082 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 11312 T1082 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 11320 T1082 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 11322 T1082 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 11324 T1082 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356898038343/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/
[junit4:junit4]   2> 11324 T1082 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44a406e8
[junit4:junit4]   2> 11325 T1082 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 11326 T1082 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3 forceNew:false
[junit4:junit4]   2> 11327 T1082 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3
[junit4:junit4]   2> 11328 T1082 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index/
[junit4:junit4]   2> 11329 T1082 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 11330 T1082 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index forceNew:false
[junit4:junit4]   2> 11338 T1082 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27513d5b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11339 T1082 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 11340 T1082 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index
[junit4:junit4]   2> 11341 T1082 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 11344 T1082 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 11344 T1082 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 11345 T1082 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 11345 T1082 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 11346 T1082 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 11346 T1082 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 11347 T1082 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 11347 T1082 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 11348 T1082 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 11349 T1082 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 11349 T1082 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 11350 T1082 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 11350 T1082 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 11351 T1082 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 11351 T1082 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 11352 T1082 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 11352 T1082 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11353 T1082 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11353 T1082 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11354 T1082 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11355 T1082 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11355 T1082 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11356 T1082 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11356 T1082 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 11357 T1082 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 11357 T1082 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 11378 T1082 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 11386 T1082 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 11387 T1082 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 11391 T1082 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3
[junit4:junit4]   2> 11394 T1082 oass.SolrIndexSearcher.<init> Opening Searcher@2842618 main
[junit4:junit4]   2> 11395 T1082 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 11396 T1082 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 11396 T1082 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 11401 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11402 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:17032_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:17032"}
[junit4:junit4]   2> 11416 T1082 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 11417 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11417 T1066 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11417 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11417 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11417 T1081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11476 T1083 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2842618 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 11482 T1082 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 11482 T1082 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12928 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12929 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:17042_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:17042"}
[junit4:junit4]   2> 12929 T1033 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 12929 T1033 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 12944 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12944 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12944 T1066 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12944 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12944 T1081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13486 T1082 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 13486 T1082 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:17042 collection:collection1 shard:shard1
[junit4:junit4]   2> 13492 T1082 oasc.ZkController.register We are http://127.0.0.1:17042/collection1/ and leader is http://127.0.0.1:17026/collection1/
[junit4:junit4]   2> 13492 T1082 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:17042
[junit4:junit4]   2> 13492 T1082 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 13492 T1082 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C132 name=collection1 org.apache.solr.core.SolrCore@7e10a8e1 url=http://127.0.0.1:17042/collection1 node=127.0.0.1:17042_ C132_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:17042_, base_url=http://127.0.0.1:17042}
[junit4:junit4]   2> 13493 T1084 C132 P17042 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 13493 T1082 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13493 T1084 C132 P17042 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 13494 T1084 C132 P17042 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 13494 T1084 C132 P17042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13494 T1010 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4]   2> 13495 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 13496 T1084 C132 P17042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13496 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13691 T1010 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 13696 T1010 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:17055
[junit4:junit4]   2> 13697 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 13698 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916
[junit4:junit4]   2> 13698 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916/'
[junit4:junit4]   2> 13750 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 13751 T1010 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 13751 T1010 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916
[junit4:junit4]   2> 13752 T1010 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916/solr.xml
[junit4:junit4]   2> 13752 T1010 oasc.CoreContainer.<init> New CoreContainer 189027157
[junit4:junit4]   2> 13753 T1010 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916/'
[junit4:junit4]   2> 13754 T1010 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916/'
[junit4:junit4]   2> 13788 T1010 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 13789 T1010 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 13789 T1010 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 13790 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 13790 T1010 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 13791 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 13791 T1010 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 13792 T1010 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 13792 T1010 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 13793 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 13814 T1010 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 13835 T1010 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:35386/solr
[junit4:junit4]   2> 13836 T1010 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 13836 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@207451e3
[junit4:junit4]   2> 13837 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13838 T1094 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 13839 T1094 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 13839 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17058
[junit4:junit4]   2> 13840 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17058
[junit4:junit4]   2> 13868 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb80000b with negotiated timeout 20000 for client /140.211.11.196:17058
[junit4:junit4]   2> 13868 T1094 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb80000b, negotiated timeout = 20000
[junit4:junit4]   2> 13868 T1095 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@207451e3 name:ZooKeeperConnection Watcher:127.0.0.1:35386 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13869 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13871 T1015 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bed6ccb80000b
[junit4:junit4]   2> 13879 T1012 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:17058 which had sessionid 0x13bed6ccb80000b
[junit4:junit4]   2> 13879 T1095 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13879 T1010 oaz.ZooKeeper.close Session: 0x13bed6ccb80000b closed
[junit4:junit4]   2> 13881 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 13892 T1010 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:35386/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@41a0b7da
[junit4:junit4]   2> 13894 T1010 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13894 T1096 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:35386. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 13895 T1096 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:35386, initiating session
[junit4:junit4]   2> 13896 T1012 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17059
[junit4:junit4]   2> 13896 T1012 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17059
[junit4:junit4]   2> 13898 T1014 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bed6ccb80000c with negotiated timeout 20000 for client /140.211.11.196:17059
[junit4:junit4]   2> 13898 T1096 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:35386, sessionid = 0x13bed6ccb80000c, negotiated timeout = 20000
[junit4:junit4]   2> 13898 T1097 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41a0b7da name:ZooKeeperConnection Watcher:127.0.0.1:35386/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13898 T1010 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13900 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb80000c type:create cxid:0x1 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13902 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb80000c type:create cxid:0x2 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13903 T1010 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:17055_
[junit4:junit4]   2> 13904 T1015 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bed6ccb80000c type:delete cxid:0x4 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:17055_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:17055_
[junit4:junit4]   2> 13913 T1010 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:17055_
[junit4:junit4]   2> 13916 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13916 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13916 T1081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13916 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13916 T1066 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 13917 T1066 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13918 T1032 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 13918 T1038 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 13919 T1081 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 13919 T1051 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 13920 T1010 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 13927 T1098 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916/collection1
[junit4:junit4]   2> 13927 T1098 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 13928 T1098 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 13928 T1098 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 13930 T1098 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916/collection1/'
[junit4:junit4]   2> 13931 T1098 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 13932 T1098 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916/collection1/lib/README' to classloader
[junit4:junit4]   2> 13986 T1098 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 14073 T1098 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14174 T1098 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14181 T1098 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 14459 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14459 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:17042_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:17042"}
[junit4:junit4]   2> 14472 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14472 T1066 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14472 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14472 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14472 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14472 T1081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14821 T1098 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 14834 T1098 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 14839 T1098 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 14855 T1098 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14861 T1098 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14869 T1098 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14870 T1098 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14872 T1098 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356898041916/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/
[junit4:junit4]   2> 14872 T1098 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44a406e8
[junit4:junit4]   2> 14873 T1098 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 14875 T1098 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4 forceNew:false
[junit4:junit4]   2> 14876 T1098 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4
[junit4:junit4]   2> 14876 T1098 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index/
[junit4:junit4]   2> 14877 T1098 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 14879 T1098 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index forceNew:false
[junit4:junit4]   2> 14887 T1098 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@743f1f8a; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14888 T1098 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 14890 T1098 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index
[junit4:junit4]   2> 14890 T1098 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 14893 T1098 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 14894 T1098 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 14894 T1098 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 14895 T1098 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 14896 T1098 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 14896 T1098 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 14897 T1098 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 14897 T1098 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 14898 T1098 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 14899 T1098 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 14900 T1098 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 14900 T1098 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 14901 T1098 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 14901 T1098 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 14902 T1098 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 14902 T1098 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 14903 T1098 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 14904 T1098 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 14904 T1098 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 14905 T1098 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 14906 T1098 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 14906 T1098 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 14907 T1098 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 14908 T1098 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 14908 T1098 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 14909 T1098 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 14929 T1098 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 14936 T1098 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 14938 T1098 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 14942 T1098 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4
[junit4:junit4]   2> 14945 T1098 oass.SolrIndexSearcher.<init> Opening Searcher@23298413 main
[junit4:junit4]   2> 14946 T1098 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 14947 T1098 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 14947 T1098 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 14957 T1098 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 15013 T1099 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23298413 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15019 T1098 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 15020 T1098 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15977 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15978 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:17055_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:17055"}
[junit4:junit4]   2> 15978 T1033 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 15978 T1033 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 16017 T1066 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16017 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16017 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16017 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16017 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16017 T1081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16023 T1098 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16023 T1098 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:17055 collection:collection1 shard:shard2
[junit4:junit4]   2> 16026 T1098 oasc.ZkController.register We are http://127.0.0.1:17055/collection1/ and leader is http://127.0.0.1:17032/collection1/
[junit4:junit4]   2> 16026 T1098 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:17055
[junit4:junit4]   2> 16026 T1098 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 16026 T1098 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C133 name=collection1 org.apache.solr.core.SolrCore@6bc4f4e3 url=http://127.0.0.1:17055/collection1 node=127.0.0.1:17055_ C133_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:17055_, base_url=http://127.0.0.1:17055}
[junit4:junit4]   2> 16027 T1100 C133 P17055 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 16027 T1098 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16027 T1100 C133 P17055 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16028 T1100 C133 P17055 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 16028 T1100 C133 P17055 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16028 T1010 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4]   2> 16029 T1010 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 16029 T1010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16029 T1100 C133 P17055 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16047 T1010 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16049 T1010 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 16050 T1010 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C132_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:17042_, base_url=http://127.0.0.1:17042}
[junit4:junit4]   2> 16515 T1084 C132 P17042 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:17026/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 16515 T1084 C132 P17042 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:17042 START replicas=[http://127.0.0.1:17026/collection1/] nUpdates=100
[junit4:junit4]   2> 16516 T1084 C132 P17042 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 16517 T1084 C132 P17042 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 16517 T1084 C132 P17042 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 16517 T1084 C132 P17042 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 16517 T1084 C132 P17042 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 16518 T1084 C132 P17042 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:17026/collection1/. core=collection1
[junit4:junit4]   2> 16518 T1084 C132 P17042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C134 name=collection1 org.apache.solr.core.SolrCore@1e92c7ed url=http://127.0.0.1:17026/collection1 node=127.0.0.1:17026_ C134_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:17026_, base_url=http://127.0.0.1:17026, leader=true}
[junit4:junit4]   2> 16527 T1042 C134 P17026 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 16530 T1043 C134 P17026 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 16530 T1043 C134 P17026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1
[junit4:junit4]   2> 16534 T1043 C134 P17026 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@86c0576; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 16535 T1043 C134 P17026 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 16539 T1043 C134 P17026 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@86c0576; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@86c0576; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 16539 T1043 C134 P17026 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 16541 T1043 C134 P17026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1
[junit4:junit4]   2> 16541 T1043 C134 P17026 oass.SolrIndexSearcher.<init> Opening Searcher@2c2b0c9a realtime
[junit4:junit4]   2> 16542 T1043 C134 P17026 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 16542 T1043 C134 P17026 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 13
[junit4:junit4]   2> 16543 T1084 C132 P17042 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 16543 T1084 C132 P17042 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 16547 T1044 C134 P17026 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 16547 T1044 C134 P17026 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 16548 T1084 C132 P17042 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 16549 T1084 C132 P17042 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 16549 T1084 C132 P17042 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 16552 T1044 C134 P17026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1
[junit4:junit4]   2> 16552 T1044 C134 P17026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1/index
[junit4:junit4]   2> 16553 T1044 C134 P17026 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 16554 T1084 C132 P17042 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 16555 T1084 C132 P17042 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index.20121231080724959 forceNew:false
[junit4:junit4]   2> 16556 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3
[junit4:junit4]   2> 16556 T1084 C132 P17042 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index.20121231080724959 lockFactory=org.apache.lucene.store.NativeFSLockFactory@46c368ce; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 16560 T1044 C134 P17026 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 16577 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index
[junit4:junit4]   2> 16578 T1084 C132 P17042 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 16578 T1084 C132 P17042 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121231080724959
[junit4:junit4]   2> 16580 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3
[junit4:junit4]   2> 16580 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3
[junit4:junit4]   2> 16580 T1084 C132 P17042 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index.20121231080724959
[junit4:junit4]   2> 16584 T1084 C132 P17042 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index.20121231080724959 lockFactory=org.apache.lucene.store.NativeFSLockFactory@46c368ce; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 16585 T1084 C132 P17042 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 16586 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3
[junit4:junit4]   2> 16586 T1084 C132 P17042 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 16586 T1084 C132 P17042 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 16587 T1084 C132 P17042 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 16587 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index.20121231080724959
[junit4:junit4]   2> 16588 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3
[junit4:junit4]   2> 16592 T1084 C132 P17042 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index.20121231080724959 lockFactory=org.apache.lucene.store.NativeFSLockFactory@46c368ce; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 16592 T1084 C132 P17042 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 16592 T1084 C132 P17042 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 16593 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3
[junit4:junit4]   2> 16593 T1084 C132 P17042 oass.SolrIndexSearcher.<init> Opening Searcher@7be9b85c main
[junit4:junit4]   2> 16595 T1083 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7be9b85c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 16595 T1083 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index
[junit4:junit4]   2> 16596 T1084 C132 P17042 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 16599 T1084 C132 P17042 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index.20121231080724959 lockFactory=org.apache.lucene.store.NativeFSLockFactory@46c368ce; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index.20121231080724959 lockFactory=org.apache.lucene.store.NativeFSLockFactory@46c368ce; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 16599 T1084 C132 P17042 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 16601 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3
[junit4:junit4]   2> 16601 T1084 C132 P17042 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 16601 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index.20121231080724959
[junit4:junit4]   2> 16601 T1084 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3/index
[junit4:junit4]   2> 16602 T1084 C132 P17042 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 16602 T1084 C132 P17042 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 16602 T1084 C132 P17042 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 16602 T1084 C132 P17042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16609 T1084 C132 P17042 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 17052 T1010 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17522 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17523 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:17055_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:17055"}
[junit4:junit4]   2> 17554 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:17042_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:17042"}
[junit4:junit4]   2> 17646 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17646 T1081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17646 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17646 T1066 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17646 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17646 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18055 T1010 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19058 T1010 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C133_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:17055_, base_url=http://127.0.0.1:17055}
[junit4:junit4]   2> 20051 T1100 C133 P17055 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:17032/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 20051 T1100 C133 P17055 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:17055 START replicas=[http://127.0.0.1:17032/collection1/] nUpdates=100
[junit4:junit4]   2> 20052 T1100 C133 P17055 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 20052 T1100 C133 P17055 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 20052 T1100 C133 P17055 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 20053 T1100 C133 P17055 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 20053 T1100 C133 P17055 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 20053 T1100 C133 P17055 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:17032/collection1/. core=collection1
[junit4:junit4]   2> 20055 T1100 C133 P17055 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 20061 T1010 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C135 name=collection1 org.apache.solr.core.SolrCore@71de2711 url=http://127.0.0.1:17032/collection1 node=127.0.0.1:17032_ C135_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:17032_, base_url=http://127.0.0.1:17032, leader=true}
[junit4:junit4]   2> 20065 T1057 C135 P17032 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 20073 T1058 C135 P17032 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 20074 T1058 C135 P17032 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2
[junit4:junit4]   2> 20077 T1058 C135 P17032 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f4c5e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 20077 T1058 C135 P17032 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 20094 T1058 C135 P17032 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f4c5e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f4c5e73; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 20094 T1058 C135 P17032 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 20095 T1058 C135 P17032 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2
[junit4:junit4]   2> 20095 T1058 C135 P17032 oass.SolrIndexSearcher.<init> Opening Searcher@13927e1e realtime
[junit4:junit4]   2> 20096 T1058 C135 P17032 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 20096 T1058 C135 P17032 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 23
[junit4:junit4]   2> 20097 T1100 C133 P17055 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 20098 T1100 C133 P17055 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 20100 T1059 C135 P17032 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 20101 T1059 C135 P17032 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 20102 T1100 C133 P17055 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 20102 T1100 C133 P17055 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 20102 T1100 C133 P17055 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 20106 T1059 C135 P17032 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2
[junit4:junit4]   2> 20107 T1059 C135 P17032 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2/index
[junit4:junit4]   2> 20107 T1059 C135 P17032 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 20108 T1100 C133 P17055 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 20109 T1100 C133 P17055 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index.20121231080728513 forceNew:false
[junit4:junit4]   2> 20109 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4
[junit4:junit4]   2> 20109 T1100 C133 P17055 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index.20121231080728513 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7110c4c9; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 20114 T1059 C135 P17032 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 20131 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index
[junit4:junit4]   2> 20132 T1100 C133 P17055 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 20132 T1100 C133 P17055 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121231080728513
[junit4:junit4]   2> 20133 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4
[junit4:junit4]   2> 20134 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4
[junit4:junit4]   2> 20134 T1100 C133 P17055 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index.20121231080728513
[junit4:junit4]   2> 20137 T1100 C133 P17055 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index.20121231080728513 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7110c4c9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 20137 T1100 C133 P17055 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 20138 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4
[junit4:junit4]   2> 20138 T1100 C133 P17055 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 20138 T1100 C133 P17055 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 20138 T1100 C133 P17055 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 20139 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index.20121231080728513
[junit4:junit4]   2> 20140 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4
[junit4:junit4]   2> 20142 T1100 C133 P17055 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index.20121231080728513 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7110c4c9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 20142 T1100 C133 P17055 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 20142 T1100 C133 P17055 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 20143 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4
[junit4:junit4]   2> 20143 T1100 C133 P17055 oass.SolrIndexSearcher.<init> Opening Searcher@5a2e4d7f main
[junit4:junit4]   2> 20145 T1099 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5a2e4d7f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 20145 T1099 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index
[junit4:junit4]   2> 20146 T1100 C133 P17055 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 20149 T1100 C133 P17055 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index.20121231080728513 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7110c4c9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index.20121231080728513 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7110c4c9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 20149 T1100 C133 P17055 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 20150 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4
[junit4:junit4]   2> 20151 T1100 C133 P17055 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 20151 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index.20121231080728513
[junit4:junit4]   2> 20151 T1100 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4/index
[junit4:junit4]   2> 20151 T1100 C133 P17055 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 20152 T1100 C133 P17055 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 20152 T1100 C133 P17055 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 20152 T1100 C133 P17055 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 20155 T1100 C133 P17055 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 20680 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20680 T1033 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:17055_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:17055"}
[junit4:junit4]   2> 20694 T1066 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20694 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20694 T1081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20694 T1051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20694 T1038 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20694 T1097 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21064 T1010 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21066 T1010 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C136 name=collection1 org.apache.solr.core.SolrCore@165c8344 url=http://127.0.0.1:47473/collection1 node=127.0.0.1:47473_ C136_STATE=coll:control_collection core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:47473_, base_url=http://127.0.0.1:47473, leader=true}
[junit4:junit4]   2> 21079 T1022 C136 P47473 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data
[junit4:junit4]   2> 21084 T1022 C136 P47473 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4369cceb; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 21084 T1022 C136 P47473 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 21086 T1022 C136 P47473 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/control/data
[junit4:junit4]   2> 21086 T1022 C136 P47473 oass.SolrIndexSearcher.<init> Opening Searcher@1ef201b8 realtime
[junit4:junit4]   2> 21087 T1022 C136 P47473 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1422810729135734784)} 0 9
[junit4:junit4]   2> 21092 T1045 C134 P17026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty1
[junit4:junit4]   2> 21099 T1060 C135 P17032 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty2
[junit4:junit4]   2>  C132_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:17042_, base_url=http://127.0.0.1:17042}
[junit4:junit4]   2> 21105 T1071 C132 P17042 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty3
[junit4:junit4]   2> 21107 T1071 C132 P17042 REQ /update {update.distrib=FROMLEADER&_version_=-1422810729147269120&update.from=http://127.0.0.1:17026/collection1/&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2>  C133_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:17055_, base_url=http://127.0.0.1:17055}
[junit4:junit4]   2> 21111 T1087 C133 P17055 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356898028410/jetty4
[junit4:junit4]   2> 21112 T1087 C133 P17055 REQ /update {update.distrib=FROMLEADER&_version_=-1422810729154609152&update.from=http://127.0.0.1:17032/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 21113 T1060 C135 P17032 REQ /update {update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=17 
[junit4:junit4]   2> 21114 T1045 C134 P17026 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1422810729147269120)} 0 24
[junit4:junit4]   2> 21128 T1022 C136 P47473 /update {wt=javabin&version=2} {add=[1 (1422810729181872128)]} 0 6
[junit4:junit4]   2> 21144 T1071 C132 P17042 REQ /update {distrib.from=http://127.0.0.1:17026/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 21145 T1046 C134 P17026 REQ /update {distrib.from=http://127.0.0.1:17032/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=13 
[junit4:junit4]   2> 21146 T1061 C135 P17032 /update {wt=javabin&version=2} {add=[1]} 0 16
[junit4:junit4]   2> 21152 T1022 C136 P47473 /update {wt=javabin&version=2} {add=[2 (1422810729210183680)]} 0 3
[junit4:junit4]   2> 21172 T1087 C133 P17055 REQ /update {distrib.from=http://127.0.0.1:17032/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 21173 T1060 C135 P17032 REQ /update {distrib.from=http://127.0.0.1:17026/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=14 
[junit4:junit4]   2> 21174 T1045 C134 P17026 /update {wt=javabin&version=2} {add=[2]} 0 19
[junit4:junit4]   2> 21180 T1022 C136 P47473 /update {wt=javabin&version=2} {add=[3 (1422810729239543808)]} 0 3
[junit4:junit4]   2> 21192 T1087 C133 P17055 REQ /update {distrib.from=http://127.0.0.1:17032/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 21193 T1061 C135 P17032 /update {wt=javabin&version=2} {add=[3 (1422810729245835264)]} 0 9
[junit4:junit4]   2> 21200 T1022 C136 P47473 /update {wt=javabin&version=2} {add=[4 (1422810729260515328)]} 0 2
[junit4:junit4]   2> 21220 T1071 C132 P17042 REQ /update {distrib.from=http://127.0.0.1:17026/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} stat

[...truncated too long message...]

nnectorEndPoint.run(SocketConnector.java:264)
[junit4:junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4]   2> 	        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 	  24) Thread[id=1055, name=qtp1474292714-1055 Acceptor0 SocketConnector@127.0.0.1:17032, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at java.net.PlainSocketImpl.socketAccept(Native Method)
[junit4:junit4]   2> 	        at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
[junit4:junit4]   2> 	        at java.net.ServerSocket.implAccept(ServerSocket.java:522)
[junit4:junit4]   2> 	        at java.net.ServerSocket.accept(ServerSocket.java:490)
[junit4:junit4]   2> 	        at org.eclipse.jetty.server.bio.SocketConnector.accept(SocketConnector.java:117)
[junit4:junit4]   2> 	        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4:junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4]   2> 	        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 	  25) Thread[id=1145, name=searcherExecutor-1075-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 	  26) Thread[id=1099, name=searcherExecutor-1053-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 	  27) Thread[id=1085, name=HashSessionScavenger-21, state=TIMED_WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at java.lang.Object.wait(Native Method)
[junit4:junit4]   2> 	        at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4:junit4]   2> 	        at java.util.TimerThread.run(Timer.java:505)
[junit4:junit4]   2> 	  28) Thread[id=1080, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[E7D277FA8C36002B]-SendThread(localhost:35386), state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:82)
[junit4:junit4]   2> 	        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4]   2> 	        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4]   2> 	  29) Thread[id=1054, name=HashSessionScavenger-19, state=TIMED_WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at java.lang.Object.wait(Native Method)
[junit4:junit4]   2> 	        at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4:junit4]   2> 	        at java.util.TimerThread.run(Timer.java:505)
[junit4:junit4]   2> 	  30) Thread[id=1083, name=searcherExecutor-1043-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {n_f1=PostingsFormat(name=NestedPulsing), foo_b=PostingsFormat(name=MockRandom), cat=MockVariableIntBlock(baseBlockSize=37), foo_d=PostingsFormat(name=Memory doPackFST= false), foo_f=PostingsFormat(name=MockRandom), n_tl1=PostingsFormat(name=NestedPulsing), n_d1=MockVariableIntBlock(baseBlockSize=37), rnd_b=PostingsFormat(name=Memory doPackFST= false), intDefault=MockVariableIntBlock(baseBlockSize=37), n_td1=PostingsFormat(name=NestedPulsing), timestamp=MockVariableIntBlock(baseBlockSize=37), id=PostingsFormat(name=Memory doPackFST= false), range_facet_sl=PostingsFormat(name=MockRandom), range_facet_si=PostingsFormat(name=NestedPulsing), oddField_s=PostingsFormat(name=MockRandom), sequence_i=PostingsFormat(name=MockRandom), name=PostingsFormat(name=Memory doPackFST= false), foo_i=PostingsFormat(name=NestedPulsing), regex_dup_B_s=MockVariableIntBlock(baseBlockSize=37), multiDefault=PostingsFormat(name=NestedPulsing), n_tf1=MockVariableIntBlock(baseBlockSize=37), n_dt1=PostingsFormat(name=NestedPulsing), genre_s=PostingsFormat(name=MockRandom), author_t=PostingsFormat(name=NestedPulsing), n_ti1=PostingsFormat(name=Memory doPackFST= false), range_facet_l=MockVariableIntBlock(baseBlockSize=37), text=PostingsFormat(name=MockRandom), _version_=MockVariableIntBlock(baseBlockSize=37), val_i=PostingsFormat(name=Memory doPackFST= false), SubjectTerms_mfacet=MockVariableIntBlock(baseBlockSize=37), series_t=PostingsFormat(name=NestedPulsing), a_t=MockVariableIntBlock(baseBlockSize=37), n_tdt1=MockVariableIntBlock(baseBlockSize=37), regex_dup_A_s=PostingsFormat(name=MockRandom), price=PostingsFormat(name=MockRandom), other_tl1=MockVariableIntBlock(baseBlockSize=37), n_l1=MockVariableIntBlock(baseBlockSize=37), a_si=PostingsFormat(name=NestedPulsing), inStock=PostingsFormat(name=MockRandom)}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=mk, timezone=Pacific/Funafuti
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=31,free=182608072,total=357564416
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SolrRequestParserTest, DistributedSpellCheckComponentTest, ShardRoutingCustomTest, MBeansHandlerTest, TestLMDirichletSimilarityFactory, MoreLikeThisHandlerTest, TestSolr4Spatial, CacheHeaderTest, TestNumberUtils, CollectionsAPIDistributedZkTest, TestStressReorder, TestFastLRUCache, AutoCommitTest, MinimalSchemaTest, TestGroupingSearch, IndexBasedSpellCheckerTest, PluginInfoTest, SpellCheckCollatorTest, CircularListTest, TestZkChroot, TestPerFieldSimilarity, TestExtendedDismaxParser, BasicDistributedZkTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.seed=E7D277FA8C36002B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mk -Dtests.timezone=Pacific/Funafuti -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR   0.00s J0 | BasicDistributedZkTest (suite) <<<
[junit4:junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([E7D277FA8C36002B]:0)
[junit4:junit4] Completed on J0 in 7223.62s, 1 test, 2 errors <<< FAILURES!

[...truncated 119 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:353: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:438: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:841: There were test failures: 245 suites, 1013 tests, 1 suite-level error, 1 error, 167 ignored (4 assumptions)

Total time: 144 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 844 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/844/

2 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([CBCB93F2E31BDD0F]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([CBCB93F2E31BDD0F]:0)




Build Log:
[...truncated 9329 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 0 T1204 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 5 T1204 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZkTest-1356956050648
[junit4:junit4]   2> 7 T1204 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T1205 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 11 T1205 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 11 T1205 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 11 T1205 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 12 T1205 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 12 T1205 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 108 T1204 oasc.ZkTestServer.run start zk server on port:25440
[junit4:junit4]   2> 108 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5681d22
[junit4:junit4]   2> 109 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 110 T1210 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 110 T1210 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 111 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25441
[junit4:junit4]   2> 111 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25441
[junit4:junit4]   2> 112 T1208 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 117 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df0000 with negotiated timeout 10000 for client /140.211.11.196:25441
[junit4:junit4]   2> 117 T1210 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df0000, negotiated timeout = 10000
[junit4:junit4]   2> 117 T1211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5681d22 name:ZooKeeperConnection Watcher:127.0.0.1:25440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 117 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 118 T1204 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 121 T1209 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf0e224df0000
[junit4:junit4]   2> 129 T1211 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 129 T1206 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:25441 which had sessionid 0x13bf0e224df0000
[junit4:junit4]   2> 129 T1204 oaz.ZooKeeper.close Session: 0x13bf0e224df0000 closed
[junit4:junit4]   2> 130 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@31b440ea
[junit4:junit4]   2> 130 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 131 T1212 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 131 T1212 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 132 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25442
[junit4:junit4]   2> 132 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25442
[junit4:junit4]   2> 133 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df0001 with negotiated timeout 10000 for client /140.211.11.196:25442
[junit4:junit4]   2> 133 T1212 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df0001, negotiated timeout = 10000
[junit4:junit4]   2> 134 T1213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31b440ea name:ZooKeeperConnection Watcher:127.0.0.1:25440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 134 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 135 T1204 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 145 T1204 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 149 T1204 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 152 T1204 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 156 T1204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 157 T1204 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 171 T1204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 172 T1204 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 277 T1204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 278 T1204 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 282 T1204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 282 T1204 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 286 T1204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 287 T1204 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 291 T1204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 292 T1204 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 296 T1204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 297 T1204 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 301 T1204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 301 T1204 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 305 T1204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 306 T1204 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 310 T1209 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf0e224df0001
[junit4:junit4]   2> 311 T1213 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 311 T1204 oaz.ZooKeeper.close Session: 0x13bf0e224df0001 closed
[junit4:junit4]   2> 311 T1206 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13bf0e224df0001, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 312 T1206 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:25442 which had sessionid 0x13bf0e224df0001
[junit4:junit4]   2> 476 T1204 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 480 T1204 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25443
[junit4:junit4]   2> 481 T1204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 482 T1204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954
[junit4:junit4]   2> 482 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954/'
[junit4:junit4]   2> 524 T1204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 525 T1204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 525 T1204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954
[junit4:junit4]   2> 526 T1204 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954/solr.xml
[junit4:junit4]   2> 526 T1204 oasc.CoreContainer.<init> New CoreContainer 1938807399
[junit4:junit4]   2> 527 T1204 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954/'
[junit4:junit4]   2> 527 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954/'
[junit4:junit4]   2> 557 T1204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 557 T1204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 558 T1204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 558 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 559 T1204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 559 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 560 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 560 T1204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 561 T1204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 562 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 583 T1204 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 602 T1204 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:25440/solr
[junit4:junit4]   2> 603 T1204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 603 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@314965cb
[junit4:junit4]   2> 604 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 605 T1223 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 605 T1223 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 606 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25444
[junit4:junit4]   2> 606 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25444
[junit4:junit4]   2> 608 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df0002 with negotiated timeout 20000 for client /140.211.11.196:25444
[junit4:junit4]   2> 608 T1223 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df0002, negotiated timeout = 20000
[junit4:junit4]   2> 608 T1224 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@314965cb name:ZooKeeperConnection Watcher:127.0.0.1:25440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 609 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 610 T1209 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf0e224df0002
[junit4:junit4]   2> 611 T1224 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 611 T1206 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:25444 which had sessionid 0x13bf0e224df0002
[junit4:junit4]   2> 611 T1204 oaz.ZooKeeper.close Session: 0x13bf0e224df0002 closed
[junit4:junit4]   2> 612 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 623 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@55dc4df
[junit4:junit4]   2> 624 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 624 T1225 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 625 T1225 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 625 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25445
[junit4:junit4]   2> 626 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25445
[junit4:junit4]   2> 627 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df0003 with negotiated timeout 20000 for client /140.211.11.196:25445
[junit4:junit4]   2> 627 T1225 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df0003, negotiated timeout = 20000
[junit4:junit4]   2> 628 T1226 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55dc4df name:ZooKeeperConnection Watcher:127.0.0.1:25440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 628 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 630 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 632 T1204 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 635 T1204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25443_
[junit4:junit4]   2> 636 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:25443_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:25443_
[junit4:junit4]   2> 637 T1204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25443_
[junit4:junit4]   2> 641 T1204 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 653 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 654 T1204 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 657 T1204 oasc.Overseer.start Overseer (id=88929471735726083-127.0.0.1:25443_-n_0000000000) starting
[junit4:junit4]   2> 658 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 667 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 668 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 675 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 676 T1228 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 678 T1204 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 682 T1204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 685 T1227 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 689 T1229 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954/collection1
[junit4:junit4]   2> 690 T1229 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 691 T1229 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 691 T1229 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 693 T1229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954/collection1/'
[junit4:junit4]   2> 694 T1229 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 695 T1229 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954/collection1/lib/README' to classloader
[junit4:junit4]   2> 748 T1229 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 819 T1229 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 920 T1229 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 926 T1229 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1557 T1229 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1567 T1229 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1571 T1229 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1588 T1229 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1593 T1229 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1598 T1229 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1599 T1229 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1601 T1229 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356956050954/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data/
[junit4:junit4]   2> 1601 T1229 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@443c2e0b
[junit4:junit4]   2> 1602 T1229 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 1634 T1229 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data forceNew:false
[junit4:junit4]   2> 1635 T1229 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data
[junit4:junit4]   2> 1635 T1229 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data/index/
[junit4:junit4]   2> 1636 T1229 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1637 T1229 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data/index forceNew:false
[junit4:junit4]   2> 1642 T1229 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@46e8294a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1643 T1229 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1644 T1229 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data/index
[junit4:junit4]   2> 1644 T1229 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1646 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1646 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1647 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1647 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1648 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1648 T1229 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1648 T1229 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1649 T1229 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1649 T1229 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1650 T1229 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1650 T1229 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1651 T1229 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1651 T1229 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1651 T1229 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1652 T1229 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1652 T1229 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1653 T1229 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1653 T1229 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1654 T1229 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1654 T1229 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1654 T1229 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1655 T1229 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1655 T1229 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1656 T1229 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1656 T1229 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1657 T1229 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1668 T1229 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1673 T1229 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1674 T1229 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1676 T1229 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data
[junit4:junit4]   2> 1678 T1229 oass.SolrIndexSearcher.<init> Opening Searcher@1a4ee87b main
[junit4:junit4]   2> 1679 T1229 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1679 T1229 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1680 T1229 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1687 T1229 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1746 T1230 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a4ee87b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1750 T1229 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1751 T1229 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1751 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2189 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2190 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25443_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25443"}
[junit4:junit4]   2> 2191 T1227 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2191 T1227 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2191 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2216 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2765 T1229 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2765 T1229 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25443 collection:control_collection shard:shard1
[junit4:junit4]   2> 2766 T1229 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2784 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2785 T1229 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2786 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2788 T1229 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2788 T1229 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2789 T1229 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:25443/collection1/
[junit4:junit4]   2> 2789 T1229 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2789 T1229 oasc.SyncStrategy.syncToMe http://127.0.0.1:25443/collection1/ has no replicas
[junit4:junit4]   2> 2790 T1229 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:25443/collection1/
[junit4:junit4]   2> 2790 T1229 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2795 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3723 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3744 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3767 T1229 oasc.ZkController.register We are http://127.0.0.1:25443/collection1/ and leader is http://127.0.0.1:25443/collection1/
[junit4:junit4]   2> 3767 T1229 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25443
[junit4:junit4]   2> 3767 T1229 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3767 T1229 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3768 T1229 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3770 T1229 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3771 T1204 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3772 T1204 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3773 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3788 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3798 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2cbfcb7c
[junit4:junit4]   2> 3799 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3800 T1231 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3800 T1231 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 3800 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25478
[junit4:junit4]   2> 3801 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25478
[junit4:junit4]   2> 3802 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df0004 with negotiated timeout 10000 for client /140.211.11.196:25478
[junit4:junit4]   2> 3802 T1231 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df0004, negotiated timeout = 10000
[junit4:junit4]   2> 3803 T1232 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2cbfcb7c name:ZooKeeperConnection Watcher:127.0.0.1:25440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3803 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3804 T1204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3806 T1204 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3989 T1204 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3993 T1204 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25491
[junit4:junit4]   2> 3994 T1204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3994 T1204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449
[junit4:junit4]   2> 3995 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449/'
[junit4:junit4]   2> 4049 T1204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4050 T1204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4051 T1204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449
[junit4:junit4]   2> 4051 T1204 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449/solr.xml
[junit4:junit4]   2> 4052 T1204 oasc.CoreContainer.<init> New CoreContainer 149056279
[junit4:junit4]   2> 4052 T1204 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449/'
[junit4:junit4]   2> 4053 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449/'
[junit4:junit4]   2> 4084 T1204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 4085 T1204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4085 T1204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4086 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4086 T1204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4087 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4087 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4088 T1204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4088 T1204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4089 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4110 T1204 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4129 T1204 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:25440/solr
[junit4:junit4]   2> 4130 T1204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4131 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7eef75cd
[junit4:junit4]   2> 4132 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4132 T1242 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4133 T1242 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 4133 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25504
[junit4:junit4]   2> 4134 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25504
[junit4:junit4]   2> 4136 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df0005 with negotiated timeout 20000 for client /140.211.11.196:25504
[junit4:junit4]   2> 4136 T1242 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df0005, negotiated timeout = 20000
[junit4:junit4]   2> 4136 T1243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7eef75cd name:ZooKeeperConnection Watcher:127.0.0.1:25440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4137 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4138 T1209 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf0e224df0005
[junit4:junit4]   2> 4139 T1243 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4139 T1204 oaz.ZooKeeper.close Session: 0x13bf0e224df0005 closed
[junit4:junit4]   2> 4139 T1206 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:25504 which had sessionid 0x13bf0e224df0005
[junit4:junit4]   2> 4140 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 4151 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@196bbd4c
[junit4:junit4]   2> 4152 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4152 T1244 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4153 T1244 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 4153 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25507
[junit4:junit4]   2> 4154 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25507
[junit4:junit4]   2> 4155 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df0006 with negotiated timeout 20000 for client /140.211.11.196:25507
[junit4:junit4]   2> 4155 T1244 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df0006, negotiated timeout = 20000
[junit4:junit4]   2> 4156 T1245 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@196bbd4c name:ZooKeeperConnection Watcher:127.0.0.1:25440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4156 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4157 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4159 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4162 T1204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25491_
[junit4:junit4]   2> 4163 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:25491_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:25491_
[junit4:junit4]   2> 4169 T1204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25491_
[junit4:junit4]   2> 4256 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4258 T1232 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4259 T1226 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4283 T1204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4291 T1246 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449/collection1
[junit4:junit4]   2> 4291 T1246 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4292 T1246 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4292 T1246 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4294 T1246 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449/collection1/'
[junit4:junit4]   2> 4295 T1246 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4296 T1246 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449/collection1/lib/README' to classloader
[junit4:junit4]   2> 4350 T1246 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4426 T1246 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4527 T1246 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4534 T1246 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5210 T1246 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5222 T1246 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5228 T1246 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5247 T1246 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5253 T1246 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5258 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5258 T1246 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5259 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25443_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25443"}
[junit4:junit4]   2> 5260 T1246 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5262 T1246 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356956054449/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1/
[junit4:junit4]   2> 5262 T1246 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@443c2e0b
[junit4:junit4]   2> 5263 T1246 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 5264 T1246 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1 forceNew:false
[junit4:junit4]   2> 5265 T1246 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1
[junit4:junit4]   2> 5265 T1246 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1/index/
[junit4:junit4]   2> 5266 T1246 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5267 T1246 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1/index forceNew:false
[junit4:junit4]   2> 5273 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5273 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5273 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5275 T1246 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2720b38e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5275 T1246 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5276 T1246 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1/index
[junit4:junit4]   2> 5277 T1246 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5279 T1246 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5279 T1246 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5280 T1246 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5280 T1246 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5281 T1246 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5281 T1246 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5282 T1246 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5282 T1246 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5283 T1246 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5284 T1246 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5284 T1246 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5285 T1246 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5285 T1246 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5286 T1246 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5286 T1246 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5287 T1246 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5287 T1246 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5288 T1246 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5288 T1246 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5289 T1246 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5289 T1246 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5290 T1246 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5290 T1246 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5291 T1246 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5292 T1246 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5292 T1246 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5310 T1246 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5315 T1246 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5316 T1246 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5319 T1246 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1
[junit4:junit4]   2> 5321 T1246 oass.SolrIndexSearcher.<init> Opening Searcher@6d133151 main
[junit4:junit4]   2> 5322 T1246 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5322 T1246 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5323 T1246 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5333 T1246 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5398 T1247 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d133151 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5404 T1246 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5404 T1246 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6796 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6797 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25491_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25491"}
[junit4:junit4]   2> 6798 T1227 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 6798 T1227 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6819 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6819 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6819 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7408 T1246 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7408 T1246 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25491 collection:collection1 shard:shard1
[junit4:junit4]   2> 7409 T1246 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7432 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0006 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7438 T1246 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7438 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0006 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7447 T1246 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7447 T1246 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7448 T1246 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:25491/collection1/
[junit4:junit4]   2> 7448 T1246 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7448 T1246 oasc.SyncStrategy.syncToMe http://127.0.0.1:25491/collection1/ has no replicas
[junit4:junit4]   2> 7448 T1246 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:25491/collection1/
[junit4:junit4]   2> 7449 T1246 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7454 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0006 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8325 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8349 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8349 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8349 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8383 T1246 oasc.ZkController.register We are http://127.0.0.1:25491/collection1/ and leader is http://127.0.0.1:25491/collection1/
[junit4:junit4]   2> 8383 T1246 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25491
[junit4:junit4]   2> 8383 T1246 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8383 T1246 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8384 T1246 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8386 T1246 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8387 T1204 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 8388 T1204 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8388 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8567 T1204 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8571 T1204 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25552
[junit4:junit4]   2> 8572 T1204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8573 T1204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045
[junit4:junit4]   2> 8573 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045/'
[junit4:junit4]   2> 8615 T1204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8616 T1204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8616 T1204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045
[junit4:junit4]   2> 8617 T1204 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045/solr.xml
[junit4:junit4]   2> 8617 T1204 oasc.CoreContainer.<init> New CoreContainer 751970788
[junit4:junit4]   2> 8618 T1204 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045/'
[junit4:junit4]   2> 8618 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045/'
[junit4:junit4]   2> 8648 T1204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 8648 T1204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8649 T1204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8649 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8650 T1204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8650 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8651 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8651 T1204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8652 T1204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8653 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8675 T1204 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8694 T1204 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:25440/solr
[junit4:junit4]   2> 8695 T1204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8696 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@136000af
[junit4:junit4]   2> 8697 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8697 T1257 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8698 T1257 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 8699 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25553
[junit4:junit4]   2> 8699 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25553
[junit4:junit4]   2> 8701 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df0007 with negotiated timeout 20000 for client /140.211.11.196:25553
[junit4:junit4]   2> 8701 T1257 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df0007, negotiated timeout = 20000
[junit4:junit4]   2> 8702 T1258 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@136000af name:ZooKeeperConnection Watcher:127.0.0.1:25440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8702 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8704 T1209 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf0e224df0007
[junit4:junit4]   2> 8715 T1258 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8715 T1206 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:25553 which had sessionid 0x13bf0e224df0007
[junit4:junit4]   2> 8715 T1204 oaz.ZooKeeper.close Session: 0x13bf0e224df0007 closed
[junit4:junit4]   2> 8715 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 8728 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e3944d4
[junit4:junit4]   2> 8730 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8730 T1259 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8731 T1259 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 8731 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25554
[junit4:junit4]   2> 8731 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25554
[junit4:junit4]   2> 8733 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df0008 with negotiated timeout 20000 for client /140.211.11.196:25554
[junit4:junit4]   2> 8733 T1259 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df0008, negotiated timeout = 20000
[junit4:junit4]   2> 8733 T1260 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e3944d4 name:ZooKeeperConnection Watcher:127.0.0.1:25440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8734 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8735 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8737 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8738 T1204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25552_
[junit4:junit4]   2> 8739 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0008 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:25552_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:25552_
[junit4:junit4]   2> 8747 T1204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25552_
[junit4:junit4]   2> 8750 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8750 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8750 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8752 T1245 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 8753 T1226 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 8753 T1232 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 8757 T1204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 8764 T1261 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045/collection1
[junit4:junit4]   2> 8765 T1261 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 8766 T1261 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 8766 T1261 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 8768 T1261 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045/collection1/'
[junit4:junit4]   2> 8769 T1261 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045/collection1/lib/README' to classloader
[junit4:junit4]   2> 8770 T1261 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 8824 T1261 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 8894 T1261 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8995 T1261 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9001 T1261 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9630 T1261 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9641 T1261 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9645 T1261 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9663 T1261 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9668 T1261 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9673 T1261 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9675 T1261 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9676 T1261 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356956059045/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2/
[junit4:junit4]   2> 9677 T1261 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@443c2e0b
[junit4:junit4]   2> 9677 T1261 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 9678 T1261 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2 forceNew:false
[junit4:junit4]   2> 9679 T1261 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2
[junit4:junit4]   2> 9679 T1261 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2/index/
[junit4:junit4]   2> 9680 T1261 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9681 T1261 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2/index forceNew:false
[junit4:junit4]   2> 9686 T1261 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15c839c4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9687 T1261 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 9687 T1261 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2/index
[junit4:junit4]   2> 9688 T1261 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 9690 T1261 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9691 T1261 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 9691 T1261 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9691 T1261 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 9692 T1261 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9692 T1261 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9693 T1261 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9693 T1261 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9694 T1261 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9695 T1261 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 9695 T1261 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 9696 T1261 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9696 T1261 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 9697 T1261 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 9697 T1261 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 9698 T1261 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9698 T1261 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9699 T1261 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9699 T1261 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9700 T1261 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9700 T1261 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9701 T1261 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9701 T1261 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9702 T1261 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9703 T1261 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 9703 T1261 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 9716 T1261 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9721 T1261 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 9722 T1261 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 9725 T1261 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2
[junit4:junit4]   2> 9726 T1261 oass.SolrIndexSearcher.<init> Opening Searcher@61a0ba11 main
[junit4:junit4]   2> 9728 T1261 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9728 T1261 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9728 T1261 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 9736 T1261 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 9794 T1262 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@61a0ba11 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9800 T1261 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 9800 T1261 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9863 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9864 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25491_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25491"}
[junit4:junit4]   2> 9869 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25552_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25552"}
[junit4:junit4]   2> 9869 T1227 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 9869 T1227 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 9880 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9880 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9880 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9880 T1260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10803 T1261 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 10803 T1261 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25552 collection:collection1 shard:shard2
[junit4:junit4]   2> 10804 T1261 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 10848 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0008 type:delete cxid:0x42 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 10849 T1261 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 10850 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0008 type:create cxid:0x43 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10860 T1261 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 10861 T1261 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 10861 T1261 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:25552/collection1/
[junit4:junit4]   2> 10861 T1261 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 10862 T1261 oasc.SyncStrategy.syncToMe http://127.0.0.1:25552/collection1/ has no replicas
[junit4:junit4]   2> 10862 T1261 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:25552/collection1/
[junit4:junit4]   2> 10862 T1261 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 10867 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df0008 type:create cxid:0x4c zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11394 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11413 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11414 T1260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11414 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11414 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11430 T1261 oasc.ZkController.register We are http://127.0.0.1:25552/collection1/ and leader is http://127.0.0.1:25552/collection1/
[junit4:junit4]   2> 11430 T1261 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25552
[junit4:junit4]   2> 11430 T1261 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 11431 T1261 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 11431 T1261 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11433 T1261 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11434 T1204 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 11435 T1204 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 11435 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11617 T1204 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 11620 T1204 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25555
[junit4:junit4]   2> 11621 T1204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11622 T1204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094
[junit4:junit4]   2> 11622 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094/'
[junit4:junit4]   2> 11664 T1204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 11665 T1204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11665 T1204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094
[junit4:junit4]   2> 11666 T1204 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094/solr.xml
[junit4:junit4]   2> 11666 T1204 oasc.CoreContainer.<init> New CoreContainer 1141799631
[junit4:junit4]   2> 11667 T1204 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094/'
[junit4:junit4]   2> 11668 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094/'
[junit4:junit4]   2> 11697 T1204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 11698 T1204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11698 T1204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 11699 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11699 T1204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11700 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11700 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11701 T1204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11701 T1204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11702 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 11722 T1204 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11742 T1204 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:25440/solr
[junit4:junit4]   2> 11742 T1204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11743 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@166ed5d9
[junit4:junit4]   2> 11744 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11745 T1272 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11745 T1272 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 11746 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25556
[junit4:junit4]   2> 11746 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25556
[junit4:junit4]   2> 11748 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df0009 with negotiated timeout 20000 for client /140.211.11.196:25556
[junit4:junit4]   2> 11748 T1272 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df0009, negotiated timeout = 20000
[junit4:junit4]   2> 11749 T1273 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@166ed5d9 name:ZooKeeperConnection Watcher:127.0.0.1:25440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11749 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11751 T1209 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf0e224df0009
[junit4:junit4]   2> 11762 T1273 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11762 T1206 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:25556 which had sessionid 0x13bf0e224df0009
[junit4:junit4]   2> 11762 T1204 oaz.ZooKeeper.close Session: 0x13bf0e224df0009 closed
[junit4:junit4]   2> 11763 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 11774 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@13083480
[junit4:junit4]   2> 11775 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11775 T1274 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11776 T1274 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 11776 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25557
[junit4:junit4]   2> 11776 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25557
[junit4:junit4]   2> 11778 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df000a with negotiated timeout 20000 for client /140.211.11.196:25557
[junit4:junit4]   2> 11778 T1274 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df000a, negotiated timeout = 20000
[junit4:junit4]   2> 11778 T1275 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13083480 name:ZooKeeperConnection Watcher:127.0.0.1:25440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11779 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11779 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11781 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df000a type:create cxid:0x2 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11783 T1204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25555_
[junit4:junit4]   2> 11784 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df000a type:delete cxid:0x4 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:25555_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:25555_
[junit4:junit4]   2> 11792 T1204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25555_
[junit4:junit4]   2> 11795 T1260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11795 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11795 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11795 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11797 T1260 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 11799 T1245 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 11799 T1232 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 11799 T1226 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 11801 T1204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 11808 T1276 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094/collection1
[junit4:junit4]   2> 11808 T1276 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 11809 T1276 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 11809 T1276 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 11811 T1276 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094/collection1/'
[junit4:junit4]   2> 11812 T1276 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 11813 T1276 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094/collection1/lib/README' to classloader
[junit4:junit4]   2> 11866 T1276 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 11938 T1276 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 12039 T1276 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 12045 T1276 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 12672 T1276 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 12683 T1276 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 12687 T1276 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 12705 T1276 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 12710 T1276 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 12715 T1276 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 12717 T1276 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 12718 T1276 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356956062094/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/
[junit4:junit4]   2> 12719 T1276 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@443c2e0b
[junit4:junit4]   2> 12719 T1276 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 12720 T1276 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3 forceNew:false
[junit4:junit4]   2> 12721 T1276 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3
[junit4:junit4]   2> 12721 T1276 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index/
[junit4:junit4]   2> 12722 T1276 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 12723 T1276 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index forceNew:false
[junit4:junit4]   2> 12755 T1276 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@587ac955),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12755 T1276 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 12756 T1276 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index
[junit4:junit4]   2> 12756 T1276 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 12759 T1276 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 12759 T1276 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 12760 T1276 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 12760 T1276 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 12761 T1276 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 12761 T1276 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 12761 T1276 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 12762 T1276 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 12763 T1276 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 12763 T1276 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 12764 T1276 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 12764 T1276 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 12765 T1276 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 12765 T1276 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 12766 T1276 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 12766 T1276 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 12767 T1276 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12767 T1276 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12768 T1276 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12768 T1276 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12769 T1276 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12770 T1276 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12770 T1276 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12771 T1276 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 12771 T1276 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 12772 T1276 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 12785 T1276 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 12789 T1276 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 12791 T1276 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 12794 T1276 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3
[junit4:junit4]   2> 12795 T1276 oass.SolrIndexSearcher.<init> Opening Searcher@78520f43 main
[junit4:junit4]   2> 12796 T1276 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 12797 T1276 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 12797 T1276 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 12805 T1276 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 12861 T1277 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@78520f43 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 12867 T1276 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 12867 T1276 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12922 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12923 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25552_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25552"}
[junit4:junit4]   2> 12927 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25555_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25555"}
[junit4:junit4]   2> 12928 T1227 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 12928 T1227 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 12938 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12939 T1260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12939 T1275 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12938 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12938 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13870 T1276 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 13870 T1276 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25555 collection:collection1 shard:shard1
[junit4:junit4]   2> 13904 T1276 oasc.ZkController.register We are http://127.0.0.1:25555/collection1/ and leader is http://127.0.0.1:25491/collection1/
[junit4:junit4]   2> 13904 T1276 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25555
[junit4:junit4]   2> 13904 T1276 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 13905 T1276 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C124 name=collection1 org.apache.solr.core.SolrCore@4df4e5a8 url=http://127.0.0.1:25555/collection1 node=127.0.0.1:25555_ C124_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:25555_, base_url=http://127.0.0.1:25555}
[junit4:junit4]   2> 13905 T1278 C124 P25555 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 13906 T1278 C124 P25555 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 13906 T1278 C124 P25555 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 13906 T1278 C124 P25555 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13906 T1276 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13908 T1278 C124 P25555 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13909 T1204 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 13909 T1204 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 13910 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14181 T1204 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 14184 T1204 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25559
[junit4:junit4]   2> 14185 T1204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 14185 T1204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571
[junit4:junit4]   2> 14186 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571/'
[junit4:junit4]   2> 14229 T1204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 14229 T1204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 14230 T1204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571
[junit4:junit4]   2> 14230 T1204 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571/solr.xml
[junit4:junit4]   2> 14231 T1204 oasc.CoreContainer.<init> New CoreContainer 1067628
[junit4:junit4]   2> 14231 T1204 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571/'
[junit4:junit4]   2> 14232 T1204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571/'
[junit4:junit4]   2> 14262 T1204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 14263 T1204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 14263 T1204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 14264 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 14264 T1204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 14265 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 14265 T1204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 14266 T1204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 14266 T1204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 14267 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 14288 T1204 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 14308 T1204 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:25440/solr
[junit4:junit4]   2> 14309 T1204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 14309 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@664a7d46
[junit4:junit4]   2> 14310 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 14311 T1288 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 14312 T1288 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 14312 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25560
[junit4:junit4]   2> 14312 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25560
[junit4:junit4]   2> 14341 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df000b with negotiated timeout 20000 for client /140.211.11.196:25560
[junit4:junit4]   2> 14341 T1288 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df000b, negotiated timeout = 20000
[junit4:junit4]   2> 14341 T1289 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@664a7d46 name:ZooKeeperConnection Watcher:127.0.0.1:25440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 14342 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 14343 T1209 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf0e224df000b
[junit4:junit4]   2> 14353 T1289 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 14353 T1206 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:25560 which had sessionid 0x13bf0e224df000b
[junit4:junit4]   2> 14353 T1204 oaz.ZooKeeper.close Session: 0x13bf0e224df000b closed
[junit4:junit4]   2> 14354 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 14365 T1204 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:25440/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@47da8444
[junit4:junit4]   2> 14366 T1204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 14366 T1290 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:25440. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 14367 T1290 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:25440, initiating session
[junit4:junit4]   2> 14367 T1206 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25561
[junit4:junit4]   2> 14368 T1206 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25561
[junit4:junit4]   2> 14370 T1208 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf0e224df000c with negotiated timeout 20000 for client /140.211.11.196:25561
[junit4:junit4]   2> 14371 T1290 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:25440, sessionid = 0x13bf0e224df000c, negotiated timeout = 20000
[junit4:junit4]   2> 14371 T1291 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47da8444 name:ZooKeeperConnection Watcher:127.0.0.1:25440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 14371 T1204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 14372 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df000c type:create cxid:0x1 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14434 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df000c type:create cxid:0x2 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14435 T1204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25559_
[junit4:junit4]   2> 14436 T1209 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf0e224df000c type:delete cxid:0x4 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:25559_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:25559_
[junit4:junit4]   2> 14481 T1204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25559_
[junit4:junit4]   2> 14483 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14484 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14484 T1260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14484 T1275 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14484 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14484 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14485 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25555_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25555"}
[junit4:junit4]   2> 14517 T1245 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 14517 T1260 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 14517 T1232 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 14517 T1275 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 14521 T1204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 14523 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14523 T1260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14523 T1275 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14523 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14530 T1292 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571/collection1
[junit4:junit4]   2> 14530 T1292 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 14539 T1292 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14539 T1292 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 14541 T1292 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571/collection1/'
[junit4:junit4]   2> 14542 T1292 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571/collection1/lib/README' to classloader
[junit4:junit4]   2> 14543 T1292 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 14559 T1226 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 14560 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14596 T1292 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 14666 T1292 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14767 T1292 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14773 T1292 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 15393 T1292 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15404 T1292 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15408 T1292 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15425 T1292 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15430 T1292 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15435 T1292 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15436 T1292 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15438 T1292 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356956064571/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/
[junit4:junit4]   2> 15438 T1292 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@443c2e0b
[junit4:junit4]   2> 15439 T1292 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 15440 T1292 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4 forceNew:false
[junit4:junit4]   2> 15441 T1292 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4
[junit4:junit4]   2> 15441 T1292 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index/
[junit4:junit4]   2> 15442 T1292 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15443 T1292 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index forceNew:false
[junit4:junit4]   2> 15452 T1292 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2915c660),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15452 T1292 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15453 T1292 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index
[junit4:junit4]   2> 15453 T1292 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 15456 T1292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15456 T1292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 15456 T1292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15457 T1292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 15458 T1292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15458 T1292 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15458 T1292 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15459 T1292 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15460 T1292 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15460 T1292 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 15461 T1292 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 15461 T1292 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15462 T1292 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 15462 T1292 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 15462 T1292 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 15463 T1292 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15463 T1292 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15464 T1292 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15465 T1292 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15465 T1292 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15466 T1292 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15466 T1292 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15467 T1292 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15467 T1292 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15468 T1292 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 15468 T1292 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 15480 T1292 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15484 T1292 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 15486 T1292 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 15488 T1292 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4
[junit4:junit4]   2> 15490 T1292 oass.SolrIndexSearcher.<init> Opening Searcher@70b78e39 main
[junit4:junit4]   2> 15491 T1292 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15491 T1292 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15492 T1292 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 15499 T1292 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 15549 T1293 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@70b78e39 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15555 T1292 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 15555 T1292 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16042 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16043 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25559_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25559"}
[junit4:junit4]   2> 16043 T1227 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 16043 T1227 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 16056 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16056 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16056 T1275 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16056 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16056 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16056 T1260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16558 T1292 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16558 T1292 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25559 collection:collection1 shard:shard2
[junit4:junit4]   2> 16562 T1292 oasc.ZkController.register We are http://127.0.0.1:25559/collection1/ and leader is http://127.0.0.1:25552/collection1/
[junit4:junit4]   2> 16562 T1292 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25559
[junit4:junit4]   2> 16562 T1292 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 16563 T1292 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C125 name=collection1 org.apache.solr.core.SolrCore@302693e9 url=http://127.0.0.1:25559/collection1 node=127.0.0.1:25559_ C125_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:25559_, base_url=http://127.0.0.1:25559}
[junit4:junit4]   2> 16563 T1294 C125 P25559 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 16564 T1292 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16564 T1294 C125 P25559 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16565 T1294 C125 P25559 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 16565 T1294 C125 P25559 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16565 T1204 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 16566 T1204 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 16566 T1294 C125 P25559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16567 T1204 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16586 T1204 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16587 T1204 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 16588 T1204 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C124_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:25555_, base_url=http://127.0.0.1:25555}
[junit4:junit4]   2> 16932 T1278 C124 P25555 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:25491/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 16932 T1278 C124 P25555 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:25555 START replicas=[http://127.0.0.1:25491/collection1/] nUpdates=100
[junit4:junit4]   2> 16933 T1278 C124 P25555 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 16933 T1278 C124 P25555 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 16934 T1278 C124 P25555 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 16934 T1278 C124 P25555 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 16934 T1278 C124 P25555 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 16934 T1278 C124 P25555 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:25491/collection1/. core=collection1
[junit4:junit4]   2> 16935 T1278 C124 P25555 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C126 name=collection1 org.apache.solr.core.SolrCore@5f40c449 url=http://127.0.0.1:25491/collection1 node=127.0.0.1:25491_ C126_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:25491_, base_url=http://127.0.0.1:25491, leader=true}
[junit4:junit4]   2> 16943 T1236 C126 P25491 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 16946 T1237 C126 P25491 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 16947 T1237 C126 P25491 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1
[junit4:junit4]   2> 16951 T1237 C126 P25491 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2720b38e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 16952 T1237 C126 P25491 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 16955 T1237 C126 P25491 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2720b38e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2720b38e),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 16955 T1237 C126 P25491 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 16957 T1237 C126 P25491 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1
[junit4:junit4]   2> 16957 T1237 C126 P25491 oass.SolrIndexSearcher.<init> Opening Searcher@299cc074 realtime
[junit4:junit4]   2> 16958 T1237 C126 P25491 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 16958 T1237 C126 P25491 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 12
[junit4:junit4]   2> 16959 T1278 C124 P25555 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 16959 T1278 C124 P25555 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 16961 T1238 C126 P25491 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 16961 T1238 C126 P25491 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 16962 T1278 C124 P25555 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 16962 T1278 C124 P25555 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 16962 T1278 C124 P25555 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 16964 T1238 C126 P25491 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1
[junit4:junit4]   2> 16965 T1238 C126 P25491 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1/index
[junit4:junit4]   2> 16966 T1238 C126 P25491 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 16966 T1278 C124 P25555 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 16967 T1278 C124 P25555 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index.20121231091427609 forceNew:false
[junit4:junit4]   2> 16968 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3
[junit4:junit4]   2> 16968 T1278 C124 P25555 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index.20121231091427609 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a2da732) fullCopy=true
[junit4:junit4]   2> 16972 T1238 C126 P25491 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 16973 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index
[junit4:junit4]   2> 16974 T1278 C124 P25555 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 16974 T1278 C124 P25555 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121231091427609
[junit4:junit4]   2> 16975 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3
[junit4:junit4]   2> 16976 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3
[junit4:junit4]   2> 16976 T1278 C124 P25555 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index.20121231091427609
[junit4:junit4]   2> 16980 T1278 C124 P25555 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index.20121231091427609 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a2da732),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 16980 T1278 C124 P25555 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 16982 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3
[junit4:junit4]   2> 16982 T1278 C124 P25555 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 16982 T1278 C124 P25555 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 16983 T1278 C124 P25555 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 16983 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index.20121231091427609
[junit4:junit4]   2> 16984 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3
[junit4:junit4]   2> 16988 T1278 C124 P25555 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index.20121231091427609 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a2da732),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 16988 T1278 C124 P25555 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 16988 T1278 C124 P25555 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 16989 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3
[junit4:junit4]   2> 16989 T1278 C124 P25555 oass.SolrIndexSearcher.<init> Opening Searcher@15447f19 main
[junit4:junit4]   2> 16991 T1277 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15447f19 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 16992 T1277 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index
[junit4:junit4]   2> 16992 T1278 C124 P25555 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 16994 T1278 C124 P25555 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index.20121231091427609 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a2da732),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index.20121231091427609 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a2da732),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 16995 T1278 C124 P25555 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 16996 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3
[junit4:junit4]   2> 16996 T1278 C124 P25555 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 16996 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index.20121231091427609
[junit4:junit4]   2> 16997 T1278 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3/index
[junit4:junit4]   2> 16997 T1278 C124 P25555 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 16997 T1278 C124 P25555 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 16997 T1278 C124 P25555 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 16998 T1278 C124 P25555 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17004 T1278 C124 P25555 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 17563 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17564 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25559_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25559"}
[junit4:junit4]   2> 17573 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25555_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25555"}
[junit4:junit4]   2> 17584 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17584 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17584 T1275 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17584 T1260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17584 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17584 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17591 T1204 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18593 T1204 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C125_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:25559_, base_url=http://127.0.0.1:25559}
[junit4:junit4]   2> 19592 T1294 C125 P25559 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:25552/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 19592 T1294 C125 P25559 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:25559 START replicas=[http://127.0.0.1:25552/collection1/] nUpdates=100
[junit4:junit4]   2> 19593 T1294 C125 P25559 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 19593 T1294 C125 P25559 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 19593 T1294 C125 P25559 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 19593 T1294 C125 P25559 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 19594 T1294 C125 P25559 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 19594 T1294 C125 P25559 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:25552/collection1/. core=collection1
[junit4:junit4]   2> 19594 T1294 C125 P25559 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19596 T1204 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C127 name=collection1 org.apache.solr.core.SolrCore@6a4645a3 url=http://127.0.0.1:25552/collection1 node=127.0.0.1:25552_ C127_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:25552_, base_url=http://127.0.0.1:25552, leader=true}
[junit4:junit4]   2> 19603 T1251 C127 P25552 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 19611 T1252 C127 P25552 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 19612 T1252 C127 P25552 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2
[junit4:junit4]   2> 19616 T1252 C127 P25552 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15c839c4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 19616 T1252 C127 P25552 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 19619 T1252 C127 P25552 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15c839c4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15c839c4),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19620 T1252 C127 P25552 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19621 T1252 C127 P25552 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2
[junit4:junit4]   2> 19622 T1252 C127 P25552 oass.SolrIndexSearcher.<init> Opening Searcher@33620e48 realtime
[junit4:junit4]   2> 19622 T1252 C127 P25552 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 19623 T1252 C127 P25552 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 13
[junit4:junit4]   2> 19623 T1294 C125 P25559 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19624 T1294 C125 P25559 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 19626 T1253 C127 P25552 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19626 T1253 C127 P25552 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 19627 T1294 C125 P25559 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 19627 T1294 C125 P25559 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 19628 T1294 C125 P25559 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 19630 T1253 C127 P25552 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2
[junit4:junit4]   2> 19631 T1253 C127 P25552 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2/index
[junit4:junit4]   2> 19631 T1253 C127 P25552 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 19632 T1294 C125 P25559 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 19633 T1294 C125 P25559 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index.20121231091430274 forceNew:false
[junit4:junit4]   2> 19634 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4
[junit4:junit4]   2> 19634 T1294 C125 P25559 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index.20121231091430274 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65b4abcb) fullCopy=true
[junit4:junit4]   2> 19638 T1253 C127 P25552 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 19639 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index
[junit4:junit4]   2> 19640 T1294 C125 P25559 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 19640 T1294 C125 P25559 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121231091430274
[junit4:junit4]   2> 19641 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4
[junit4:junit4]   2> 19642 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4
[junit4:junit4]   2> 19642 T1294 C125 P25559 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index.20121231091430274
[junit4:junit4]   2> 19646 T1294 C125 P25559 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index.20121231091430274 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65b4abcb),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19646 T1294 C125 P25559 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19648 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4
[junit4:junit4]   2> 19648 T1294 C125 P25559 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 19648 T1294 C125 P25559 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 19648 T1294 C125 P25559 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 19649 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index.20121231091430274
[junit4:junit4]   2> 19650 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4
[junit4:junit4]   2> 19653 T1294 C125 P25559 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index.20121231091430274 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65b4abcb),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19654 T1294 C125 P25559 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19654 T1294 C125 P25559 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 19655 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4
[junit4:junit4]   2> 19655 T1294 C125 P25559 oass.SolrIndexSearcher.<init> Opening Searcher@5097d653 main
[junit4:junit4]   2> 19657 T1293 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5097d653 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 19658 T1293 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index
[junit4:junit4]   2> 19658 T1294 C125 P25559 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 19660 T1294 C125 P25559 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index.20121231091430274 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65b4abcb),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index.20121231091430274 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65b4abcb),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 19661 T1294 C125 P25559 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 19662 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4
[junit4:junit4]   2> 19662 T1294 C125 P25559 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 19662 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index.20121231091430274
[junit4:junit4]   2> 19663 T1294 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4/index
[junit4:junit4]   2> 19663 T1294 C125 P25559 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 19663 T1294 C125 P25559 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 19663 T1294 C125 P25559 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 19663 T1294 C125 P25559 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19665 T1294 C125 P25559 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 20594 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20595 T1227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:25559_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:25559"}
[junit4:junit4]   2> 20600 T1204 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20604 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20604 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20604 T1232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20604 T1275 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20604 T1260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20604 T1245 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21602 T1204 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21604 T1204 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C128 name=collection1 org.apache.solr.core.SolrCore@db3a715 url=http://127.0.0.1:25443/collection1 node=127.0.0.1:25443_ C128_STATE=coll:control_collection core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:25443_, base_url=http://127.0.0.1:25443, leader=true}
[junit4:junit4]   2> 21615 T1216 C128 P25443 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data
[junit4:junit4]   2> 21619 T1216 C128 P25443 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@46e8294a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 21620 T1216 C128 P25443 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 21621 T1216 C128 P25443 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/control/data
[junit4:junit4]   2> 21622 T1216 C128 P25443 oass.SolrIndexSearcher.<init> Opening Searcher@19e76bc realtime
[junit4:junit4]   2> 21623 T1216 C128 P25443 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1422871570421907456)} 0 10
[junit4:junit4]   2> 21626 T1254 C127 P25552 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty2
[junit4:junit4]   2> 21631 T1239 C126 P25491 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty1
[junit4:junit4]   2>  C125_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:25559_, base_url=http://127.0.0.1:25559}
[junit4:junit4]   2> 21636 T1281 C125 P25559 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty4
[junit4:junit4]   2> 21637 T1281 C125 P25559 REQ /update {update.distrib=FROMLEADER&_version_=-1422871570433441792&update.from=http://127.0.0.1:25552/collection1/&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2>  C124_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:25555_, base_url=http://127.0.0.1:25555}
[junit4:junit4]   2> 21640 T1265 C124 P25555 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZkTest-1356956050648/jetty3
[junit4:junit4]   2> 21641 T1265 C124 P25555 REQ /update {update.distrib=FROMLEADER&_version_=-1422871570437636096&update.from=http://127.0.0.1:25491/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 21642 T1239 C126 P25491 REQ /update {update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=13 
[junit4:junit4]   2> 21643 T1254 C127 P25552 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1422871570433441792)} 0 18
[junit4:junit4]   2> 21650 T1216 C128 P25443 /update {wt=javabin&version=2} {add=[1 (1422871570455461888)]} 0 4
[junit4:junit4]   2> 21662 T1265 C124 P25555 REQ /update {distrib.from=http://127.0.0.1:25491/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4 
[junit4:junit4]   2> 21662 T1240 C126 P25491 /update {wt=javabin&version=2} {add=[1 (1422871570461753344)]} 0 10
[junit4:junit4]   2> 21666 T1216 C128 P25443 /update {wt=javabin&version=2} {add=[2 (1422871570475384832)]} 0 1
[junit4:junit4]   2> 21679 T1281 C125 P25559 REQ /update {distrib.from=http://127.0.0.1:25552/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 21680 T1255 C127 P25552 REQ /update {distrib.from=http://127.0.0.1:25491/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=10 
[junit4:junit4]   2> 21681 T1240 C126 P25491 /update {wt=javabin&version=2} {add=[2]} 0 12
[junit4:junit4]   2> 21686 T1216 C128 P25443 /update {wt=javabin&version=2} {add=[3 (1422871570496356352)]} 0 1
[junit4:junit4]   2> 21695 T1281 C125 P25559 REQ /update {distrib.from=http://127.0.0.1:25552/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 21696 T1255 C127 P25552 REQ /update {distrib.from=http://127.0.0.1:25491/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 21696 T1240 C126 P25491 /update {wt=javabin&version=2} {add=[3]} 0 7
[junit4:junit4]   2> 21700 T1216 C128 P25443 /update {wt=javabin&version=2} {add=[4 (1422871570511036416)]} 0 1
[junit4:junit4]   2> 21707 T1265 C124 P25555 REQ /update {distrib.from=http://127.0.0.1:25491/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 21708 T1240 C126 P25491 /update {wt=javabin&version=2} {add=[4 (1422871570515230720)]} 0 5
[junit4:junit4]   2> 21712 T1216 C128 P25443 /update {wt=javabin&version=2} {add=[5 (1422871570523619328)]} 0 1
[junit4:junit4]   2> 21720 T1281 C125 P25559 REQ /update {distrib.from=http://127.0.0.1:25552/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 21721 T1254 C127 P25552 /update {wt=javabin&version=2} {add=[5 (1422871570527813632)]} 0 6
[junit4:junit4]   2> 21725 T1216 C128 P25443 /update {wt=javabin&version=2} {add=[6 (1422871570537250816)]} 0 1
[junit4:junit4]   2> 21732 T1281 C125 P25559 REQ /update {distrib.from=http://127.0.0.1:25552/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 21733 T1254 C127 P25552 /update {wt=javabin&version=2} {add=[6 (1422871570541445120)]} 0 5
[junit4:junit4]   2> 21737 T1216 C128 P25443 /update {wt=javabin&version=2} {add=[7 (1422871570549833728)]} 0 1
[junit4:junit4]   2> 21744 T1281 C125 P25559 REQ /update {distrib.from=http://127.0.0.1:25552/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 21745 T1254 C127 P25552 /update {wt=javabin&version=2} {add=[7 (1422871570554028032)]} 0 5
[junit4:junit4]   2> 21749 T1216 C128 P25443 /update

[...truncated too long message...]

it4]   2> 	        at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4:junit4]   2> 	        at java.util.TimerThread.run(Timer.java:505)
[junit4:junit4]   2> 	  42) Thread[id=1336, name=searcherExecutor-828-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 	  43) Thread[id=1349, name=searcherExecutor-850-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 	  44) Thread[id=1354, name=searcherExecutor-862-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 	  45) Thread[id=1340, name=searcherExecutor-834-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 	  46) Thread[id=1244, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[CBCB93F2E31BDD0F]-SendThread(localhost:25440), state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4]   2> 	        at sun.nio.ch.KQueueArrayWrapper.interrupt(Native Method)
[junit4:junit4]   2> 	        at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueArrayWrapper.java:164)
[junit4:junit4]   2> 	        at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:245)
[junit4:junit4]   2> 	        at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
[junit4:junit4]   2> 	        at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
[junit4:junit4]   2> 	        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:102)
[junit4:junit4]   2> 	        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4:junit4]   2> 	        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4]   2> 	        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {n_f1=PostingsFormat(name=MockRandom), foo_b=PostingsFormat(name=Asserting), cat=Lucene41(blocksize=128), foo_d=PostingsFormat(name=Direct), foo_f=PostingsFormat(name=Asserting), n_tl1=PostingsFormat(name=MockRandom), n_d1=Lucene41(blocksize=128), rnd_b=PostingsFormat(name=Direct), intDefault=PostingsFormat(name=MockRandom), n_td1=PostingsFormat(name=MockRandom), timestamp=Lucene41(blocksize=128), id=PostingsFormat(name=Direct), range_facet_sl=PostingsFormat(name=Direct), range_facet_si=Lucene41(blocksize=128), oddField_s=PostingsFormat(name=Direct), sequence_i=PostingsFormat(name=Direct), name=PostingsFormat(name=Direct), foo_i=PostingsFormat(name=MockRandom), regex_dup_B_s=Lucene41(blocksize=128), multiDefault=Lucene41(blocksize=128), n_tf1=Lucene41(blocksize=128), n_dt1=PostingsFormat(name=MockRandom), genre_s=PostingsFormat(name=Direct), author_t=PostingsFormat(name=MockRandom), n_ti1=PostingsFormat(name=Direct), range_facet_l=Lucene41(blocksize=128), text=PostingsFormat(name=Asserting), _version_=PostingsFormat(name=MockRandom), val_i=PostingsFormat(name=Direct), SubjectTerms_mfacet=PostingsFormat(name=MockRandom), series_t=PostingsFormat(name=MockRandom), a_t=Lucene41(blocksize=128), n_tdt1=PostingsFormat(name=MockRandom), regex_dup_A_s=PostingsFormat(name=Asserting), price=PostingsFormat(name=Asserting), other_tl1=PostingsFormat(name=MockRandom), n_l1=Lucene41(blocksize=128), a_si=PostingsFormat(name=MockRandom), inStock=PostingsFormat(name=Asserting)}, sim=DefaultSimilarity, locale=in, timezone=America/Araguaina
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=49,free=200833320,total=407896064
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestReload, TestSolrDeletionPolicy2, SuggesterTSTTest, DisMaxRequestHandlerTest, TestValueSourceCache, SchemaVersionSpecificBehaviorTest, TestElisionMultitermQuery, LeaderElectionTest, DOMUtilTest, ConvertedLegacyTest, DocumentAnalysisRequestHandlerTest, TestDocumentBuilder, SuggesterTest, DistributedQueryElevationComponentTest, PolyFieldTest, TestAtomicUpdateErrorCases, TestUpdate, PrimitiveFieldTypeTest, HighlighterTest, TestSolrIndexConfig, LegacyHTMLStripCharFilterTest, TestLRUCache, ZkSolrClientTest, ZkNodePropsTest, OverseerCollectionProcessorTest, IndexSchemaRuntimeFieldTest, ReturnFieldsTest, TestCodecSupport, ExternalFileFieldSortTest, TestWriterPerf, QueryParsingTest, TestPhraseSuggestions, RAMDirectoryFactoryTest, OutputWriterTest, CoreContainerCoreInitFailuresTest, TestBinaryField, TestUtils, TestPropInject, TestDistributedGrouping, PrimUtilsTest, DocumentBuilderTest, TestDistributedSearch, TestDocSet, IndexReaderFactoryTest, PingRequestHandlerTest, TestCSVResponseWriter, TestJmxIntegration, TestReversedWildcardFilterFactory, BasicZkTest, EchoParamsTest, TestRecovery, TestTrie, TestReplicationHandler, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, TestArbitraryIndexDir, TimeZoneUtilsTest, FullSolrCloudDistribCmdsTest, BasicDistributedZkTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.seed=CBCB93F2E31BDD0F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=in -Dtests.timezone=America/Araguaina -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR   0.00s J1 | BasicDistributedZkTest (suite) <<<
[junit4:junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([CBCB93F2E31BDD0F]:0)
[junit4:junit4] Completed on J1 in 7224.18s, 1 test, 2 errors <<< FAILURES!

[...truncated 11 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:353: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:438: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:841: There were test failures: 245 suites, 1013 tests, 1 suite-level error, 1 error, 22 ignored (4 assumptions)

Total time: 147 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 843 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/843/

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 should have just been set up to be inconsistent - but it's still consistent

Stack Trace:
java.lang.AssertionError: shard1 should have just been set up to be inconsistent - but it's still consistent
	at __randomizedtesting.SeedInfo.seed([B4681CAE9328E7FF:358E92B6E47787C3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:214)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9214 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T2766 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /o_kq/
[junit4:junit4]   2> 3 T2766 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1356941694196
[junit4:junit4]   2> 4 T2766 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 5 T2767 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 8 T2767 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 8 T2767 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 9 T2767 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 9 T2767 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 10 T2767 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 106 T2766 oasc.ZkTestServer.run start zk server on port:18517
[junit4:junit4]   2> 106 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1fe8543c
[junit4:junit4]   2> 108 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 108 T2772 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 108 T2772 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 109 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:30529
[junit4:junit4]   2> 109 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:30529
[junit4:junit4]   2> 110 T2770 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 113 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb0000 with negotiated timeout 10000 for client /140.211.11.196:30529
[junit4:junit4]   2> 113 T2772 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb0000, negotiated timeout = 10000
[junit4:junit4]   2> 114 T2773 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fe8543c name:ZooKeeperConnection Watcher:127.0.0.1:18517 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 114 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 114 T2766 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 124 T2771 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf00714fb0000
[junit4:junit4]   2> 125 T2773 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 126 T2768 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:30529 which had sessionid 0x13bf00714fb0000
[junit4:junit4]   2> 125 T2766 oaz.ZooKeeper.close Session: 0x13bf00714fb0000 closed
[junit4:junit4]   2> 126 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d4d4729
[junit4:junit4]   2> 127 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 127 T2774 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 128 T2774 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 128 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22664
[junit4:junit4]   2> 129 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22664
[junit4:junit4]   2> 130 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb0001 with negotiated timeout 10000 for client /140.211.11.196:22664
[junit4:junit4]   2> 130 T2774 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb0001, negotiated timeout = 10000
[junit4:junit4]   2> 131 T2775 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d4d4729 name:ZooKeeperConnection Watcher:127.0.0.1:18517/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 131 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 131 T2766 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 141 T2766 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 143 T2766 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 146 T2766 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 155 T2766 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 156 T2766 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 169 T2766 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 170 T2766 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 275 T2766 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 276 T2766 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 279 T2766 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 279 T2766 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 282 T2766 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 283 T2766 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 285 T2766 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 286 T2766 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 293 T2766 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 294 T2766 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 297 T2766 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 298 T2766 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 301 T2766 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 302 T2766 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 304 T2771 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf00714fb0001
[junit4:junit4]   2> 305 T2775 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 305 T2768 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:22664 which had sessionid 0x13bf00714fb0001
[junit4:junit4]   2> 305 T2766 oaz.ZooKeeper.close Session: 0x13bf00714fb0001 closed
[junit4:junit4]   2> 473 T2766 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 477 T2766 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:16123
[junit4:junit4]   2> 478 T2766 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 479 T2766 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498
[junit4:junit4]   2> 479 T2766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498/'
[junit4:junit4]   2> 524 T2766 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 525 T2766 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 525 T2766 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498
[junit4:junit4]   2> 526 T2766 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498/solr.xml
[junit4:junit4]   2> 526 T2766 oasc.CoreContainer.<init> New CoreContainer 287827871
[junit4:junit4]   2> 527 T2766 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498/'
[junit4:junit4]   2> 528 T2766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498/'
[junit4:junit4]   2> 560 T2766 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 560 T2766 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 561 T2766 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 561 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 562 T2766 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 563 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 563 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 564 T2766 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 564 T2766 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 565 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 586 T2766 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 606 T2766 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:18517/solr
[junit4:junit4]   2> 607 T2766 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 608 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@461b8fd7
[junit4:junit4]   2> 609 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 609 T2785 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 610 T2785 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 610 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:20756
[junit4:junit4]   2> 611 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:20756
[junit4:junit4]   2> 613 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb0002 with negotiated timeout 20000 for client /140.211.11.196:20756
[junit4:junit4]   2> 613 T2785 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb0002, negotiated timeout = 20000
[junit4:junit4]   2> 613 T2786 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@461b8fd7 name:ZooKeeperConnection Watcher:127.0.0.1:18517 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 613 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 615 T2771 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf00714fb0002
[junit4:junit4]   2> 666 T2786 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 666 T2768 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:20756 which had sessionid 0x13bf00714fb0002
[junit4:junit4]   2> 666 T2766 oaz.ZooKeeper.close Session: 0x13bf00714fb0002 closed
[junit4:junit4]   2> 667 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 679 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c21fd09
[junit4:junit4]   2> 680 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 680 T2787 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 681 T2787 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 681 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17192
[junit4:junit4]   2> 682 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17192
[junit4:junit4]   2> 683 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb0003 with negotiated timeout 20000 for client /140.211.11.196:17192
[junit4:junit4]   2> 683 T2787 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb0003, negotiated timeout = 20000
[junit4:junit4]   2> 683 T2788 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c21fd09 name:ZooKeeperConnection Watcher:127.0.0.1:18517/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 684 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 736 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 738 T2766 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 767 T2766 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:16123_o_kq
[junit4:junit4]   2> 767 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:16123_o_kq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:16123_o_kq
[junit4:junit4]   2> 769 T2766 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:16123_o_kq
[junit4:junit4]   2> 794 T2766 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 804 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 806 T2766 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 814 T2766 oasc.Overseer.start Overseer (id=88928530871287811-127.0.0.1:16123_o_kq-n_0000000000) starting
[junit4:junit4]   2> 814 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 815 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 821 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 823 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 824 T2790 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 825 T2766 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 828 T2766 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 835 T2791 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498/collection1
[junit4:junit4]   2> 835 T2789 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 835 T2791 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 836 T2791 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 836 T2791 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 837 T2791 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498/collection1/'
[junit4:junit4]   2> 839 T2791 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498/collection1/lib/README' to classloader
[junit4:junit4]   2> 839 T2791 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 896 T2791 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 967 T2791 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1068 T2791 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1102 T2791 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1741 T2791 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1753 T2791 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1757 T2791 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1771 T2791 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1776 T2791 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1780 T2791 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1781 T2791 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1783 T2791 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1356941694498/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1356941694196/control/data/
[junit4:junit4]   2> 1783 T2791 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7a0136b0
[junit4:junit4]   2> 1784 T2791 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1822 T2791 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/control/data forceNew:false
[junit4:junit4]   2> 1824 T2791 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/control/data
[junit4:junit4]   2> 1824 T2791 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1356941694196/control/data/index/
[junit4:junit4]   2> 1825 T2791 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1356941694196/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1827 T2791 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/control/data/index forceNew:false
[junit4:junit4]   2> 1837 T2791 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@776b8241; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1838 T2791 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1839 T2791 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/control/data/index
[junit4:junit4]   2> 1840 T2791 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1842 T2791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1842 T2791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1843 T2791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1843 T2791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1844 T2791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1844 T2791 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1845 T2791 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1845 T2791 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1846 T2791 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1846 T2791 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1847 T2791 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1847 T2791 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1848 T2791 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1848 T2791 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1848 T2791 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1849 T2791 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1849 T2791 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1850 T2791 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1850 T2791 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1851 T2791 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1851 T2791 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1852 T2791 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1852 T2791 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1853 T2791 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1853 T2791 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1854 T2791 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1867 T2791 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1872 T2791 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1873 T2791 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1876 T2791 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/control/data
[junit4:junit4]   2> 1878 T2791 oass.SolrIndexSearcher.<init> Opening Searcher@2892b391 main
[junit4:junit4]   2> 1879 T2791 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1879 T2791 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1880 T2791 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1889 T2791 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1974 T2792 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2892b391 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1978 T2791 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1978 T2791 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1979 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2339 T2789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2339 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:16123_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:16123/o_kq"}
[junit4:junit4]   2> 2340 T2789 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2340 T2789 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2341 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2381 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2994 T2791 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2994 T2791 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:16123/o_kq collection:control_collection shard:shard1
[junit4:junit4]   2> 2995 T2791 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 3011 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 3017 T2791 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3017 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3020 T2791 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3020 T2791 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3020 T2791 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:16123/o_kq/collection1/
[junit4:junit4]   2> 3021 T2791 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3021 T2791 oasc.SyncStrategy.syncToMe http://127.0.0.1:16123/o_kq/collection1/ has no replicas
[junit4:junit4]   2> 3021 T2791 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:16123/o_kq/collection1/
[junit4:junit4]   2> 3022 T2791 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 3033 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3885 T2789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3929 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3959 T2791 oasc.ZkController.register We are http://127.0.0.1:16123/o_kq/collection1/ and leader is http://127.0.0.1:16123/o_kq/collection1/
[junit4:junit4]   2> 3959 T2791 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:16123/o_kq
[junit4:junit4]   2> 3959 T2791 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3960 T2791 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3960 T2791 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3961 T2791 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3962 T2766 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3963 T2766 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3964 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3978 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3987 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d6fea2e
[junit4:junit4]   2> 3988 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3988 T2793 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3989 T2793 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 3989 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:46628
[junit4:junit4]   2> 3989 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:46628
[junit4:junit4]   2> 3990 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb0004 with negotiated timeout 10000 for client /140.211.11.196:46628
[junit4:junit4]   2> 3990 T2793 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb0004, negotiated timeout = 10000
[junit4:junit4]   2> 3991 T2794 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d6fea2e name:ZooKeeperConnection Watcher:127.0.0.1:18517/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3991 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3992 T2766 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3994 T2766 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 4160 T2766 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4164 T2766 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:35147
[junit4:junit4]   2> 4165 T2766 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4166 T2766 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186
[junit4:junit4]   2> 4166 T2766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186/'
[junit4:junit4]   2> 4211 T2766 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4211 T2766 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4212 T2766 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186
[junit4:junit4]   2> 4213 T2766 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186/solr.xml
[junit4:junit4]   2> 4213 T2766 oasc.CoreContainer.<init> New CoreContainer 1541320802
[junit4:junit4]   2> 4214 T2766 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186/'
[junit4:junit4]   2> 4214 T2766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186/'
[junit4:junit4]   2> 4247 T2766 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 4248 T2766 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4249 T2766 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4249 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4250 T2766 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4250 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4251 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4251 T2766 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4252 T2766 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4252 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4272 T2766 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4292 T2766 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:18517/solr
[junit4:junit4]   2> 4293 T2766 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4294 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@45bfa5a0
[junit4:junit4]   2> 4295 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4295 T2804 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4297 T2804 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 4297 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57248
[junit4:junit4]   2> 4297 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57248
[junit4:junit4]   2> 4305 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb0005 with negotiated timeout 20000 for client /140.211.11.196:57248
[junit4:junit4]   2> 4305 T2804 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb0005, negotiated timeout = 20000
[junit4:junit4]   2> 4306 T2805 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45bfa5a0 name:ZooKeeperConnection Watcher:127.0.0.1:18517 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4306 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4307 T2771 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf00714fb0005
[junit4:junit4]   2> 4308 T2805 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4308 T2768 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:57248 which had sessionid 0x13bf00714fb0005
[junit4:junit4]   2> 4308 T2766 oaz.ZooKeeper.close Session: 0x13bf00714fb0005 closed
[junit4:junit4]   2> 4309 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 4319 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2aa1047e
[junit4:junit4]   2> 4321 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4321 T2806 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4322 T2806 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 4322 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:41808
[junit4:junit4]   2> 4322 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:41808
[junit4:junit4]   2> 4324 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb0006 with negotiated timeout 20000 for client /140.211.11.196:41808
[junit4:junit4]   2> 4324 T2806 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb0006, negotiated timeout = 20000
[junit4:junit4]   2> 4325 T2807 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2aa1047e name:ZooKeeperConnection Watcher:127.0.0.1:18517/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4325 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4326 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4333 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4335 T2766 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35147_o_kq
[junit4:junit4]   2> 4336 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35147_o_kq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35147_o_kq
[junit4:junit4]   2> 4345 T2766 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35147_o_kq
[junit4:junit4]   2> 4353 T2794 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4353 T2788 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4353 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4356 T2766 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4363 T2808 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186/collection1
[junit4:junit4]   2> 4364 T2808 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4364 T2808 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4364 T2808 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4367 T2808 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186/collection1/'
[junit4:junit4]   2> 4368 T2808 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186/collection1/lib/README' to classloader
[junit4:junit4]   2> 4369 T2808 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4426 T2808 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 4520 T2808 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4621 T2808 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4628 T2808 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5242 T2808 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5255 T2808 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5259 T2808 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5271 T2808 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5276 T2808 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5280 T2808 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5281 T2808 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5282 T2808 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1356941698186/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/
[junit4:junit4]   2> 5282 T2808 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7a0136b0
[junit4:junit4]   2> 5283 T2808 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 5284 T2808 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1 forceNew:false
[junit4:junit4]   2> 5285 T2808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1
[junit4:junit4]   2> 5285 T2808 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index/
[junit4:junit4]   2> 5285 T2808 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5287 T2808 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index forceNew:false
[junit4:junit4]   2> 5293 T2808 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@651016d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5294 T2808 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5295 T2808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index
[junit4:junit4]   2> 5295 T2808 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5297 T2808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5298 T2808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5298 T2808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5299 T2808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5299 T2808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5300 T2808 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5300 T2808 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5301 T2808 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5301 T2808 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5302 T2808 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5302 T2808 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5303 T2808 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5303 T2808 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5304 T2808 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5304 T2808 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5304 T2808 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5305 T2808 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5305 T2808 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5306 T2808 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5306 T2808 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5307 T2808 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5308 T2808 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5308 T2808 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5309 T2808 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5309 T2808 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5310 T2808 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5322 T2808 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5327 T2808 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5328 T2808 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5331 T2808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1
[junit4:junit4]   2> 5333 T2808 oass.SolrIndexSearcher.<init> Opening Searcher@3e093abd main
[junit4:junit4]   2> 5334 T2808 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5334 T2808 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5335 T2808 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5342 T2808 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5412 T2809 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e093abd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5416 T2808 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5416 T2808 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5441 T2789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5442 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:16123_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:16123/o_kq"}
[junit4:junit4]   2> 5445 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:35147_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:35147/o_kq"}
[junit4:junit4]   2> 5445 T2789 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 5445 T2789 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5466 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5466 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5466 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6418 T2808 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6418 T2808 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35147/o_kq collection:collection1 shard:shard1
[junit4:junit4]   2> 6419 T2808 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6466 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0006 type:delete cxid:0x43 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 6467 T2808 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6468 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0006 type:create cxid:0x44 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6479 T2808 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6479 T2808 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6480 T2808 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35147/o_kq/collection1/
[junit4:junit4]   2> 6480 T2808 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6480 T2808 oasc.SyncStrategy.syncToMe http://127.0.0.1:35147/o_kq/collection1/ has no replicas
[junit4:junit4]   2> 6481 T2808 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35147/o_kq/collection1/
[junit4:junit4]   2> 6481 T2808 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 6485 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0006 type:create cxid:0x4e zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7011 T2789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7035 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7035 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7035 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7056 T2808 oasc.ZkController.register We are http://127.0.0.1:35147/o_kq/collection1/ and leader is http://127.0.0.1:35147/o_kq/collection1/
[junit4:junit4]   2> 7056 T2808 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35147/o_kq
[junit4:junit4]   2> 7056 T2808 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 7056 T2808 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 7057 T2808 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7059 T2808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7060 T2766 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 7061 T2766 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7061 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7274 T2766 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 7278 T2766 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:16149
[junit4:junit4]   2> 7279 T2766 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7279 T2766 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270
[junit4:junit4]   2> 7280 T2766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270/'
[junit4:junit4]   2> 7334 T2766 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 7335 T2766 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 7336 T2766 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270
[junit4:junit4]   2> 7336 T2766 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270/solr.xml
[junit4:junit4]   2> 7337 T2766 oasc.CoreContainer.<init> New CoreContainer 315635547
[junit4:junit4]   2> 7338 T2766 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270/'
[junit4:junit4]   2> 7338 T2766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270/'
[junit4:junit4]   2> 7376 T2766 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 7377 T2766 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7377 T2766 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 7378 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7378 T2766 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7379 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7379 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7380 T2766 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7380 T2766 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7381 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 7405 T2766 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7428 T2766 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:18517/solr
[junit4:junit4]   2> 7429 T2766 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7429 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b9adb88
[junit4:junit4]   2> 7430 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7431 T2819 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7432 T2819 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 7432 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16150
[junit4:junit4]   2> 7432 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16150
[junit4:junit4]   2> 7435 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb0007 with negotiated timeout 20000 for client /140.211.11.196:16150
[junit4:junit4]   2> 7435 T2819 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb0007, negotiated timeout = 20000
[junit4:junit4]   2> 7435 T2820 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b9adb88 name:ZooKeeperConnection Watcher:127.0.0.1:18517 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7435 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7437 T2771 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf00714fb0007
[junit4:junit4]   2> 7446 T2820 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7446 T2768 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:16150 which had sessionid 0x13bf00714fb0007
[junit4:junit4]   2> 7446 T2766 oaz.ZooKeeper.close Session: 0x13bf00714fb0007 closed
[junit4:junit4]   2> 7447 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 7480 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@52883a2f
[junit4:junit4]   2> 7481 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7481 T2821 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7482 T2821 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 7482 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16151
[junit4:junit4]   2> 7483 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16151
[junit4:junit4]   2> 7484 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb0008 with negotiated timeout 20000 for client /140.211.11.196:16151
[junit4:junit4]   2> 7484 T2821 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb0008, negotiated timeout = 20000
[junit4:junit4]   2> 7485 T2822 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52883a2f name:ZooKeeperConnection Watcher:127.0.0.1:18517/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7485 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7486 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7487 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0008 type:create cxid:0x2 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7494 T2766 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:16149_o_kq
[junit4:junit4]   2> 7495 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb0008 type:delete cxid:0x4 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:16149_o_kq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:16149_o_kq
[junit4:junit4]   2> 7496 T2766 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:16149_o_kq
[junit4:junit4]   2> 7499 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7499 T2807 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7499 T2788 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7500 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7500 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7501 T2794 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7503 T2766 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7509 T2823 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270/collection1
[junit4:junit4]   2> 7510 T2823 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7511 T2823 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7511 T2823 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7512 T2823 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270/collection1/'
[junit4:junit4]   2> 7514 T2823 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7515 T2823 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270/collection1/lib/README' to classloader
[junit4:junit4]   2> 7579 T2823 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 7660 T2823 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7761 T2823 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7769 T2823 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8423 T2823 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8432 T2823 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8435 T2823 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8444 T2823 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8448 T2823 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8451 T2823 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8452 T2823 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8453 T2823 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1356941701270/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/
[junit4:junit4]   2> 8453 T2823 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7a0136b0
[junit4:junit4]   2> 8453 T2823 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 8454 T2823 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2 forceNew:false
[junit4:junit4]   2> 8455 T2823 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2
[junit4:junit4]   2> 8455 T2823 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index/
[junit4:junit4]   2> 8455 T2823 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8457 T2823 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index forceNew:false
[junit4:junit4]   2> 8461 T2823 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1de77769; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8462 T2823 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8462 T2823 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index
[junit4:junit4]   2> 8463 T2823 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8464 T2823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8465 T2823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8465 T2823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8465 T2823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8466 T2823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8466 T2823 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8466 T2823 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8467 T2823 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8467 T2823 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8467 T2823 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8468 T2823 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8468 T2823 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8469 T2823 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8469 T2823 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8469 T2823 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8469 T2823 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8470 T2823 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8470 T2823 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8470 T2823 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8471 T2823 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8471 T2823 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8471 T2823 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8472 T2823 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8472 T2823 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8473 T2823 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8473 T2823 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8483 T2823 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8487 T2823 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8488 T2823 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8490 T2823 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2
[junit4:junit4]   2> 8491 T2823 oass.SolrIndexSearcher.<init> Opening Searcher@c77daa0 main
[junit4:junit4]   2> 8492 T2823 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8492 T2823 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8492 T2823 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8498 T2823 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8525 T2824 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c77daa0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8528 T2823 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8528 T2823 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8548 T2789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8548 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:35147_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:35147/o_kq"}
[junit4:junit4]   2> 8551 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:16149_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:16149/o_kq"}
[junit4:junit4]   2> 8551 T2789 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 8551 T2789 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 8554 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8554 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8554 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8554 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9531 T2823 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 9531 T2823 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:16149/o_kq collection:collection1 shard:shard1
[junit4:junit4]   2> 9535 T2823 oasc.ZkController.register We are http://127.0.0.1:16149/o_kq/collection1/ and leader is http://127.0.0.1:35147/o_kq/collection1/
[junit4:junit4]   2> 9536 T2823 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:16149/o_kq
[junit4:junit4]   2> 9536 T2823 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 9536 T2823 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C138 name=collection1 org.apache.solr.core.SolrCore@68c31f84 url=http://127.0.0.1:16149/o_kq/collection1 node=127.0.0.1:16149_o_kq C138_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:16149_o_kq, base_url=http://127.0.0.1:16149/o_kq}
[junit4:junit4]   2> 9536 T2825 C138 P16149 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 9538 T2825 C138 P16149 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 9538 T2823 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9538 T2825 C138 P16149 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 9538 T2825 C138 P16149 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9539 T2766 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 9539 T2766 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9540 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9548 T2825 C138 P16149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9729 T2766 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 9732 T2766 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:16153
[junit4:junit4]   2> 9733 T2766 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9733 T2766 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768
[junit4:junit4]   2> 9734 T2766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768/'
[junit4:junit4]   2> 9777 T2766 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 9778 T2766 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9779 T2766 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768
[junit4:junit4]   2> 9779 T2766 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768/solr.xml
[junit4:junit4]   2> 9779 T2766 oasc.CoreContainer.<init> New CoreContainer 1363264065
[junit4:junit4]   2> 9780 T2766 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768/'
[junit4:junit4]   2> 9781 T2766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768/'
[junit4:junit4]   2> 9811 T2766 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 9812 T2766 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9812 T2766 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 9812 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9813 T2766 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9813 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9813 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9814 T2766 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9814 T2766 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9815 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 9832 T2766 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9850 T2766 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:18517/solr
[junit4:junit4]   2> 9851 T2766 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 9852 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@504c8a15
[junit4:junit4]   2> 9853 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9853 T2835 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9854 T2835 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 9854 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16154
[junit4:junit4]   2> 9855 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16154
[junit4:junit4]   2> 9856 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb0009 with negotiated timeout 20000 for client /140.211.11.196:16154
[junit4:junit4]   2> 9856 T2835 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb0009, negotiated timeout = 20000
[junit4:junit4]   2> 9856 T2836 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@504c8a15 name:ZooKeeperConnection Watcher:127.0.0.1:18517 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9857 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9858 T2771 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf00714fb0009
[junit4:junit4]   2> 9859 T2836 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9859 T2768 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:16154 which had sessionid 0x13bf00714fb0009
[junit4:junit4]   2> 9859 T2766 oaz.ZooKeeper.close Session: 0x13bf00714fb0009 closed
[junit4:junit4]   2> 9859 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 9867 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2107ee36
[junit4:junit4]   2> 9868 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9868 T2837 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9869 T2837 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 9869 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16155
[junit4:junit4]   2> 9869 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16155
[junit4:junit4]   2> 9871 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb000a with negotiated timeout 20000 for client /140.211.11.196:16155
[junit4:junit4]   2> 9871 T2837 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb000a, negotiated timeout = 20000
[junit4:junit4]   2> 9871 T2838 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2107ee36 name:ZooKeeperConnection Watcher:127.0.0.1:18517/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9872 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9872 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb000a type:create cxid:0x1 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9873 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb000a type:create cxid:0x2 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9882 T2766 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:16153_o_kq
[junit4:junit4]   2> 9883 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb000a type:delete cxid:0x4 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:16153_o_kq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:16153_o_kq
[junit4:junit4]   2> 9884 T2766 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:16153_o_kq
[junit4:junit4]   2> 9886 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9887 T2822 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9887 T2788 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9887 T2807 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9887 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9887 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9887 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 9888 T2794 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 9896 T2766 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9902 T2839 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768/collection1
[junit4:junit4]   2> 9902 T2839 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9903 T2839 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9903 T2839 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9904 T2839 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768/collection1/'
[junit4:junit4]   2> 9905 T2839 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768/collection1/lib/README' to classloader
[junit4:junit4]   2> 9906 T2839 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9953 T2839 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 10014 T2839 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 10059 T2789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10060 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:16149_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:16149/o_kq"}
[junit4:junit4]   2> 10073 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10073 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10073 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10073 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10115 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10115 T2839 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 10121 T2839 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10685 T2839 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10695 T2839 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10698 T2839 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10709 T2839 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10713 T2839 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10717 T2839 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10718 T2839 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10719 T2839 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1356941703768/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/
[junit4:junit4]   2> 10720 T2839 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7a0136b0
[junit4:junit4]   2> 10720 T2839 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10721 T2839 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3 forceNew:false
[junit4:junit4]   2> 10721 T2839 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3
[junit4:junit4]   2> 10722 T2839 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index/
[junit4:junit4]   2> 10722 T2839 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10723 T2839 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index forceNew:false
[junit4:junit4]   2> 10801 T2839 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@58a9d94e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10801 T2839 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10802 T2839 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index
[junit4:junit4]   2> 10803 T2839 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 10805 T2839 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10805 T2839 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 10805 T2839 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10806 T2839 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 10806 T2839 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10807 T2839 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10807 T2839 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10807 T2839 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10808 T2839 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10808 T2839 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 10809 T2839 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 10809 T2839 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10810 T2839 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 10810 T2839 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 10810 T2839 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 10811 T2839 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10811 T2839 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10812 T2839 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10812 T2839 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10812 T2839 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10813 T2839 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10813 T2839 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10814 T2839 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10814 T2839 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10815 T2839 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 10815 T2839 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 10828 T2839 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10833 T2839 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 10834 T2839 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 10836 T2839 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3
[junit4:junit4]   2> 10838 T2839 oass.SolrIndexSearcher.<init> Opening Searcher@40ab8954 main
[junit4:junit4]   2> 10839 T2839 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10839 T2839 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10839 T2839 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 10863 T2839 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 10930 T2840 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40ab8954 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10933 T2839 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10933 T2839 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11582 T2789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11583 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:16153_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:16153/o_kq"}
[junit4:junit4]   2> 11583 T2789 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 11583 T2789 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11588 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11588 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11588 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11588 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11588 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11936 T2839 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11936 T2839 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:16153/o_kq collection:collection1 shard:shard1
[junit4:junit4]   2> 11941 T2839 oasc.ZkController.register We are http://127.0.0.1:16153/o_kq/collection1/ and leader is http://127.0.0.1:35147/o_kq/collection1/
[junit4:junit4]   2> 11941 T2839 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:16153/o_kq
[junit4:junit4]   2> 11942 T2839 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 11942 T2839 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C139 name=collection1 org.apache.solr.core.SolrCore@194b2c8b url=http://127.0.0.1:16153/o_kq/collection1 node=127.0.0.1:16153_o_kq C139_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:16153_o_kq, base_url=http://127.0.0.1:16153/o_kq}
[junit4:junit4]   2> 11942 T2841 C139 P16153 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 11943 T2839 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11944 T2841 C139 P16153 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 11944 T2841 C139 P16153 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 11944 T2841 C139 P16153 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11945 T2766 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 11945 T2766 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 11946 T2841 C139 P16153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11946 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12076 T2766 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 12078 T2766 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:16157
[junit4:junit4]   2> 12079 T2766 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12079 T2766 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153
[junit4:junit4]   2> 12080 T2766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153/'
[junit4:junit4]   2> 12119 T2766 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 12119 T2766 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12120 T2766 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153
[junit4:junit4]   2> 12120 T2766 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153/solr.xml
[junit4:junit4]   2> 12120 T2766 oasc.CoreContainer.<init> New CoreContainer 1518680471
[junit4:junit4]   2> 12121 T2766 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153/'
[junit4:junit4]   2> 12121 T2766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153/'
[junit4:junit4]   2> 12147 T2766 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 12148 T2766 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 12148 T2766 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 12148 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 12149 T2766 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 12149 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 12150 T2766 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 12150 T2766 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 12150 T2766 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 12151 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 12166 T2766 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 12181 T2766 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:18517/solr
[junit4:junit4]   2> 12182 T2766 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 12182 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7ce8e54
[junit4:junit4]   2> 12183 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12183 T2851 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12184 T2851 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 12185 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16158
[junit4:junit4]   2> 12185 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16158
[junit4:junit4]   2> 12186 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb000b with negotiated timeout 20000 for client /140.211.11.196:16158
[junit4:junit4]   2> 12186 T2851 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb000b, negotiated timeout = 20000
[junit4:junit4]   2> 12187 T2852 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ce8e54 name:ZooKeeperConnection Watcher:127.0.0.1:18517 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12187 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12188 T2771 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bf00714fb000b
[junit4:junit4]   2> 12189 T2852 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12189 T2768 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:16158 which had sessionid 0x13bf00714fb000b
[junit4:junit4]   2> 12189 T2766 oaz.ZooKeeper.close Session: 0x13bf00714fb000b closed
[junit4:junit4]   2> 12189 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 12197 T2766 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18517/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@195cd52b
[junit4:junit4]   2> 12197 T2766 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12198 T2853 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18517. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12198 T2853 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18517, initiating session
[junit4:junit4]   2> 12198 T2768 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16159
[junit4:junit4]   2> 12199 T2768 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16159
[junit4:junit4]   2> 12200 T2770 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bf00714fb000c with negotiated timeout 20000 for client /140.211.11.196:16159
[junit4:junit4]   2> 12200 T2853 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18517, sessionid = 0x13bf00714fb000c, negotiated timeout = 20000
[junit4:junit4]   2> 12200 T2854 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@195cd52b name:ZooKeeperConnection Watcher:127.0.0.1:18517/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12201 T2766 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12201 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb000c type:create cxid:0x1 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12202 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb000c type:create cxid:0x2 zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12211 T2766 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:16157_o_kq
[junit4:junit4]   2> 12212 T2771 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bf00714fb000c type:delete cxid:0x4 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:16157_o_kq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:16157_o_kq
[junit4:junit4]   2> 12213 T2766 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:16157_o_kq
[junit4:junit4]   2> 12215 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12215 T2788 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12215 T2838 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12216 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12216 T2807 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12216 T2822 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12216 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12216 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12217 T2794 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12216 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12226 T2766 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12232 T2855 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153/collection1
[junit4:junit4]   2> 12232 T2855 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 12233 T2855 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 12233 T2855 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 12235 T2855 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153/collection1/'
[junit4:junit4]   2> 12236 T2855 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153/collection1/lib/README' to classloader
[junit4:junit4]   2> 12236 T2855 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 12293 T2855 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_41
[junit4:junit4]   2> 12365 T2855 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 12466 T2855 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 12473 T2855 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2>  C138_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:16149_o_kq, base_url=http://127.0.0.1:16149/o_kq}
[junit4:junit4]   2> 12586 T2825 C138 P16149 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35147/o_kq/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 12586 T2825 C138 P16149 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:16149/o_kq START replicas=[http://127.0.0.1:35147/o_kq/collection1/] nUpdates=100
[junit4:junit4]   2> 12587 T2825 C138 P16149 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 12588 T2825 C138 P16149 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 12588 T2825 C138 P16149 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 12588 T2825 C138 P16149 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 12588 T2825 C138 P16149 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 12588 T2825 C138 P16149 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35147/o_kq/collection1/. core=collection1
[junit4:junit4]   2> 12589 T2825 C138 P16149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C140 name=collection1 org.apache.solr.core.SolrCore@6b980bc url=http://127.0.0.1:35147/o_kq/collection1 node=127.0.0.1:35147_o_kq C140_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:35147_o_kq, base_url=http://127.0.0.1:35147/o_kq, leader=true}
[junit4:junit4]   2> 12594 T2799 C140 P35147 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 12596 T2800 C140 P35147 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12597 T2800 C140 P35147 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1
[junit4:junit4]   2> 12601 T2800 C140 P35147 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@651016d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12602 T2800 C140 P35147 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 12605 T2800 C140 P35147 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@651016d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@651016d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12606 T2800 C140 P35147 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 12607 T2800 C140 P35147 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1
[junit4:junit4]   2> 12607 T2800 C140 P35147 oass.SolrIndexSearcher.<init> Opening Searcher@33225773 realtime
[junit4:junit4]   2> 12608 T2800 C140 P35147 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12608 T2800 C140 P35147 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 12
[junit4:junit4]   2> 12609 T2825 C138 P16149 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12609 T2825 C138 P16149 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 12610 T2801 C140 P35147 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12611 T2801 C140 P35147 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12611 T2825 C138 P16149 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 12612 T2825 C138 P16149 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 12612 T2825 C138 P16149 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 12614 T2801 C140 P35147 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1
[junit4:junit4]   2> 12615 T2801 C140 P35147 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index
[junit4:junit4]   2> 12615 T2801 C140 P35147 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 12615 T2825 C138 P16149 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 12616 T2825 C138 P16149 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index.20121231081506808 forceNew:false
[junit4:junit4]   2> 12617 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2
[junit4:junit4]   2> 12617 T2825 C138 P16149 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index.20121231081506808 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f180974; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 12621 T2801 C140 P35147 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 12622 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index
[junit4:junit4]   2> 12622 T2825 C138 P16149 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 12623 T2825 C138 P16149 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121231081506808
[junit4:junit4]   2> 12624 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2
[junit4:junit4]   2> 12625 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2
[junit4:junit4]   2> 12625 T2825 C138 P16149 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index/ new=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index.20121231081506808
[junit4:junit4]   2> 12628 T2825 C138 P16149 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index.20121231081506808 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f180974; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12629 T2825 C138 P16149 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 12630 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2
[junit4:junit4]   2> 12630 T2825 C138 P16149 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 12631 T2825 C138 P16149 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 12631 T2825 C138 P16149 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 12631 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index.20121231081506808
[junit4:junit4]   2> 12632 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2
[junit4:junit4]   2> 12635 T2825 C138 P16149 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index.20121231081506808 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f180974; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12635 T2825 C138 P16149 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 12636 T2825 C138 P16149 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 12636 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2
[junit4:junit4]   2> 12636 T2825 C138 P16149 oass.SolrIndexSearcher.<init> Opening Searcher@7c82e185 main
[junit4:junit4]   2> 12638 T2824 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7c82e185 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 12638 T2824 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index
[junit4:junit4]   2> 12638 T2825 C138 P16149 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12641 T2825 C138 P16149 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index.20121231081506808 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f180974; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index.20121231081506808 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f180974; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 12641 T2825 C138 P16149 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 12642 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2
[junit4:junit4]   2> 12643 T2825 C138 P16149 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12643 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index.20121231081506808
[junit4:junit4]   2> 12643 T2825 C138 P16149 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty2/index
[junit4:junit4]   2> 12643 T2825 C138 P16149 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 12643 T2825 C138 P16149 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 12643 T2825 C138 P16149 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 12644 T2825 C138 P16149 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12651 T2825 C138 P16149 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 13091 T2789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13092 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:16153_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:16153/o_kq"}
[junit4:junit4]   2> 13097 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:16149_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:16149/o_kq"}
[junit4:junit4]   2> 13112 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13113 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13113 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13113 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13113 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13112 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13142 T2855 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 13154 T2855 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 13159 T2855 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 13171 T2855 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13189 T2855 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13194 T2855 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13195 T2855 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13196 T2855 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1356941706153/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4/
[junit4:junit4]   2> 13196 T2855 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7a0136b0
[junit4:junit4]   2> 13197 T2855 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 13198 T2855 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4 forceNew:false
[junit4:junit4]   2> 13199 T2855 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4
[junit4:junit4]   2> 13199 T2855 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4/index/
[junit4:junit4]   2> 13200 T2855 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 13201 T2855 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4/index forceNew:false
[junit4:junit4]   2> 13207 T2855 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@68e2de21; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13208 T2855 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13209 T2855 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4/index
[junit4:junit4]   2> 13209 T2855 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 13212 T2855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 13212 T2855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 13213 T2855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 13213 T2855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 13214 T2855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 13214 T2855 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 13215 T2855 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 13215 T2855 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 13216 T2855 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 13216 T2855 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 13217 T2855 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 13217 T2855 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 13218 T2855 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 13218 T2855 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 13219 T2855 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 13219 T2855 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 13220 T2855 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13220 T2855 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13221 T2855 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13221 T2855 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13222 T2855 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13222 T2855 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13223 T2855 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13223 T2855 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13224 T2855 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 13224 T2855 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 13238 T2855 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 13243 T2855 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 13244 T2855 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 13247 T2855 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4
[junit4:junit4]   2> 13249 T2855 oass.SolrIndexSearcher.<init> Opening Searcher@ccbcf18 main
[junit4:junit4]   2> 13250 T2855 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 13250 T2855 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 13251 T2855 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 13258 T2855 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 13314 T2858 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ccbcf18 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 13319 T2855 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 13319 T2855 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14633 T2789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14634 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:16157_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:16157/o_kq"}
[junit4:junit4]   2> 14634 T2789 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 14634 T2789 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 14671 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14671 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14671 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14671 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14671 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14671 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15323 T2855 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 15323 T2855 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:16157/o_kq collection:collection1 shard:shard1
[junit4:junit4]   2> 15340 T2855 oasc.ZkController.register We are http://127.0.0.1:16157/o_kq/collection1/ and leader is http://127.0.0.1:35147/o_kq/collection1/
[junit4:junit4]   2> 15340 T2855 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:16157/o_kq
[junit4:junit4]   2> 15341 T2855 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 15341 T2855 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C141 name=collection1 org.apache.solr.core.SolrCore@5cabe0d5 url=http://127.0.0.1:16157/o_kq/collection1 node=127.0.0.1:16157_o_kq C141_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:16157_o_kq, base_url=http://127.0.0.1:16157/o_kq}
[junit4:junit4]   2> 15341 T2859 C141 P16157 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 15342 T2855 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15343 T2859 C141 P16157 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 15343 T2859 C141 P16157 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 15343 T2859 C141 P16157 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15343 T2766 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 15344 T2766 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 15344 T2766 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15350 T2859 C141 P16157 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15356 T2766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15357 T2766 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 15357 T2766 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 15358 T2766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C139_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:16153_o_kq, base_url=http://127.0.0.1:16153/o_kq}
[junit4:junit4]   2> 15965 T2841 C139 P16153 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35147/o_kq/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 15965 T2841 C139 P16153 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:16153/o_kq START replicas=[http://127.0.0.1:35147/o_kq/collection1/] nUpdates=100
[junit4:junit4]   2> 15966 T2841 C139 P16153 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 15966 T2841 C139 P16153 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 15966 T2841 C139 P16153 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 15967 T2841 C139 P16153 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 15967 T2841 C139 P16153 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 15967 T2841 C139 P16153 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35147/o_kq/collection1/. core=collection1
[junit4:junit4]   2> 15967 T2841 C139 P16153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15968 T2799 C140 P35147 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 15980 T2803 C140 P35147 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 16007 T2803 C140 P35147 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@651016d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@651016d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 16008 T2803 C140 P35147 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 16009 T2803 C140 P35147 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1
[junit4:junit4]   2> 16010 T2803 C140 P35147 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 16010 T2803 C140 P35147 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 30
[junit4:junit4]   2> 16011 T2841 C139 P16153 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 16012 T2841 C139 P16153 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 16014 T2801 C140 P35147 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 16015 T2841 C139 P16153 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 16016 T2841 C139 P16153 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 16016 T2841 C139 P16153 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 16018 T2801 C140 P35147 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1
[junit4:junit4]   2> 16019 T2801 C140 P35147 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index
[junit4:junit4]   2> 16020 T2801 C140 P35147 REQ /replication {command=filelist&generation=3&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 16021 T2841 C139 P16153 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 16022 T2841 C139 P16153 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index.20121231081510213 forceNew:false
[junit4:junit4]   2> 16023 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3
[junit4:junit4]   2> 16024 T2841 C139 P16153 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index.20121231081510213 lockFactory=org.apache.lucene.store.NativeFSLockFactory@140789d2; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 16027 T2801 C140 P35147 REQ /replication {file=segments_3&command=filecontent&checksum=true&generation=3&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 16029 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index
[junit4:junit4]   2> 16029 T2841 C139 P16153 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 16030 T2841 C139 P16153 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121231081510213
[junit4:junit4]   2> 16031 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3
[junit4:junit4]   2> 16031 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3
[junit4:junit4]   2> 16032 T2841 C139 P16153 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index/ new=./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index.20121231081510213
[junit4:junit4]   2> 16035 T2841 C139 P16153 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index.20121231081510213 lockFactory=org.apache.lucene.store.NativeFSLockFactory@140789d2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 16036 T2841 C139 P16153 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 16037 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3
[junit4:junit4]   2> 16038 T2841 C139 P16153 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 16038 T2841 C139 P16153 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 16038 T2841 C139 P16153 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 16039 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index.20121231081510213
[junit4:junit4]   2> 16040 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3
[junit4:junit4]   2> 16043 T2841 C139 P16153 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index.20121231081510213 lockFactory=org.apache.lucene.store.NativeFSLockFactory@140789d2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 16043 T2841 C139 P16153 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 16044 T2841 C139 P16153 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 16044 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3
[junit4:junit4]   2> 16045 T2841 C139 P16153 oass.SolrIndexSearcher.<init> Opening Searcher@4336e375 main
[junit4:junit4]   2> 16046 T2840 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4336e375 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 16047 T2840 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index
[junit4:junit4]   2> 16047 T2841 C139 P16153 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 16051 T2841 C139 P16153 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index.20121231081510213 lockFactory=org.apache.lucene.store.NativeFSLockFactory@140789d2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index.20121231081510213 lockFactory=org.apache.lucene.store.NativeFSLockFactory@140789d2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 16052 T2841 C139 P16153 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 16053 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3
[junit4:junit4]   2> 16053 T2841 C139 P16153 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 16054 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index.20121231081510213
[junit4:junit4]   2> 16054 T2841 C139 P16153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty3/index
[junit4:junit4]   2> 16054 T2841 C139 P16153 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 16054 T2841 C139 P16153 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 16055 T2841 C139 P16153 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 16055 T2841 C139 P16153 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16057 T2841 C139 P16153 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 16183 T2789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16184 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:16157_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:16157/o_kq"}
[junit4:junit4]   2> 16189 T2789 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:16153_o_kq",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:16153/o_kq"}
[junit4:junit4]   2> 16201 T2807 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16201 T2788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16201 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16201 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16201 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16201 T2794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16359 T2766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17362 T2766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C141_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:16157_o_kq, base_url=http://127.0.0.1:16157/o_kq}
[junit4:junit4]   2> 18360 T2859 C141 P16157 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35147/o_kq/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 18360 T2859 C141 P16157 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:16157/o_kq START replicas=[http://127.0.0.1:35147/o_kq/collection1/] nUpdates=100
[junit4:junit4]   2> 18361 T2859 C141 P16157 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 18361 T2859 C141 P16157 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 18361 T2859 C141 P16157 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 18361 T2859 C141 P16157 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 18362 T2859 C141 P16157 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 18362 T2859 C141 P16157 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35147/o_kq/collection1/. core=collection1
[junit4:junit4]   2> 18362 T2859 C141 P16157 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18363 T2799 C140 P35147 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 18365 T2766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18378 T2797 C140 P35147 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18382 T2797 C140 P35147 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@651016d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@651016d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@651016d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 18383 T2797 C140 P35147 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 18384 T2797 C140 P35147 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1
[junit4:junit4]   2> 18385 T2797 C140 P35147 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18385 T2797 C140 P35147 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 7
[junit4:junit4]   2> 18386 T2859 C141 P16157 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 18386 T2859 C141 P16157 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 18389 T2801 C140 P35147 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18390 T2859 C141 P16157 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 18390 T2859 C141 P16157 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 18390 T2859 C141 P16157 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 18392 T2801 C140 P35147 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1
[junit4:junit4]   2> 18393 T2801 C140 P35147 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty1/index
[junit4:junit4]   2> 18393 T2801 C140 P35147 REQ /replication {command=filelist&generation=4&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 18394 T2859 C141 P16157 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 18396 T2859 C141 P16157 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4/index.20121231081512586 forceNew:false
[junit4:junit4]   2> 18397 T2859 C141 P16157 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4
[junit4:junit4]   2> 18397 T2859 C141 P16157 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4/index.20121231081512586 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5662b671; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 18401 T2801 C140 P35147 REQ /replication {file=segments_4&command=filecontent&checksum=true&generation=4&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 18402 T2859 C141 P16157 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4/index
[junit4:junit4]   2> 18403 T2859 C141 P16157 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 18403 T2859 C141 P16157 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121231081512586
[junit4:junit4]   2> 18404 T2859 C141 P16157 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4
[junit4:junit4]   2> 18405 T2859 C141 P16157 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1356941694196/jetty4
[junit4:junit4]   2> 18405 T2859 C141 P16157 oasc.SolrCore.getNewInd

[...truncated too long message...]

 -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=B4681CAE9328E7FF -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pl -Dtests.timezone=Europe/Isle_of_Man -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  140s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: shard1 should have just been set up to be inconsistent - but it's still consistent
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([B4681CAE9328E7FF:358E92B6E47787C3]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > 	at org.junit.Assert.assertNotNull(Assert.java:526)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:214)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 140330 T2766 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=pl, timezone=Europe/Isle_of_Man
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=2,free=270164288,total=424673280
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SolrCoreTest, SchemaVersionSpecificBehaviorTest, TestValueSourceCache, EchoParamsTest, TestElisionMultitermQuery, TestUtils, QueryEqualityTest, ResponseLogComponentTest, MultiTermTest, TestSolrIndexConfig, ZkSolrClientTest, SoftAutoCommitTest, TestSolrDeletionPolicy2, TestDistributedGrouping, DocumentBuilderTest, TestJmxIntegration, DocumentAnalysisRequestHandlerTest, TestFastWriter, TestMultiCoreConfBootstrap, OverseerCollectionProcessorTest, TestSurroundQueryParser, RecoveryZkTest, TestReversedWildcardFilterFactory, PingRequestHandlerTest, ShowFileRequestHandlerTest, SuggesterTest, TestMergePolicyConfig, XmlUpdateRequestHandlerTest, SolrInfoMBeanTest, LegacyHTMLStripCharFilterTest, BasicFunctionalityTest, ClusterStateUpdateTest, StandardRequestHandlerTest, StatelessScriptUpdateProcessorFactoryTest, OutputWriterTest, TermVectorComponentTest, TestDFRSimilarityFactory, TestSolrXMLSerializer, TestPropInjectDefaults, TestComponentsName, DisMaxRequestHandlerTest, SpellingQueryConverterTest, TestPropInject, TestStressVersions, TestSort, TestFoldingMultitermQuery, CoreContainerCoreInitFailuresTest, DistributedQueryElevationComponentTest, URLClassifyProcessorTest, PolyFieldTest, SignatureUpdateProcessorFactoryTest, TestRealTimeGet, LukeRequestHandlerTest, TestHashPartitioner, TestCSVResponseWriter, SolrIndexConfigTest, TestPluginEnable, ConvertedLegacyTest, TestPhraseSuggestions, OverseerTest, SpellCheckComponentTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, LeaderElectionIntegrationTest, LeaderElectionTest, ZkControllerTest, TestRandomFaceting, TestDistributedSearch, SpellCheckCollatorTest, TestExtendedDismaxParser, BasicZkTest, StatsComponentTest, TestRecovery, DirectUpdateHandlerTest, TestCoreContainer, TestGroupingSearch, DirectSolrSpellCheckerTest, TestFiltering, FileBasedSpellCheckerTest, QueryElevationComponentTest, HighlighterTest, TestTrie, SolrRequestParserTest, TestCSVLoader, IndexSchemaTest, XsltUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, JsonLoaderTest, DirectUpdateHandlerOptimizeTest, SolrPluginUtilsTest, ReturnFieldsTest, RequiredFieldsTest, SuggesterFSTTest, TestQueryUtils, SuggesterTSTTest, BadIndexSchemaTest, UpdateRequestProcessorFactoryTest, PrimitiveFieldTypeTest, TestUpdate, HighlighterConfigTest, TestDocSet, TestQuerySenderListener, TestQuerySenderNoQuery, TestSolrCoreProperties, SpellPossibilityIteratorTest, TestLMDirichletSimilarityFactory, TestDefaultSimilarityFactory, PrimUtilsTest, ResourceLoaderTest, TestSuggestSpellingConverter, DOMUtilTest, ChaosMonkeySafeLeaderTest, UUIDFieldTest, ZkNodePropsTest, CircularListTest, AnalysisAfterCoreReloadTest, ClusterStateTest, SyncSliceTest]
[junit4:junit4] Completed on J1 in 140.35s, 1 test, 1 failure <<< FAILURES!

[...truncated 10 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:353: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:438: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:841: There were test failures: 245 suites, 1013 tests, 1 failure, 22 ignored (4 assumptions)

Total time: 39 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure