You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/02/04 00:15:30 UTC
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3705 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3705/
2 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([437C1ACFB7351B0A]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([437C1ACFB7351B0A]:0)
Build Log:
[...truncated 9446 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4] 2> 1 T499 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /lt_/
[junit4:junit4] 2> 6 T499 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1359926089911
[junit4:junit4] 2> 7 T499 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 8 T500 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 10 T500 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 10 T500 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 10 T500 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 11 T500 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 11 T500 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 109 T499 oasc.ZkTestServer.run start zk server on port:43537
[junit4:junit4] 2> 109 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@40f81bb4
[junit4:junit4] 2> 110 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 111 T505 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 112 T505 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 112 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:43538
[junit4:junit4] 2> 112 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:43538
[junit4:junit4] 2> 113 T503 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 117 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0000 with negotiated timeout 10000 for client /140.211.11.196:43538
[junit4:junit4] 2> 117 T505 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0000, negotiated timeout = 10000
[junit4:junit4] 2> 117 T506 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40f81bb4 name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 117 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 118 T499 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 121 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0000
[junit4:junit4] 2> 133 T506 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 133 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0000 closed
[junit4:junit4] 2> 134 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:43538 which had sessionid 0x13ca1e958bc0000
[junit4:junit4] 2> 134 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@70df8d56
[junit4:junit4] 2> 135 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 135 T507 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 136 T507 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 136 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:43539
[junit4:junit4] 2> 136 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:43539
[junit4:junit4] 2> 160 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0001 with negotiated timeout 10000 for client /140.211.11.196:43539
[junit4:junit4] 2> 160 T507 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0001, negotiated timeout = 10000
[junit4:junit4] 2> 160 T508 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70df8d56 name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 160 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 161 T499 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 166 T499 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 175 T499 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 178 T499 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 182 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 183 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 196 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 197 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 302 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 302 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 306 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 307 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 310 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 311 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 315 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 315 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 319 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 320 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 323 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 324 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 327 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 328 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 331 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0001
[junit4:junit4] 2> 338 T508 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 338 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:43539 which had sessionid 0x13ca1e958bc0001
[junit4:junit4] 2> 338 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0001 closed
[junit4:junit4] 2> 486 T499 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 490 T499 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25591
[junit4:junit4] 2> 490 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 491 T499 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 491 T499 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243
[junit4:junit4] 2> 492 T499 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/solr.xml
[junit4:junit4] 2> 492 T499 oasc.CoreContainer.<init> New CoreContainer 2073771471
[junit4:junit4] 2> 492 T499 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/'
[junit4:junit4] 2> 493 T499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/'
[junit4:junit4] 2> 562 T499 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 562 T499 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 563 T499 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 563 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 564 T499 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 564 T499 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 565 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 565 T499 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 566 T499 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 566 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 590 T499 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 610 T499 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:43537/solr
[junit4:junit4] 2> 610 T499 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 611 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3daa432
[junit4:junit4] 2> 612 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 612 T518 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 613 T518 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 614 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:55204
[junit4:junit4] 2> 614 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:55204
[junit4:junit4] 2> 619 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0002 with negotiated timeout 20000 for client /140.211.11.196:55204
[junit4:junit4] 2> 619 T518 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0002, negotiated timeout = 20000
[junit4:junit4] 2> 619 T519 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3daa432 name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 619 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 621 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0002
[junit4:junit4] 2> 622 T519 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 622 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:55204 which had sessionid 0x13ca1e958bc0002
[junit4:junit4] 2> 622 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0002 closed
[junit4:junit4] 2> 623 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 637 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7eb5d65e
[junit4:junit4] 2> 638 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 638 T520 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 639 T520 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 639 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45054
[junit4:junit4] 2> 639 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45054
[junit4:junit4] 2> 641 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0003 with negotiated timeout 20000 for client /140.211.11.196:45054
[junit4:junit4] 2> 641 T520 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0003, negotiated timeout = 20000
[junit4:junit4] 2> 641 T521 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7eb5d65e name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 641 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 644 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 652 T499 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 654 T499 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25591_lt_
[junit4:junit4] 2> 655 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:25591_lt_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:25591_lt_
[junit4:junit4] 2> 657 T499 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25591_lt_
[junit4:junit4] 2> 667 T499 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 680 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 681 T499 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 685 T499 oasc.Overseer.start Overseer (id=89124116228734979-127.0.0.1:25591_lt_-n_0000000000) starting
[junit4:junit4] 2> 685 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 691 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 693 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 699 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 701 T523 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 702 T499 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 705 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 708 T522 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 720 T524 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/collection1
[junit4:junit4] 2> 720 T524 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 721 T524 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 722 T524 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 724 T524 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/collection1/'
[junit4:junit4] 2> 725 T524 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/collection1/lib/README' to classloader
[junit4:junit4] 2> 726 T524 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 782 T524 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 854 T524 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 955 T524 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 961 T524 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1569 T524 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1577 T524 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1580 T524 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1596 T524 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1600 T524 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1603 T524 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1605 T524 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1606 T524 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/
[junit4:junit4] 2> 1606 T524 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36298619
[junit4:junit4] 2> 1607 T524 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1630 T524 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data forceNew:false
[junit4:junit4] 2> 1630 T524 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data
[junit4:junit4] 2> 1630 T524 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index/
[junit4:junit4] 2> 1631 T524 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1632 T524 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index forceNew:false
[junit4:junit4] 2> 1638 T524 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@708ce5ef; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1638 T524 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1639 T524 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index
[junit4:junit4] 2> 1639 T524 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 1641 T524 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1641 T524 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 1641 T524 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1641 T524 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 1642 T524 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1642 T524 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1642 T524 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1642 T524 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1643 T524 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1643 T524 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 1644 T524 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 1644 T524 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1644 T524 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 1644 T524 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 1645 T524 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 1645 T524 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1645 T524 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1646 T524 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1646 T524 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1646 T524 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1647 T524 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1647 T524 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1647 T524 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1648 T524 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1648 T524 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 1648 T524 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 1657 T524 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1660 T524 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 1661 T524 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 1663 T524 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data
[junit4:junit4] 2> 1664 T524 oass.SolrIndexSearcher.<init> Opening Searcher@4b06504d main
[junit4:junit4] 2> 1665 T524 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1665 T524 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1665 T524 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 1682 T524 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 1728 T525 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4b06504d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1732 T524 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1732 T524 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1732 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2212 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2213 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:25591_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25591/lt_"}
[junit4:junit4] 2> 2213 T522 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2226 T522 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2226 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2245 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2741 T524 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2741 T524 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25591/lt_ collection:control_collection shard:shard1
[junit4:junit4] 2> 2742 T524 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2759 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2760 T524 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2760 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2771 T524 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2771 T524 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2771 T524 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:25591/lt_/collection1/
[junit4:junit4] 2> 2772 T524 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2772 T524 oasc.SyncStrategy.syncToMe http://127.0.0.1:25591/lt_/collection1/ has no replicas
[junit4:junit4] 2> 2772 T524 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:25591/lt_/collection1/
[junit4:junit4] 2> 2772 T524 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2777 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3751 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3802 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3851 T524 oasc.ZkController.register We are http://127.0.0.1:25591/lt_/collection1/ and leader is http://127.0.0.1:25591/lt_/collection1/
[junit4:junit4] 2> 3851 T524 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25591/lt_
[junit4:junit4] 2> 3851 T524 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3851 T524 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3852 T524 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3854 T524 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3855 T499 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3856 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3857 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3873 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3890 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@417dbcb6
[junit4:junit4] 2> 3891 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3892 T526 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3892 T526 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 3893 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40197
[junit4:junit4] 2> 3893 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40197
[junit4:junit4] 2> 3895 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0004 with negotiated timeout 10000 for client /140.211.11.196:40197
[junit4:junit4] 2> 3895 T526 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0004, negotiated timeout = 10000
[junit4:junit4] 2> 3895 T527 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@417dbcb6 name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3895 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3897 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3901 T499 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4069 T499 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4073 T499 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:59558
[junit4:junit4] 2> 4073 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4074 T499 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4074 T499 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806
[junit4:junit4] 2> 4075 T499 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/solr.xml
[junit4:junit4] 2> 4075 T499 oasc.CoreContainer.<init> New CoreContainer 2041002222
[junit4:junit4] 2> 4076 T499 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/'
[junit4:junit4] 2> 4076 T499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/'
[junit4:junit4] 2> 4131 T499 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 4132 T499 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4132 T499 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4132 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4133 T499 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4133 T499 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4134 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4134 T499 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4135 T499 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4135 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4157 T499 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4176 T499 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:43537/solr
[junit4:junit4] 2> 4176 T499 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4177 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@14c6f4dd
[junit4:junit4] 2> 4178 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4178 T537 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4179 T537 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 4180 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:35606
[junit4:junit4] 2> 4180 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:35606
[junit4:junit4] 2> 4182 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0005 with negotiated timeout 20000 for client /140.211.11.196:35606
[junit4:junit4] 2> 4182 T537 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0005, negotiated timeout = 20000
[junit4:junit4] 2> 4182 T538 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14c6f4dd name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4183 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4184 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0005
[junit4:junit4] 2> 4193 T538 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4193 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:35606 which had sessionid 0x13ca1e958bc0005
[junit4:junit4] 2> 4193 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0005 closed
[junit4:junit4] 2> 4194 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 4205 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4d111d50
[junit4:junit4] 2> 4206 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4207 T539 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4207 T539 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 4208 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25987
[junit4:junit4] 2> 4208 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25987
[junit4:junit4] 2> 4209 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0006 with negotiated timeout 20000 for client /140.211.11.196:25987
[junit4:junit4] 2> 4209 T539 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0006, negotiated timeout = 20000
[junit4:junit4] 2> 4210 T540 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d111d50 name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4210 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4211 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4213 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4214 T499 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59558_lt_
[junit4:junit4] 2> 4215 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:59558_lt_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:59558_lt_
[junit4:junit4] 2> 4222 T499 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59558_lt_
[junit4:junit4] 2> 4225 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4226 T527 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4228 T521 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4230 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4238 T541 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/collection1
[junit4:junit4] 2> 4238 T541 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4239 T541 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4239 T541 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4241 T541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/collection1/'
[junit4:junit4] 2> 4242 T541 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/collection1/lib/README' to classloader
[junit4:junit4] 2> 4243 T541 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4295 T541 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 4366 T541 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4467 T541 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4473 T541 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5077 T541 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5084 T541 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5087 T541 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5102 T541 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5106 T541 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5109 T541 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5111 T541 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5112 T541 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/
[junit4:junit4] 2> 5112 T541 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36298619
[junit4:junit4] 2> 5112 T541 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 5113 T541 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1 forceNew:false
[junit4:junit4] 2> 5113 T541 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
[junit4:junit4] 2> 5114 T541 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index/
[junit4:junit4] 2> 5114 T541 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5115 T541 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index forceNew:false
[junit4:junit4] 2> 5119 T541 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bf4515f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5120 T541 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5120 T541 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index
[junit4:junit4] 2> 5121 T541 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 5122 T541 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5122 T541 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 5123 T541 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5123 T541 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 5123 T541 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5124 T541 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5124 T541 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5124 T541 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5125 T541 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5125 T541 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 5126 T541 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 5126 T541 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5126 T541 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 5127 T541 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 5127 T541 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 5127 T541 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5128 T541 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5128 T541 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5129 T541 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5129 T541 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5129 T541 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5130 T541 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5130 T541 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5131 T541 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5131 T541 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 5132 T541 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 5140 T541 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5143 T541 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 5144 T541 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 5146 T541 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
[junit4:junit4] 2> 5147 T541 oass.SolrIndexSearcher.<init> Opening Searcher@2aa0240c main
[junit4:junit4] 2> 5148 T541 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5148 T541 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5148 T541 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 5153 T541 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 5196 T542 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2aa0240c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5200 T541 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5200 T541 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 5317 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5318 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:25591_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25591/lt_"}
[junit4:junit4] 2> 5322 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:59558_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59558/lt_"}
[junit4:junit4] 2> 5322 T522 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 5323 T522 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 5334 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5334 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5334 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6203 T541 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 6203 T541 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59558/lt_ collection:collection1 shard:shard1
[junit4:junit4] 2> 6204 T541 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 6224 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:delete cxid:0x43 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 6225 T541 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 6225 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:create cxid:0x44 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6236 T541 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 6236 T541 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 6237 T541 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59558/lt_/collection1/
[junit4:junit4] 2> 6237 T541 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 6237 T541 oasc.SyncStrategy.syncToMe http://127.0.0.1:59558/lt_/collection1/ has no replicas
[junit4:junit4] 2> 6237 T541 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59558/lt_/collection1/
[junit4:junit4] 2> 6238 T541 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 6243 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:create cxid:0x4e zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6848 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6892 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6892 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6892 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6916 T541 oasc.ZkController.register We are http://127.0.0.1:59558/lt_/collection1/ and leader is http://127.0.0.1:59558/lt_/collection1/
[junit4:junit4] 2> 6916 T541 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59558/lt_
[junit4:junit4] 2> 6916 T541 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 6916 T541 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 6917 T541 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6919 T541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6920 T499 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 6920 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 6921 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 7104 T499 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 7107 T499 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:39198
[junit4:junit4] 2> 7108 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 7108 T499 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 7109 T499 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841
[junit4:junit4] 2> 7109 T499 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/solr.xml
[junit4:junit4] 2> 7110 T499 oasc.CoreContainer.<init> New CoreContainer 1233522068
[junit4:junit4] 2> 7110 T499 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/'
[junit4:junit4] 2> 7111 T499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/'
[junit4:junit4] 2> 7165 T499 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 7166 T499 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 7166 T499 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 7167 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 7167 T499 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 7168 T499 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 7168 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 7169 T499 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 7169 T499 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 7170 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 7193 T499 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 7212 T499 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:43537/solr
[junit4:junit4] 2> 7213 T499 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 7213 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@499a601e
[junit4:junit4] 2> 7215 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7215 T552 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 7216 T552 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 7216 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59693
[junit4:junit4] 2> 7217 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59693
[junit4:junit4] 2> 7219 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0007 with negotiated timeout 20000 for client /140.211.11.196:59693
[junit4:junit4] 2> 7219 T552 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0007, negotiated timeout = 20000
[junit4:junit4] 2> 7219 T553 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@499a601e name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7220 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7221 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0007
[junit4:junit4] 2> 7232 T553 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 7232 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:59693 which had sessionid 0x13ca1e958bc0007
[junit4:junit4] 2> 7232 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0007 closed
[junit4:junit4] 2> 7233 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 7247 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@11b5f02e
[junit4:junit4] 2> 7248 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7248 T554 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 7249 T554 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 7249 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28727
[junit4:junit4] 2> 7249 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28727
[junit4:junit4] 2> 7251 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0008 with negotiated timeout 20000 for client /140.211.11.196:28727
[junit4:junit4] 2> 7251 T554 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0008, negotiated timeout = 20000
[junit4:junit4] 2> 7251 T555 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11b5f02e name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7251 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7253 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7254 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:create cxid:0x2 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7256 T499 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39198_lt_
[junit4:junit4] 2> 7257 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:delete cxid:0x4 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39198_lt_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39198_lt_
[junit4:junit4] 2> 7265 T499 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39198_lt_
[junit4:junit4] 2> 7268 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7268 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7268 T540 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 7269 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 7270 T521 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 7271 T527 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 7273 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 7281 T556 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/collection1
[junit4:junit4] 2> 7281 T556 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 7282 T556 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 7282 T556 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 7284 T556 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/collection1/'
[junit4:junit4] 2> 7285 T556 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 7286 T556 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/collection1/lib/README' to classloader
[junit4:junit4] 2> 7339 T556 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 7411 T556 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 7512 T556 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 7518 T556 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 8112 T556 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 8120 T556 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 8123 T556 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 8140 T556 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8144 T556 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8147 T556 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8149 T556 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8150 T556 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/
[junit4:junit4] 2> 8150 T556 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36298619
[junit4:junit4] 2> 8150 T556 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 8151 T556 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2 forceNew:false
[junit4:junit4] 2> 8151 T556 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
[junit4:junit4] 2> 8152 T556 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index/
[junit4:junit4] 2> 8152 T556 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 8153 T556 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index forceNew:false
[junit4:junit4] 2> 8158 T556 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@254256b1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 8158 T556 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 8159 T556 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index
[junit4:junit4] 2> 8159 T556 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 8161 T556 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 8161 T556 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 8161 T556 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 8161 T556 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 8162 T556 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 8162 T556 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 8162 T556 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 8163 T556 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 8163 T556 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 8164 T556 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 8164 T556 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 8164 T556 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 8165 T556 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 8165 T556 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 8165 T556 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 8166 T556 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 8166 T556 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8167 T556 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8167 T556 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8167 T556 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8168 T556 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8168 T556 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8169 T556 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8169 T556 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8169 T556 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 8170 T556 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 8178 T556 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 8181 T556 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 8182 T556 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 8184 T556 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
[junit4:junit4] 2> 8185 T556 oass.SolrIndexSearcher.<init> Opening Searcher@550b9e33 main
[junit4:junit4] 2> 8186 T556 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 8186 T556 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 8187 T556 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 8192 T556 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 8243 T557 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@550b9e33 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 8247 T556 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 8247 T556 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8406 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8406 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:59558_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59558/lt_"}
[junit4:junit4] 2> 8411 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:39198_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39198/lt_"}
[junit4:junit4] 2> 8411 T522 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 8411 T522 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 8423 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8423 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8423 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8423 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9250 T556 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 9250 T556 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39198/lt_ collection:collection1 shard:shard2
[junit4:junit4] 2> 9251 T556 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 9275 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:delete cxid:0x42 zxid:0x7c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 9281 T556 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 9281 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:create cxid:0x43 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9284 T556 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 9285 T556 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 9285 T556 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39198/lt_/collection1/
[junit4:junit4] 2> 9285 T556 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 9285 T556 oasc.SyncStrategy.syncToMe http://127.0.0.1:39198/lt_/collection1/ has no replicas
[junit4:junit4] 2> 9286 T556 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39198/lt_/collection1/
[junit4:junit4] 2> 9286 T556 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 9298 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:create cxid:0x4c zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9937 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9976 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9977 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9977 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9976 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9980 T556 oasc.ZkController.register We are http://127.0.0.1:39198/lt_/collection1/ and leader is http://127.0.0.1:39198/lt_/collection1/
[junit4:junit4] 2> 9980 T556 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39198/lt_
[junit4:junit4] 2> 9980 T556 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 9980 T556 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 9981 T556 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9986 T556 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9993 T499 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 9994 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 9995 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 10200 T499 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 10204 T499 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48808
[junit4:junit4] 2> 10204 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 10205 T499 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 10205 T499 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918
[junit4:junit4] 2> 10206 T499 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/solr.xml
[junit4:junit4] 2> 10206 T499 oasc.CoreContainer.<init> New CoreContainer 1199416839
[junit4:junit4] 2> 10207 T499 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/'
[junit4:junit4] 2> 10207 T499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/'
[junit4:junit4] 2> 10262 T499 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 10263 T499 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 10263 T499 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 10264 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 10264 T499 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 10264 T499 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 10265 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 10265 T499 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 10266 T499 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 10266 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 10291 T499 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 10313 T499 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:43537/solr
[junit4:junit4] 2> 10314 T499 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 10314 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@15f0b12d
[junit4:junit4] 2> 10315 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10316 T567 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10317 T567 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 10317 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49643
[junit4:junit4] 2> 10318 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49643
[junit4:junit4] 2> 10319 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0009 with negotiated timeout 20000 for client /140.211.11.196:49643
[junit4:junit4] 2> 10320 T567 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0009, negotiated timeout = 20000
[junit4:junit4] 2> 10320 T568 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15f0b12d name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10320 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10322 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0009
[junit4:junit4] 2> 10323 T568 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 10323 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:49643 which had sessionid 0x13ca1e958bc0009
[junit4:junit4] 2> 10323 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0009 closed
[junit4:junit4] 2> 10324 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 10337 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@39cc1709
[junit4:junit4] 2> 10338 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10339 T569 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10339 T569 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 10340 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:19439
[junit4:junit4] 2> 10340 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:19439
[junit4:junit4] 2> 10348 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc000a with negotiated timeout 20000 for client /140.211.11.196:19439
[junit4:junit4] 2> 10348 T569 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc000a, negotiated timeout = 20000
[junit4:junit4] 2> 10348 T570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39cc1709 name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10349 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10350 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000a type:create cxid:0x1 zxid:0x8d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10351 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000a type:create cxid:0x2 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10353 T499 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48808_lt_
[junit4:junit4] 2> 10354 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000a type:delete cxid:0x4 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48808_lt_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48808_lt_
[junit4:junit4] 2> 10362 T499 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48808_lt_
[junit4:junit4] 2> 10364 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10365 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10365 T555 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10365 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 10366 T540 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10366 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 10367 T521 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10367 T527 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10371 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10380 T571 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/collection1
[junit4:junit4] 2> 10380 T571 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 10381 T571 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 10381 T571 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 10383 T571 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/collection1/'
[junit4:junit4] 2> 10384 T571 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 10385 T571 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/collection1/lib/README' to classloader
[junit4:junit4] 2> 10440 T571 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 10526 T571 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10627 T571 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10634 T571 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 11264 T571 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 11289 T571 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 11293 T571 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 11312 T571 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 11317 T571 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 11322 T571 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11323 T571 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11325 T571 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/
[junit4:junit4] 2> 11325 T571 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36298619
[junit4:junit4] 2> 11326 T571 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 11327 T571 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3 forceNew:false
[junit4:junit4] 2> 11327 T571 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
[junit4:junit4] 2> 11328 T571 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index/
[junit4:junit4] 2> 11328 T571 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 11329 T571 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index forceNew:false
[junit4:junit4] 2> 11335 T571 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61c28a10; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 11336 T571 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 11337 T571 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index
[junit4:junit4] 2> 11337 T571 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 11340 T571 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 11340 T571 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 11340 T571 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 11341 T571 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 11341 T571 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 11342 T571 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 11342 T571 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 11343 T571 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 11343 T571 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 11344 T571 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 11345 T571 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 11345 T571 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 11346 T571 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 11346 T571 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 11346 T571 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 11347 T571 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 11348 T571 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11348 T571 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11349 T571 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11349 T571 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11350 T571 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11351 T571 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11351 T571 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11352 T571 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11353 T571 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 11353 T571 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 11366 T571 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 11371 T571 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 11372 T571 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 11375 T571 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
[junit4:junit4] 2> 11376 T571 oass.SolrIndexSearcher.<init> Opening Searcher@5b2f54cd main
[junit4:junit4] 2> 11377 T571 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 11378 T571 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 11378 T571 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 11385 T571 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 11443 T572 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5b2f54cd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 11450 T571 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 11450 T571 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11496 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11497 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:39198_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39198/lt_"}
[junit4:junit4] 2> 11502 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:48808_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48808/lt_"}
[junit4:junit4] 2> 11503 T522 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11503 T522 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11514 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11514 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11514 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11514 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11514 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12453 T571 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 12453 T571 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48808/lt_ collection:collection1 shard:shard1
[junit4:junit4] 2> 12483 T571 oasc.ZkController.register We are http://127.0.0.1:48808/lt_/collection1/ and leader is http://127.0.0.1:59558/lt_/collection1/
[junit4:junit4] 2> 12484 T571 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48808/lt_
[junit4:junit4] 2> 12484 T571 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 12484 T571 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C67 name=collection1 org.apache.solr.core.SolrCore@6fbe4c22 url=http://127.0.0.1:48808/lt_/collection1 node=127.0.0.1:48808_lt_ C67_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48808_lt_, base_url=http://127.0.0.1:48808/lt_}
[junit4:junit4] 2> 12491 T573 C67 P48808 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 12491 T571 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12492 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 12493 T573 C67 P48808 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 12493 T573 C67 P48808 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12493 T499 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 12494 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12494 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12495 T573 C67 P48808 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12691 T499 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12694 T499 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:56235
[junit4:junit4] 2> 12695 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12695 T499 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12696 T499 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423
[junit4:junit4] 2> 12696 T499 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/solr.xml
[junit4:junit4] 2> 12696 T499 oasc.CoreContainer.<init> New CoreContainer 8126726
[junit4:junit4] 2> 12697 T499 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/'
[junit4:junit4] 2> 12697 T499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/'
[junit4:junit4] 2> 12752 T499 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 12753 T499 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12753 T499 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12754 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12754 T499 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12754 T499 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12755 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12755 T499 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12756 T499 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12756 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12780 T499 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12799 T499 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:43537/solr
[junit4:junit4] 2> 12800 T499 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12800 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6678bc7
[junit4:junit4] 2> 12801 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12802 T583 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12802 T583 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 12803 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45364
[junit4:junit4] 2> 12803 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45364
[junit4:junit4] 2> 12805 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc000b with negotiated timeout 20000 for client /140.211.11.196:45364
[junit4:junit4] 2> 12805 T583 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc000b, negotiated timeout = 20000
[junit4:junit4] 2> 12806 T584 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6678bc7 name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12806 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12807 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc000b
[junit4:junit4] 2> 12819 T584 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12819 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45364 which had sessionid 0x13ca1e958bc000b
[junit4:junit4] 2> 12819 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc000b closed
[junit4:junit4] 2> 12820 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 12834 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@48a02f43
[junit4:junit4] 2> 12835 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12835 T585 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12836 T585 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
[junit4:junit4] 2> 12836 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34033
[junit4:junit4] 2> 12836 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34033
[junit4:junit4] 2> 12838 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc000c with negotiated timeout 20000 for client /140.211.11.196:34033
[junit4:junit4] 2> 12838 T585 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc000c, negotiated timeout = 20000
[junit4:junit4] 2> 12838 T586 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48a02f43 name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12838 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12840 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000c type:create cxid:0x1 zxid:0x9f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12841 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000c type:create cxid:0x2 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12843 T499 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56235_lt_
[junit4:junit4] 2> 12844 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000c type:delete cxid:0x4 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56235_lt_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56235_lt_
[junit4:junit4] 2> 12851 T499 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56235_lt_
[junit4:junit4] 2> 12854 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12854 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12854 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12855 T555 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 12855 T540 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 12855 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 12855 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 12857 T521 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 12858 T570 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 12858 T527 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 12860 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 12867 T587 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/collection1
[junit4:junit4] 2> 12867 T587 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 12868 T587 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 12868 T587 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 12870 T587 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/collection1/'
[junit4:junit4] 2> 12871 T587 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/collection1/lib/README' to classloader
[junit4:junit4] 2> 12872 T587 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 12925 T587 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 12997 T587 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13029 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13030 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:48808_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48808/lt_"}
[junit4:junit4] 2> 13036 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13036 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13036 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13036 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13036 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13098 T587 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13098 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 13105 T587 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13728 T587 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 13740 T587 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 13744 T587 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 13763 T587 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13768 T587 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13773 T587 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13774 T587 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13776 T587 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/
[junit4:junit4] 2> 13776 T587 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36298619
[junit4:junit4] 2> 13777 T587 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 13778 T587 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4 forceNew:false
[junit4:junit4] 2> 13779 T587 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
[junit4:junit4] 2> 13779 T587 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index/
[junit4:junit4] 2> 13779 T587 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 13781 T587 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index forceNew:false
[junit4:junit4] 2> 13787 T587 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3df9fbf9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13788 T587 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13789 T587 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index
[junit4:junit4] 2> 13789 T587 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 13791 T587 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 13792 T587 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 13792 T587 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 13792 T587 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 13793 T587 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 13793 T587 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 13794 T587 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 13794 T587 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 13795 T587 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 13796 T587 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 13796 T587 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 13797 T587 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 13798 T587 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 13798 T587 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 13798 T587 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 13799 T587 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 13799 T587 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13800 T587 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13801 T587 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13801 T587 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13802 T587 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13803 T587 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13803 T587 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13804 T587 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13804 T587 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 13805 T587 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 13818 T587 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 13823 T587 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 13825 T587 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 13827 T587 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
[junit4:junit4] 2> 13829 T587 oass.SolrIndexSearcher.<init> Opening Searcher@7ec4e721 main
[junit4:junit4] 2> 13830 T587 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 13830 T587 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 13831 T587 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 13838 T587 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 13893 T588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ec4e721 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 13900 T587 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 13900 T587 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14548 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14549 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:56235_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56235/lt_"}
[junit4:junit4] 2> 14550 T522 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 14550 T522 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 14563 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14563 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14563 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14563 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14563 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14563 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14903 T587 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 14903 T587 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56235/lt_ collection:collection1 shard:shard2
[junit4:junit4] 2> 14907 T587 oasc.ZkController.register We are http://127.0.0.1:56235/lt_/collection1/ and leader is http://127.0.0.1:39198/lt_/collection1/
[junit4:junit4] 2> 14907 T587 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56235/lt_
[junit4:junit4] 2> 14907 T587 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 14908 T587 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C68 name=collection1 org.apache.solr.core.SolrCore@56dc599f url=http://127.0.0.1:56235/lt_/collection1 node=127.0.0.1:56235_lt_ C68_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:56235_lt_, base_url=http://127.0.0.1:56235/lt_}
[junit4:junit4] 2> 14909 T589 C68 P56235 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 14909 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 14910 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14910 T589 C68 P56235 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 14910 T589 C68 P56235 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14911 T499 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 14911 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14912 T589 C68 P56235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14912 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14938 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14940 T499 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 14941 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C67_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48808_lt_, base_url=http://127.0.0.1:48808/lt_}
[junit4:junit4] 2> 15545 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:59558/lt_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 15555 T573 C67 P48808 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 15576 T573 C67 P48808 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48808/lt_ START replicas=[http://127.0.0.1:59558/lt_/collection1/] nUpdates=100
[junit4:junit4] 2> 15586 T573 C67 P48808 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 15587 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 15587 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 15588 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 15588 T573 C67 P48808 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 15588 T573 C67 P48808 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:59558/lt_/collection1/. core=collection1
[junit4:junit4] 2> 15588 T573 C67 P48808 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C69 name=collection1 org.apache.solr.core.SolrCore@7a561b47 url=http://127.0.0.1:59558/lt_/collection1 node=127.0.0.1:59558_lt_ C69_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59558_lt_, base_url=http://127.0.0.1:59558/lt_, leader=true}
[junit4:junit4] 2> 15604 T531 C69 P59558 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 15611 T532 C69 P59558 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 15612 T532 C69 P59558 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
[junit4:junit4] 2> 15616 T532 C69 P59558 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bf4515f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15617 T532 C69 P59558 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15621 T532 C69 P59558 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bf4515f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bf4515f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15621 T532 C69 P59558 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15622 T532 C69 P59558 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
[junit4:junit4] 2> 15623 T532 C69 P59558 oass.SolrIndexSearcher.<init> Opening Searcher@65c40485 realtime
[junit4:junit4] 2> 15623 T532 C69 P59558 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15624 T532 C69 P59558 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 14
[junit4:junit4] 2> 15625 T573 C67 P48808 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15625 T573 C67 P48808 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 15653 T573 C67 P48808 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 15656 T533 C69 P59558 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15657 T533 C69 P59558 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 15658 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 15658 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 15658 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 15662 T533 C69 P59558 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
[junit4:junit4] 2> 15663 T533 C69 P59558 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index
[junit4:junit4] 2> 15663 T533 C69 P59558 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 15664 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 15665 T573 C67 P48808 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 forceNew:false
[junit4:junit4] 2> 15666 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
[junit4:junit4] 2> 15667 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2db7be4d; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 15681 T533 C69 P59558 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=6
[junit4:junit4] 2> 15688 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index
[junit4:junit4] 2> 15689 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 15689 T573 C67 P48808 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130203221505568
[junit4:junit4] 2> 15691 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
[junit4:junit4] 2> 15692 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
[junit4:junit4] 2> 15692 T573 C67 P48808 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568
[junit4:junit4] 2> 15696 T573 C67 P48808 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2db7be4d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15696 T573 C67 P48808 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15698 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
[junit4:junit4] 2> 15703 T573 C67 P48808 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 15703 T573 C67 P48808 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 15703 T573 C67 P48808 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 15704 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568
[junit4:junit4] 2> 15705 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
[junit4:junit4] 2> 15709 T573 C67 P48808 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2db7be4d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15709 T573 C67 P48808 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15710 T573 C67 P48808 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 15710 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
[junit4:junit4] 2> 15711 T573 C67 P48808 oass.SolrIndexSearcher.<init> Opening Searcher@3c2d6104 main
[junit4:junit4] 2> 15717 T572 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3c2d6104 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 15718 T572 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index
[junit4:junit4] 2> 15719 T573 C67 P48808 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 15776 T573 C67 P48808 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2db7be4d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2db7be4d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 15777 T573 C67 P48808 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 15778 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
[junit4:junit4] 2> 15778 T573 C67 P48808 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15779 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568
[junit4:junit4] 2> 15779 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index
[junit4:junit4] 2> 15779 T573 C67 P48808 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 15779 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 15780 T573 C67 P48808 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 15780 T573 C67 P48808 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15806 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 15943 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16069 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16070 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:56235_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56235/lt_"}
[junit4:junit4] 2> 16078 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:48808_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48808/lt_"}
[junit4:junit4] 2> 16095 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16095 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16095 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16095 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16095 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16095 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16946 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17950 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C68_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:56235_lt_, base_url=http://127.0.0.1:56235/lt_}
[junit4:junit4] 2> 18942 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:39198/lt_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 18942 T589 C68 P56235 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56235/lt_ START replicas=[http://127.0.0.1:39198/lt_/collection1/] nUpdates=100
[junit4:junit4] 2> 18943 T589 C68 P56235 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 18943 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 18943 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 18943 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 18944 T589 C68 P56235 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 18945 T589 C68 P56235 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:39198/lt_/collection1/. core=collection1
[junit4:junit4] 2> 18945 T589 C68 P56235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18953 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C70 name=collection1 org.apache.solr.core.SolrCore@b2471fb url=http://127.0.0.1:39198/lt_/collection1 node=127.0.0.1:39198_lt_ C70_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:39198_lt_, base_url=http://127.0.0.1:39198/lt_, leader=true}
[junit4:junit4] 2> 18955 T546 C70 P39198 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 18965 T547 C70 P39198 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 18966 T547 C70 P39198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
[junit4:junit4] 2> 18970 T547 C70 P39198 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@254256b1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 18971 T547 C70 P39198 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 18982 T547 C70 P39198 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@254256b1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@254256b1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 18982 T547 C70 P39198 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 18984 T547 C70 P39198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
[junit4:junit4] 2> 18984 T547 C70 P39198 oass.SolrIndexSearcher.<init> Opening Searcher@4aef3675 realtime
[junit4:junit4] 2> 18985 T547 C70 P39198 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18985 T547 C70 P39198 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 20
[junit4:junit4] 2> 18986 T589 C68 P56235 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18986 T589 C68 P56235 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 18989 T548 C70 P39198 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18989 T548 C70 P39198 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 18990 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 18991 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 18991 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 18994 T548 C70 P39198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
[junit4:junit4] 2> 18994 T548 C70 P39198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index
[junit4:junit4] 2> 18995 T548 C70 P39198 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 18996 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 18997 T589 C68 P56235 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 forceNew:false
[junit4:junit4] 2> 18998 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
[junit4:junit4] 2> 18999 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6d976e; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 19002 T548 C70 P39198 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 19004 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index
[junit4:junit4] 2> 19004 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19005 T589 C68 P56235 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130203221508900
[junit4:junit4] 2> 19006 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
[junit4:junit4] 2> 19007 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
[junit4:junit4] 2> 19007 T589 C68 P56235 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900
[junit4:junit4] 2> 19011 T589 C68 P56235 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6d976e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19012 T589 C68 P56235 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19014 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
[junit4:junit4] 2> 19014 T589 C68 P56235 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19014 T589 C68 P56235 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19014 T589 C68 P56235 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 19015 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900
[junit4:junit4] 2> 19016 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
[junit4:junit4] 2> 19021 T589 C68 P56235 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6d976e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19021 T589 C68 P56235 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19021 T589 C68 P56235 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19022 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
[junit4:junit4] 2> 19022 T589 C68 P56235 oass.SolrIndexSearcher.<init> Opening Searcher@692cbe60 main
[junit4:junit4] 2> 19024 T588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@692cbe60 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19025 T588 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index
[junit4:junit4] 2> 19025 T589 C68 P56235 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 19030 T589 C68 P56235 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6d976e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6d976e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 19030 T589 C68 P56235 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 19032 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
[junit4:junit4] 2> 19032 T589 C68 P56235 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19032 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900
[junit4:junit4] 2> 19033 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index
[junit4:junit4] 2> 19033 T589 C68 P56235 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19033 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19033 T589 C68 P56235 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19033 T589 C68 P56235 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19035 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19115 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19116 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:56235_lt_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56235/lt_"}
[junit4:junit4] 2> 19130 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19131 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19130 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19130 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19130 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19130 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19956 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19957 T499 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C71 name=collection1 org.apache.solr.core.SolrCore@6a68c9a1 url=http://127.0.0.1:25591/lt_/collection1 node=127.0.0.1:25591_lt_ C71_STATE=coll:control_collection core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:25591_lt_, base_url=http://127.0.0.1:25591/lt_, leader=true}
[junit4:junit4] 2> 19971 T511 C71 P25591 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data
[junit4:junit4] 2> 19975 T511 C71 P25591 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@708ce5ef; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19976 T511 C71 P25591 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19977 T511 C71 P25591 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data
[junit4:junit4] 2> 19978 T511 C71 P25591 oass.SolrIndexSearcher.<init> Opening Searcher@159adcf5 realtime
[junit4:junit4] 2> 19979 T511 C71 P25591 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1425985880586190848)} 0 10
[junit4:junit4] 2> 19995 T549 C70 P39198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
[junit4:junit4] 2> 20000 T534 C69 P59558 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
[junit4:junit4] 2> C68_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:56235_lt_, base_url=http://127.0.0.1:56235/lt_}
[junit4:junit4] 2> 20010 T576 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
[junit4:junit4] 2> 20011 T576 C68 P56235 /update {update.distrib=FROMLEADER&_version_=-1425985880611356672&update.from=http://127.0.0.1:39198/lt_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1425985880611356672)} 0 3
[junit4:junit4] 2> C67_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48808_lt_, base_url=http://127.0.0.1:48808/lt_}
[junit4:junit4] 2> 20014 T560 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
[junit4:junit4] 2> 20015 T560 C67 P48808 /update {update.distrib=FROMLEADER&_version_=-1425985880617648128&update.from=http://127.0.0.1:59558/lt_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1425985880617648128)} 0 3
[junit4:junit4] 2> 20016 T534 C69 P59558 /update {update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1425985880617648128)} 0 18
[junit4:junit4] 2> 20017 T549 C70 P39198 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1425985880611356672)} 0 25
[junit4:junit4] 2> 20027 T511 C71 P25591 /update {wt=javabin&version=2} {add=[1 (1425985880641765376)]} 0 5
[junit4:junit4] 2> 20054 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1425985880659591168)]} 0 6
[junit4:junit4] 2> 20055 T534 C69 P59558 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1425985880659591168)]} 0 16
[junit4:junit4] 2> 20056 T549 C70 P39198 /update {wt=javabin&version=2} {add=[1]} 0 26
[junit4:junit4] 2> 20062 T511 C71 P25591 /update {wt=javabin&version=2} {add=[2 (1425985880681611264)]} 0 2
[junit4:junit4] 2> 20079 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1425985880689999872)]} 0 5
[junit4:junit4] 2> 20080 T550 C70 P39198 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1425985880689999872)]} 0 13
[junit4:junit4] 2> 20081 T535 C69 P59558 /update {wt=javabin&version=2} {add=[2]} 0 16
[junit4:junit4] 2> 20087 T511 C71 P25591 /update {wt=javabin&version=2} {add=[3 (1425985880707825664)]} 0 3
[junit4:junit4] 2> 20101 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1425985880717262848)]} 0 3
[junit4:junit4] 2> 20102 T550 C70 P39198 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1425985880717262848)]} 0 9
[junit4:junit4] 2> 20103 T535 C69 P59558 /update {wt=javabin&version=2} {add=[3]} 0 13
[junit4:junit4] 2> 20109 T511 C71 P25591 /update {wt=javabin&version=2} {add=[4 (1425985880730894336)]} 0 3
[junit4:junit4] 2> 20124 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1425985880740331520)]} 0 3
[junit4:junit4] 2> 20125 T534 C69 P59558 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1425985880740331520)]} 0 10
[junit4:junit4] 2> 20126 T549 C70 P39198 /update {wt=javabin&version=2} {add=[4]} 0 14
[junit4:junit4] 2> 20132 T511 C71 P25591 /update {wt=javabin&version=2} {add=[5 (1425985880755011584)]} 0 3
[junit4:junit4] 2> 20146 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1425985880764448768)]} 0 3
[junit4:junit4] 2> 20147 T550 C70 P39198 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1425985880764448768)]} 0 9
[junit4:junit4] 2> 20148 T535 C69 P59558 /update {wt=javabin&version=2} {add=[5]} 0 12
[junit4:junit4] 2> 20154 T511 C71 P25591 /update {wt=javabin&version=2} {add=[6 (1425985880778080256)]} 0 3
[junit4:junit4] 2> 20168 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1425985880787517440)]} 0 3
[junit4:junit4] 2> 20169 T550 C70 P39198 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1425985880787517440)]} 0 9
[junit4:junit4] 2> 20170 T535 C69 P59558 /update {wt=javabin&version=2} {add=[6]} 0 13
[junit4:junit4] 2> 20176 T511 C71 P25591 /update {wt=javabin&version=2} {add=[7 (1425985880801148928)]} 0 3
[junit4:junit4] 2> 20189 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1425985880807440384)]} 0 3
[junit4:junit4] 2> 20190 T549 C70 P39198 /update {wt=javabin&version=2} {add=[7 (1425985880807440384)]} 0 11
[junit4:junit4] 2> 20196 T511 C71 P25591 /update {wt=javabin&version=2} {add=[8 (1425985880822120448)]} 0 3
[junit4:junit4] 2> 20211 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1425985880831557632)]} 0 3
[junit4:junit4] 2> 20212 T534 C69 P59558 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1425985880831557632)]} 0 10
[junit4:junit4] 2> 20213 T549 C70 P39198 /update {wt=javabin&version=2} {add=[8]} 0 14
[junit4:junit4] 2> 20219 T511 C71 P25591 /update {wt=javabin&version=2} {add=[9 (1425985880846237696)]} 0 3
[junit4:junit4] 2> 20233 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1425985880855674880)]} 0 3
[junit4:junit4] 2> 20233 T550 C70 P39198 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1425985880855674880)]} 0 8
[junit4:junit4] 2> 20234 T535 C69 P59558 /update {wt=javabin&version=2} {add=[9]} 0 12
[junit4:junit4] 2> 20261 T511 C71 P25591 /update {wt=javabin&version=2} {add=[10 (1425985880869306368)]} 0 23
[junit4:junit4] 2> 20276 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1425985880900763648)]} 0 3
[junit4:junit4] 2> 20276 T534 C69 P59558 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1425985880900763648)]} 0 8
[junit4:junit4] 2> 20277 T549 C70 P39198 /update {wt=javabin&version=2} {add=[10]} 0 12
[junit4:junit4] 2> 20284 T511 C71 P25591 /update {wt=javabin&version=2} {add=[11 (1425985880913346560)]} 0 4
[junit4:junit4] 2> 20298 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1425985880923832320)]} 0 3
[junit4:junit4] 2> 20299 T534 C69 P59558 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1425985880923832320)]} 0 9
[junit4:junit4] 2> 20299 T549 C70 P39198 /update {wt=javabin&version=2} {add=[11]} 0 12
[junit4:junit4] 2> 20306 T511 C71 P25591 /update {wt=javabin&version=2} {add=[12 (1425985880937463808)]} 0 3
[junit4:junit4] 2> 20320 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=
[...truncated too long message...]
rdownChained.java:50)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 22) Thread[id=572, name=searcherExecutor-469-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 23) Thread[id=629, name=searcherExecutor-496-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {n_f1=PostingsFormat(name=SimpleText), foo_b=PostingsFormat(name=MockSep), foo_d=MockVariableIntBlock(baseBlockSize=77), foo_f=PostingsFormat(name=MockSep), n_tl1=PostingsFormat(name=SimpleText), n_d1=MockFixedIntBlock(blockSize=1003), rnd_b=MockVariableIntBlock(baseBlockSize=77), intDefault=MockFixedIntBlock(blockSize=1003), n_td1=PostingsFormat(name=SimpleText), timestamp=MockFixedIntBlock(blockSize=1003), id=MockVariableIntBlock(baseBlockSize=77), range_facet_sl=PostingsFormat(name=MockSep), range_facet_si=PostingsFormat(name=SimpleText), oddField_s=PostingsFormat(name=MockSep), foo_i=PostingsFormat(name=SimpleText), multiDefault=PostingsFormat(name=SimpleText), n_tf1=MockFixedIntBlock(blockSize=1003), n_dt1=PostingsFormat(name=SimpleText), n_ti1=MockVariableIntBlock(baseBlockSize=77), range_facet_l=MockFixedIntBlock(blockSize=1003), text=PostingsFormat(name=MockSep), _version_=MockFixedIntBlock(blockSize=1003), val_i=MockVariableIntBlock(baseBlockSize=77), SubjectTerms_mfacet=MockFixedIntBlock(blockSize=1003), a_t=MockFixedIntBlock(blockSize=1003), n_tdt1=MockFixedIntBlock(blockSize=1003), other_tl1=MockFixedIntBlock(blockSize=1003), n_l1=MockFixedIntBlock(blockSize=1003), a_si=PostingsFormat(name=SimpleText)}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ro, timezone=Europe/Malta
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=25,free=255086936,total=470810624
[junit4:junit4] 2> NOTE: All tests run in this JVM: [QueryElevationComponentTest, SystemInfoHandlerTest, JSONWriterTest, CopyFieldTest, DateFieldTest, TestSuggestSpellingConverter, TestSearchPerf, DirectSolrConnectionTest, NumericFieldsTest, TestReload, SOLR749Test, IndexBasedSpellCheckerTest, SolrCmdDistributorTest, TestFuzzyAnalyzedSuggestions, FastVectorHighlighterTest, PreAnalyzedFieldTest, TestRangeQuery, TestComponentsName, LeaderElectionIntegrationTest, TestDefaultSimilarityFactory, TestPerFieldSimilarity, DirectUpdateHandlerOptimizeTest, NoCacheHeaderTest, TermsComponentTest, DefaultValueUpdateProcessorTest, TestSolrIndexConfig, TestPHPSerializedResponseWriter, SpellCheckComponentTest, TestBinaryResponseWriter, TestIndexingPerformance, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, TestStressVersions, AlternateDirectoryTest, TestSolr4Spatial, UpdateRequestProcessorFactoryTest, TestPseudoReturnFields, AutoCommitTest, TestNumberUtils, TestFastOutputStream, BasicDistributedZkTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZkTest -Dtests.seed=437C1ACFB7351B0A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ro -Dtests.timezone=Europe/Malta -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 0.00s J0 | BasicDistributedZkTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([437C1ACFB7351B0A]:0)
[junit4:junit4] Completed on J0 in 7223.60s, 1 test, 2 errors <<< FAILURES!
[...truncated 74 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:841: There were test failures: 249 suites, 1038 tests, 1 suite-level error, 1 error, 66 ignored (5 assumptions)
Total time: 144 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3711 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3711/
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 1) Thread[id=4585, name=Thread-1944-EventThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1241) at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:304) at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85) at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193) at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117) at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46) at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest:
1) Thread[id=4585, name=Thread-1944-EventThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1241)
at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:304)
at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
at __randomizedtesting.SeedInfo.seed([3B2ECE55067E5F9]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=4585, name=Thread-1944-EventThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest] at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391) at java.net.Socket.connect(Socket.java:579) at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123) at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148) at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150) at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121) at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181) at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1236) at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:304) at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85) at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193) at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117) at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46) at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=4585, name=Thread-1944-EventThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
at java.net.Socket.connect(Socket.java:579)
at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1236)
at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:304)
at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
at __randomizedtesting.SeedInfo.seed([3B2ECE55067E5F9]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([3B2ECE55067E5F9]:0)
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([3B2ECE55067E5F9]:0)
Build Log:
[...truncated 9343 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4] 2> 0 T4089 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 5 T4089 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeySafeLeaderTest-1360103291572
[junit4:junit4] 2> 7 T4089 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 7 T4090 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 10 T4090 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 11 T4090 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 11 T4090 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 11 T4090 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 12 T4090 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 108 T4089 oasc.ZkTestServer.run start zk server on port:45907
[junit4:junit4] 2> 108 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7c9bb633
[junit4:junit4] 2> 109 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 109 T4095 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 110 T4095 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 110 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45908
[junit4:junit4] 2> 111 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45908
[junit4:junit4] 2> 111 T4093 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 139 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0000 with negotiated timeout 10000 for client /140.211.11.196:45908
[junit4:junit4] 2> 139 T4095 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0000, negotiated timeout = 10000
[junit4:junit4] 2> 139 T4096 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c9bb633 name:ZooKeeperConnection Watcher:127.0.0.1:45907 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 140 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 140 T4089 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 143 T4094 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cac793abb0000
[junit4:junit4] 2> 145 T4096 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 145 T4089 oaz.ZooKeeper.close Session: 0x13cac793abb0000 closed
[junit4:junit4] 2> 145 T4091 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45908 which had sessionid 0x13cac793abb0000
[junit4:junit4] 2> 146 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@36bd8461
[junit4:junit4] 2> 146 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 147 T4097 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 147 T4097 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 148 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45909
[junit4:junit4] 2> 148 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45909
[junit4:junit4] 2> 157 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0001 with negotiated timeout 10000 for client /140.211.11.196:45909
[junit4:junit4] 2> 157 T4097 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0001, negotiated timeout = 10000
[junit4:junit4] 2> 157 T4098 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36bd8461 name:ZooKeeperConnection Watcher:127.0.0.1:45907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 158 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 158 T4089 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 162 T4089 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 170 T4089 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 173 T4089 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 176 T4089 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 177 T4089 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 190 T4089 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 191 T4089 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 295 T4089 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 296 T4089 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 299 T4089 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 300 T4089 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 303 T4089 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 304 T4089 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 315 T4089 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 316 T4089 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 319 T4089 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 320 T4089 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 323 T4089 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 323 T4089 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 326 T4089 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 327 T4089 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 330 T4094 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cac793abb0001
[junit4:junit4] 2> 337 T4098 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 337 T4091 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45909 which had sessionid 0x13cac793abb0001
[junit4:junit4] 2> 337 T4089 oaz.ZooKeeper.close Session: 0x13cac793abb0001 closed
[junit4:junit4] 2> 510 T4089 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 515 T4089 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45910
[junit4:junit4] 2> 516 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 516 T4089 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 517 T4089 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360103291904
[junit4:junit4] 2> 517 T4089 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360103291904/solr.xml
[junit4:junit4] 2> 518 T4089 oasc.CoreContainer.<init> New CoreContainer 1760950837
[junit4:junit4] 2> 518 T4089 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360103291904/'
[junit4:junit4] 2> 519 T4089 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360103291904/'
[junit4:junit4] 2> 576 T4089 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 577 T4089 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 577 T4089 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 578 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 578 T4089 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 579 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 579 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 580 T4089 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 580 T4089 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 581 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 603 T4089 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 623 T4089 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45907/solr
[junit4:junit4] 2> 624 T4089 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 624 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@39d7ec24
[junit4:junit4] 2> 625 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 626 T4108 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 626 T4108 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 627 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45911
[junit4:junit4] 2> 627 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45911
[junit4:junit4] 2> 629 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0002 with negotiated timeout 20000 for client /140.211.11.196:45911
[junit4:junit4] 2> 629 T4108 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0002, negotiated timeout = 20000
[junit4:junit4] 2> 629 T4109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39d7ec24 name:ZooKeeperConnection Watcher:127.0.0.1:45907 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 629 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 631 T4094 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cac793abb0002
[junit4:junit4] 2> 632 T4109 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 632 T4091 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45911 which had sessionid 0x13cac793abb0002
[junit4:junit4] 2> 632 T4089 oaz.ZooKeeper.close Session: 0x13cac793abb0002 closed
[junit4:junit4] 2> 632 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 644 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7ec372f5
[junit4:junit4] 2> 645 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 645 T4110 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 646 T4110 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 646 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45912
[junit4:junit4] 2> 647 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45912
[junit4:junit4] 2> 648 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0003 with negotiated timeout 20000 for client /140.211.11.196:45912
[junit4:junit4] 2> 648 T4110 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0003, negotiated timeout = 20000
[junit4:junit4] 2> 648 T4111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ec372f5 name:ZooKeeperConnection Watcher:127.0.0.1:45907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 649 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 651 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 659 T4089 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 661 T4089 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45910_
[junit4:junit4] 2> 662 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45910_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45910_
[junit4:junit4] 2> 663 T4089 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45910_
[junit4:junit4] 2> 673 T4089 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 686 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 687 T4089 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 690 T4089 oasc.Overseer.start Overseer (id=89135729316921347-127.0.0.1:45910_-n_0000000000) starting
[junit4:junit4] 2> 690 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 697 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 699 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 705 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 707 T4113 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 707 T4089 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 711 T4089 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 713 T4112 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 718 T4114 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360103291904/collection1
[junit4:junit4] 2> 718 T4114 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 719 T4114 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 719 T4114 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 720 T4114 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360103291904/collection1/'
[junit4:junit4] 2> 722 T4114 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360103291904/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 722 T4114 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360103291904/collection1/lib/README' to classloader
[junit4:junit4] 2> 780 T4114 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 855 T4114 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 956 T4114 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 966 T4114 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1162 T3 oasc.CoreContainer.finalize SEVERE CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=649180823
[junit4:junit4] 2> 1163 T3 oasc.CoreContainer.finalize SEVERE CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=109314475
[junit4:junit4] 2> 1617 T4114 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1629 T4114 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1633 T4114 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1646 T4114 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1651 T4114 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1655 T4114 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1656 T4114 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1657 T4114 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1360103291904/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/control/data/
[junit4:junit4] 2> 1658 T4114 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1783206b
[junit4:junit4] 2> 1658 T4114 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1659 T4114 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/control/data forceNew:false
[junit4:junit4] 2> 1660 T4114 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/control/data
[junit4:junit4] 2> 1660 T4114 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/control/data/index/
[junit4:junit4] 2> 1661 T4114 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1662 T4114 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/control/data/index forceNew:false
[junit4:junit4] 2> 1667 T4114 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a609eee),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1668 T4114 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1669 T4114 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/control/data/index
[junit4:junit4] 2> 1669 T4114 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 1671 T4114 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1671 T4114 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 1672 T4114 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1672 T4114 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 1673 T4114 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1673 T4114 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1673 T4114 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1674 T4114 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1675 T4114 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1675 T4114 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 1676 T4114 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 1676 T4114 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1677 T4114 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 1677 T4114 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 1677 T4114 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 1678 T4114 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1678 T4114 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1679 T4114 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1679 T4114 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1680 T4114 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1681 T4114 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1681 T4114 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1682 T4114 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1682 T4114 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 1683 T4114 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 1683 T4114 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 1695 T4114 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1700 T4114 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 1701 T4114 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 1703 T4114 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/control/data
[junit4:junit4] 2> 1705 T4114 oass.SolrIndexSearcher.<init> Opening Searcher@5ee1d38 main
[junit4:junit4] 2> 1706 T4114 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1706 T4114 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1707 T4114 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 1723 T4114 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 1779 T4115 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ee1d38 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1786 T4114 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1786 T4114 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1786 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2216 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2217 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:45910_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45910"}
[junit4:junit4] 2> 2217 T4112 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2218 T4112 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2218 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2238 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2790 T4114 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2790 T4114 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45910 collection:control_collection shard:shard1
[junit4:junit4] 2> 2791 T4114 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2808 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2809 T4114 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2809 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2811 T4114 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2812 T4114 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2812 T4114 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45910/collection1/
[junit4:junit4] 2> 2812 T4114 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2812 T4114 oasc.SyncStrategy.syncToMe http://127.0.0.1:45910/collection1/ has no replicas
[junit4:junit4] 2> 2813 T4114 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45910/collection1/
[junit4:junit4] 2> 2813 T4114 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2817 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3742 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3760 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3787 T4114 oasc.ZkController.register We are http://127.0.0.1:45910/collection1/ and leader is http://127.0.0.1:45910/collection1/
[junit4:junit4] 2> 3787 T4114 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45910
[junit4:junit4] 2> 3787 T4114 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3787 T4114 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3788 T4114 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3790 T4114 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3791 T4089 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3792 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3793 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3807 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3816 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@48201516
[junit4:junit4] 2> 3817 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3817 T4116 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3818 T4116 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 3818 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45913
[junit4:junit4] 2> 3818 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45913
[junit4:junit4] 2> 3820 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0004 with negotiated timeout 10000 for client /140.211.11.196:45913
[junit4:junit4] 2> 3820 T4116 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0004, negotiated timeout = 10000
[junit4:junit4] 2> 3820 T4117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48201516 name:ZooKeeperConnection Watcher:127.0.0.1:45907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3820 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3821 T4089 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3823 T4089 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3992 T4089 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3996 T4089 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45914
[junit4:junit4] 2> 3997 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3997 T4089 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3998 T4089 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360103295389
[junit4:junit4] 2> 3999 T4089 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360103295389/solr.xml
[junit4:junit4] 2> 3999 T4089 oasc.CoreContainer.<init> New CoreContainer 368524678
[junit4:junit4] 2> 4000 T4089 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360103295389/'
[junit4:junit4] 2> 4000 T4089 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360103295389/'
[junit4:junit4] 2> 4057 T4089 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 4058 T4089 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4058 T4089 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4059 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4060 T4089 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4060 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4061 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4061 T4089 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4062 T4089 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4062 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4082 T4089 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4102 T4089 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45907/solr
[junit4:junit4] 2> 4103 T4089 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4104 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c1d65d1
[junit4:junit4] 2> 4105 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4105 T4127 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4106 T4127 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 4106 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45915
[junit4:junit4] 2> 4106 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45915
[junit4:junit4] 2> 4108 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0005 with negotiated timeout 20000 for client /140.211.11.196:45915
[junit4:junit4] 2> 4108 T4127 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0005, negotiated timeout = 20000
[junit4:junit4] 2> 4109 T4128 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c1d65d1 name:ZooKeeperConnection Watcher:127.0.0.1:45907 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4109 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4110 T4094 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cac793abb0005
[junit4:junit4] 2> 4123 T4128 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4123 T4091 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45915 which had sessionid 0x13cac793abb0005
[junit4:junit4] 2> 4123 T4089 oaz.ZooKeeper.close Session: 0x13cac793abb0005 closed
[junit4:junit4] 2> 4123 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 4133 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@277c0bf
[junit4:junit4] 2> 4134 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4135 T4129 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4135 T4129 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 4136 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45916
[junit4:junit4] 2> 4136 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45916
[junit4:junit4] 2> 4137 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0006 with negotiated timeout 20000 for client /140.211.11.196:45916
[junit4:junit4] 2> 4137 T4129 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0006, negotiated timeout = 20000
[junit4:junit4] 2> 4138 T4130 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@277c0bf name:ZooKeeperConnection Watcher:127.0.0.1:45907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4138 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4139 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4140 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4142 T4089 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45914_
[junit4:junit4] 2> 4143 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45914_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45914_
[junit4:junit4] 2> 4152 T4089 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45914_
[junit4:junit4] 2> 4155 T4117 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4155 T4111 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4155 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4158 T4089 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4165 T4131 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360103295389/collection1
[junit4:junit4] 2> 4166 T4131 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4166 T4131 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4167 T4131 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4168 T4131 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360103295389/collection1/'
[junit4:junit4] 2> 4169 T4131 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360103295389/collection1/lib/README' to classloader
[junit4:junit4] 2> 4170 T4131 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360103295389/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4226 T4131 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 4326 T4131 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4427 T4131 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4436 T4131 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5078 T4131 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5087 T4131 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5090 T4131 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5100 T4131 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5103 T4131 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5106 T4131 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5107 T4131 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5108 T4131 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1360103295389/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty1/
[junit4:junit4] 2> 5108 T4131 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1783206b
[junit4:junit4] 2> 5109 T4131 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 5109 T4131 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty1 forceNew:false
[junit4:junit4] 2> 5110 T4131 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty1
[junit4:junit4] 2> 5110 T4131 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty1/index/
[junit4:junit4] 2> 5110 T4131 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5111 T4131 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty1/index forceNew:false
[junit4:junit4] 2> 5115 T4131 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57ad8988),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5116 T4131 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5116 T4131 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty1/index
[junit4:junit4] 2> 5116 T4131 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 5118 T4131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5118 T4131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 5119 T4131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5119 T4131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 5119 T4131 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5119 T4131 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5120 T4131 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5120 T4131 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5121 T4131 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5121 T4131 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 5122 T4131 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 5122 T4131 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5123 T4131 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 5123 T4131 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 5123 T4131 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 5124 T4131 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5124 T4131 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5125 T4131 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5125 T4131 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5126 T4131 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5126 T4131 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5127 T4131 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5127 T4131 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5128 T4131 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 5128 T4131 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 5129 T4131 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 5137 T4131 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5140 T4131 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 5141 T4131 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 5143 T4131 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty1
[junit4:junit4] 2> 5144 T4131 oass.SolrIndexSearcher.<init> Opening Searcher@4d8e3765 main
[junit4:junit4] 2> 5145 T4131 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5145 T4131 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5146 T4131 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 5151 T4131 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 5203 T4132 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4d8e3765 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5209 T4131 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5209 T4131 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 5265 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5266 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:45910_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45910"}
[junit4:junit4] 2> 5269 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45914_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45914"}
[junit4:junit4] 2> 5269 T4112 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4] 2> 5270 T4112 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 5281 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5281 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5281 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6211 T4131 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 6211 T4131 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45914 collection:collection1 shard:shard1
[junit4:junit4] 2> 6212 T4131 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 6235 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0006 type:delete cxid:0x43 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 6236 T4131 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 6236 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0006 type:create cxid:0x44 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6238 T4131 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 6239 T4131 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 6239 T4131 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45914/collection1/
[junit4:junit4] 2> 6239 T4131 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 6240 T4131 oasc.SyncStrategy.syncToMe http://127.0.0.1:45914/collection1/ has no replicas
[junit4:junit4] 2> 6240 T4131 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45914/collection1/
[junit4:junit4] 2> 6240 T4131 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 6244 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0006 type:create cxid:0x4e zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6794 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6813 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6813 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6813 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6858 T4131 oasc.ZkController.register We are http://127.0.0.1:45914/collection1/ and leader is http://127.0.0.1:45914/collection1/
[junit4:junit4] 2> 6858 T4131 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45914
[junit4:junit4] 2> 6858 T4131 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 6858 T4131 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 6859 T4131 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6861 T4131 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6862 T4089 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 6863 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 6863 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 7045 T4089 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 7049 T4089 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45921
[junit4:junit4] 2> 7050 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 7050 T4089 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 7051 T4089 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360103298444
[junit4:junit4] 2> 7051 T4089 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360103298444/solr.xml
[junit4:junit4] 2> 7052 T4089 oasc.CoreContainer.<init> New CoreContainer 498757348
[junit4:junit4] 2> 7053 T4089 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360103298444/'
[junit4:junit4] 2> 7053 T4089 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360103298444/'
[junit4:junit4] 2> 7109 T4089 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 7110 T4089 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 7111 T4089 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 7111 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 7112 T4089 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 7112 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 7113 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 7113 T4089 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 7114 T4089 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 7114 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 7136 T4089 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 7156 T4089 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45907/solr
[junit4:junit4] 2> 7157 T4089 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 7157 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7833d74a
[junit4:junit4] 2> 7159 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7159 T4142 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 7160 T4142 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 7160 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45922
[junit4:junit4] 2> 7161 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45922
[junit4:junit4] 2> 7162 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0007 with negotiated timeout 20000 for client /140.211.11.196:45922
[junit4:junit4] 2> 7162 T4142 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0007, negotiated timeout = 20000
[junit4:junit4] 2> 7163 T4143 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7833d74a name:ZooKeeperConnection Watcher:127.0.0.1:45907 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7163 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7164 T4094 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cac793abb0007
[junit4:junit4] 2> 7174 T4143 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 7174 T4091 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45922 which had sessionid 0x13cac793abb0007
[junit4:junit4] 2> 7174 T4089 oaz.ZooKeeper.close Session: 0x13cac793abb0007 closed
[junit4:junit4] 2> 7175 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 7185 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@38b721df
[junit4:junit4] 2> 7186 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7186 T4144 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 7187 T4144 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 7187 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45923
[junit4:junit4] 2> 7188 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45923
[junit4:junit4] 2> 7189 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0008 with negotiated timeout 20000 for client /140.211.11.196:45923
[junit4:junit4] 2> 7189 T4144 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0008, negotiated timeout = 20000
[junit4:junit4] 2> 7189 T4145 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38b721df name:ZooKeeperConnection Watcher:127.0.0.1:45907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7190 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7191 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7192 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0008 type:create cxid:0x2 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7194 T4089 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45921_
[junit4:junit4] 2> 7194 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0008 type:delete cxid:0x4 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45921_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45921_
[junit4:junit4] 2> 7201 T4089 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45921_
[junit4:junit4] 2> 7203 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7204 T4130 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 7204 T4111 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 7204 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 7204 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 7205 T4117 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 7207 T4089 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 7214 T4146 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360103298444/collection1
[junit4:junit4] 2> 7215 T4146 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 7215 T4146 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 7216 T4146 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 7217 T4146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360103298444/collection1/'
[junit4:junit4] 2> 7218 T4146 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360103298444/collection1/lib/README' to classloader
[junit4:junit4] 2> 7219 T4146 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360103298444/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 7276 T4146 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 7351 T4146 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 7452 T4146 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 7460 T4146 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 8112 T4146 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 8125 T4146 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 8129 T4146 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 8142 T4146 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8215 T4146 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8220 T4146 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8221 T4146 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8222 T4146 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1360103298444/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty2/
[junit4:junit4] 2> 8223 T4146 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1783206b
[junit4:junit4] 2> 8223 T4146 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 8224 T4146 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty2 forceNew:false
[junit4:junit4] 2> 8225 T4146 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty2
[junit4:junit4] 2> 8225 T4146 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty2/index/
[junit4:junit4] 2> 8226 T4146 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 8227 T4146 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty2/index forceNew:false
[junit4:junit4] 2> 8232 T4146 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6be9e050),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 8233 T4146 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 8233 T4146 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty2/index
[junit4:junit4] 2> 8234 T4146 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 8236 T4146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 8236 T4146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 8237 T4146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 8237 T4146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 8238 T4146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 8238 T4146 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 8239 T4146 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 8239 T4146 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 8240 T4146 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 8241 T4146 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 8241 T4146 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 8242 T4146 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 8242 T4146 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 8243 T4146 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 8243 T4146 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 8244 T4146 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 8244 T4146 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8245 T4146 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8245 T4146 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8246 T4146 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8247 T4146 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8247 T4146 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8248 T4146 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8248 T4146 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 8249 T4146 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 8249 T4146 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 8262 T4146 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 8267 T4146 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 8268 T4146 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 8271 T4146 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty2
[junit4:junit4] 2> 8273 T4146 oass.SolrIndexSearcher.<init> Opening Searcher@c45adc6 main
[junit4:junit4] 2> 8274 T4146 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 8274 T4146 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 8275 T4146 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 8282 T4146 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 8319 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8320 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45914_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45914"}
[junit4:junit4] 2> 8330 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8330 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8330 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8330 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8337 T4147 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c45adc6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 8343 T4146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 8343 T4146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9842 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9843 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45921_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45921"}
[junit4:junit4] 2> 9843 T4112 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 9844 T4112 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 9888 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9888 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9888 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9888 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10347 T4146 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 10347 T4146 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45921 collection:collection1 shard:shard2
[junit4:junit4] 2> 10348 T4146 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 10364 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0008 type:delete cxid:0x44 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 10366 T4146 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 10366 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0008 type:create cxid:0x45 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10375 T4146 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 10375 T4146 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 10376 T4146 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45921/collection1/
[junit4:junit4] 2> 10376 T4146 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 10376 T4146 oasc.SyncStrategy.syncToMe http://127.0.0.1:45921/collection1/ has no replicas
[junit4:junit4] 2> 10377 T4146 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45921/collection1/
[junit4:junit4] 2> 10377 T4146 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 10380 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0008 type:create cxid:0x4e zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11392 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11411 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11412 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11412 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11411 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11452 T4146 oasc.ZkController.register We are http://127.0.0.1:45921/collection1/ and leader is http://127.0.0.1:45921/collection1/
[junit4:junit4] 2> 11452 T4146 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45921
[junit4:junit4] 2> 11452 T4146 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 11452 T4146 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 11453 T4146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11454 T4146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11455 T4089 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 11456 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 11457 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11638 T4089 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 11641 T4089 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45926
[junit4:junit4] 2> 11642 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 11643 T4089 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 11643 T4089 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360103303037
[junit4:junit4] 2> 11644 T4089 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360103303037/solr.xml
[junit4:junit4] 2> 11644 T4089 oasc.CoreContainer.<init> New CoreContainer 1893353221
[junit4:junit4] 2> 11645 T4089 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360103303037/'
[junit4:junit4] 2> 11645 T4089 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360103303037/'
[junit4:junit4] 2> 11702 T4089 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 11703 T4089 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 11703 T4089 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 11704 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 11704 T4089 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 11705 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 11705 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 11706 T4089 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 11706 T4089 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 11707 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 11726 T4089 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 11746 T4089 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45907/solr
[junit4:junit4] 2> 11747 T4089 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 11748 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5451636e
[junit4:junit4] 2> 11749 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11749 T4157 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 11750 T4157 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 11750 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45927
[junit4:junit4] 2> 11750 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45927
[junit4:junit4] 2> 11753 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0009 with negotiated timeout 20000 for client /140.211.11.196:45927
[junit4:junit4] 2> 11753 T4157 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0009, negotiated timeout = 20000
[junit4:junit4] 2> 11753 T4158 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5451636e name:ZooKeeperConnection Watcher:127.0.0.1:45907 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11753 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11755 T4094 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cac793abb0009
[junit4:junit4] 2> 11770 T4158 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 11770 T4091 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45927 which had sessionid 0x13cac793abb0009
[junit4:junit4] 2> 11770 T4089 oaz.ZooKeeper.close Session: 0x13cac793abb0009 closed
[junit4:junit4] 2> 11771 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 11781 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@455055a3
[junit4:junit4] 2> 11782 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11782 T4159 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 11783 T4159 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 11783 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45928
[junit4:junit4] 2> 11783 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45928
[junit4:junit4] 2> 11784 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb000a with negotiated timeout 20000 for client /140.211.11.196:45928
[junit4:junit4] 2> 11785 T4159 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb000a, negotiated timeout = 20000
[junit4:junit4] 2> 11785 T4160 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@455055a3 name:ZooKeeperConnection Watcher:127.0.0.1:45907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11785 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11786 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11788 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000a type:create cxid:0x2 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11795 T4089 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45926_
[junit4:junit4] 2> 11795 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000a type:delete cxid:0x4 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45926_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45926_
[junit4:junit4] 2> 11797 T4089 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45926_
[junit4:junit4] 2> 11799 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11799 T4145 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 11800 T4111 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 11800 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11800 T4130 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 11800 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11800 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 11801 T4117 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 11809 T4089 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 11816 T4161 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360103303037/collection1
[junit4:junit4] 2> 11816 T4161 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 11817 T4161 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 11817 T4161 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 11819 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360103303037/collection1/'
[junit4:junit4] 2> 11820 T4161 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360103303037/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 11820 T4161 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360103303037/collection1/lib/README' to classloader
[junit4:junit4] 2> 11876 T4161 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 11951 T4161 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 12052 T4161 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 12060 T4161 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 12699 T4161 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 12710 T4161 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 12714 T4161 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 12727 T4161 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12732 T4161 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12736 T4161 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12738 T4161 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12739 T4161 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1360103303037/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty3/
[junit4:junit4] 2> 12739 T4161 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1783206b
[junit4:junit4] 2> 12740 T4161 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 12740 T4161 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty3 forceNew:false
[junit4:junit4] 2> 12741 T4161 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty3
[junit4:junit4] 2> 12741 T4161 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty3/index/
[junit4:junit4] 2> 12742 T4161 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 12743 T4161 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty3/index forceNew:false
[junit4:junit4] 2> 12748 T4161 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a925c15),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 12748 T4161 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 12749 T4161 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty3/index
[junit4:junit4] 2> 12750 T4161 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 12752 T4161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 12752 T4161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 12752 T4161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 12753 T4161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 12753 T4161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 12754 T4161 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 12754 T4161 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 12755 T4161 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 12755 T4161 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 12756 T4161 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 12756 T4161 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 12757 T4161 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 12757 T4161 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 12758 T4161 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 12758 T4161 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 12759 T4161 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 12759 T4161 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12760 T4161 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12760 T4161 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12761 T4161 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12761 T4161 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12762 T4161 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12762 T4161 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12763 T4161 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12763 T4161 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 12764 T4161 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 12776 T4161 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 12780 T4161 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 12781 T4161 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 12784 T4161 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty3
[junit4:junit4] 2> 12786 T4161 oass.SolrIndexSearcher.<init> Opening Searcher@41f062b main
[junit4:junit4] 2> 12787 T4161 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 12787 T4161 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 12787 T4161 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 12794 T4161 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 12844 T4162 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@41f062b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 12849 T4161 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 12849 T4161 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12917 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12918 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45921_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45921"}
[junit4:junit4] 2> 12921 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45926_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45926"}
[junit4:junit4] 2> 12922 T4112 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 12922 T4112 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4:junit4] 2> 12933 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12933 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12933 T4160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12933 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12933 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13851 T4161 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 13851 T4161 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45926 collection:collection1 shard:shard3
[junit4:junit4] 2> 13852 T4161 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4] 2> 13868 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000a type:delete cxid:0x42 zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard3 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard3
[junit4:junit4] 2> 13869 T4161 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 13870 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000a type:create cxid:0x43 zxid:0x9f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13872 T4161 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 13872 T4161 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 13873 T4161 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45926/collection1/
[junit4:junit4] 2> 13873 T4161 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 13873 T4161 oasc.SyncStrategy.syncToMe http://127.0.0.1:45926/collection1/ has no replicas
[junit4:junit4] 2> 13873 T4161 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45926/collection1/
[junit4:junit4] 2> 13874 T4161 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4] 2> 13877 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000a type:create cxid:0x4c zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14447 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14506 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14506 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14506 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14506 T4160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14506 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14541 T4161 oasc.ZkController.register We are http://127.0.0.1:45926/collection1/ and leader is http://127.0.0.1:45926/collection1/
[junit4:junit4] 2> 14541 T4161 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45926
[junit4:junit4] 2> 14541 T4161 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 14542 T4161 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 14542 T4161 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14543 T4161 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14544 T4089 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 14545 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14546 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14727 T4089 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14730 T4089 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45929
[junit4:junit4] 2> 14731 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14732 T4089 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14732 T4089 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360103306126
[junit4:junit4] 2> 14733 T4089 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360103306126/solr.xml
[junit4:junit4] 2> 14734 T4089 oasc.CoreContainer.<init> New CoreContainer 491567217
[junit4:junit4] 2> 14734 T4089 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360103306126/'
[junit4:junit4] 2> 14735 T4089 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360103306126/'
[junit4:junit4] 2> 14791 T4089 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 14792 T4089 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14792 T4089 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14793 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14794 T4089 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14794 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14795 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14795 T4089 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14796 T4089 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14796 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14818 T4089 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14838 T4089 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45907/solr
[junit4:junit4] 2> 14839 T4089 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14839 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7c62ae70
[junit4:junit4] 2> 14840 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14841 T4172 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14841 T4172 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 14842 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45930
[junit4:junit4] 2> 14842 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45930
[junit4:junit4] 2> 14870 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb000b with negotiated timeout 20000 for client /140.211.11.196:45930
[junit4:junit4] 2> 14870 T4172 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb000b, negotiated timeout = 20000
[junit4:junit4] 2> 14871 T4173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c62ae70 name:ZooKeeperConnection Watcher:127.0.0.1:45907 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14871 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14872 T4094 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cac793abb000b
[junit4:junit4] 2> 14881 T4173 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14881 T4091 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45930 which had sessionid 0x13cac793abb000b
[junit4:junit4] 2> 14881 T4089 oaz.ZooKeeper.close Session: 0x13cac793abb000b closed
[junit4:junit4] 2> 14882 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 14893 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@386b587a
[junit4:junit4] 2> 14894 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14895 T4174 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14895 T4174 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 14896 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45931
[junit4:junit4] 2> 14896 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45931
[junit4:junit4] 2> 14897 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb000c with negotiated timeout 20000 for client /140.211.11.196:45931
[junit4:junit4] 2> 14897 T4174 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb000c, negotiated timeout = 20000
[junit4:junit4] 2> 14898 T4175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@386b587a name:ZooKeeperConnection Watcher:127.0.0.1:45907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14898 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14899 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000c type:create cxid:0x1 zxid:0xaf txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14901 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000c type:create cxid:0x2 zxid:0xb0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14902 T4089 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45929_
[junit4:junit4] 2> 14903 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000c type:delete cxid:0x4 zxid:0xb1 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45929_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45929_
[junit4:junit4] 2> 14911 T4089 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45929_
[junit4:junit4] 2> 14913 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14913 T4130 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14914 T4111 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14914 T4160 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14914 T4145 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14914 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14914 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14914 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14914 T4160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14915 T4117 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 14917 T4089 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14924 T4176 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360103306126/collection1
[junit4:junit4] 2> 14925 T4176 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14925 T4176 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14925 T4176 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14927 T4176 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360103306126/collection1/'
[junit4:junit4] 2> 14928 T4176 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360103306126/collection1/lib/README' to classloader
[junit4:junit4] 2> 14929 T4176 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360103306126/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14984 T4176 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 15080 T4176 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15181 T4176 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15189 T4176 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15837 T4176 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15850 T4176 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15854 T4176 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15867 T4176 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15872 T4176 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15877 T4176 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15878 T4176 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15879 T4176 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1360103306126/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty4/
[junit4:junit4] 2> 15880 T4176 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1783206b
[junit4:junit4] 2> 15880 T4176 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 15881 T4176 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty4 forceNew:false
[junit4:junit4] 2> 15882 T4176 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty4
[junit4:junit4] 2> 15882 T4176 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty4/index/
[junit4:junit4] 2> 15883 T4176 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15884 T4176 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty4/index forceNew:false
[junit4:junit4] 2> 15889 T4176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b31b6c2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15889 T4176 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15890 T4176 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty4/index
[junit4:junit4] 2> 15891 T4176 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 15893 T4176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15893 T4176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 15894 T4176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15894 T4176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 15895 T4176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15895 T4176 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15895 T4176 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15896 T4176 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15897 T4176 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15897 T4176 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 15898 T4176 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 15898 T4176 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15899 T4176 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 15899 T4176 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 15900 T4176 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 15900 T4176 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15901 T4176 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15902 T4176 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15902 T4176 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15903 T4176 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15903 T4176 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15904 T4176 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15904 T4176 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15905 T4176 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15906 T4176 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 15906 T4176 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 15919 T4176 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15924 T4176 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 15925 T4176 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 15928 T4176 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty4
[junit4:junit4] 2> 15929 T4176 oass.SolrIndexSearcher.<init> Opening Searcher@499ac127 main
[junit4:junit4] 2> 15930 T4176 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15931 T4176 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15931 T4176 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 15938 T4176 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 15985 T4177 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@499ac127 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15990 T4176 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15991 T4176 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16043 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16044 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45926_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45926"}
[junit4:junit4] 2> 16048 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45929_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45929"}
[junit4:junit4] 2> 16048 T4112 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 16049 T4112 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16060 T4160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16060 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16060 T4175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16060 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16060 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16060 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16993 T4176 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16993 T4176 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45929 collection:collection1 shard:shard1
[junit4:junit4] 2> 16996 T4176 oasc.ZkController.register We are http://127.0.0.1:45929/collection1/ and leader is http://127.0.0.1:45914/collection1/
[junit4:junit4] 2> 16997 T4176 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45929
[junit4:junit4] 2> 16997 T4176 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16997 T4176 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C214 name=collection1 org.apache.solr.core.SolrCore@4810ee3e url=http://127.0.0.1:45929/collection1 node=127.0.0.1:45929_ C214_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:45929_, base_url=http://127.0.0.1:45929}
[junit4:junit4] 2> 16998 T4178 C214 P45929 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16998 T4176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17000 T4178 C214 P45929 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17000 T4178 C214 P45929 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17000 T4178 C214 P45929 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17000 T4089 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 17001 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17002 T4178 C214 P45929 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17002 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17193 T4089 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 17196 T4089 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52676
[junit4:junit4] 2> 17197 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 17198 T4089 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 17198 T4089 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360103308591
[junit4:junit4] 2> 17199 T4089 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360103308591/solr.xml
[junit4:junit4] 2> 17199 T4089 oasc.CoreContainer.<init> New CoreContainer 1267772678
[junit4:junit4] 2> 17200 T4089 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360103308591/'
[junit4:junit4] 2> 17200 T4089 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360103308591/'
[junit4:junit4] 2> 17257 T4089 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 17257 T4089 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 17258 T4089 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 17258 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 17259 T4089 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 17260 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 17260 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 17261 T4089 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 17261 T4089 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 17262 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 17283 T4089 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 17303 T4089 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45907/solr
[junit4:junit4] 2> 17304 T4089 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 17305 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1306eea4
[junit4:junit4] 2> 17306 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17306 T4188 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 17307 T4188 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 17307 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:30555
[junit4:junit4] 2> 17308 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:30555
[junit4:junit4] 2> 17310 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb000d with negotiated timeout 20000 for client /140.211.11.196:30555
[junit4:junit4] 2> 17310 T4188 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb000d, negotiated timeout = 20000
[junit4:junit4] 2> 17310 T4189 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1306eea4 name:ZooKeeperConnection Watcher:127.0.0.1:45907 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17311 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17312 T4094 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cac793abb000d
[junit4:junit4] 2> 17324 T4189 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 17324 T4091 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:30555 which had sessionid 0x13cac793abb000d
[junit4:junit4] 2> 17324 T4089 oaz.ZooKeeper.close Session: 0x13cac793abb000d closed
[junit4:junit4] 2> 17325 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 17337 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3a92ab6
[junit4:junit4] 2> 17338 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17338 T4190 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 17339 T4190 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 17339 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:56643
[junit4:junit4] 2> 17339 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:56643
[junit4:junit4] 2> 17341 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb000e with negotiated timeout 20000 for client /140.211.11.196:56643
[junit4:junit4] 2> 17341 T4190 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb000e, negotiated timeout = 20000
[junit4:junit4] 2> 17341 T4191 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a92ab6 name:ZooKeeperConnection Watcher:127.0.0.1:45907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17341 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17342 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000e type:create cxid:0x1 zxid:0xc1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17344 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000e type:create cxid:0x2 zxid:0xc2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17351 T4089 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52676_
[junit4:junit4] 2> 17352 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb000e type:delete cxid:0x4 zxid:0xc3 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52676_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52676_
[junit4:junit4] 2> 17354 T4089 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52676_
[junit4:junit4] 2> 17356 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17356 T4160 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17357 T4145 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17357 T4130 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17356 T4175 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17357 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17357 T4160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17357 T4111 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17358 T4117 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 17357 T4175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17357 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17358 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17360 T4089 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17367 T4192 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360103308591/collection1
[junit4:junit4] 2> 17367 T4192 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17368 T4192 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17368 T4192 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17370 T4192 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360103308591/collection1/'
[junit4:junit4] 2> 17371 T4192 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360103308591/collection1/lib/README' to classloader
[junit4:junit4] 2> 17372 T4192 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360103308591/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17428 T4192 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 17505 T4192 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17574 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17574 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45929_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45929"}
[junit4:junit4] 2> 17590 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17590 T4160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17591 T4175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17591 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17591 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17590 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17606 T4192 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17606 T4191 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 17612 T4192 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 18269 T4192 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 18281 T4192 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 18286 T4192 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 18298 T4192 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 18304 T4192 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 18308 T4192 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 18309 T4192 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 18311 T4192 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1360103308591/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty5/
[junit4:junit4] 2> 18311 T4192 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1783206b
[junit4:junit4] 2> 18312 T4192 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 18313 T4192 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty5 forceNew:false
[junit4:junit4] 2> 18313 T4192 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty5
[junit4:junit4] 2> 18314 T4192 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty5/index/
[junit4:junit4] 2> 18314 T4192 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty5/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 18315 T4192 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty5/index forceNew:false
[junit4:junit4] 2> 18321 T4192 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty5/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e979ab7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 18321 T4192 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 18322 T4192 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty5/index
[junit4:junit4] 2> 18322 T4192 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 18325 T4192 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 18325 T4192 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 18326 T4192 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 18326 T4192 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 18327 T4192 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 18327 T4192 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 18327 T4192 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 18328 T4192 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 18329 T4192 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 18329 T4192 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 18330 T4192 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 18330 T4192 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 18331 T4192 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 18331 T4192 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 18332 T4192 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 18332 T4192 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 18333 T4192 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18334 T4192 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18334 T4192 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18335 T4192 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18335 T4192 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18336 T4192 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18336 T4192 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18337 T4192 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18338 T4192 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 18338 T4192 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 18351 T4192 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 18356 T4192 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 18357 T4192 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 18360 T4192 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1360103291572/jetty5
[junit4:junit4] 2> 18361 T4192 oass.SolrIndexSearcher.<init> Opening Searcher@4e6fcd38 main
[junit4:junit4] 2> 18362 T4192 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 18363 T4192 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 18363 T4192 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 18371 T4192 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 18421 T4193 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e6fcd38 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 18426 T4192 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 18427 T4192 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19095 T4112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19096 T4112 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52676_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52676"}
[junit4:junit4] 2> 19096 T4112 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 19096 T4112 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 19114 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19114 T4191 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19114 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19114 T4160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19114 T4175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19114 T4145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19114 T4111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19429 T4192 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 19429 T4192 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52676 collection:collection1 shard:shard2
[junit4:junit4] 2> 19433 T4192 oasc.ZkController.register We are http://127.0.0.1:52676/collection1/ and leader is http://127.0.0.1:45921/collection1/
[junit4:junit4] 2> 19433 T4192 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52676
[junit4:junit4] 2> 19433 T4192 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 19433 T4192 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C215 name=collection1 org.apache.solr.core.SolrCore@1b7e4c28 url=http://127.0.0.1:52676/collection1 node=127.0.0.1:52676_ C215_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52676_, base_url=http://127.0.0.1:52676}
[junit4:junit4] 2> 19434 T4194 C215 P52676 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 19434 T4192 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19435 T4194 C215 P52676 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 19436 T4194 C215 P52676 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 19436 T4194 C215 P52676 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19436 T4089 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 19437 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 19438 T4194 C215 P52676 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19438 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19621 T4089 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 19624 T4089 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:31031
[junit4:junit4] 2> 19625 T4089 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 19626 T4089 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 19626 T4089 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360103311020
[junit4:junit4] 2> 19627 T4089 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360103311020/solr.xml
[junit4:junit4] 2> 19627 T4089 oasc.CoreContainer.<init> New CoreContainer 509902003
[junit4:junit4] 2> 19628 T4089 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360103311020/'
[junit4:junit4] 2> 19629 T4089 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1360103311020/'
[junit4:junit4] 2> 19685 T4089 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 19686 T4089 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 19686 T4089 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 19687 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 19687 T4089 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 19688 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 19688 T4089 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 19689 T4089 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 19689 T4089 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 19690 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 19709 T4089 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 19730 T4089 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45907/solr
[junit4:junit4] 2> 19731 T4089 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 19732 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@48c5a02b
[junit4:junit4] 2> 19733 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 19734 T4204 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 19734 T4204 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 19734 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34943
[junit4:junit4] 2> 19735 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34943
[junit4:junit4] 2> 19762 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb000f with negotiated timeout 20000 for client /140.211.11.196:34943
[junit4:junit4] 2> 19762 T4204 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb000f, negotiated timeout = 20000
[junit4:junit4] 2> 19763 T4205 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48c5a02b name:ZooKeeperConnection Watcher:127.0.0.1:45907 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 19763 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 19764 T4094 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13cac793abb000f
[junit4:junit4] 2> 19765 T4205 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 19765 T4091 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34943 which had sessionid 0x13cac793abb000f
[junit4:junit4] 2> 19765 T4089 oaz.ZooKeeper.close Session: 0x13cac793abb000f closed
[junit4:junit4] 2> 19766 T4089 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 19775 T4089 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45907/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5682d37e
[junit4:junit4] 2> 19777 T4089 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 19777 T4206 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45907. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 19777 T4206 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45907, initiating session
[junit4:junit4] 2> 19778 T4091 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:62483
[junit4:junit4] 2> 19778 T4091 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:62483
[junit4:junit4] 2> 19779 T4093 oazs.ZooKeeperServer.finishSessionInit Established session 0x13cac793abb0010 with negotiated timeout 20000 for client /140.211.11.196:62483
[junit4:junit4] 2> 19779 T4206 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45907, sessionid = 0x13cac793abb0010, negotiated timeout = 20000
[junit4:junit4] 2> 19780 T4207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5682d37e name:ZooKeeperConnection Watcher:127.0.0.1:45907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 19780 T4089 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 19781 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0010 type:create cxid:0x1 zxid:0xd4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 19782 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0010 type:create cxid:0x2 zxid:0xd5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 19791 T4089 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:31031_
[junit4:junit4] 2> 19791 T4094 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13cac793abb0010 type:delete cxid:0x4 zxid:0xd6 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:31031_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:31031_
[junit4:junit4] 2> 19792 T4089 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:31031_
[junit4:junit4] 2> 19795 T4191 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19795 T4117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19796 T4130 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 19796 T4111 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 19796 T4160 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 19796 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 19796 T4145 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 19796 T4175
[...truncated too long message...]
ool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 18) Thread[id=548, name=searcherExecutor-456-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 19) Thread[id=530, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[3B2ECE55067E5F9]-SendThread(localhost:43773), state=TIMED_WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4:junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] 2> 20) Thread[id=535, name=qtp596863905-535 Acceptor0 SocketConnector@127.0.0.1:43799, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.net.PlainSocketImpl.socketAccept(Native Method)
[junit4:junit4] 2> at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
[junit4:junit4] 2> at java.net.ServerSocket.implAccept(ServerSocket.java:522)
[junit4:junit4] 2> at java.net.ServerSocket.accept(ServerSocket.java:490)
[junit4:junit4] 2> at org.eclipse.jetty.server.bio.SocketConnector.accept(SocketConnector.java:117)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 21) Thread[id=575, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[3B2ECE55067E5F9]-SendThread(localhost:43773), state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.nio.ch.IOUtil.drain(Native Method)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:167)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:108)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 22) Thread[id=550, name=HashSessionScavenger-4, state=TIMED_WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.lang.Object.wait(Native Method)
[junit4:junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4:junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4:junit4] 2> 23) Thread[id=551, name=qtp1688655239-551 Acceptor0 SocketConnector@127.0.0.1:43805, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.net.PlainSocketImpl.socketAccept(Native Method)
[junit4:junit4] 2> at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
[junit4:junit4] 2> at java.net.ServerSocket.implAccept(ServerSocket.java:522)
[junit4:junit4] 2> at java.net.ServerSocket.accept(ServerSocket.java:490)
[junit4:junit4] 2> at org.eclipse.jetty.server.bio.SocketConnector.accept(SocketConnector.java:117)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 24) Thread[id=534, name=HashSessionScavenger-3, state=TIMED_WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.lang.Object.wait(Native Method)
[junit4:junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4:junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {n_f1=PostingsFormat(name=Asserting), foo_b=PostingsFormat(name=Lucene41WithOrds), foo_d=PostingsFormat(name=MockRandom), foo_f=PostingsFormat(name=Lucene41WithOrds), n_tl1=PostingsFormat(name=Asserting), n_d1=PostingsFormat(name=SimpleText), rnd_b=PostingsFormat(name=MockRandom), intDefault=PostingsFormat(name=SimpleText), n_td1=PostingsFormat(name=Asserting), timestamp=PostingsFormat(name=SimpleText), id=PostingsFormat(name=MockRandom), range_facet_sl=PostingsFormat(name=Lucene41WithOrds), range_facet_si=PostingsFormat(name=Asserting), oddField_s=PostingsFormat(name=Lucene41WithOrds), foo_i=PostingsFormat(name=Asserting), multiDefault=PostingsFormat(name=Asserting), n_tf1=PostingsFormat(name=SimpleText), n_dt1=PostingsFormat(name=Asserting), n_ti1=PostingsFormat(name=MockRandom), range_facet_l=PostingsFormat(name=SimpleText), text=PostingsFormat(name=Lucene41WithOrds), _version_=PostingsFormat(name=SimpleText), val_i=PostingsFormat(name=MockRandom), SubjectTerms_mfacet=PostingsFormat(name=SimpleText), a_t=PostingsFormat(name=SimpleText), n_tdt1=PostingsFormat(name=SimpleText), other_tl1=PostingsFormat(name=SimpleText), n_l1=PostingsFormat(name=SimpleText), a_si=PostingsFormat(name=Asserting)}, sim=DefaultSimilarity, locale=es_PR, timezone=Europe/Samara
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=26,free=83003344,total=244318208
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestJoin, SuggesterWFSTTest, TestNumberUtils, TestXIncludeConfig, TestWordDelimiterFilterFactory, HighlighterConfigTest, UpdateRequestProcessorFactoryTest, TestZkChroot, SOLR749Test, TestCoreContainer, AnalysisAfterCoreReloadTest, TestIBSimilarityFactory, TestFuzzyAnalyzedSuggestions, ScriptEngineTest, TestPostingsSolrHighlighter, TestFastOutputStream, SpellPossibilityIteratorTest, PreAnalyzedFieldTest, TestCharFilters, TestSolr4Spatial, ChaosMonkeyNothingIsSafeTest, TestReload, FileBasedSpellCheckerTest, TestSearchPerf, WordBreakSolrSpellCheckerTest, IndexBasedSpellCheckerTest, DistanceFunctionTest, ClusterStateUpdateTest, MoreLikeThisHandlerTest, UniqFieldsUpdateProcessorFactoryTest, ExternalFileFieldSortTest, SolrCoreCheckLockOnStartupTest, SortByFunctionTest, LoggingHandlerTest, AutoCommitTest, CSVRequestHandlerTest, MinimalSchemaTest, TestSuggestSpellingConverter, JSONWriterTest, TestStressVersions, TestGroupingSearch, TestCollationField, SolrPluginUtilsTest, DefaultValueUpdateProcessorTest, TestExtendedDismaxParser, TestElisionMultitermQuery, TestDefaultSimilarityFactory, TestFiltering, TestPerFieldSimilarity, SolrRequestParserTest, TestFaceting, TestIndexingPerformance, SpatialFilterTest, TestSystemIdResolver, TestDocumentBuilder, NotRequiredUniqueKeyTest, SpellCheckCollatorTest, TestLMJelinekMercerSimilarityFactory, BasicDistributedZkTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZkTest -Dtests.seed=3B2ECE55067E5F9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_PR -Dtests.timezone=Europe/Samara -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 0.00s J0 | BasicDistributedZkTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([3B2ECE55067E5F9]:0)
[junit4:junit4] Completed on J0 in 7223.55s, 1 test, 2 errors <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:432: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:841: There were test failures: 249 suites, 1038 tests, 3 suite-level errors, 1 error, 78 ignored (4 assumptions)
Total time: 148 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3710 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3710/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([B5C653350651FA91]:0)
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([B5C653350651FA91]:0)
Build Log:
[...truncated 9523 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4] 2> 0 T397 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /s
[junit4:junit4] 2> 5 T397 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1360067984389
[junit4:junit4] 2> 7 T397 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 7 T398 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 10 T398 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 10 T398 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 10 T398 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 11 T398 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 12 T398 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 108 T397 oasc.ZkTestServer.run start zk server on port:40554
[junit4:junit4] 2> 108 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@59a6a49
[junit4:junit4] 2> 109 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 109 T403 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 110 T403 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 110 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28395
[junit4:junit4] 2> 111 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28395
[junit4:junit4] 2> 111 T401 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 114 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b0000 with negotiated timeout 10000 for client /140.211.11.196:28395
[junit4:junit4] 2> 114 T403 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b0000, negotiated timeout = 10000
[junit4:junit4] 2> 115 T404 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59a6a49 name:ZooKeeperConnection Watcher:127.0.0.1:40554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 115 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 115 T397 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 135 T402 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13caa5e7c0b0000
[junit4:junit4] 2> 136 T404 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 136 T397 oaz.ZooKeeper.close Session: 0x13caa5e7c0b0000 closed
[junit4:junit4] 2> 136 T399 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28395 which had sessionid 0x13caa5e7c0b0000
[junit4:junit4] 2> 137 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@14ca1ff7
[junit4:junit4] 2> 138 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 138 T405 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 138 T405 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 139 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58493
[junit4:junit4] 2> 139 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58493
[junit4:junit4] 2> 141 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b0001 with negotiated timeout 10000 for client /140.211.11.196:58493
[junit4:junit4] 2> 141 T405 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b0001, negotiated timeout = 10000
[junit4:junit4] 2> 141 T406 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14ca1ff7 name:ZooKeeperConnection Watcher:127.0.0.1:40554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 141 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 142 T397 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 147 T397 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 151 T397 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 159 T397 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 164 T397 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 165 T397 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 178 T397 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 179 T397 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 285 T397 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 285 T397 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 290 T397 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 291 T397 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 295 T397 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 296 T397 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 301 T397 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 301 T397 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 307 T397 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 308 T397 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 312 T397 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 313 T397 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 318 T397 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 318 T397 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 323 T402 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13caa5e7c0b0001
[junit4:junit4] 2> 324 T406 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 324 T397 oaz.ZooKeeper.close Session: 0x13caa5e7c0b0001 closed
[junit4:junit4] 2> 324 T399 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:58493 which had sessionid 0x13caa5e7c0b0001
[junit4:junit4] 2> 1077 T397 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 1311 T397 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:15496
[junit4:junit4] 2> 1348 T397 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1348 T397 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1348 T397 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360067984708
[junit4:junit4] 2> 1349 T397 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360067984708/solr.xml
[junit4:junit4] 2> 1349 T397 oasc.CoreContainer.<init> New CoreContainer 1334230517
[junit4:junit4] 2> 1350 T397 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360067984708/'
[junit4:junit4] 2> 1350 T397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360067984708/'
[junit4:junit4] 2> 1387 T397 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 1387 T397 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1387 T397 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1388 T397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1388 T397 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1388 T397 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1389 T397 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1389 T397 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1389 T397 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1390 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1407 T397 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 1422 T397 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40554/solr
[junit4:junit4] 2> 1422 T397 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1423 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7b420664
[junit4:junit4] 2> 1436 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1437 T417 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1438 T417 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 1439 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64157
[junit4:junit4] 2> 1439 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64157
[junit4:junit4] 2> 1440 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b0002 with negotiated timeout 20000 for client /140.211.11.196:64157
[junit4:junit4] 2> 1440 T417 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b0002, negotiated timeout = 20000
[junit4:junit4] 2> 1441 T418 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b420664 name:ZooKeeperConnection Watcher:127.0.0.1:40554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1441 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1442 T402 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13caa5e7c0b0002
[junit4:junit4] 2> 1443 T399 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:64157 which had sessionid 0x13caa5e7c0b0002
[junit4:junit4] 2> 1443 T418 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1443 T397 oaz.ZooKeeper.close Session: 0x13caa5e7c0b0002 closed
[junit4:junit4] 2> 1444 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 1454 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@78ffa42a
[junit4:junit4] 2> 1454 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1455 T419 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1455 T419 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 1455 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:13674
[junit4:junit4] 2> 1456 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:13674
[junit4:junit4] 2> 1457 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b0003 with negotiated timeout 20000 for client /140.211.11.196:13674
[junit4:junit4] 2> 1457 T419 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b0003, negotiated timeout = 20000
[junit4:junit4] 2> 1458 T420 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78ffa42a name:ZooKeeperConnection Watcher:127.0.0.1:40554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1458 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1460 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1467 T397 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1470 T397 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:15496_s
[junit4:junit4] 2> 1471 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:15496_s Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:15496_s
[junit4:junit4] 2> 1472 T397 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:15496_s
[junit4:junit4] 2> 1476 T397 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1492 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 1493 T397 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1496 T397 oasc.Overseer.start Overseer (id=89133415425310723-127.0.0.1:15496_s-n_0000000000) starting
[junit4:junit4] 2> 1497 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1503 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1504 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1511 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1512 T422 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1513 T397 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1516 T397 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1522 T423 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360067984708/collection1
[junit4:junit4] 2> 1522 T421 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1522 T423 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1523 T423 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1523 T423 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1525 T423 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360067984708/collection1/'
[junit4:junit4] 2> 1526 T423 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360067984708/collection1/lib/README' to classloader
[junit4:junit4] 2> 1527 T423 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360067984708/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1580 T423 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1651 T423 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1752 T423 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1758 T423 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 2394 T423 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2407 T423 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2411 T423 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2436 T423 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2441 T423 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2447 T423 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2449 T423 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2450 T423 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360067984708/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data/
[junit4:junit4] 2> 2451 T423 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ad875c
[junit4:junit4] 2> 2452 T423 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 2489 T423 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data forceNew:false
[junit4:junit4] 2> 2490 T423 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data
[junit4:junit4] 2> 2490 T423 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data/index/
[junit4:junit4] 2> 2491 T423 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2492 T423 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data/index forceNew:false
[junit4:junit4] 2> 2498 T423 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19bc3c3c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 2499 T423 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 2500 T423 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data/index
[junit4:junit4] 2> 2500 T423 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 2502 T423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2503 T423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 2503 T423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2503 T423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 2504 T423 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2504 T423 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2505 T423 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2505 T423 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2506 T423 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2506 T423 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 2507 T423 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 2507 T423 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2508 T423 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 2508 T423 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 2508 T423 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 2509 T423 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2509 T423 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2510 T423 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2510 T423 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2511 T423 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2511 T423 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2512 T423 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2512 T423 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2513 T423 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2513 T423 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 2514 T423 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 2527 T423 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2531 T423 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 2533 T423 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 2535 T423 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data
[junit4:junit4] 2> 2537 T423 oass.SolrIndexSearcher.<init> Opening Searcher@c914bfb main
[junit4:junit4] 2> 2538 T423 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2539 T423 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2539 T423 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 2558 T423 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 2614 T424 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c914bfb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2620 T423 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2620 T423 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2621 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 3028 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3029 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:15496_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:15496/s"}
[junit4:junit4] 2> 3029 T421 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 3034 T421 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 3035 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 3054 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3634 T423 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 3634 T423 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:15496/s collection:control_collection shard:shard1
[junit4:junit4] 2> 3635 T423 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 3659 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 3660 T423 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 3661 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3671 T423 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 3672 T423 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 3672 T423 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:15496/s/collection1/
[junit4:junit4] 2> 3672 T423 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 3673 T423 oasc.SyncStrategy.syncToMe http://127.0.0.1:15496/s/collection1/ has no replicas
[junit4:junit4] 2> 3673 T423 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:15496/s/collection1/
[junit4:junit4] 2> 3673 T423 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 3680 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4565 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4614 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4657 T423 oasc.ZkController.register We are http://127.0.0.1:15496/s/collection1/ and leader is http://127.0.0.1:15496/s/collection1/
[junit4:junit4] 2> 4657 T423 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:15496/s
[junit4:junit4] 2> 4657 T423 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 4657 T423 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 4658 T423 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 4661 T423 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4662 T397 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 4663 T397 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4736 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4763 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 4779 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@18755efe
[junit4:junit4] 2> 4781 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4781 T425 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4781 T425 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 4782 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:21448
[junit4:junit4] 2> 4782 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:21448
[junit4:junit4] 2> 4809 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b0004 with negotiated timeout 10000 for client /140.211.11.196:21448
[junit4:junit4] 2> 4810 T425 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b0004, negotiated timeout = 10000
[junit4:junit4] 2> 4810 T426 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18755efe name:ZooKeeperConnection Watcher:127.0.0.1:40554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4810 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4812 T397 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4817 T397 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4988 T397 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4991 T397 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:11927
[junit4:junit4] 2> 4992 T397 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4993 T397 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4993 T397 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360067989200
[junit4:junit4] 2> 4994 T397 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360067989200/solr.xml
[junit4:junit4] 2> 4994 T397 oasc.CoreContainer.<init> New CoreContainer 1566760852
[junit4:junit4] 2> 4995 T397 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360067989200/'
[junit4:junit4] 2> 4995 T397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360067989200/'
[junit4:junit4] 2> 5051 T397 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 5051 T397 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 5052 T397 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 5052 T397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 5053 T397 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 5053 T397 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 5053 T397 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 5054 T397 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 5054 T397 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 5055 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 5077 T397 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 5096 T397 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40554/solr
[junit4:junit4] 2> 5096 T397 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 5097 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@64bd76f4
[junit4:junit4] 2> 5098 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5098 T436 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5099 T436 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 5099 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:13340
[junit4:junit4] 2> 5100 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:13340
[junit4:junit4] 2> 5102 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b0005 with negotiated timeout 20000 for client /140.211.11.196:13340
[junit4:junit4] 2> 5102 T436 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b0005, negotiated timeout = 20000
[junit4:junit4] 2> 5102 T437 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64bd76f4 name:ZooKeeperConnection Watcher:127.0.0.1:40554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5102 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5104 T402 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13caa5e7c0b0005
[junit4:junit4] 2> 5113 T437 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 5113 T399 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:13340 which had sessionid 0x13caa5e7c0b0005
[junit4:junit4] 2> 5113 T397 oaz.ZooKeeper.close Session: 0x13caa5e7c0b0005 closed
[junit4:junit4] 2> 5114 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 5126 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7b4afbd3
[junit4:junit4] 2> 5127 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5127 T438 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5128 T438 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 5128 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27291
[junit4:junit4] 2> 5128 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27291
[junit4:junit4] 2> 5129 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b0006 with negotiated timeout 20000 for client /140.211.11.196:27291
[junit4:junit4] 2> 5130 T438 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b0006, negotiated timeout = 20000
[junit4:junit4] 2> 5130 T439 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b4afbd3 name:ZooKeeperConnection Watcher:127.0.0.1:40554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5130 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5131 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5133 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5141 T397 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11927_s
[junit4:junit4] 2> 5141 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:11927_s Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:11927_s
[junit4:junit4] 2> 5143 T397 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:11927_s
[junit4:junit4] 2> 5146 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5147 T426 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5149 T420 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5152 T397 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5161 T440 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360067989200/collection1
[junit4:junit4] 2> 5161 T440 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5162 T440 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5162 T440 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5164 T440 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360067989200/collection1/'
[junit4:junit4] 2> 5165 T440 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360067989200/collection1/lib/README' to classloader
[junit4:junit4] 2> 5166 T440 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360067989200/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5230 T440 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5302 T440 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5403 T440 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5409 T440 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6050 T440 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6062 T440 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6066 T440 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6089 T440 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6095 T440 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6101 T440 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6103 T440 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6105 T440 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360067989200/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1/
[junit4:junit4] 2> 6105 T440 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ad875c
[junit4:junit4] 2> 6106 T440 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 6106 T440 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1 forceNew:false
[junit4:junit4] 2> 6107 T440 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1
[junit4:junit4] 2> 6107 T440 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1/index/
[junit4:junit4] 2> 6108 T440 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6109 T440 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1/index forceNew:false
[junit4:junit4] 2> 6115 T440 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@59ce2c7; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6116 T440 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6117 T440 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1/index
[junit4:junit4] 2> 6117 T440 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 6120 T440 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6120 T440 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 6120 T440 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6121 T440 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 6121 T440 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6122 T440 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6122 T440 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6123 T440 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6123 T440 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6124 T440 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 6125 T440 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 6125 T440 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6126 T440 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 6126 T440 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 6126 T440 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 6127 T440 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6128 T440 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6128 T440 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6128 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6129 T440 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6129 T440 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6130 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:15496_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:15496/s"}
[junit4:junit4] 2> 6130 T440 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6131 T440 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6132 T440 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6132 T440 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6133 T440 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 6133 T440 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 6136 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6136 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6136 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6147 T440 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6152 T440 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 6154 T440 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 6156 T440 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1
[junit4:junit4] 2> 6158 T440 oass.SolrIndexSearcher.<init> Opening Searcher@268dc656 main
[junit4:junit4] 2> 6159 T440 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6159 T440 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6160 T440 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 6168 T440 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 6224 T441 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@268dc656 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6230 T440 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6231 T440 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7644 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7645 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:11927_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11927/s"}
[junit4:junit4] 2> 7645 T421 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 7646 T421 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 7652 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7652 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7652 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8235 T440 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 8235 T440 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:11927/s collection:collection1 shard:shard1
[junit4:junit4] 2> 8236 T440 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 8300 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0006 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 8332 T440 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 8333 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0006 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8336 T440 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 8336 T440 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 8336 T440 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:11927/s/collection1/
[junit4:junit4] 2> 8336 T440 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 8337 T440 oasc.SyncStrategy.syncToMe http://127.0.0.1:11927/s/collection1/ has no replicas
[junit4:junit4] 2> 8337 T440 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:11927/s/collection1/
[junit4:junit4] 2> 8337 T440 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 8343 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0006 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9171 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9237 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9237 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9237 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9264 T440 oasc.ZkController.register We are http://127.0.0.1:11927/s/collection1/ and leader is http://127.0.0.1:11927/s/collection1/
[junit4:junit4] 2> 9264 T440 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:11927/s
[junit4:junit4] 2> 9264 T440 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 9265 T440 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 9265 T440 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9268 T440 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9269 T397 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 9270 T397 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 9270 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 9457 T397 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 9460 T397 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:16649
[junit4:junit4] 2> 9461 T397 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 9461 T397 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 9462 T397 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360067993669
[junit4:junit4] 2> 9462 T397 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360067993669/solr.xml
[junit4:junit4] 2> 9463 T397 oasc.CoreContainer.<init> New CoreContainer 1968406234
[junit4:junit4] 2> 9463 T397 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360067993669/'
[junit4:junit4] 2> 9464 T397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360067993669/'
[junit4:junit4] 2> 9519 T397 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 9520 T397 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 9520 T397 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 9521 T397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 9521 T397 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 9522 T397 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 9522 T397 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 9523 T397 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 9523 T397 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 9524 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 9547 T397 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 9566 T397 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40554/solr
[junit4:junit4] 2> 9567 T397 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 9567 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d3ffe7f
[junit4:junit4] 2> 9568 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 9569 T451 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 9570 T451 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 9570 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:41751
[junit4:junit4] 2> 9570 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:41751
[junit4:junit4] 2> 9572 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b0007 with negotiated timeout 20000 for client /140.211.11.196:41751
[junit4:junit4] 2> 9572 T451 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b0007, negotiated timeout = 20000
[junit4:junit4] 2> 9573 T452 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d3ffe7f name:ZooKeeperConnection Watcher:127.0.0.1:40554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 9573 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 9575 T402 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13caa5e7c0b0007
[junit4:junit4] 2> 9586 T452 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 9586 T399 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:41751 which had sessionid 0x13caa5e7c0b0007
[junit4:junit4] 2> 9586 T397 oaz.ZooKeeper.close Session: 0x13caa5e7c0b0007 closed
[junit4:junit4] 2> 9587 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 9601 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6e255b2c
[junit4:junit4] 2> 9602 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 9603 T453 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 9603 T453 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 9603 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:13517
[junit4:junit4] 2> 9604 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:13517
[junit4:junit4] 2> 9607 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b0008 with negotiated timeout 20000 for client /140.211.11.196:13517
[junit4:junit4] 2> 9607 T453 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b0008, negotiated timeout = 20000
[junit4:junit4] 2> 9607 T454 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e255b2c name:ZooKeeperConnection Watcher:127.0.0.1:40554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 9607 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 9609 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9611 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9613 T397 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:16649_s
[junit4:junit4] 2> 9615 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0008 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:16649_s Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:16649_s
[junit4:junit4] 2> 9616 T397 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:16649_s
[junit4:junit4] 2> 9619 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9619 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9620 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9622 T420 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9622 T439 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9622 T426 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9630 T397 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9638 T455 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360067993669/collection1
[junit4:junit4] 2> 9638 T455 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9639 T455 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9639 T455 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9641 T455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360067993669/collection1/'
[junit4:junit4] 2> 9643 T455 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360067993669/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9643 T455 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360067993669/collection1/lib/README' to classloader
[junit4:junit4] 2> 9707 T455 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 9779 T455 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9880 T455 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9886 T455 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10530 T455 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10542 T455 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10546 T455 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10571 T455 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10577 T455 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10583 T455 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10585 T455 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10587 T455 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360067993669/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2/
[junit4:junit4] 2> 10587 T455 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ad875c
[junit4:junit4] 2> 10588 T455 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 10589 T455 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2 forceNew:false
[junit4:junit4] 2> 10589 T455 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2
[junit4:junit4] 2> 10590 T455 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2/index/
[junit4:junit4] 2> 10590 T455 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10591 T455 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2/index forceNew:false
[junit4:junit4] 2> 10598 T455 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6756223f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10598 T455 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10599 T455 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2/index
[junit4:junit4] 2> 10600 T455 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 10602 T455 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10602 T455 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 10603 T455 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10603 T455 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 10604 T455 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10604 T455 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10605 T455 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10605 T455 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10606 T455 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10607 T455 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 10607 T455 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 10608 T455 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10608 T455 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 10609 T455 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 10609 T455 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 10610 T455 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10610 T455 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10611 T455 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10611 T455 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10612 T455 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10613 T455 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10613 T455 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10614 T455 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10614 T455 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10615 T455 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 10616 T455 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 10628 T455 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10632 T455 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 10634 T455 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 10636 T455 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2
[junit4:junit4] 2> 10638 T455 oass.SolrIndexSearcher.<init> Opening Searcher@313de952 main
[junit4:junit4] 2> 10639 T455 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10639 T455 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10640 T455 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 10647 T455 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 10700 T456 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@313de952 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10706 T455 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10706 T455 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10752 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10753 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:11927_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11927/s"}
[junit4:junit4] 2> 10759 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:16649_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:16649/s"}
[junit4:junit4] 2> 10759 T421 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 10759 T421 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 10771 T454 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10771 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10771 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10771 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11710 T455 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11710 T455 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:16649/s collection:collection1 shard:shard2
[junit4:junit4] 2> 11711 T455 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 11728 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0008 type:delete cxid:0x42 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 11729 T455 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11730 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0008 type:create cxid:0x43 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11740 T455 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11741 T455 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11741 T455 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:16649/s/collection1/
[junit4:junit4] 2> 11741 T455 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11741 T455 oasc.SyncStrategy.syncToMe http://127.0.0.1:16649/s/collection1/ has no replicas
[junit4:junit4] 2> 11742 T455 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:16649/s/collection1/
[junit4:junit4] 2> 11742 T455 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 11747 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b0008 type:create cxid:0x4c zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12286 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12306 T454 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12306 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12306 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12306 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12311 T455 oasc.ZkController.register We are http://127.0.0.1:16649/s/collection1/ and leader is http://127.0.0.1:16649/s/collection1/
[junit4:junit4] 2> 12311 T455 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:16649/s
[junit4:junit4] 2> 12311 T455 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 12311 T455 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 12312 T455 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12316 T455 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12318 T397 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 12319 T397 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12319 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12510 T397 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12513 T397 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:21808
[junit4:junit4] 2> 12514 T397 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12514 T397 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12515 T397 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360067996721
[junit4:junit4] 2> 12515 T397 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360067996721/solr.xml
[junit4:junit4] 2> 12516 T397 oasc.CoreContainer.<init> New CoreContainer 1999324040
[junit4:junit4] 2> 12517 T397 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360067996721/'
[junit4:junit4] 2> 12517 T397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360067996721/'
[junit4:junit4] 2> 12573 T397 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 12574 T397 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12574 T397 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12575 T397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12575 T397 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12576 T397 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12576 T397 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12577 T397 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12577 T397 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12577 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12599 T397 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12619 T397 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40554/solr
[junit4:junit4] 2> 12619 T397 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12620 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@60cfddc8
[junit4:junit4] 2> 12621 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12622 T466 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12623 T466 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 12623 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:35024
[junit4:junit4] 2> 12623 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:35024
[junit4:junit4] 2> 12626 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b0009 with negotiated timeout 20000 for client /140.211.11.196:35024
[junit4:junit4] 2> 12626 T466 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b0009, negotiated timeout = 20000
[junit4:junit4] 2> 12626 T467 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60cfddc8 name:ZooKeeperConnection Watcher:127.0.0.1:40554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12626 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12628 T402 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13caa5e7c0b0009
[junit4:junit4] 2> 12640 T467 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12640 T399 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:35024 which had sessionid 0x13caa5e7c0b0009
[junit4:junit4] 2> 12640 T397 oaz.ZooKeeper.close Session: 0x13caa5e7c0b0009 closed
[junit4:junit4] 2> 12641 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 12652 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7df4b72f
[junit4:junit4] 2> 12654 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12654 T468 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12654 T468 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 12655 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:63107
[junit4:junit4] 2> 12655 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:63107
[junit4:junit4] 2> 12657 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b000a with negotiated timeout 20000 for client /140.211.11.196:63107
[junit4:junit4] 2> 12657 T468 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b000a, negotiated timeout = 20000
[junit4:junit4] 2> 12657 T469 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7df4b72f name:ZooKeeperConnection Watcher:127.0.0.1:40554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12657 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12658 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12660 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b000a type:create cxid:0x2 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12663 T397 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:21808_s
[junit4:junit4] 2> 12664 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b000a type:delete cxid:0x4 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:21808_s Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:21808_s
[junit4:junit4] 2> 12671 T397 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:21808_s
[junit4:junit4] 2> 12674 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12674 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12674 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12675 T454 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12676 T454 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12677 T426 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12677 T439 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12677 T420 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12680 T397 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 12688 T470 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360067996721/collection1
[junit4:junit4] 2> 12689 T470 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 12690 T470 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 12690 T470 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 12692 T470 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360067996721/collection1/'
[junit4:junit4] 2> 12693 T470 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360067996721/collection1/lib/README' to classloader
[junit4:junit4] 2> 12694 T470 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360067996721/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 12758 T470 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 12831 T470 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 12932 T470 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 12938 T470 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13600 T470 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 13612 T470 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 13616 T470 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 13637 T470 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13643 T470 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13648 T470 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13650 T470 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13651 T470 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360067996721/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/
[junit4:junit4] 2> 13652 T470 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ad875c
[junit4:junit4] 2> 13652 T470 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 13653 T470 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3 forceNew:false
[junit4:junit4] 2> 13654 T470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3
[junit4:junit4] 2> 13654 T470 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index/
[junit4:junit4] 2> 13655 T470 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 13655 T470 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index forceNew:false
[junit4:junit4] 2> 13662 T470 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@20a0faaf; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13662 T470 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13663 T470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index
[junit4:junit4] 2> 13664 T470 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 13666 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 13666 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 13667 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 13667 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 13668 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 13668 T470 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 13668 T470 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 13669 T470 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 13670 T470 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 13670 T470 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 13671 T470 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 13671 T470 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 13672 T470 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 13672 T470 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 13673 T470 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 13673 T470 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 13674 T470 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13674 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13675 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13675 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13676 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13677 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13677 T470 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13678 T470 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 13678 T470 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 13679 T470 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 13691 T470 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 13695 T470 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 13697 T470 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 13699 T470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3
[junit4:junit4] 2> 13701 T470 oass.SolrIndexSearcher.<init> Opening Searcher@3246246f main
[junit4:junit4] 2> 13702 T470 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 13702 T470 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 13703 T470 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 13710 T470 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 13767 T471 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3246246f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 13773 T470 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 13773 T470 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13823 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13824 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:16649_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:16649/s"}
[junit4:junit4] 2> 13844 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:21808_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:21808/s"}
[junit4:junit4] 2> 13844 T421 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 13844 T421 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 13856 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13856 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13856 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13856 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13856 T454 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14776 T470 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 14776 T470 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:21808/s collection:collection1 shard:shard1
[junit4:junit4] 2> 14785 T470 oasc.ZkController.register We are http://127.0.0.1:21808/s/collection1/ and leader is http://127.0.0.1:11927/s/collection1/
[junit4:junit4] 2> 14786 T470 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:21808/s
[junit4:junit4] 2> 14786 T470 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 14786 T470 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C87 name=collection1 org.apache.solr.core.SolrCore@33344bc url=http://127.0.0.1:21808/s/collection1 node=127.0.0.1:21808_s C87_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:21808_s, base_url=http://127.0.0.1:21808/s}
[junit4:junit4] 2> 14793 T472 C87 P21808 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 14794 T470 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14794 T472 C87 P21808 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 14795 T472 C87 P21808 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 14795 T472 C87 P21808 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14795 T397 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 14796 T397 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14797 T472 C87 P21808 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14797 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15044 T397 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 15047 T397 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37523
[junit4:junit4] 2> 15048 T397 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 15049 T397 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 15049 T397 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360067999203
[junit4:junit4] 2> 15049 T397 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360067999203/solr.xml
[junit4:junit4] 2> 15050 T397 oasc.CoreContainer.<init> New CoreContainer 633908158
[junit4:junit4] 2> 15051 T397 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360067999203/'
[junit4:junit4] 2> 15051 T397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360067999203/'
[junit4:junit4] 2> 15131 T397 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 15132 T397 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 15132 T397 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 15133 T397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 15133 T397 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 15134 T397 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 15134 T397 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 15135 T397 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 15135 T397 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 15136 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 15161 T397 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 15196 T397 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:40554/solr
[junit4:junit4] 2> 15196 T397 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 15197 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7361b79f
[junit4:junit4] 2> 15198 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 15199 T482 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 15200 T482 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 15200 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45488
[junit4:junit4] 2> 15200 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45488
[junit4:junit4] 2> 15202 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b000b with negotiated timeout 20000 for client /140.211.11.196:45488
[junit4:junit4] 2> 15202 T482 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b000b, negotiated timeout = 20000
[junit4:junit4] 2> 15203 T483 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7361b79f name:ZooKeeperConnection Watcher:127.0.0.1:40554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 15203 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 15205 T402 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13caa5e7c0b000b
[junit4:junit4] 2> 15221 T483 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 15221 T399 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45488 which had sessionid 0x13caa5e7c0b000b
[junit4:junit4] 2> 15221 T397 oaz.ZooKeeper.close Session: 0x13caa5e7c0b000b closed
[junit4:junit4] 2> 15222 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 15235 T397 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:40554/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@38ade9c4
[junit4:junit4] 2> 15236 T397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 15236 T484 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:40554. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 15237 T484 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:40554, initiating session
[junit4:junit4] 2> 15237 T399 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:38068
[junit4:junit4] 2> 15238 T399 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:38068
[junit4:junit4] 2> 15239 T401 oazs.ZooKeeperServer.finishSessionInit Established session 0x13caa5e7c0b000c with negotiated timeout 20000 for client /140.211.11.196:38068
[junit4:junit4] 2> 15239 T484 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:40554, sessionid = 0x13caa5e7c0b000c, negotiated timeout = 20000
[junit4:junit4] 2> 15239 T485 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38ade9c4 name:ZooKeeperConnection Watcher:127.0.0.1:40554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 15240 T397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 15241 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b000c type:create cxid:0x1 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 15243 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b000c type:create cxid:0x2 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 15250 T397 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37523_s
[junit4:junit4] 2> 15251 T402 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13caa5e7c0b000c type:delete cxid:0x4 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37523_s Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37523_s
[junit4:junit4] 2> 15252 T397 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37523_s
[junit4:junit4] 2> 15256 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15256 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15256 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15256 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15257 T454 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15257 T454 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15260 T439 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15260 T469 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15260 T420 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15260 T426 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15263 T397 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 15272 T486 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360067999203/collection1
[junit4:junit4] 2> 15272 T486 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 15273 T486 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15273 T486 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 15275 T486 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360067999203/collection1/'
[junit4:junit4] 2> 15277 T486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360067999203/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 15277 T486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360067999203/collection1/lib/README' to classloader
[junit4:junit4] 2> 15371 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15372 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:21808_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:21808/s"}
[junit4:junit4] 2> 15382 T486 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 15385 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15385 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15386 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15386 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15385 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15385 T454 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15465 T486 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15566 T486 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15590 T486 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 16358 T486 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 16369 T486 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 16373 T486 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 16391 T486 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16407 T486 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16411 T486 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16413 T486 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16415 T486 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360067999203/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/
[junit4:junit4] 2> 16415 T486 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ad875c
[junit4:junit4] 2> 16416 T486 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 16416 T486 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4 forceNew:false
[junit4:junit4] 2> 16417 T486 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4
[junit4:junit4] 2> 16417 T486 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index/
[junit4:junit4] 2> 16418 T486 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 16419 T486 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index forceNew:false
[junit4:junit4] 2> 16425 T486 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@37035dff; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 16425 T486 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 16426 T486 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index
[junit4:junit4] 2> 16426 T486 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 16429 T486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 16429 T486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 16429 T486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 16430 T486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 16430 T486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 16430 T486 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 16431 T486 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 16431 T486 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 16432 T486 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 16433 T486 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 16433 T486 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 16434 T486 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 16434 T486 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 16434 T486 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 16435 T486 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 16435 T486 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 16436 T486 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16437 T486 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16437 T486 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16438 T486 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16438 T486 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16439 T486 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16439 T486 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16440 T486 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16440 T486 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 16441 T486 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 16453 T486 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 16457 T486 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 16459 T486 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 16461 T486 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4
[junit4:junit4] 2> 16463 T486 oass.SolrIndexSearcher.<init> Opening Searcher@ff577 main
[junit4:junit4] 2> 16464 T486 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 16464 T486 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 16464 T486 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 16472 T486 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 16524 T487 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ff577 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 16531 T486 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 16531 T486 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16893 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16894 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:37523_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:37523/s"}
[junit4:junit4] 2> 16894 T421 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 16895 T421 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 16910 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16910 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16910 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16910 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16910 T454 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16910 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17534 T486 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 17534 T486 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37523/s collection:collection1 shard:shard2
[junit4:junit4] 2> 17539 T486 oasc.ZkController.register We are http://127.0.0.1:37523/s/collection1/ and leader is http://127.0.0.1:16649/s/collection1/
[junit4:junit4] 2> 17539 T486 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37523/s
[junit4:junit4] 2> 17539 T486 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 17539 T486 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C88 name=collection1 org.apache.solr.core.SolrCore@1fd097d9 url=http://127.0.0.1:37523/s/collection1 node=127.0.0.1:37523_s C88_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:37523_s, base_url=http://127.0.0.1:37523/s}
[junit4:junit4] 2> 17540 T488 C88 P37523 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 17540 T486 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17541 T488 C88 P37523 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17541 T488 C88 P37523 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17542 T488 C88 P37523 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17542 T397 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 17542 T397 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17543 T397 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17550 T488 C88 P37523 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17562 T397 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17564 T397 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 17565 T397 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C87_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:21808_s, base_url=http://127.0.0.1:21808/s}
[junit4:junit4] 2> 18336 T472 C87 P21808 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:11927/s/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 18346 T472 C87 P21808 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 18364 T472 C87 P21808 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:21808/s START replicas=[http://127.0.0.1:11927/s/collection1/] nUpdates=100
[junit4:junit4] 2> 18375 T472 C87 P21808 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 18376 T472 C87 P21808 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 18376 T472 C87 P21808 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 18376 T472 C87 P21808 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 18376 T472 C87 P21808 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 18376 T472 C87 P21808 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:11927/s/collection1/. core=collection1
[junit4:junit4] 2> 18377 T472 C87 P21808 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18416 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18417 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:37523_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:37523/s"}
[junit4:junit4] 2> ASYNC NEW_CORE C89 name=collection1 org.apache.solr.core.SolrCore@22c8af6b url=http://127.0.0.1:11927/s/collection1 node=127.0.0.1:11927_s C89_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:11927_s, base_url=http://127.0.0.1:11927/s, leader=true}
[junit4:junit4] 2> 18431 T430 C89 P11927 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=7
[junit4:junit4] 2> 18436 T454 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18436 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18436 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18436 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18436 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18436 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18449 T431 C89 P11927 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 18450 T431 C89 P11927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1
[junit4:junit4] 2> 18454 T431 C89 P11927 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@59ce2c7; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 18455 T431 C89 P11927 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 18459 T431 C89 P11927 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@59ce2c7; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@59ce2c7; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 18460 T431 C89 P11927 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 18461 T431 C89 P11927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1
[junit4:junit4] 2> 18461 T431 C89 P11927 oass.SolrIndexSearcher.<init> Opening Searcher@2514265a realtime
[junit4:junit4] 2> 18462 T431 C89 P11927 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18462 T431 C89 P11927 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 38
[junit4:junit4] 2> 18521 T472 C87 P21808 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18522 T472 C87 P21808 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 18548 T472 C87 P21808 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 18568 T397 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18606 T432 C89 P11927 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18607 T432 C89 P11927 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=57
[junit4:junit4] 2> 18608 T472 C87 P21808 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 18609 T472 C87 P21808 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 18609 T472 C87 P21808 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 18612 T432 C89 P11927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1
[junit4:junit4] 2> 18613 T432 C89 P11927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1/index
[junit4:junit4] 2> 18614 T432 C89 P11927 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 18615 T472 C87 P21808 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 18616 T472 C87 P21808 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index.20130205144002998 forceNew:false
[junit4:junit4] 2> 18617 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3
[junit4:junit4] 2> 18618 T472 C87 P21808 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index.20130205144002998 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19464a92; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 18631 T432 C89 P11927 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=4
[junit4:junit4] 2> 18645 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index
[junit4:junit4] 2> 18646 T472 C87 P21808 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 18650 T472 C87 P21808 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130205144002998
[junit4:junit4] 2> 18651 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3
[junit4:junit4] 2> 18652 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3
[junit4:junit4] 2> 18653 T472 C87 P21808 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index.20130205144002998
[junit4:junit4] 2> 18657 T472 C87 P21808 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index.20130205144002998 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19464a92; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 18658 T472 C87 P21808 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 18660 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3
[junit4:junit4] 2> 18665 T472 C87 P21808 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 18665 T472 C87 P21808 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 18665 T472 C87 P21808 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 18667 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index.20130205144002998
[junit4:junit4] 2> 18668 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3
[junit4:junit4] 2> 18671 T472 C87 P21808 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index.20130205144002998 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19464a92; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 18672 T472 C87 P21808 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 18672 T472 C87 P21808 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 18673 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3
[junit4:junit4] 2> 18673 T472 C87 P21808 oass.SolrIndexSearcher.<init> Opening Searcher@4142cea6 main
[junit4:junit4] 2> 18675 T471 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4142cea6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 18676 T471 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index
[junit4:junit4] 2> 18676 T472 C87 P21808 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 18679 T472 C87 P21808 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index.20130205144002998 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19464a92; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index.20130205144002998 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19464a92; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18680 T472 C87 P21808 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18681 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3
[junit4:junit4] 2> 18681 T472 C87 P21808 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18682 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index.20130205144002998
[junit4:junit4] 2> 18682 T472 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3/index
[junit4:junit4] 2> 18682 T472 C87 P21808 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 18682 T472 C87 P21808 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 18682 T472 C87 P21808 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 18683 T472 C87 P21808 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18690 T472 C87 P21808 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19571 T397 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19944 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19945 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:21808_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:21808/s"}
[junit4:junit4] 2> 19965 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19965 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19965 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19965 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19965 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19965 T454 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> C88_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:37523_s, base_url=http://127.0.0.1:37523/s}
[junit4:junit4] 2> 20568 T488 C88 P37523 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:16649/s/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20568 T488 C88 P37523 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37523/s START replicas=[http://127.0.0.1:16649/s/collection1/] nUpdates=100
[junit4:junit4] 2> 20569 T488 C88 P37523 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20569 T488 C88 P37523 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20569 T488 C88 P37523 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20569 T488 C88 P37523 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20569 T488 C88 P37523 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20570 T488 C88 P37523 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:16649/s/collection1/. core=collection1
[junit4:junit4] 2> 20571 T488 C88 P37523 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20574 T397 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C90 name=collection1 org.apache.solr.core.SolrCore@40aa18ef url=http://127.0.0.1:16649/s/collection1 node=127.0.0.1:16649_s C90_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:16649_s, base_url=http://127.0.0.1:16649/s, leader=true}
[junit4:junit4] 2> 20581 T445 C90 P16649 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 20589 T446 C90 P16649 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 20590 T446 C90 P16649 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2
[junit4:junit4] 2> 20594 T446 C90 P16649 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6756223f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20595 T446 C90 P16649 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20599 T446 C90 P16649 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6756223f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6756223f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20599 T446 C90 P16649 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20600 T446 C90 P16649 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2
[junit4:junit4] 2> 20601 T446 C90 P16649 oass.SolrIndexSearcher.<init> Opening Searcher@1ecc75f2 realtime
[junit4:junit4] 2> 20601 T446 C90 P16649 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20602 T446 C90 P16649 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 20603 T488 C88 P37523 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20603 T488 C88 P37523 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20606 T447 C90 P16649 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20606 T447 C90 P16649 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 20607 T488 C88 P37523 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 20608 T488 C88 P37523 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20608 T488 C88 P37523 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20611 T447 C90 P16649 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2
[junit4:junit4] 2> 20612 T447 C90 P16649 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2/index
[junit4:junit4] 2> 20612 T447 C90 P16649 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 20613 T488 C88 P37523 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20614 T488 C88 P37523 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index.20130205144004996 forceNew:false
[junit4:junit4] 2> 20615 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4
[junit4:junit4] 2> 20616 T488 C88 P37523 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index.20130205144004996 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ffaf942; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 20632 T447 C90 P16649 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 20634 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index
[junit4:junit4] 2> 20634 T488 C88 P37523 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20635 T488 C88 P37523 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130205144004996
[junit4:junit4] 2> 20636 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4
[junit4:junit4] 2> 20637 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4
[junit4:junit4] 2> 20637 T488 C88 P37523 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index.20130205144004996
[junit4:junit4] 2> 20641 T488 C88 P37523 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index.20130205144004996 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ffaf942; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20641 T488 C88 P37523 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20642 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4
[junit4:junit4] 2> 20643 T488 C88 P37523 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20643 T488 C88 P37523 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20643 T488 C88 P37523 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 20644 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index.20130205144004996
[junit4:junit4] 2> 20645 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4
[junit4:junit4] 2> 20648 T488 C88 P37523 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index.20130205144004996 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ffaf942; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20649 T488 C88 P37523 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20649 T488 C88 P37523 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20649 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4
[junit4:junit4] 2> 20650 T488 C88 P37523 oass.SolrIndexSearcher.<init> Opening Searcher@1efa3571 main
[junit4:junit4] 2> 20652 T487 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1efa3571 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 20652 T487 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index
[junit4:junit4] 2> 20653 T488 C88 P37523 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 20656 T488 C88 P37523 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index.20130205144004996 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ffaf942; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index.20130205144004996 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ffaf942; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 20656 T488 C88 P37523 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 20658 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4
[junit4:junit4] 2> 20658 T488 C88 P37523 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20658 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index.20130205144004996
[junit4:junit4] 2> 20658 T488 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4/index
[junit4:junit4] 2> 20659 T488 C88 P37523 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20659 T488 C88 P37523 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20659 T488 C88 P37523 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20659 T488 C88 P37523 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20666 T488 C88 P37523 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 21473 T421 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21474 T421 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:37523_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:37523/s"}
[junit4:junit4] 2> 21490 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21490 T426 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21490 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21490 T439 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21490 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21490 T454 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21577 T397 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21579 T397 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C91 name=collection1 org.apache.solr.core.SolrCore@2c117afd url=http://127.0.0.1:15496/s/collection1 node=127.0.0.1:15496_s C91_STATE=coll:control_collection core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:15496_s, base_url=http://127.0.0.1:15496/s, leader=true}
[junit4:junit4] 2> 21687 T412 C91 P15496 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data
[junit4:junit4] 2> 21692 T412 C91 P15496 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19bc3c3c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21693 T412 C91 P15496 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21698 T412 C91 P15496 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/control/data
[junit4:junit4] 2> 21699 T412 C91 P15496 oass.SolrIndexSearcher.<init> Opening Searcher@22f4d970 realtime
[junit4:junit4] 2> 21699 T412 C91 P15496 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1426134669531807744)} 0 37
[junit4:junit4] 2> 21723 T448 C90 P16649 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty2
[junit4:junit4] 2> 21747 T433 C89 P11927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty1
[junit4:junit4] 2> C88_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:37523_s, base_url=http://127.0.0.1:37523/s}
[junit4:junit4] 2> 21755 T475 C88 P37523 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty4
[junit4:junit4] 2> 21756 T475 C88 P37523 /update {update.distrib=FROMLEADER&_version_=-1426134669569556480&update.from=http://127.0.0.1:16649/s/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1426134669569556480)} 0 3
[junit4:junit4] 2> C87_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:21808_s, base_url=http://127.0.0.1:21808/s}
[junit4:junit4] 2> 21760 T459 C87 P21808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360067984389/jetty3
[junit4:junit4] 2> 21761 T459 C87 P21808 /update {update.distrib=FROMLEADER&_version_=-1426134669594722304&update.from=http://127.0.0.1:11927/s/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1426134669594722304)} 0 3
[junit4:junit4] 2> 21762 T433 C89 P11927 /update {update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1426134669594722304)} 0 17
[junit4:junit4] 2> 21763 T448 C90 P16649 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1426134669569556480)} 0 49
[junit4:junit4] 2> 21773 T412 C91 P15496 /update {wt=javabin&version=2} {add=[1 (1426134669618839552)]} 0 5
[junit4:junit4] 2> 21808 T459 C87 P21808 /update {distrib.from=http://127.0.0.1:11927/s/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1426134669646102528)]} 0 5
[junit4:junit4] 2> 21808 T433 C89 P11927 /update {distrib.from=http://127.0.0.1:16649/s/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1426134669646102528)]} 0 13
[junit4:junit4] 2> 21809 T448 C90 P16649 /update {wt=javabin&version=2} {add=[1]} 0 33
[junit4:junit4] 2> 21815 T412 C91 P15496 /update {wt=javabin&version=2} {add=[2 (1426134669664976896)]} 0 3
[junit4:junit4] 2> 21833 T475 C88 P37523 /update {distrib.from=http://127.0.0.1:16649/s/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1426134669671268352)]} 0 7
[junit4:junit4] 2> 21834 T448 C90 P16649 /update {wt=javabin&version=2} {add=[2 (1426134669671268352)]} 0 16
[junit4:junit4] 2> 21841 T412 C91 P15496 /update {wt=javabin&version=2} {add=[3 (1426134669691191296)]} 0 4
[junit4:junit4] 2> 21856 T475 C88 P37523 /update {distrib.from=http://127.0.0.1:16649/s/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1426134669698531328)]} 0 5
[junit4:junit4] 2> 21857 T448 C90 P16649 /update {wt=javabin&version=2} {add=[3 (1426134669698531328)]} 0 13
[junit4:junit4] 2> 21864 T412 C91 P15496 /update {wt=javabin&version=2} {add=[4 (1426134669715308544)]} 0 4
[junit4:junit4] 2> 21880 T459 C87 P21808 /update {distrib.from=http://127.0.0.1:11927/s/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1426134669725794304)]} 0 3
[junit4:junit4] 2> 21881 T433 C89 P11927 /update {distrib.from=http://127.0.0.1:16649/s/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1426134669725794304)]} 0 10
[junit4:junit4] 2> 21882 T448 C90 P16649 /update {wt=javabin&version=2} {add=[4]} 0 15
[junit4:junit4] 2> 21888 T412 C91 P15496 /update {wt=javabin&version=2} {add=[5 (1426134669741522944)]} 0 3
[junit4:junit4] 2> 21908 T475 C88 P37523 /update {distrib.from=http://127.0.0.1:16649/s/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1426134669750960128)]} 0 5
[junit4:junit4] 2> 21909 T449 C90 P16649 /update {distrib.from=http://127.0.0.1:11927/s/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1426134669750960128)]} 0 15
[junit4:junit4] 2> 21910 T434 C89 P11927 /update {wt=javabin&version=2} {add=[5]} 0 19
[junit4:junit4] 2> 21916 T412 C91 P15496 /update {wt=javabin&version=2} {add=[6 (1426134669770883072)]} 0 3
[junit4:junit4] 2> 21932 T475 C88 P37523 /update {distrib.from=http://127.0.0.1:16649/s/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1426134669778223104)]} 0 5
[junit4:junit4] 2> 21933 T448 C90 P16649 /update {wt=javabin&version=2} {add=[6 (1426134669778223104)]} 0 12
[junit4:junit4] 2> 21940 T412 C91 P15496 /update {wt=javabin&version=2} {add=[7 (1426134669795000320)]} 0 3
[junit4:junit4] 2> 21960 T475 C88 P37523 /update {distrib.from=http://127.0.0.1:16649/s/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1426134669806534656)]} 0 5
[junit4:junit4] 2> 21961 T449 C90 P16649 /update {distrib.from=http://127.0.0.1:11927/s/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1426134669806534656)]} 0 14
[junit4:junit4] 2> 21962 T434 C89 P11927 /update {wt=javabin&version=2} {add=[7]} 0 19
[junit4:junit4] 2> 21968 T412 C91 P15496 /update {wt=javabin&version=2} {add=[8 (1426134669825409024)]} 0 3
[junit4:junit4] 2> 21986 T459 C87 P21808 /update {distrib.from=http://127.0.0.1:11927/s/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1426134669835894784)]} 0 4
[junit4:junit4] 2> 21987 T433 C89 P11927 /update {distrib.from=http://127.0.0.1:16649/s/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1426134669835894784)]} 0 12
[junit4:junit4] 2> 21988 T448 C90 P16649 /update {wt=javabin&version=2} {add=[8]} 0 17
[junit4:junit4] 2> 21995 T412 C91 P15496 /update {wt=javabin&version=2} {add=[9 (1426134669852672000)]} 0 4
[junit4:junit4] 2> 22016 T475 C88 P37523 /update {distrib.from=http://127.0.0.1:16649/s/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1426134669864206336)]} 0 5
[junit4:junit4] 2> 22017 T449 C90 P16649 /update {distrib.from=http://127.0.0.1:1
[...truncated too long message...]
Method)
[junit4:junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4:junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4:junit4] 2> 20) Thread[id=474, name=qtp1373514468-474 Acceptor0 SocketConnector@127.0.0.1:37523, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.net.PlainSocketImpl.socketAccept(Native Method)
[junit4:junit4] 2> at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
[junit4:junit4] 2> at java.net.ServerSocket.implAccept(ServerSocket.java:522)
[junit4:junit4] 2> at java.net.ServerSocket.accept(ServerSocket.java:490)
[junit4:junit4] 2> at org.eclipse.jetty.server.bio.SocketConnector.accept(SocketConnector.java:117)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 21) Thread[id=532, name=searcherExecutor-600-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 22) Thread[id=471, name=searcherExecutor-574-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 23) Thread[id=484, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[B5C653350651FA91]-SendThread(localhost:40554), state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.nio.ch.KQueueArrayWrapper.interrupt(Native Method)
[junit4:junit4] 2> at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueArrayWrapper.java:164)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:245)
[junit4:junit4] 2> at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
[junit4:junit4] 2> at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:102)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 24) Thread[id=538, name=searcherExecutor-612-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {n_f1=PostingsFormat(name=Asserting), foo_b=PostingsFormat(name=MockRandom), foo_d=MockFixedIntBlock(blockSize=688), foo_f=PostingsFormat(name=MockRandom), n_tl1=PostingsFormat(name=Asserting), n_d1=MockVariableIntBlock(baseBlockSize=69), rnd_b=MockFixedIntBlock(blockSize=688), intDefault=MockVariableIntBlock(baseBlockSize=69), n_td1=PostingsFormat(name=Asserting), timestamp=MockVariableIntBlock(baseBlockSize=69), id=MockFixedIntBlock(blockSize=688), range_facet_sl=PostingsFormat(name=MockRandom), range_facet_si=PostingsFormat(name=Asserting), oddField_s=PostingsFormat(name=MockRandom), foo_i=PostingsFormat(name=Asserting), multiDefault=PostingsFormat(name=Asserting), n_tf1=MockVariableIntBlock(baseBlockSize=69), n_dt1=PostingsFormat(name=Asserting), n_ti1=MockFixedIntBlock(blockSize=688), range_facet_l=MockVariableIntBlock(baseBlockSize=69), text=PostingsFormat(name=MockRandom), _version_=MockVariableIntBlock(baseBlockSize=69), val_i=MockFixedIntBlock(blockSize=688), SubjectTerms_mfacet=MockVariableIntBlock(baseBlockSize=69), a_t=MockVariableIntBlock(baseBlockSize=69), n_tdt1=MockVariableIntBlock(baseBlockSize=69), other_tl1=MockVariableIntBlock(baseBlockSize=69), n_l1=MockVariableIntBlock(baseBlockSize=69), a_si=PostingsFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=et_EE, timezone=Asia/Damascus
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=26,free=153391040,total=233832448
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestPseudoReturnFields, TestPostingsSolrHighlighter, TestLazyCores, TestGroupingSearch, SolrCoreCheckLockOnStartupTest, JsonLoaderTest, SearchHandlerTest, DirectSolrConnectionTest, TestReload, TestIBSimilarityFactory, TestJmxMonitoredMap, TestIndexSearcher, SuggesterWFSTTest, CurrencyFieldTest, TestQueryTypes, FieldAnalysisRequestHandlerTest, ScriptEngineTest, TestRangeQuery, TestDocumentBuilder, DirectUpdateHandlerOptimizeTest, TestSystemIdResolver, DateMathParserTest, CSVRequestHandlerTest, MBeansHandlerTest, TestSuggestSpellingConverter, ExternalFileFieldSortTest, SuggesterFSTTest, QueryElevationComponentTest, TestCoreContainer, TestLMJelinekMercerSimilarityFactory, TestLMDirichletSimilarityFactory, CopyFieldTest, TestElisionMultitermQuery, TestComponentsName, ChaosMonkeyNothingIsSafeTest, ChaosMonkeySafeLeaderTest, TestBinaryResponseWriter, SimpleFacetsTest, TestFastOutputStream, TestSearchPerf, TestPartialUpdateDeduplication, NotRequiredUniqueKeyTest, ClusterStateUpdateTest, TestFastLRUCache, SpatialFilterTest, AutoCommitTest, JSONWriterTest, TestExtendedDismaxParser, DefaultValueUpdateProcessorTest, FileBasedSpellCheckerTest, DateFieldTest, TestQuerySenderNoQuery, TestSolrQueryParser, ResourceLoaderTest, TestCharFilters, TestLFUCache, PluginInfoTest, TestWordDelimiterFilterFactory, BasicDistributedZkTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZkTest -Dtests.seed=B5C653350651FA91 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=et_EE -Dtests.timezone=Asia/Damascus -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 0.00s J0 | BasicDistributedZkTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([B5C653350651FA91]:0)
[junit4:junit4] Completed on J0 in 7223.57s, 1 test, 2 errors <<< FAILURES!
[...truncated 11 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:432: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:841: There were test failures: 249 suites, 1038 tests, 1 suite-level error, 1 error, 23 ignored (5 assumptions)
Total time: 144 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3709 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3709/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([38B502A79FD73A82]:0)
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([38B502A79FD73A82]:0)
Build Log:
[...truncated 9503 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4] 2> 0 T820 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /i/
[junit4:junit4] 2> 5 T820 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1360035917541
[junit4:junit4] 2> 6 T820 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 7 T821 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 11 T821 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 11 T821 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 11 T821 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 12 T821 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 13 T821 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 108 T820 oasc.ZkTestServer.run start zk server on port:58698
[junit4:junit4] 2> 109 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a7497ee
[junit4:junit4] 2> 109 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 110 T826 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 110 T826 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 111 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58699
[junit4:junit4] 2> 111 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58699
[junit4:junit4] 2> 112 T824 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 117 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed0000 with negotiated timeout 10000 for client /140.211.11.196:58699
[junit4:junit4] 2> 117 T826 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed0000, negotiated timeout = 10000
[junit4:junit4] 2> 117 T827 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a7497ee name:ZooKeeperConnection Watcher:127.0.0.1:58698 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 118 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 118 T820 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 162 T825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca8752eed0000
[junit4:junit4] 2> 164 T827 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 164 T822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:58699 which had sessionid 0x13ca8752eed0000
[junit4:junit4] 2> 164 T820 oaz.ZooKeeper.close Session: 0x13ca8752eed0000 closed
[junit4:junit4] 2> 164 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c155c72
[junit4:junit4] 2> 165 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 165 T828 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 166 T828 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 166 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58701
[junit4:junit4] 2> 166 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58701
[junit4:junit4] 2> 178 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed0001 with negotiated timeout 10000 for client /140.211.11.196:58701
[junit4:junit4] 2> 178 T828 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed0001, negotiated timeout = 10000
[junit4:junit4] 2> 179 T829 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c155c72 name:ZooKeeperConnection Watcher:127.0.0.1:58698/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 179 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 179 T820 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 187 T820 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 207 T820 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 210 T820 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 221 T820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 222 T820 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 251 T820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 252 T820 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 357 T820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 358 T820 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 362 T820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 363 T820 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 372 T820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 373 T820 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 376 T820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 377 T820 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 381 T820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 382 T820 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 386 T820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 387 T820 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 398 T820 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 399 T820 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 403 T825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca8752eed0001
[junit4:junit4] 2> 419 T829 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 419 T822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:58701 which had sessionid 0x13ca8752eed0001
[junit4:junit4] 2> 419 T820 oaz.ZooKeeper.close Session: 0x13ca8752eed0001 closed
[junit4:junit4] 2> 657 T820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 662 T820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58702
[junit4:junit4] 2> 663 T820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 663 T820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 664 T820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360035917955
[junit4:junit4] 2> 664 T820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360035917955/solr.xml
[junit4:junit4] 2> 665 T820 oasc.CoreContainer.<init> New CoreContainer 214051420
[junit4:junit4] 2> 665 T820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360035917955/'
[junit4:junit4] 2> 666 T820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360035917955/'
[junit4:junit4] 2> 741 T820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 741 T820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 742 T820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 742 T820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 743 T820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 743 T820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 744 T820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 744 T820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 745 T820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 745 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 773 T820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 799 T820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58698/solr
[junit4:junit4] 2> 799 T820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 800 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@584f50db
[junit4:junit4] 2> 801 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 802 T839 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 803 T839 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 803 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58703
[junit4:junit4] 2> 804 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58703
[junit4:junit4] 2> 806 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed0002 with negotiated timeout 20000 for client /140.211.11.196:58703
[junit4:junit4] 2> 806 T839 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed0002, negotiated timeout = 20000
[junit4:junit4] 2> 806 T840 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@584f50db name:ZooKeeperConnection Watcher:127.0.0.1:58698 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 807 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 808 T825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca8752eed0002
[junit4:junit4] 2> 826 T840 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 826 T822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:58703 which had sessionid 0x13ca8752eed0002
[junit4:junit4] 2> 826 T820 oaz.ZooKeeper.close Session: 0x13ca8752eed0002 closed
[junit4:junit4] 2> 827 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 841 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4784933a
[junit4:junit4] 2> 842 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 843 T841 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 843 T841 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 843 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58704
[junit4:junit4] 2> 844 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58704
[junit4:junit4] 2> 851 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed0003 with negotiated timeout 20000 for client /140.211.11.196:58704
[junit4:junit4] 2> 851 T841 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed0003, negotiated timeout = 20000
[junit4:junit4] 2> 851 T842 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4784933a name:ZooKeeperConnection Watcher:127.0.0.1:58698/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 852 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 896 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 898 T820 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 901 T820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58702_i
[junit4:junit4] 2> 902 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58702_i Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58702_i
[junit4:junit4] 2> 928 T820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58702_i
[junit4:junit4] 2> 935 T820 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 959 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 975 T820 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 980 T820 oasc.Overseer.start Overseer (id=89131313892491267-127.0.0.1:58702_i-n_0000000000) starting
[junit4:junit4] 2> 980 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 994 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 995 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1001 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1024 T844 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1025 T820 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1035 T820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1037 T843 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1046 T845 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360035917955/collection1
[junit4:junit4] 2> 1046 T845 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1047 T845 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1047 T845 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1049 T845 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360035917955/collection1/'
[junit4:junit4] 2> 1051 T845 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360035917955/collection1/lib/README' to classloader
[junit4:junit4] 2> 1051 T845 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360035917955/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1129 T845 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1219 T845 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1320 T845 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1346 T845 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 2137 T845 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2150 T845 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2158 T845 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2184 T845 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2191 T845 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2196 T845 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2197 T845 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2199 T845 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360035917955/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data/
[junit4:junit4] 2> 2199 T845 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2394c833
[junit4:junit4] 2> 2200 T845 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 2245 T845 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data forceNew:false
[junit4:junit4] 2> 2246 T845 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data
[junit4:junit4] 2> 2247 T845 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data/index/
[junit4:junit4] 2> 2247 T845 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2249 T845 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data/index forceNew:false
[junit4:junit4] 2> 2274 T845 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@790d9a3a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 2275 T845 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 2276 T845 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data/index
[junit4:junit4] 2> 2277 T845 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 2279 T845 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2279 T845 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 2279 T845 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2280 T845 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 2281 T845 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2281 T845 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2281 T845 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2282 T845 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2282 T845 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2283 T845 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 2283 T845 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 2284 T845 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2284 T845 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 2285 T845 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 2285 T845 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 2286 T845 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2286 T845 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2287 T845 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2287 T845 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2288 T845 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2288 T845 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2289 T845 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2289 T845 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2290 T845 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2290 T845 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 2291 T845 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 2329 T845 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2337 T845 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 2339 T845 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 2343 T845 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data
[junit4:junit4] 2> 2346 T845 oass.SolrIndexSearcher.<init> Opening Searcher@2b2aa4d3 main
[junit4:junit4] 2> 2347 T845 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2347 T845 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2348 T845 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 2490 T845 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 2620 T846 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b2aa4d3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2626 T845 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2626 T845 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2627 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:create cxid:0x53 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 4045 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4046 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:58702_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58702/i"}
[junit4:junit4] 2> 4046 T843 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 4053 T843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 4054 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:create cxid:0x5b zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 4097 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4666 T845 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 4666 T845 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58702/i collection:control_collection shard:shard1
[junit4:junit4] 2> 4667 T845 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 4704 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:delete cxid:0x75 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 4705 T845 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 4706 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:create cxid:0x76 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4729 T845 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 4729 T845 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 4730 T845 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58702/i/collection1/
[junit4:junit4] 2> 4730 T845 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 4730 T845 oasc.SyncStrategy.syncToMe http://127.0.0.1:58702/i/collection1/ has no replicas
[junit4:junit4] 2> 4731 T845 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58702/i/collection1/
[junit4:junit4] 2> 4731 T845 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 4745 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0003 type:create cxid:0x80 zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5604 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5637 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5677 T845 oasc.ZkController.register We are http://127.0.0.1:58702/i/collection1/ and leader is http://127.0.0.1:58702/i/collection1/
[junit4:junit4] 2> 5677 T845 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58702/i
[junit4:junit4] 2> 5677 T845 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 5678 T845 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 5678 T845 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 5681 T845 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5682 T820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 5683 T820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 5684 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5704 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 5731 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@330b6e9
[junit4:junit4] 2> 5732 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5732 T847 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5733 T847 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 5733 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58720
[junit4:junit4] 2> 5734 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58720
[junit4:junit4] 2> 5736 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed0004 with negotiated timeout 10000 for client /140.211.11.196:58720
[junit4:junit4] 2> 5736 T847 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed0004, negotiated timeout = 10000
[junit4:junit4] 2> 5736 T848 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@330b6e9 name:ZooKeeperConnection Watcher:127.0.0.1:58698/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5737 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5738 T820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5743 T820 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 5959 T820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 5962 T820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58721
[junit4:junit4] 2> 5963 T820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 5963 T820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 5964 T820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360035923279
[junit4:junit4] 2> 5964 T820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360035923279/solr.xml
[junit4:junit4] 2> 5965 T820 oasc.CoreContainer.<init> New CoreContainer 1491351555
[junit4:junit4] 2> 5965 T820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360035923279/'
[junit4:junit4] 2> 5966 T820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360035923279/'
[junit4:junit4] 2> 6032 T820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 6032 T820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 6033 T820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 6033 T820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 6034 T820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 6034 T820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 6035 T820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 6035 T820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 6036 T820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 6036 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 6063 T820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 6083 T820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58698/solr
[junit4:junit4] 2> 6084 T820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 6085 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7d03a9b0
[junit4:junit4] 2> 6086 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 6086 T858 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 6087 T858 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 6088 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58722
[junit4:junit4] 2> 6088 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58722
[junit4:junit4] 2> 6090 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed0005 with negotiated timeout 20000 for client /140.211.11.196:58722
[junit4:junit4] 2> 6090 T858 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed0005, negotiated timeout = 20000
[junit4:junit4] 2> 6091 T859 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d03a9b0 name:ZooKeeperConnection Watcher:127.0.0.1:58698 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 6091 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 6093 T825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca8752eed0005
[junit4:junit4] 2> 6094 T859 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 6095 T822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:58722 which had sessionid 0x13ca8752eed0005
[junit4:junit4] 2> 6094 T820 oaz.ZooKeeper.close Session: 0x13ca8752eed0005 closed
[junit4:junit4] 2> 6095 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 6109 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@29a1387d
[junit4:junit4] 2> 6110 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 6111 T860 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 6111 T860 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 6112 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58723
[junit4:junit4] 2> 6112 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58723
[junit4:junit4] 2> 6114 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed0006 with negotiated timeout 20000 for client /140.211.11.196:58723
[junit4:junit4] 2> 6114 T860 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed0006, negotiated timeout = 20000
[junit4:junit4] 2> 6115 T861 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29a1387d name:ZooKeeperConnection Watcher:127.0.0.1:58698/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 6115 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 6116 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6118 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6136 T820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58721_i
[junit4:junit4] 2> 6137 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58721_i Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58721_i
[junit4:junit4] 2> 6139 T820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58721_i
[junit4:junit4] 2> 6142 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 6143 T848 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 6144 T842 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 6147 T820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 6155 T862 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360035923279/collection1
[junit4:junit4] 2> 6155 T862 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 6156 T862 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 6156 T862 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 6157 T862 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360035923279/collection1/'
[junit4:junit4] 2> 6159 T862 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360035923279/collection1/lib/README' to classloader
[junit4:junit4] 2> 6159 T862 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360035923279/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 6229 T862 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 6314 T862 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 6415 T862 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 6440 T862 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 7063 T862 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 7073 T862 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 7077 T862 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 7095 T862 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 7100 T862 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 7105 T862 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 7106 T862 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 7108 T862 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360035923279/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1/
[junit4:junit4] 2> 7108 T862 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2394c833
[junit4:junit4] 2> 7109 T862 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 7110 T862 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1 forceNew:false
[junit4:junit4] 2> 7110 T862 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1
[junit4:junit4] 2> 7111 T862 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1/index/
[junit4:junit4] 2> 7111 T862 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 7113 T862 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1/index forceNew:false
[junit4:junit4] 2> 7120 T862 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5aa4e1af),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 7120 T862 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 7121 T862 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1/index
[junit4:junit4] 2> 7122 T862 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 7124 T862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 7124 T862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 7124 T862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 7125 T862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 7125 T862 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 7126 T862 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 7126 T862 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 7127 T862 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 7127 T862 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 7128 T862 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 7128 T862 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 7129 T862 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 7129 T862 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 7130 T862 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 7130 T862 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 7131 T862 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 7131 T862 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7132 T862 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7132 T862 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7133 T862 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7133 T862 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7134 T862 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7134 T862 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7135 T862 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7135 T862 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 7136 T862 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 7145 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7146 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:58702_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58702/i"}
[junit4:junit4] 2> 7150 T862 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 7154 T862 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 7162 T862 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 7163 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7163 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7163 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7165 T862 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1
[junit4:junit4] 2> 7167 T862 oass.SolrIndexSearcher.<init> Opening Searcher@188bbd6b main
[junit4:junit4] 2> 7168 T862 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 7168 T862 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 7169 T862 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 7183 T862 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 7274 T863 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@188bbd6b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 7342 T862 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 7342 T862 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8677 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8678 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58721_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58721/i"}
[junit4:junit4] 2> 8678 T843 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 8678 T843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 8716 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8716 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8716 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9365 T862 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 9365 T862 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58721/i collection:collection1 shard:shard1
[junit4:junit4] 2> 9366 T862 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 9397 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0006 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 9406 T862 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 9407 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0006 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9410 T862 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 9410 T862 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 9410 T862 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58721/i/collection1/
[junit4:junit4] 2> 9411 T862 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 9411 T862 oasc.SyncStrategy.syncToMe http://127.0.0.1:58721/i/collection1/ has no replicas
[junit4:junit4] 2> 9411 T862 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58721/i/collection1/
[junit4:junit4] 2> 9411 T862 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 9428 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0006 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10223 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10250 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10250 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10250 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10263 T862 oasc.ZkController.register We are http://127.0.0.1:58721/i/collection1/ and leader is http://127.0.0.1:58721/i/collection1/
[junit4:junit4] 2> 10263 T862 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58721/i
[junit4:junit4] 2> 10263 T862 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 10263 T862 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 10264 T862 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10274 T862 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10276 T820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 10276 T820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 10277 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 10474 T820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 10477 T820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58724
[junit4:junit4] 2> 10478 T820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 10478 T820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 10479 T820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360035927830
[junit4:junit4] 2> 10479 T820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360035927830/solr.xml
[junit4:junit4] 2> 10479 T820 oasc.CoreContainer.<init> New CoreContainer 1052745438
[junit4:junit4] 2> 10480 T820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360035927830/'
[junit4:junit4] 2> 10480 T820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360035927830/'
[junit4:junit4] 2> 10535 T820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 10536 T820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 10536 T820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 10537 T820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 10537 T820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 10538 T820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 10538 T820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 10538 T820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 10539 T820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 10539 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 10560 T820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 10578 T820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58698/solr
[junit4:junit4] 2> 10579 T820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 10580 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@351393e4
[junit4:junit4] 2> 10581 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10581 T873 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10582 T873 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 10582 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58725
[junit4:junit4] 2> 10583 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58725
[junit4:junit4] 2> 10589 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed0007 with negotiated timeout 20000 for client /140.211.11.196:58725
[junit4:junit4] 2> 10589 T873 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed0007, negotiated timeout = 20000
[junit4:junit4] 2> 10589 T874 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@351393e4 name:ZooKeeperConnection Watcher:127.0.0.1:58698 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10589 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10591 T825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca8752eed0007
[junit4:junit4] 2> 10600 T874 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 10600 T822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:58725 which had sessionid 0x13ca8752eed0007
[junit4:junit4] 2> 10600 T820 oaz.ZooKeeper.close Session: 0x13ca8752eed0007 closed
[junit4:junit4] 2> 10601 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 10612 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@627ba26f
[junit4:junit4] 2> 10613 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10614 T875 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10614 T875 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 10614 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58726
[junit4:junit4] 2> 10615 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58726
[junit4:junit4] 2> 10619 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed0008 with negotiated timeout 20000 for client /140.211.11.196:58726
[junit4:junit4] 2> 10619 T875 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed0008, negotiated timeout = 20000
[junit4:junit4] 2> 10620 T876 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@627ba26f name:ZooKeeperConnection Watcher:127.0.0.1:58698/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10620 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10621 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10623 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10630 T820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58724_i
[junit4:junit4] 2> 10631 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0008 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58724_i Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58724_i
[junit4:junit4] 2> 10633 T820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58724_i
[junit4:junit4] 2> 10636 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10636 T861 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10636 T848 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10636 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10636 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10638 T842 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10653 T820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10661 T877 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360035927830/collection1
[junit4:junit4] 2> 10661 T877 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 10662 T877 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 10662 T877 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 10664 T877 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360035927830/collection1/'
[junit4:junit4] 2> 10665 T877 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360035927830/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 10666 T877 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360035927830/collection1/lib/README' to classloader
[junit4:junit4] 2> 10725 T877 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 10803 T877 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10904 T877 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10911 T877 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 11801 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11803 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58721_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58721/i"}
[junit4:junit4] 2> 11824 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11824 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11825 T876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11832 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11938 T877 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 11966 T877 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 11971 T877 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 12016 T877 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12023 T877 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12033 T877 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12035 T877 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12038 T877 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360035927830/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2/
[junit4:junit4] 2> 12038 T877 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2394c833
[junit4:junit4] 2> 12040 T877 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 12041 T877 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2 forceNew:false
[junit4:junit4] 2> 12042 T877 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2
[junit4:junit4] 2> 12042 T877 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2/index/
[junit4:junit4] 2> 12043 T877 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 12044 T877 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2/index forceNew:false
[junit4:junit4] 2> 12088 T877 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d130642),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 12089 T877 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 12090 T877 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2/index
[junit4:junit4] 2> 12091 T877 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 12094 T877 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 12095 T877 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 12095 T877 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 12095 T877 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 12096 T877 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 12096 T877 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 12097 T877 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 12098 T877 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 12098 T877 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 12099 T877 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 12099 T877 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 12100 T877 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 12101 T877 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 12101 T877 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 12101 T877 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 12102 T877 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 12103 T877 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12104 T877 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12105 T877 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12106 T877 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12107 T877 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12107 T877 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12108 T877 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12109 T877 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12110 T877 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 12111 T877 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 12145 T877 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 12152 T877 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 12155 T877 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 12169 T877 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2
[junit4:junit4] 2> 12173 T877 oass.SolrIndexSearcher.<init> Opening Searcher@7afb6f54 main
[junit4:junit4] 2> 12175 T877 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 12175 T877 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 12176 T877 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 12211 T877 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 12754 T878 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7afb6f54 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 12771 T877 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 12771 T877 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13354 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13355 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58724_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58724/i"}
[junit4:junit4] 2> 13356 T843 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 13356 T843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 13400 T876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13400 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13400 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13400 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13787 T877 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 13787 T877 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58724/i collection:collection1 shard:shard2
[junit4:junit4] 2> 13791 T877 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 13821 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0008 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 13826 T877 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 13828 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0008 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13841 T877 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 13842 T877 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 13842 T877 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58724/i/collection1/
[junit4:junit4] 2> 13842 T877 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 13843 T877 oasc.SyncStrategy.syncToMe http://127.0.0.1:58724/i/collection1/ has no replicas
[junit4:junit4] 2> 13843 T877 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58724/i/collection1/
[junit4:junit4] 2> 13843 T877 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 13859 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed0008 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14912 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14948 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14948 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14948 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14948 T876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15005 T877 oasc.ZkController.register We are http://127.0.0.1:58724/i/collection1/ and leader is http://127.0.0.1:58724/i/collection1/
[junit4:junit4] 2> 15005 T877 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58724/i
[junit4:junit4] 2> 15005 T877 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 15006 T877 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 15006 T877 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15009 T877 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15010 T820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 15011 T820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 15011 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15223 T820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 15227 T820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58727
[junit4:junit4] 2> 15227 T820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 15228 T820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 15228 T820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360035932562
[junit4:junit4] 2> 15229 T820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360035932562/solr.xml
[junit4:junit4] 2> 15229 T820 oasc.CoreContainer.<init> New CoreContainer 43236172
[junit4:junit4] 2> 15230 T820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360035932562/'
[junit4:junit4] 2> 15230 T820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360035932562/'
[junit4:junit4] 2> 15293 T820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 15294 T820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 15294 T820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 15295 T820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 15295 T820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 15296 T820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 15296 T820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 15297 T820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 15297 T820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 15298 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 15325 T820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 15347 T820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58698/solr
[junit4:junit4] 2> 15348 T820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 15348 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@d32d034
[junit4:junit4] 2> 15350 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 15350 T888 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 15351 T888 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 15351 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58728
[junit4:junit4] 2> 15352 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58728
[junit4:junit4] 2> 15361 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed0009 with negotiated timeout 20000 for client /140.211.11.196:58728
[junit4:junit4] 2> 15361 T888 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed0009, negotiated timeout = 20000
[junit4:junit4] 2> 15361 T889 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d32d034 name:ZooKeeperConnection Watcher:127.0.0.1:58698 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 15362 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 15363 T825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca8752eed0009
[junit4:junit4] 2> 15435 T889 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 15435 T822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:58728 which had sessionid 0x13ca8752eed0009
[junit4:junit4] 2> 15435 T820 oaz.ZooKeeper.close Session: 0x13ca8752eed0009 closed
[junit4:junit4] 2> 15436 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 15451 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7be7f8ea
[junit4:junit4] 2> 15452 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 15452 T890 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 15453 T890 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 15453 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58729
[junit4:junit4] 2> 15454 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58729
[junit4:junit4] 2> 15457 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed000a with negotiated timeout 20000 for client /140.211.11.196:58729
[junit4:junit4] 2> 15458 T890 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed000a, negotiated timeout = 20000
[junit4:junit4] 2> 15458 T891 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7be7f8ea name:ZooKeeperConnection Watcher:127.0.0.1:58698/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 15458 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 15460 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 15475 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 15477 T820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58727_i
[junit4:junit4] 2> 15478 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed000a type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58727_i Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58727_i
[junit4:junit4] 2> 15491 T820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58727_i
[junit4:junit4] 2> 15500 T876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15500 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15501 T848 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15501 T861 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15501 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15501 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15502 T876 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15502 T842 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15506 T820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 15515 T892 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360035932562/collection1
[junit4:junit4] 2> 15515 T892 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 15516 T892 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15516 T892 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 15518 T892 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360035932562/collection1/'
[junit4:junit4] 2> 15519 T892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360035932562/collection1/lib/README' to classloader
[junit4:junit4] 2> 15519 T892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360035932562/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 15576 T892 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 15650 T892 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15751 T892 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15758 T892 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 16243 T892 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 16252 T892 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 16255 T892 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 16268 T892 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16272 T892 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16275 T892 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16276 T892 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16277 T892 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360035932562/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/
[junit4:junit4] 2> 16277 T892 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2394c833
[junit4:junit4] 2> 16278 T892 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 16278 T892 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3 forceNew:false
[junit4:junit4] 2> 16279 T892 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3
[junit4:junit4] 2> 16279 T892 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index/
[junit4:junit4] 2> 16279 T892 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 16280 T892 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index forceNew:false
[junit4:junit4] 2> 16293 T892 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@679fa099),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 16293 T892 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 16294 T892 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index
[junit4:junit4] 2> 16294 T892 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 16296 T892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 16296 T892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 16296 T892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 16297 T892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 16297 T892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 16297 T892 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 16298 T892 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 16298 T892 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 16298 T892 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 16299 T892 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 16299 T892 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 16300 T892 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 16300 T892 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 16300 T892 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 16300 T892 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 16301 T892 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 16301 T892 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16302 T892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16302 T892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16302 T892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16303 T892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16303 T892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16304 T892 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16304 T892 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 16304 T892 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 16305 T892 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 16313 T892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 16316 T892 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 16318 T892 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 16319 T892 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3
[junit4:junit4] 2> 16321 T892 oass.SolrIndexSearcher.<init> Opening Searcher@71e9d532 main
[junit4:junit4] 2> 16321 T892 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 16322 T892 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 16322 T892 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 16328 T892 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 16386 T893 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@71e9d532 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 16389 T892 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 16390 T892 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16474 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16475 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58724_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58724/i"}
[junit4:junit4] 2> 16505 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58727_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58727/i"}
[junit4:junit4] 2> 16506 T843 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 16506 T843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16532 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16532 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16532 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16532 T876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16532 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17392 T892 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 17392 T892 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58727/i collection:collection1 shard:shard1
[junit4:junit4] 2> 17426 T892 oasc.ZkController.register We are http://127.0.0.1:58727/i/collection1/ and leader is http://127.0.0.1:58721/i/collection1/
[junit4:junit4] 2> 17426 T892 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58727/i
[junit4:junit4] 2> 17426 T892 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 17427 T892 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C92 name=collection1 org.apache.solr.core.SolrCore@23c83d6f url=http://127.0.0.1:58727/i/collection1 node=127.0.0.1:58727_i C92_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:58727_i, base_url=http://127.0.0.1:58727/i}
[junit4:junit4] 2> 17435 T894 C92 P58727 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 17436 T892 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17437 T894 C92 P58727 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17437 T894 C92 P58727 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17437 T894 C92 P58727 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17438 T820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 17438 T820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17439 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17440 T894 C92 P58727 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17628 T820 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 17631 T820 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58735
[junit4:junit4] 2> 17632 T820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 17632 T820 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 17633 T820 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360035934996
[junit4:junit4] 2> 17633 T820 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360035934996/solr.xml
[junit4:junit4] 2> 17634 T820 oasc.CoreContainer.<init> New CoreContainer 1006411657
[junit4:junit4] 2> 17634 T820 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360035934996/'
[junit4:junit4] 2> 17635 T820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360035934996/'
[junit4:junit4] 2> 17691 T820 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 17692 T820 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 17692 T820 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 17693 T820 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 17693 T820 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 17694 T820 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 17694 T820 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 17694 T820 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 17695 T820 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 17695 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 17717 T820 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 17736 T820 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:58698/solr
[junit4:junit4] 2> 17736 T820 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 17737 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2b9a98f1
[junit4:junit4] 2> 17738 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17739 T904 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 17739 T904 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 17740 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58737
[junit4:junit4] 2> 17740 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58737
[junit4:junit4] 2> 17749 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed000b with negotiated timeout 20000 for client /140.211.11.196:58737
[junit4:junit4] 2> 17749 T904 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed000b, negotiated timeout = 20000
[junit4:junit4] 2> 17749 T905 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b9a98f1 name:ZooKeeperConnection Watcher:127.0.0.1:58698 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17749 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17751 T825 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca8752eed000b
[junit4:junit4] 2> 17790 T822 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:58737 which had sessionid 0x13ca8752eed000b
[junit4:junit4] 2> 17790 T905 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 17790 T820 oaz.ZooKeeper.close Session: 0x13ca8752eed000b closed
[junit4:junit4] 2> 17791 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 17806 T820 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:58698/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@71d20652
[junit4:junit4] 2> 17807 T820 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17807 T906 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:58698. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 17808 T906 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:58698, initiating session
[junit4:junit4] 2> 17808 T822 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58738
[junit4:junit4] 2> 17809 T822 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58738
[junit4:junit4] 2> 17838 T824 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca8752eed000c with negotiated timeout 20000 for client /140.211.11.196:58738
[junit4:junit4] 2> 17838 T906 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:58698, sessionid = 0x13ca8752eed000c, negotiated timeout = 20000
[junit4:junit4] 2> 17839 T907 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71d20652 name:ZooKeeperConnection Watcher:127.0.0.1:58698/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17839 T820 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17840 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed000c type:create cxid:0x1 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17863 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed000c type:create cxid:0x2 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17865 T820 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58735_i
[junit4:junit4] 2> 17866 T825 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca8752eed000c type:delete cxid:0x4 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58735_i Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58735_i
[junit4:junit4] 2> 17887 T820 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58735_i
[junit4:junit4] 2> 17891 T876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17891 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17892 T861 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17892 T848 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17892 T891 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17892 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17892 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17892 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17894 T876 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17894 T842 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17908 T820 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17915 T908 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360035934996/collection1
[junit4:junit4] 2> 17916 T908 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17916 T908 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17917 T908 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17918 T908 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360035934996/collection1/'
[junit4:junit4] 2> 17919 T908 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360035934996/collection1/lib/README' to classloader
[junit4:junit4] 2> 17920 T908 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360035934996/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17978 T908 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 18050 T908 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18052 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18053 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58727_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58727/i"}
[junit4:junit4] 2> 18074 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18074 T876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18074 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18074 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18074 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18151 T908 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18151 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18158 T908 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 18777 T908 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 18788 T908 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 18792 T908 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 18815 T908 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 18820 T908 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 18824 T908 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 18826 T908 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 18827 T908 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360035934996/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/
[junit4:junit4] 2> 18827 T908 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2394c833
[junit4:junit4] 2> 18828 T908 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 18829 T908 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4 forceNew:false
[junit4:junit4] 2> 18830 T908 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4
[junit4:junit4] 2> 18830 T908 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index/
[junit4:junit4] 2> 18830 T908 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 18831 T908 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index forceNew:false
[junit4:junit4] 2> 18876 T908 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2f21b19b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 18876 T908 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 18877 T908 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index
[junit4:junit4] 2> 18877 T908 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 18880 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 18880 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 18880 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 18881 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 18881 T908 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 18882 T908 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 18882 T908 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 18883 T908 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 18883 T908 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 18884 T908 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 18884 T908 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 18885 T908 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 18885 T908 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 18886 T908 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 18886 T908 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 18886 T908 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 18887 T908 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18888 T908 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18888 T908 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18889 T908 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18889 T908 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18890 T908 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18890 T908 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18891 T908 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 18891 T908 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 18892 T908 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 18904 T908 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 18908 T908 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 18910 T908 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 18912 T908 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4
[junit4:junit4] 2> 18914 T908 oass.SolrIndexSearcher.<init> Opening Searcher@730f58f main
[junit4:junit4] 2> 18915 T908 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 18915 T908 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 18915 T908 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 18945 T908 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 19069 T909 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@730f58f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19074 T908 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 19074 T908 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19580 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19581 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58735_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58735/i"}
[junit4:junit4] 2> 19581 T843 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 19581 T843 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 19603 T876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19604 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19603 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19604 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19604 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19604 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20077 T908 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 20077 T908 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58735/i collection:collection1 shard:shard2
[junit4:junit4] 2> 20081 T908 oasc.ZkController.register We are http://127.0.0.1:58735/i/collection1/ and leader is http://127.0.0.1:58724/i/collection1/
[junit4:junit4] 2> 20082 T908 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58735/i
[junit4:junit4] 2> 20082 T908 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 20082 T908 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C93 name=collection1 org.apache.solr.core.SolrCore@700133da url=http://127.0.0.1:58735/i/collection1 node=127.0.0.1:58735_i C93_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:58735_i, base_url=http://127.0.0.1:58735/i}
[junit4:junit4] 2> 20083 T910 C93 P58735 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 20083 T908 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20084 T910 C93 P58735 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 20084 T910 C93 P58735 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 20084 T910 C93 P58735 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20085 T820 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 20085 T820 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 20086 T910 C93 P58735 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20086 T820 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20107 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20109 T820 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 20110 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C92_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:58727_i, base_url=http://127.0.0.1:58727/i}
[junit4:junit4] 2> 20476 T894 C92 P58727 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:58721/i/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20487 T894 C92 P58727 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 20510 T894 C92 P58727 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:58727/i START replicas=[http://127.0.0.1:58721/i/collection1/] nUpdates=100
[junit4:junit4] 2> 20510 T894 C92 P58727 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20511 T894 C92 P58727 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20511 T894 C92 P58727 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20512 T894 C92 P58727 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20512 T894 C92 P58727 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20512 T894 C92 P58727 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:58721/i/collection1/. core=collection1
[junit4:junit4] 2> 20513 T894 C92 P58727 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C94 name=collection1 org.apache.solr.core.SolrCore@6bedc615 url=http://127.0.0.1:58721/i/collection1 node=127.0.0.1:58721_i C94_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58721_i, base_url=http://127.0.0.1:58721/i, leader=true}
[junit4:junit4] 2> 20523 T852 C94 P58721 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 20552 T853 C94 P58721 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 20552 T853 C94 P58721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1
[junit4:junit4] 2> 20557 T853 C94 P58721 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5aa4e1af),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20557 T853 C94 P58721 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20566 T853 C94 P58721 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5aa4e1af),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5aa4e1af),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20566 T853 C94 P58721 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20568 T853 C94 P58721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1
[junit4:junit4] 2> 20568 T853 C94 P58721 oass.SolrIndexSearcher.<init> Opening Searcher@19e269a3 realtime
[junit4:junit4] 2> 20568 T853 C94 P58721 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20569 T853 C94 P58721 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 35
[junit4:junit4] 2> 20570 T894 C92 P58727 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20571 T894 C92 P58727 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 20600 T894 C92 P58727 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20603 T854 C94 P58721 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20604 T854 C94 P58721 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 20605 T894 C92 P58727 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 20605 T894 C92 P58727 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20606 T894 C92 P58727 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20609 T854 C94 P58721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1
[junit4:junit4] 2> 20609 T854 C94 P58721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1/index
[junit4:junit4] 2> 20610 T854 C94 P58721 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 20611 T894 C92 P58727 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20612 T894 C92 P58727 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index.20130204214538146 forceNew:false
[junit4:junit4] 2> 20613 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3
[junit4:junit4] 2> 20614 T894 C92 P58727 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index.20130204214538146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@408f1117) fullCopy=true
[junit4:junit4] 2> 20628 T854 C94 P58721 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=5
[junit4:junit4] 2> 20635 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index
[junit4:junit4] 2> 20635 T894 C92 P58727 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20636 T894 C92 P58727 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130204214538146
[junit4:junit4] 2> 20638 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3
[junit4:junit4] 2> 20639 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3
[junit4:junit4] 2> 20640 T894 C92 P58727 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index.20130204214538146
[junit4:junit4] 2> 20643 T894 C92 P58727 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index.20130204214538146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@408f1117),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20644 T894 C92 P58727 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20646 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3
[junit4:junit4] 2> 20650 T894 C92 P58727 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20651 T894 C92 P58727 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20651 T894 C92 P58727 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 20652 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index.20130204214538146
[junit4:junit4] 2> 20653 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3
[junit4:junit4] 2> 20656 T894 C92 P58727 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index.20130204214538146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@408f1117),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20657 T894 C92 P58727 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20657 T894 C92 P58727 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20658 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3
[junit4:junit4] 2> 20658 T894 C92 P58727 oass.SolrIndexSearcher.<init> Opening Searcher@36461db6 main
[junit4:junit4] 2> 20661 T893 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@36461db6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 20661 T893 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index
[junit4:junit4] 2> 20662 T894 C92 P58727 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 20664 T894 C92 P58727 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index.20130204214538146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@408f1117),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index.20130204214538146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@408f1117),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 20665 T894 C92 P58727 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 20666 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3
[junit4:junit4] 2> 20666 T894 C92 P58727 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20667 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index.20130204214538146
[junit4:junit4] 2> 20667 T894 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3/index
[junit4:junit4] 2> 20667 T894 C92 P58727 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20668 T894 C92 P58727 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20668 T894 C92 P58727 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20668 T894 C92 P58727 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20670 T894 C92 P58727 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 21112 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21112 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21113 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58735_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58735/i"}
[junit4:junit4] 2> 21118 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58727_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58727/i"}
[junit4:junit4] 2> 21136 T876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21136 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21136 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21136 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21136 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21136 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22115 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23118 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C93_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:58735_i, base_url=http://127.0.0.1:58735/i}
[junit4:junit4] 2> 24111 T910 C93 P58735 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:58724/i/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 24111 T910 C93 P58735 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:58735/i START replicas=[http://127.0.0.1:58724/i/collection1/] nUpdates=100
[junit4:junit4] 2> 24112 T910 C93 P58735 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 24112 T910 C93 P58735 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 24112 T910 C93 P58735 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 24112 T910 C93 P58735 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 24113 T910 C93 P58735 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 24113 T910 C93 P58735 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:58724/i/collection1/. core=collection1
[junit4:junit4] 2> 24114 T910 C93 P58735 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 24121 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C95 name=collection1 org.apache.solr.core.SolrCore@c94f09b url=http://127.0.0.1:58724/i/collection1 node=127.0.0.1:58724_i C95_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58724_i, base_url=http://127.0.0.1:58724/i, leader=true}
[junit4:junit4] 2> 24125 T867 C95 P58724 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 24132 T868 C95 P58724 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 24133 T868 C95 P58724 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2
[junit4:junit4] 2> 24137 T868 C95 P58724 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d130642),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 24138 T868 C95 P58724 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 24143 T868 C95 P58724 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d130642),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d130642),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24144 T868 C95 P58724 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24145 T868 C95 P58724 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2
[junit4:junit4] 2> 24145 T868 C95 P58724 oass.SolrIndexSearcher.<init> Opening Searcher@3852e669 realtime
[junit4:junit4] 2> 24146 T868 C95 P58724 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24146 T868 C95 P58724 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 14
[junit4:junit4] 2> 24147 T910 C93 P58735 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24148 T910 C93 P58735 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 24150 T869 C95 P58724 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24151 T869 C95 P58724 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 24152 T910 C93 P58735 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 24152 T910 C93 P58735 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 24152 T910 C93 P58735 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 24154 T869 C95 P58724 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2
[junit4:junit4] 2> 24155 T869 C95 P58724 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2/index
[junit4:junit4] 2> 24156 T869 C95 P58724 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 24156 T910 C93 P58735 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 24158 T910 C93 P58735 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index.20130204214541692 forceNew:false
[junit4:junit4] 2> 24158 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4
[junit4:junit4] 2> 24159 T910 C93 P58735 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index.20130204214541692 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e89b998) fullCopy=true
[junit4:junit4] 2> 24163 T869 C95 P58724 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 24165 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index
[junit4:junit4] 2> 24166 T910 C93 P58735 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 24171 T910 C93 P58735 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130204214541692
[junit4:junit4] 2> 24172 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4
[junit4:junit4] 2> 24173 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4
[junit4:junit4] 2> 24173 T910 C93 P58735 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index.20130204214541692
[junit4:junit4] 2> 24176 T910 C93 P58735 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index.20130204214541692 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e89b998),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24177 T910 C93 P58735 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24178 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4
[junit4:junit4] 2> 24178 T910 C93 P58735 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 24179 T910 C93 P58735 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 24179 T910 C93 P58735 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 24180 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index.20130204214541692
[junit4:junit4] 2> 24180 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4
[junit4:junit4] 2> 24184 T910 C93 P58735 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index.20130204214541692 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e89b998),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24184 T910 C93 P58735 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24184 T910 C93 P58735 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 24185 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4
[junit4:junit4] 2> 24185 T910 C93 P58735 oass.SolrIndexSearcher.<init> Opening Searcher@5f1e37eb main
[junit4:junit4] 2> 24187 T909 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5f1e37eb main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 24188 T909 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index
[junit4:junit4] 2> 24188 T910 C93 P58735 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 24209 T910 C93 P58735 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index.20130204214541692 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e89b998),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index.20130204214541692 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e89b998),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 24210 T910 C93 P58735 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 24242 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4
[junit4:junit4] 2> 24243 T910 C93 P58735 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24243 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index.20130204214541692
[junit4:junit4] 2> 24243 T910 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4/index
[junit4:junit4] 2> 24243 T910 C93 P58735 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 24244 T910 C93 P58735 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 24244 T910 C93 P58735 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 24244 T910 C93 P58735 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 24250 T910 C93 P58735 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 25123 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25649 T843 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25650 T843 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58735_i",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58735/i"}
[junit4:junit4] 2> 25677 T861 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25677 T907 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25677 T842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25677 T891 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25677 T848 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25677 T876 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26127 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26128 T820 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C96 name=collection1 org.apache.solr.core.SolrCore@2410a383 url=http://127.0.0.1:58702/i/collection1 node=127.0.0.1:58702_i C96_STATE=coll:control_collection core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:58702_i, base_url=http://127.0.0.1:58702/i, leader=true}
[junit4:junit4] 2> 26161 T832 C96 P58702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data
[junit4:junit4] 2> 26166 T832 C96 P58702 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@790d9a3a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 26166 T832 C96 P58702 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 26168 T832 C96 P58702 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/control/data
[junit4:junit4] 2> 26169 T832 C96 P58702 oass.SolrIndexSearcher.<init> Opening Searcher@5955cd23 realtime
[junit4:junit4] 2> 26169 T832 C96 P58702 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1426101049695928320)} 0 14
[junit4:junit4] 2> 26186 T870 C95 P58724 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty2
[junit4:junit4] 2> 26242 T855 C94 P58721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty1
[junit4:junit4] 2> C93_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58735_i, base_url=http://127.0.0.1:58735/i}
[junit4:junit4] 2> 26242 T897 C93 P58735 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty4
[junit4:junit4] 2> 26243 T897 C93 P58735 /update {update.distrib=FROMLEADER&_version_=-1426101049721094144&update.from=http://127.0.0.1:58724/i/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1426101049721094144)} 0 19
[junit4:junit4] 2> C92_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58727_i, base_url=http://127.0.0.1:58727/i}
[junit4:junit4] 2> 26256 T881 C92 P58727 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360035917540/jetty3
[junit4:junit4] 2> 26258 T881 C92 P58727 /update {update.distrib=FROMLEADER&_version_=-1426101049749405696&update.from=http://127.0.0.1:58721/i/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1426101049749405696)} 0 4
[junit4:junit4] 2> 26259 T855 C94 P58721 /update {update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1426101049749405696)} 0 48
[junit4:junit4] 2> 26259 T870 C95 P58724 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1426101049721094144)} 0 86
[junit4:junit4] 2> 26269 T832 C96 P58702 /update {wt=javabin&version=2} {add=[1 (1426101049804980224)]} 0 6
[junit4:junit4] 2> 26296 T881 C92 P58727 /update {distrib.from=http://127.0.0.1:58721/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1426101049813368832)]} 0 6
[junit4:junit4] 2> 26297 T856 C94 P58721 /update {wt=javabin&version=2} {add=[1 (1426101049813368832)]} 0 25
[junit4:junit4] 2> 26304 T832 C96 P58702 /update {wt=javabin&version=2} {add=[2 (1426101049844826112)]} 0 3
[junit4:junit4] 2> 26320 T897 C93 P58735 /update {distrib.from=http://127.0.0.1:58724/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1426101049851117568)]} 0 5
[junit4:junit4] 2> 26321 T870 C95 P58724 /update {wt=javabin&version=2} {add=[2 (1426101049851117568)]} 0 14
[junit4:junit4] 2> 26327 T832 C96 P58702 /update {wt=javabin&version=2} {add=[3 (1426101049868943360)]} 0 3
[junit4:junit4] 2> 26347 T897 C93 P58735 /update {distrib.from=http://127.0.0.1:58724/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1426101049883623424)]} 0 3
[junit4:junit4] 2> 26347 T871 C95 P58724 /update {distrib.from=http://127.0.0.1:58721/i/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1426101049883623424)]} 0 9
[junit4:junit4] 2> 26348 T856 C94 P58721 /update {wt=javabin&version=2} {add=[3]} 0 18
[junit4:junit4] 2> 26354 T832 C96 P58702 /update {wt=javabin&version=2} {add=[4 (1426101049897254912)]} 0 3
[junit4:junit4] 2> 26365 T881 C92 P58727 /update {distrib.from=http://127.0.0.1:58721/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1426101049903546368)]} 0 3
[junit4:junit4] 2> 26366 T856 C94 P58721 /update {wt=javabin&version=2} {add=[4 (1426101049903546368)]} 0 9
[junit4:junit4] 2> 26372 T832 C96 P58702 /update {wt=javabin&version=2} {add=[5 (1426101049916129280)]} 0 3
[junit4:junit4] 2> 26383 T897 C93 P58735 /update {distrib.from=http://127.0.0.1:58724/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1426101049922420736)]} 0 3
[junit4:junit4] 2> 26383 T870 C95 P58724 /update {wt=javabin&version=2} {add=[5 (1426101049922420736)]} 0 8
[junit4:junit4] 2> 26390 T832 C96 P58702 /update {wt=javabin&version=2} {add=[6 (1426101049935003648)]} 0 3
[junit4:junit4] 2> 26401 T897 C93 P58735 /update {distrib.from=http://127.0.0.1:58724/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1426101049941295104)]} 0 3
[junit4:junit4] 2> 26402 T870 C95 P58724 /update {wt=javabin&version=2} {add=[6 (1426101049941295104)]} 0 9
[junit4:junit4] 2> 26408 T832 C96 P58702 /update {wt=javabin&version=2} {add=[7 (1426101049953878016)]} 0 3
[junit4:junit4] 2> 26422 T897 C93 P58735 /update {distrib.from=http://127.0.0.1:58724/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1426101049963315200)]} 0 3
[junit4:junit4] 2> 26423 T871 C95 P58724 /update {distrib.from=http://127.0.0.1:58721/i/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1426101049963315200)]} 0 9
[junit4:junit4] 2> 26423 T856 C94 P58721 /update {wt=javabin&version=2} {add=[7]} 0 12
[junit4:junit4] 2> 26430 T832 C96 P58702 /update {wt=javabin&version=2} {add=[8 (1426101049976946688)]} 0 3
[junit4:junit4] 2> 26445 T881 C92 P58727 /update {distrib.from=http://127.0.0.1:58721/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1426101049986383872)]} 0 3
[junit4:junit4] 2> 26446 T855 C94 P58721 /update {distrib.from=http://127.0.0.1:58724/i/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1426101049986383872)]} 0 10
[junit4:junit4] 2> 26446 T870 C95 P58724 /update {wt=javabin&version=2} {add=[8]} 0 13
[junit4:junit4] 2> 26453 T832 C96 P58702 /update {wt=javabin&version=2} {add=[9 (1426101050001063936)]} 0 3
[junit4:junit4] 2> 26467 T897 C93 P58735 /update {distrib.from=http://127.0.0.1:58724/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1426101050010501120)]} 0 3
[junit4:junit4] 2> 26467 T871 C95 P58724 /update {distrib.from=http://127.0.0.1:58721/i/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1426101050010501120)]} 0 8
[junit4:junit4] 2> 26468 T856 C94 P58721 /update {wt=javabin&version=2} {add=[9]} 0 12
[junit4:junit4] 2> 26505 T832 C96 P58702 /update {wt=javabin&version=2} {add=[10 (1426101050023084032)]} 0 34
[junit4:junit4] 2> 26519 T881 C92 P58727 /update {distrib.from=http://127.0.0.1:58721/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1426101050065027072)]} 0 3
[junit4:junit4] 2> 26520 T855 C94 P58721 /update {distrib.from=http://127.0.0.1:58724/i/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1426101050065027072)]} 0 9
[junit4:junit4] 2> 26520 T870 C95 P58724 /update {wt=javabin&version=2} {add=[10]} 0 12
[junit4:junit4] 2> 26529 T832 C96 P58702 /update {wt=javabin&version=2} {add=[11 (1426101050078658560)]} 0 5
[junit4:junit4] 2> 26540 T881 C92 P58727 /update {distrib.from=http://127.0.0.1:58721/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1426101050087047168)]} 0 3
[junit4:junit4] 2> 26541 T856 C94 P58721 /update {wt=javabin&version=2} {add=[11 (1426101050087047168)]} 0 9
[junit4:junit4] 2> 26547 T832 C96 P58702 /update {wt=javabin&version=2} {add=[12 (1426101050099630080)]} 0 3
[junit4:junit4] 2> 26558 T881 C92 P58727 /update {distrib.from=http://127.0.0.1:58721/i/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1426101050105921536)]} 0 3
[junit4:junit4] 2> 26558 T856 C94 P58721 /update {wt=javabin&version=2} {add=[12 (1426101050105921536)]} 0 8
[junit4:junit4] 2> 26565 T832 C96 P58702 /update {wt=javabin&version=2} {add=[13 (1426101050118504448)]} 0 3
[junit4:junit4] 2> 26576 T881 C92 P58727 /update {distrib.fr
[...truncated too long message...]
at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 24) Thread[id=901, name=qtp1078494859-901, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.net.SocketInputStream.socketRead0(Native Method)
[junit4:junit4] 2> at java.net.SocketInputStream.read(SocketInputStream.java:150)
[junit4:junit4] 2> at java.net.SocketInputStream.read(SocketInputStream.java:121)
[junit4:junit4] 2> at org.eclipse.jetty.io.ByteArrayBuffer.readFrom(ByteArrayBuffer.java:375)
[junit4:junit4] 2> at org.eclipse.jetty.io.bio.StreamEndPoint.fill(StreamEndPoint.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.fill(SocketConnector.java:227)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.fill(HttpParser.java:1035)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:280)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4:junit4] 2> at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
[junit4:junit4] 2> at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 25) Thread[id=906, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[38B502A79FD73A82]-SendThread(localhost:58698), state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:82)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 26) Thread[id=896, name=qtp1078494859-896 Acceptor0 SocketConnector@127.0.0.1:58735, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.net.PlainSocketImpl.socketAccept(Native Method)
[junit4:junit4] 2> at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
[junit4:junit4] 2> at java.net.ServerSocket.implAccept(ServerSocket.java:522)
[junit4:junit4] 2> at java.net.ServerSocket.accept(ServerSocket.java:490)
[junit4:junit4] 2> at org.eclipse.jetty.server.bio.SocketConnector.accept(SocketConnector.java:117)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 27) Thread[id=878, name=searcherExecutor-616-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 28) Thread[id=850, name=qtp454322762-850 Acceptor0 SocketConnector@127.0.0.1:58721, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.net.PlainSocketImpl.socketAccept(Native Method)
[junit4:junit4] 2> at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
[junit4:junit4] 2> at java.net.ServerSocket.implAccept(ServerSocket.java:522)
[junit4:junit4] 2> at java.net.ServerSocket.accept(ServerSocket.java:490)
[junit4:junit4] 2> at org.eclipse.jetty.server.bio.SocketConnector.accept(SocketConnector.java:117)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {n_f1=PostingsFormat(name=NestedPulsing), foo_b=PostingsFormat(name=MockSep), foo_d=MockFixedIntBlock(blockSize=585), foo_f=PostingsFormat(name=MockSep), n_tl1=PostingsFormat(name=NestedPulsing), n_d1=Pulsing41(freqCutoff=14 minBlockSize=42 maxBlockSize=92), rnd_b=MockFixedIntBlock(blockSize=585), intDefault=PostingsFormat(name=NestedPulsing), n_td1=PostingsFormat(name=NestedPulsing), timestamp=Pulsing41(freqCutoff=14 minBlockSize=42 maxBlockSize=92), id=MockFixedIntBlock(blockSize=585), range_facet_sl=MockFixedIntBlock(blockSize=585), range_facet_si=Pulsing41(freqCutoff=14 minBlockSize=42 maxBlockSize=92), oddField_s=MockFixedIntBlock(blockSize=585), multiDefault=Pulsing41(freqCutoff=14 minBlockSize=42 maxBlockSize=92), n_tf1=Pulsing41(freqCutoff=14 minBlockSize=42 maxBlockSize=92), n_dt1=PostingsFormat(name=NestedPulsing), n_ti1=MockFixedIntBlock(blockSize=585), range_facet_l=Pulsing41(freqCutoff=14 minBlockSize=42 maxBlockSize=92), text=PostingsFormat(name=MockSep), _version_=PostingsFormat(name=NestedPulsing), SubjectTerms_mfacet=PostingsFormat(name=NestedPulsing), a_t=Pulsing41(freqCutoff=14 minBlockSize=42 maxBlockSize=92), n_tdt1=PostingsFormat(name=NestedPulsing), other_tl1=PostingsFormat(name=NestedPulsing), n_l1=Pulsing41(freqCutoff=14 minBlockSize=42 maxBlockSize=92), a_si=PostingsFormat(name=NestedPulsing)}, sim=DefaultSimilarity, locale=hr_HR, timezone=Etc/GMT+6
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=37,free=171959472,total=308281344
[junit4:junit4] 2> NOTE: All tests run in this JVM: [DirectUpdateHandlerOptimizeTest, TestDocumentBuilder, PluginInfoTest, IndexBasedSpellCheckerTest, TestQuerySenderNoQuery, ResourceLoaderTest, NumericFieldsTest, PreAnalyzedFieldTest, DateMathParserTest, TestPerFieldSimilarity, TestGroupingSearch, TestLazyCores, TestSolrIndexConfig, AutoCommitTest, TestCharFilters, TestSolr4Spatial, TestIndexSearcher, MinimalSchemaTest, SampleTest, SpellPossibilityIteratorTest, TestNumberUtils, WordBreakSolrSpellCheckerTest, AnalysisAfterCoreReloadTest, CoreContainerCoreInitFailuresTest, FieldAnalysisRequestHandlerTest, DistributedSpellCheckComponentTest, SolrCoreCheckLockOnStartupTest, DateFieldTest, SolrRequestParserTest, ZkCLITest, TestFuzzyAnalyzedSuggestions, JSONWriterTest, ScriptEngineTest, ClusterStateUpdateTest, FileBasedSpellCheckerTest, TestConfig, TestStressVersions, TestReload, CoreAdminHandlerTest, TestPHPSerializedResponseWriter, JsonLoaderTest, HighlighterConfigTest, SpatialFilterTest, DistributedTermsComponentTest, MBeansHandlerTest, ZkControllerTest, SpellCheckCollatorTest, DefaultValueUpdateProcessorTest, TestPseudoReturnFields, NoCacheHeaderTest, RequestHandlersTest, TestExtendedDismaxParser, NotRequiredUniqueKeyTest, TestSearchPerf, SearchHandlerTest, QueryElevationComponentTest, CurrencyFieldTest, TestQueryTypes, DistanceFunctionTest, BasicDistributedZkTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZkTest -Dtests.seed=38B502A79FD73A82 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hr_HR -Dtests.timezone=Etc/GMT+6 -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 0.00s J0 | BasicDistributedZkTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([38B502A79FD73A82]:0)
[junit4:junit4] Completed on J0 in 7223.58s, 1 test, 2 errors <<< FAILURES!
[...truncated 11 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:841: There were test failures: 249 suites, 1038 tests, 1 suite-level error, 1 error, 23 ignored (5 assumptions)
Total time: 155 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3708 - Still Failing
Posted by Mark Miller <ma...@gmail.com>.
Tripped a one minute so timeout - guess I can up it to 2 minutes.
- Mark
On Feb 4, 2013, at 6:26 PM, Apache Jenkins Server <je...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3708/
>
> 1 tests failed.
> FAILED: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
>
> Error Message:
> Captured an uncaught exception in thread: Thread[id=935, name=testExecutor-345-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=935, name=testExecutor-345-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
> Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:30255/sp_ffw/f
> at __randomizedtesting.SeedInfo.seed([715CCD8973136CF0]:0)
> at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:658)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:722)
> Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:30255/sp_ffw/f
> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:412)
> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
> at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:656)
> ... 3 more
> Caused by: java.net.SocketTimeoutException: Read timed out
> at java.net.SocketInputStream.socketRead0(Native Method)
> at java.net.SocketInputStream.read(SocketInputStream.java:150)
> at java.net.SocketInputStream.read(SocketInputStream.java:121)
> at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149)
> at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
> at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264)
> at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98)
> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
> at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
> at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
> at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
> at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
> ... 5 more
>
>
>
>
> Build Log:
> [...truncated 8817 lines...]
> [junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
> [junit4:junit4] 2> 0 T428 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /sp_ffw/f
> [junit4:junit4] 2> 4 T428 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
> [junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1360019516837
> [junit4:junit4] 2> 11 T428 oasc.ZkTestServer.run STARTING ZK TEST SERVER
> [junit4:junit4] 2> 15 T429 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
> [junit4:junit4] 2> 73 T429 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
> [junit4:junit4] 2> 74 T429 oaz.Environment.logEnv Server environment:host.name=lucene.zones.apache.org
> [junit4:junit4] 2> 74 T429 oaz.Environment.logEnv Server environment:java.version=1.7.0_09
> [junit4:junit4] 2> 74 T429 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
> [junit4:junit4] 2> 74 T429 oaz.Environment.logEnv Server environment:java.home=/usr/local/openjdk7/jre
> [junit4:junit4] 2> 74 T429 oaz.Environment.logEnv Server environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpclient-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpcore-4.1.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpmime-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
> [junit4:junit4] 2> 75 T429 oaz.Environment.logEnv Server environment:java.library.path=/usr/local/openjdk7/jre/lib/amd64/server:/usr/local/openjdk7/jre/lib/amd64:/usr/local/openjdk7/jre/../lib/amd64:/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
> [junit4:junit4] 2> 75 T429 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
> [junit4:junit4] 2> 75 T429 oaz.Environment.logEnv Server environment:java.compiler=<NA>
> [junit4:junit4] 2> 75 T429 oaz.Environment.logEnv Server environment:os.name=FreeBSD
> [junit4:junit4] 2> 75 T429 oaz.Environment.logEnv Server environment:os.arch=amd64
> [junit4:junit4] 2> 76 T429 oaz.Environment.logEnv Server environment:os.version=9.0-RELEASE
> [junit4:junit4] 2> 76 T429 oaz.Environment.logEnv Server environment:user.name=hudson
> [junit4:junit4] 2> 76 T429 oaz.Environment.logEnv Server environment:user.home=/home/hudson
> [junit4:junit4] 2> 76 T429 oaz.Environment.logEnv Server environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 109 T429 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
> [junit4:junit4] 2> 109 T429 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
> [junit4:junit4] 2> 109 T429 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
> [junit4:junit4] 2> 115 T429 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
> [junit4:junit4] 2> 116 T428 oasc.ZkTestServer.run start zk server on port:45780
> [junit4:junit4] 2> 179 T428 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
> [junit4:junit4] 2> 180 T428 oaz.Environment.logEnv Client environment:host.name=lucene.zones.apache.org
> [junit4:junit4] 2> 180 T428 oaz.Environment.logEnv Client environment:java.version=1.7.0_09
> [junit4:junit4] 2> 180 T428 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
> [junit4:junit4] 2> 180 T428 oaz.Environment.logEnv Client environment:java.home=/usr/local/openjdk7/jre
> [junit4:junit4] 2> 181 T428 oaz.Environment.logEnv Client environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpclient-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpcore-4.1.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpmime-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
> [junit4:junit4] 2> 182 T428 oaz.Environment.logEnv Client environment:java.library.path=/usr/local/openjdk7/jre/lib/amd64/server:/usr/local/openjdk7/jre/lib/amd64:/usr/local/openjdk7/jre/../lib/amd64:/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
> [junit4:junit4] 2> 182 T428 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
> [junit4:junit4] 2> 182 T428 oaz.Environment.logEnv Client environment:java.compiler=<NA>
> [junit4:junit4] 2> 183 T429 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/zookeeper/server1/data/version-2/snapshot.0
> [junit4:junit4] 2> 183 T428 oaz.Environment.logEnv Client environment:os.name=FreeBSD
> [junit4:junit4] 2> 183 T428 oaz.Environment.logEnv Client environment:os.arch=amd64
> [junit4:junit4] 2> 183 T428 oaz.Environment.logEnv Client environment:os.version=9.0-RELEASE
> [junit4:junit4] 2> 183 T428 oaz.Environment.logEnv Client environment:user.name=hudson
> [junit4:junit4] 2> 184 T428 oaz.Environment.logEnv Client environment:user.home=/home/hudson
> [junit4:junit4] 2> 184 T428 oaz.Environment.logEnv Client environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 187 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@b2da32d
> [junit4:junit4] 2> 246 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 263 T432 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 266 T432 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 267 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:21112
> [junit4:junit4] 2> 284 T430 oazs.NIOServerCnxn.doIO WARNING Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
> [junit4:junit4] 2> 285 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:21112 (no session established for client)
> [junit4:junit4] 2> 285 T432 oaz.ClientCnxn$SendThread.run Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
> [junit4:junit4] 2> 2163 T432 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 2164 T432 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 2164 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:19269
> [junit4:junit4] 2> 2178 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:19269
> [junit4:junit4] 2> 2194 T434 oazsp.FileTxnLog.append Creating new log file: log.1
> [junit4:junit4] 2> 2235 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720000 with negotiated timeout 10000 for client /140.211.11.196:19269
> [junit4:junit4] 2> 2236 T432 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720000, negotiated timeout = 10000
> [junit4:junit4] 2> 2240 T433 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b2da32d name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 2240 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 2245 T428 oascc.SolrZkClient.makePath makePath: /solr
> [junit4:junit4] 2> 2329 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720000
> [junit4:junit4] 2> 2331 T433 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 2331 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720000 closed
> [junit4:junit4] 2> 2331 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:19269 which had sessionid 0x13ca77aee720000
> [junit4:junit4] 2> 2331 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@79ba1ec8
> [junit4:junit4] 2> 2332 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 2333 T436 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 2333 T436 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 2334 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49718
> [junit4:junit4] 2> 2334 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49718
> [junit4:junit4] 2> 2336 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720001 with negotiated timeout 10000 for client /140.211.11.196:49718
> [junit4:junit4] 2> 2336 T436 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720001, negotiated timeout = 10000
> [junit4:junit4] 2> 2337 T437 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79ba1ec8 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 2337 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 2343 T428 oascc.SolrZkClient.makePath makePath: /collections/collection1
> [junit4:junit4] 2> 2349 T428 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
> [junit4:junit4] 2> 2360 T428 oascc.SolrZkClient.makePath makePath: /collections/control_collection
> [junit4:junit4] 2> 2364 T428 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
> [junit4:junit4] 2> 2369 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
> [junit4:junit4] 2> 2397 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
> [junit4:junit4] 2> 2413 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
> [junit4:junit4] 2> 2414 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
> [junit4:junit4] 2> 2521 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
> [junit4:junit4] 2> 2522 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
> [junit4:junit4] 2> 2528 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
> [junit4:junit4] 2> 2529 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
> [junit4:junit4] 2> 2535 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
> [junit4:junit4] 2> 2535 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
> [junit4:junit4] 2> 2542 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
> [junit4:junit4] 2> 2542 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
> [junit4:junit4] 2> 2549 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4] 2> 2549 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4] 2> 2555 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
> [junit4:junit4] 2> 2556 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
> [junit4:junit4] 2> 2562 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
> [junit4:junit4] 2> 2563 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
> [junit4:junit4] 2> 2569 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720001
> [junit4:junit4] 2> 2570 T437 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 2570 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720001 closed
> [junit4:junit4] 2> 2570 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:49718 which had sessionid 0x13ca77aee720001
> [junit4:junit4] 2> 2769 T428 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4] 2> 2773 T428 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:64828
> [junit4:junit4] 2> 2774 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 2774 T428 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 2775 T428 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403
> [junit4:junit4] 2> 2775 T428 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/solr.xml
> [junit4:junit4] 2> 2776 T428 oasc.CoreContainer.<init> New CoreContainer 1882182574
> [junit4:junit4] 2> 2777 T428 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/'
> [junit4:junit4] 2> 2777 T428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/'
> [junit4:junit4] 2> 2839 T428 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
> [junit4:junit4] 2> 2839 T428 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 2840 T428 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 2840 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 2841 T428 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 2841 T428 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 2842 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 2842 T428 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 2843 T428 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 2843 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 2871 T428 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4] 2> 2895 T428 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45780/solr
> [junit4:junit4] 2> 2921 T428 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 2922 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@31415815
> [junit4:junit4] 2> 2923 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 2923 T447 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 2924 T447 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 2924 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:24071
> [junit4:junit4] 2> 2925 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:24071
> [junit4:junit4] 2> 2926 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720002 with negotiated timeout 20000 for client /140.211.11.196:24071
> [junit4:junit4] 2> 2926 T447 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720002, negotiated timeout = 20000
> [junit4:junit4] 2> 2927 T448 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31415815 name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 2927 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 2929 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720002
> [junit4:junit4] 2> 2930 T448 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 2930 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:24071 which had sessionid 0x13ca77aee720002
> [junit4:junit4] 2> 2930 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720002 closed
> [junit4:junit4] 2> 2936 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
> [junit4:junit4] 2> 2955 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@56fe2145
> [junit4:junit4] 2> 2956 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 2957 T449 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 2957 T449 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 2958 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49673
> [junit4:junit4] 2> 2958 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49673
> [junit4:junit4] 2> 2960 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720003 with negotiated timeout 20000 for client /140.211.11.196:49673
> [junit4:junit4] 2> 2960 T449 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720003, negotiated timeout = 20000
> [junit4:junit4] 2> 2960 T450 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56fe2145 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 2960 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 2982 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 2994 T428 oascc.SolrZkClient.makePath makePath: /live_nodes
> [junit4:junit4] 2> 2998 T428 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64828_sp_ffw%2Ff
> [junit4:junit4] 2> 3004 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:64828_sp_ffw%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:64828_sp_ffw%2Ff
> [junit4:junit4] 2> 3006 T428 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64828_sp_ffw%2Ff
> [junit4:junit4] 2> 3012 T428 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
> [junit4:junit4] 2> 3047 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
> [junit4:junit4] 2> 3048 T428 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
> [junit4:junit4] 2> 3053 T428 oasc.Overseer.start Overseer (id=89130239068864515-127.0.0.1:64828_sp_ffw%2Ff-n_0000000000) starting
> [junit4:junit4] 2> 3055 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 3086 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 3088 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 3102 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 3104 T452 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
> [junit4:junit4] 2> 3115 T428 oascc.SolrZkClient.makePath makePath: /clusterstate.json
> [junit4:junit4] 2> 3119 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 3144 T451 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
> [junit4:junit4] 2> 3161 T453 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/collection1
> [junit4:junit4] 2> 3161 T453 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
> [junit4:junit4] 2> 3162 T453 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 3162 T453 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
> [junit4:junit4] 2> 3165 T453 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/collection1/'
> [junit4:junit4] 2> 3166 T453 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/collection1/lib/README' to classloader
> [junit4:junit4] 2> 3167 T453 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 3246 T453 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 3326 T453 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 3427 T453 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4] 2> 3435 T453 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4] 2> 4143 T453 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 4156 T453 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 4160 T453 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 4187 T453 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 4194 T453 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 4200 T453 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 4202 T453 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 4204 T453 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/
> [junit4:junit4] 2> 4209 T453 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5925c9a4
> [junit4:junit4] 2> 4209 T453 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4] 2> 4211 T453 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data forceNew:false
> [junit4:junit4] 2> 4211 T453 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data
> [junit4:junit4] 2> 4212 T453 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/index/
> [junit4:junit4] 2> 4212 T453 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 4213 T453 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/index forceNew:false
> [junit4:junit4] 2> 4220 T453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1713586c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 4220 T453 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 4221 T453 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/index
> [junit4:junit4] 2> 4222 T453 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4] 2> 4226 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 4226 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4] 2> 4226 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 4227 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4] 2> 4228 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 4228 T453 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 4229 T453 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 4229 T453 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 4230 T453 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 4230 T453 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4] 2> 4231 T453 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4] 2> 4232 T453 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 4232 T453 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4] 2> 4233 T453 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4] 2> 4233 T453 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4] 2> 4234 T453 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 4234 T453 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 4235 T453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 4235 T453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 4236 T453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 4236 T453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 4237 T453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 4237 T453 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 4237 T453 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 4238 T453 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4] 2> 4239 T453 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4] 2> 4252 T453 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 4257 T453 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4] 2> 4258 T453 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4] 2> 4261 T453 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data
> [junit4:junit4] 2> 4263 T453 oass.SolrIndexSearcher.<init> Opening Searcher@78d4654e main
> [junit4:junit4] 2> 4289 T453 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 4289 T453 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 4290 T453 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4] 2> 4309 T453 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4] 2> 4362 T454 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@78d4654e main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 4367 T453 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 4368 T453 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 4369 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
> [junit4:junit4] 2> 4654 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 4655 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"control_collection",
> [junit4:junit4] 2> "node_name":"127.0.0.1:64828_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:64828/sp_ffw/f"}
> [junit4:junit4] 2> 4656 T451 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
> [junit4:junit4] 2> 4691 T451 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 4692 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
> [junit4:junit4] 2> 4729 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4] 2> 5382 T453 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 5382 T453 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:64828/sp_ffw/f collection:control_collection shard:shard1
> [junit4:junit4] 2> 5393 T453 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
> [junit4:junit4] 2> 5410 T453 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
> [junit4:junit4] 2> 5432 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
> [junit4:junit4] 2> 5433 T453 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4] 2> 5434 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 5444 T453 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4] 2> 5445 T453 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4] 2> 5445 T453 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:64828/sp_ffw/f/collection1/
> [junit4:junit4] 2> 5446 T453 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4] 2> 5446 T453 oasc.SyncStrategy.syncToMe http://127.0.0.1:64828/sp_ffw/f/collection1/ has no replicas
> [junit4:junit4] 2> 5446 T453 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:64828/sp_ffw/f/collection1/
> [junit4:junit4] 2> 5446 T453 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
> [junit4:junit4] 2> 5454 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 6236 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 6312 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4] 2> 6377 T453 oasc.ZkController.register We are http://127.0.0.1:64828/sp_ffw/f/collection1/ and leader is http://127.0.0.1:64828/sp_ffw/f/collection1/
> [junit4:junit4] 2> 6381 T453 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:64828/sp_ffw/f
> [junit4:junit4] 2> 6381 T453 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4] 2> 6381 T453 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 6382 T453 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 6385 T453 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 6386 T428 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 6387 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 6388 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 6404 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:
> [junit4:junit4] 2> 6421 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@771cc1d1
> [junit4:junit4] 2> 6422 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 6423 T455 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 6424 T455 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 6424 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29639
> [junit4:junit4] 2> 6424 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29639
> [junit4:junit4] 2> 6426 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720004 with negotiated timeout 10000 for client /140.211.11.196:29639
> [junit4:junit4] 2> 6426 T455 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720004, negotiated timeout = 10000
> [junit4:junit4] 2> 6426 T456 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@771cc1d1 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 6427 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 6428 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 6433 T428 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
> [junit4:junit4] 2> 6622 T428 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4] 2> 6625 T428 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58138
> [junit4:junit4] 2> 6626 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 6626 T428 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 6627 T428 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266
> [junit4:junit4] 2> 6627 T428 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/solr.xml
> [junit4:junit4] 2> 6628 T428 oasc.CoreContainer.<init> New CoreContainer 247900808
> [junit4:junit4] 2> 6628 T428 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/'
> [junit4:junit4] 2> 6629 T428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/'
> [junit4:junit4] 2> 6689 T428 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
> [junit4:junit4] 2> 6690 T428 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 6691 T428 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 6691 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 6691 T428 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 6692 T428 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 6692 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 6693 T428 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 6693 T428 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 6694 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 6730 T428 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4] 2> 6752 T428 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45780/solr
> [junit4:junit4] 2> 6752 T428 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 6753 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@e24af2d
> [junit4:junit4] 2> 6754 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 6755 T466 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 6756 T466 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 6756 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:33189
> [junit4:junit4] 2> 6756 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:33189
> [junit4:junit4] 2> 6794 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720005 with negotiated timeout 20000 for client /140.211.11.196:33189
> [junit4:junit4] 2> 6794 T466 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720005, negotiated timeout = 20000
> [junit4:junit4] 2> 6795 T467 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e24af2d name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 6795 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 6797 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720005
> [junit4:junit4] 2> 6798 T467 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 6798 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720005 closed
> [junit4:junit4] 2> 6799 T430 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13ca77aee720005, likely client has closed socket
> [junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
> [junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> [junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4] 2>
> [junit4:junit4] 2> 6799 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
> [junit4:junit4] 2> 6801 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:33189 which had sessionid 0x13ca77aee720005
> [junit4:junit4] 2> 6816 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3151ee66
> [junit4:junit4] 2> 6818 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 6818 T468 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 6819 T468 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 6819 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:15764
> [junit4:junit4] 2> 6820 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:15764
> [junit4:junit4] 2> 6821 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720006 with negotiated timeout 20000 for client /140.211.11.196:15764
> [junit4:junit4] 2> 6821 T468 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720006, negotiated timeout = 20000
> [junit4:junit4] 2> 6822 T469 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3151ee66 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 6822 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 6823 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 6825 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 6833 T428 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58138_sp_ffw%2Ff
> [junit4:junit4] 2> 6835 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58138_sp_ffw%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58138_sp_ffw%2Ff
> [junit4:junit4] 2> 6836 T428 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58138_sp_ffw%2Ff
> [junit4:junit4] 2> 6841 T450 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4] 2> 6841 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 6841 T456 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4] 2> 6851 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 6859 T470 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/collection1
> [junit4:junit4] 2> 6859 T470 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 6860 T470 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 6861 T470 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 6863 T470 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/collection1/'
> [junit4:junit4] 2> 6864 T470 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/collection1/lib/README' to classloader
> [junit4:junit4] 2> 6865 T470 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 6923 T470 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 6999 T470 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 7100 T470 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4] 2> 7108 T470 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4] 2> 7759 T470 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 7771 T470 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 7776 T470 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 7802 T470 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 7808 T470 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 7813 T470 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 7815 T470 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 7817 T470 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/
> [junit4:junit4] 2> 7817 T470 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5925c9a4
> [junit4:junit4] 2> 7818 T470 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4] 2> 7819 T470 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1 forceNew:false
> [junit4:junit4] 2> 7820 T470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1
> [junit4:junit4] 2> 7820 T470 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index/
> [junit4:junit4] 2> 7820 T470 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 7822 T470 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index forceNew:false
> [junit4:junit4] 2> 7828 T470 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb6de9f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 7829 T470 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 7830 T470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index
> [junit4:junit4] 2> 7830 T470 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4] 2> 7831 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 7832 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"control_collection",
> [junit4:junit4] 2> "node_name":"127.0.0.1:64828_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:64828/sp_ffw/f"}
> [junit4:junit4] 2> 7832 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 7833 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4] 2> 7833 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 7834 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4] 2> 7834 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 7835 T470 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 7835 T470 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 7836 T470 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 7836 T470 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 7837 T470 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4] 2> 7837 T470 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4] 2> 7838 T470 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 7838 T470 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4] 2> 7839 T470 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4] 2> 7839 T470 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4] 2> 7840 T470 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 7840 T470 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 7841 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 7842 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 7842 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 7843 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 7844 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 7844 T470 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 7845 T470 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 7845 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 7845 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 7846 T470 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4] 2> 7845 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 7847 T470 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4] 2> 7860 T470 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 7865 T470 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4] 2> 7866 T470 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4] 2> 7869 T470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1
> [junit4:junit4] 2> 7871 T470 oass.SolrIndexSearcher.<init> Opening Searcher@4f74a09b main
> [junit4:junit4] 2> 7872 T470 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 7872 T470 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 7873 T470 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4] 2> 7880 T470 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4] 2> 7933 T471 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f74a09b main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 7938 T470 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 7939 T470 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 9358 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 9359 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:58138_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:58138/sp_ffw/f"}
> [junit4:junit4] 2> 9359 T451 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
> [junit4:junit4] 2> 9359 T451 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 9373 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 9375 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 9375 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 9943 T470 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 9943 T470 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58138/sp_ffw/f collection:collection1 shard:shard1
> [junit4:junit4] 2> 9944 T470 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
> [junit4:junit4] 2> 9963 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
> [junit4:junit4] 2> 9964 T470 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4] 2> 9964 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 9975 T470 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4] 2> 9975 T470 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4] 2> 9975 T470 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58138/sp_ffw/f/collection1/
> [junit4:junit4] 2> 9975 T470 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4] 2> 9976 T470 oasc.SyncStrategy.syncToMe http://127.0.0.1:58138/sp_ffw/f/collection1/ has no replicas
> [junit4:junit4] 2> 9976 T470 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58138/sp_ffw/f/collection1/
> [junit4:junit4] 2> 9976 T470 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
> [junit4:junit4] 2> 9983 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 10883 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 10907 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 10907 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 10907 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 10960 T470 oasc.ZkController.register We are http://127.0.0.1:58138/sp_ffw/f/collection1/ and leader is http://127.0.0.1:58138/sp_ffw/f/collection1/
> [junit4:junit4] 2> 10960 T470 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58138/sp_ffw/f
> [junit4:junit4] 2> 10960 T470 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4] 2> 10960 T470 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 10961 T470 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 10963 T470 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 10964 T428 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 10965 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 10966 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 11158 T428 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4] 2> 11162 T428 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37419
> [junit4:junit4] 2> 11162 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 11163 T428 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 11163 T428 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813
> [junit4:junit4] 2> 11164 T428 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/solr.xml
> [junit4:junit4] 2> 11164 T428 oasc.CoreContainer.<init> New CoreContainer 157865851
> [junit4:junit4] 2> 11165 T428 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/'
> [junit4:junit4] 2> 11165 T428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/'
> [junit4:junit4] 2> 11221 T428 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
> [junit4:junit4] 2> 11221 T428 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 11222 T428 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 11222 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 11223 T428 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 11223 T428 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 11224 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 11224 T428 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 11224 T428 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 11225 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 11246 T428 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4] 2> 11266 T428 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45780/solr
> [junit4:junit4] 2> 11267 T428 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 11267 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5bd3155b
> [junit4:junit4] 2> 11269 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 11269 T481 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 11270 T481 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 11270 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40216
> [junit4:junit4] 2> 11270 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40216
> [junit4:junit4] 2> 11273 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720007 with negotiated timeout 20000 for client /140.211.11.196:40216
> [junit4:junit4] 2> 11273 T481 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720007, negotiated timeout = 20000
> [junit4:junit4] 2> 11273 T482 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bd3155b name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 11273 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 11275 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720007
> [junit4:junit4] 2> 11286 T482 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 11286 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:40216 which had sessionid 0x13ca77aee720007
> [junit4:junit4] 2> 11286 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720007 closed
> [junit4:junit4] 2> 11287 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
> [junit4:junit4] 2> 11298 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@152e63d8
> [junit4:junit4] 2> 11299 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 11300 T483 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 11300 T483 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 11300 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:54741
> [junit4:junit4] 2> 11301 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:54741
> [junit4:junit4] 2> 11302 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720008 with negotiated timeout 20000 for client /140.211.11.196:54741
> [junit4:junit4] 2> 11302 T483 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720008, negotiated timeout = 20000
> [junit4:junit4] 2> 11303 T484 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@152e63d8 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 11303 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 11304 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 11306 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 11313 T428 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37419_sp_ffw%2Ff
> [junit4:junit4] 2> 11314 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37419_sp_ffw%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37419_sp_ffw%2Ff
> [junit4:junit4] 2> 11315 T428 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37419_sp_ffw%2Ff
> [junit4:junit4] 2> 11319 T469 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4] 2> 11320 T456 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4] 2> 11320 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 11320 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 11320 T450 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4] 2> 11320 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 11325 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 11333 T485 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/collection1
> [junit4:junit4] 2> 11333 T485 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 11334 T485 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 11334 T485 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 11336 T485 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/collection1/'
> [junit4:junit4] 2> 11338 T485 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/collection1/lib/README' to classloader
> [junit4:junit4] 2> 11338 T485 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 11393 T485 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 11467 T485 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 11568 T485 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4] 2> 11576 T485 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4] 2> 12240 T485 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 12252 T485 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 12256 T485 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 12283 T485 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 12289 T485 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 12294 T485 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 12296 T485 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 12298 T485 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/
> [junit4:junit4] 2> 12298 T485 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5925c9a4
> [junit4:junit4] 2> 12299 T485 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4] 2> 12299 T485 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2 forceNew:false
> [junit4:junit4] 2> 12300 T485 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2
> [junit4:junit4] 2> 12300 T485 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/index/
> [junit4:junit4] 2> 12301 T485 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 12302 T485 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/index forceNew:false
> [junit4:junit4] 2> 12313 T485 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@475d785c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 12313 T485 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 12314 T485 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/index
> [junit4:junit4] 2> 12315 T485 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4] 2> 12317 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 12317 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4] 2> 12317 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 12318 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4] 2> 12319 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 12319 T485 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 12319 T485 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 12320 T485 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 12320 T485 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 12321 T485 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4] 2> 12322 T485 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4] 2> 12322 T485 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 12323 T485 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4] 2> 12323 T485 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4] 2> 12323 T485 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4] 2> 12324 T485 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 12324 T485 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 12325 T485 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 12326 T485 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 12326 T485 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 12327 T485 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 12327 T485 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 12328 T485 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 12328 T485 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 12329 T485 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4] 2> 12330 T485 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4] 2> 12342 T485 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 12347 T485 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4] 2> 12348 T485 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4] 2> 12351 T485 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2
> [junit4:junit4] 2> 12353 T485 oass.SolrIndexSearcher.<init> Opening Searcher@713d0cf main
> [junit4:junit4] 2> 12354 T485 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 12354 T485 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 12355 T485 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4] 2> 12362 T485 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4] 2> 12414 T486 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@713d0cf main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 12420 T485 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 12420 T485 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 12423 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 12424 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:58138_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:58138/sp_ffw/f"}
> [junit4:junit4] 2> 12435 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:37419_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:37419/sp_ffw/f"}
> [junit4:junit4] 2> 12435 T451 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4:junit4] 2> 12435 T451 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
> [junit4:junit4] 2> 12447 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 12447 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 12447 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 12447 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 13423 T485 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 13423 T485 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37419/sp_ffw/f collection:collection1 shard:shard2
> [junit4:junit4] 2> 13424 T485 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
> [junit4:junit4] 2> 13469 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:delete cxid:0x42 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
> [junit4:junit4] 2> 13470 T485 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4] 2> 13471 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:create cxid:0x43 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 13481 T485 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4] 2> 13481 T485 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4] 2> 13481 T485 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37419/sp_ffw/f/collection1/
> [junit4:junit4] 2> 13481 T485 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4] 2> 13482 T485 oasc.SyncStrategy.syncToMe http://127.0.0.1:37419/sp_ffw/f/collection1/ has no replicas
> [junit4:junit4] 2> 13482 T485 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37419/sp_ffw/f/collection1/
> [junit4:junit4] 2> 13482 T485 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
> [junit4:junit4] 2> 13487 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:create cxid:0x4c zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 13958 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 13978 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 13978 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 13978 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 13978 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 14000 T485 oasc.ZkController.register We are http://127.0.0.1:37419/sp_ffw/f/collection1/ and leader is http://127.0.0.1:37419/sp_ffw/f/collection1/
> [junit4:junit4] 2> 14000 T485 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37419/sp_ffw/f
> [junit4:junit4] 2> 14000 T485 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4] 2> 14000 T485 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 14001 T485 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 14003 T485 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 14004 T428 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 14005 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 14005 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 14191 T428 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4] 2> 14194 T428 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30255
> [junit4:junit4] 2> 14195 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 14195 T428 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 14196 T428 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853
> [junit4:junit4] 2> 14196 T428 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/solr.xml
> [junit4:junit4] 2> 14197 T428 oasc.CoreContainer.<init> New CoreContainer 363940238
> [junit4:junit4] 2> 14197 T428 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/'
> [junit4:junit4] 2> 14198 T428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/'
> [junit4:junit4] 2> 14253 T428 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
> [junit4:junit4] 2> 14253 T428 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 14254 T428 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 14254 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 14254 T428 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 14255 T428 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 14255 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 14256 T428 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 14256 T428 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 14257 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 14280 T428 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4] 2> 14300 T428 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45780/solr
> [junit4:junit4] 2> 14301 T428 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 14301 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5c65b07d
> [junit4:junit4] 2> 14302 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 14303 T496 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 14304 T496 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 14304 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:12017
> [junit4:junit4] 2> 14305 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:12017
> [junit4:junit4] 2> 14307 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720009 with negotiated timeout 20000 for client /140.211.11.196:12017
> [junit4:junit4] 2> 14307 T496 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720009, negotiated timeout = 20000
> [junit4:junit4] 2> 14307 T497 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c65b07d name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 14307 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 14309 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720009
> [junit4:junit4] 2> 14322 T497 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 14322 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:12017 which had sessionid 0x13ca77aee720009
> [junit4:junit4] 2> 14322 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720009 closed
> [junit4:junit4] 2> 14323 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
> [junit4:junit4] 2> 14337 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@21b9d8f4
> [junit4:junit4] 2> 14338 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 14338 T498 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 14338 T498 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 14339 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:15905
> [junit4:junit4] 2> 14339 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:15905
> [junit4:junit4] 2> 14340 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee72000a with negotiated timeout 20000 for client /140.211.11.196:15905
> [junit4:junit4] 2> 14340 T498 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee72000a, negotiated timeout = 20000
> [junit4:junit4] 2> 14341 T499 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21b9d8f4 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 14341 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 14342 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 14344 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000a type:create cxid:0x2 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 14351 T428 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30255_sp_ffw%2Ff
> [junit4:junit4] 2> 14352 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000a type:delete cxid:0x4 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:30255_sp_ffw%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:30255_sp_ffw%2Ff
> [junit4:junit4] 2> 14353 T428 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30255_sp_ffw%2Ff
> [junit4:junit4] 2> 14356 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 14357 T456 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 14357 T469 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 14357 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 14357 T450 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 14358 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 14358 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 14359 T484 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 14363 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 14371 T500 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/collection1
> [junit4:junit4] 2> 14371 T500 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 14372 T500 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 14372 T500 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 14374 T500 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/collection1/'
> [junit4:junit4] 2> 14376 T500 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/collection1/lib/README' to classloader
> [junit4:junit4] 2> 14376 T500 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 14431 T500 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 14506 T500 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 14607 T500 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4] 2> 14615 T500 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4] 2> 15272 T500 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 15285 T500 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 15289 T500 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 15315 T500 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 15321 T500 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 15326 T500 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 15328 T500 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 15330 T500 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/
> [junit4:junit4] 2> 15330 T500 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5925c9a4
> [junit4:junit4] 2> 15331 T500 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4] 2> 15331 T500 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3 forceNew:false
> [junit4:junit4] 2> 15332 T500 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
> [junit4:junit4] 2> 15332 T500 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index/
> [junit4:junit4] 2> 15333 T500 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 15334 T500 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index forceNew:false
> [junit4:junit4] 2> 15341 T500 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57b3153c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 15341 T500 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 15342 T500 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index
> [junit4:junit4] 2> 15342 T500 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4] 2> 15345 T500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 15345 T500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4] 2> 15345 T500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 15346 T500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4] 2> 15346 T500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 15347 T500 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 15347 T500 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 15348 T500 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 15348 T500 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 15349 T500 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4] 2> 15349 T500 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4] 2> 15350 T500 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 15351 T500 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4] 2> 15351 T500 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4] 2> 15351 T500 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4] 2> 15352 T500 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 15352 T500 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 15353 T500 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 15353 T500 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 15354 T500 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 15355 T500 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 15355 T500 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 15356 T500 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 15356 T500 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 15357 T500 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4] 2> 15357 T500 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4] 2> 15370 T500 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 15375 T500 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4] 2> 15376 T500 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4] 2> 15379 T500 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
> [junit4:junit4] 2> 15381 T500 oass.SolrIndexSearcher.<init> Opening Searcher@58c9d231 main
> [junit4:junit4] 2> 15382 T500 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 15382 T500 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 15383 T500 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4] 2> 15390 T500 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4] 2> 15446 T501 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@58c9d231 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 15452 T500 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 15452 T500 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 15492 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 15494 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard2",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:37419_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:37419/sp_ffw/f"}
> [junit4:junit4] 2> 15499 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:30255_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:30255/sp_ffw/f"}
> [junit4:junit4] 2> 15499 T451 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4:junit4] 2> 15500 T451 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 15518 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 15518 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 15518 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 15518 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 15518 T499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 16455 T500 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 16455 T500 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30255/sp_ffw/f collection:collection1 shard:shard1
> [junit4:junit4] 2> 16486 T500 oasc.ZkController.register We are http://127.0.0.1:30255/sp_ffw/f/collection1/ and leader is http://127.0.0.1:58138/sp_ffw/f/collection1/
> [junit4:junit4] 2> 16486 T500 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30255/sp_ffw/f
> [junit4:junit4] 2> 16486 T500 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4] 2> 16487 T500 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4] 2> ASYNC NEW_CORE C14 name=collection1 org.apache.solr.core.SolrCore@3e2cc207 url=http://127.0.0.1:30255/sp_ffw/f/collection1 node=127.0.0.1:30255_sp_ffw%2Ff C14_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:30255_sp_ffw%2Ff, base_url=http://127.0.0.1:30255/sp_ffw/f}
> [junit4:junit4] 2> 16494 T502 C14 P30255 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
> [junit4:junit4] 2> 16494 T500 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 16495 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4] 2> 16495 T502 C14 P30255 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4] 2> 16495 T502 C14 P30255 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 16496 T428 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 16496 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 16497 T502 C14 P30255 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 16497 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 16694 T428 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4] 2> 16697 T428 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55162
> [junit4:junit4] 2> 16698 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 16698 T428 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 16699 T428 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349
> [junit4:junit4] 2> 16699 T428 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/solr.xml
> [junit4:junit4] 2> 16700 T428 oasc.CoreContainer.<init> New CoreContainer 63645884
> [junit4:junit4] 2> 16700 T428 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/'
> [junit4:junit4] 2> 16701 T428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/'
> [junit4:junit4] 2> 16769 T428 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
> [junit4:junit4] 2> 16770 T428 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 16770 T428 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 16771 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 16771 T428 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 16772 T428 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 16772 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 16773 T428 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 16773 T428 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 16774 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 16796 T428 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4] 2> 16816 T428 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45780/solr
> [junit4:junit4] 2> 16817 T428 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 16817 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3d5bc62e
> [junit4:junit4] 2> 16818 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 16819 T512 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 16820 T512 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 16820 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:47360
> [junit4:junit4] 2> 16821 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:47360
> [junit4:junit4] 2> 16855 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee72000b with negotiated timeout 20000 for client /140.211.11.196:47360
> [junit4:junit4] 2> 16856 T512 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee72000b, negotiated timeout = 20000
> [junit4:junit4] 2> 16856 T513 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d5bc62e name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 16856 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 16858 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee72000b
> [junit4:junit4] 2> 16871 T513 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 16871 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:47360 which had sessionid 0x13ca77aee72000b
> [junit4:junit4] 2> 16871 T428 oaz.ZooKeeper.close Session: 0x13ca77aee72000b closed
> [junit4:junit4] 2> 16872 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
> [junit4:junit4] 2> 16883 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3155ba4
> [junit4:junit4] 2> 16884 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 16884 T514 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 16885 T514 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
> [junit4:junit4] 2> 16885 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49058
> [junit4:junit4] 2> 16886 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49058
> [junit4:junit4] 2> 16887 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee72000c with negotiated timeout 20000 for client /140.211.11.196:49058
> [junit4:junit4] 2> 16887 T514 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee72000c, negotiated timeout = 20000
> [junit4:junit4] 2> 16887 T515 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3155ba4 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 16888 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 16889 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000c type:create cxid:0x1 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 16890 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000c type:create cxid:0x2 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 16898 T428 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55162_sp_ffw%2Ff
> [junit4:junit4] 2> 16899 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000c type:delete cxid:0x4 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55162_sp_ffw%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55162_sp_ffw%2Ff
> [junit4:junit4] 2> 16900 T428 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55162_sp_ffw%2Ff
> [junit4:junit4] 2> 16904 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 16905 T456 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 16905 T450 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 16905 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 16905 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 16905 T499 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 16905 T469 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 16906 T499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 16906 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 16908 T484 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 16912 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 16920 T516 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/collection1
> [junit4:junit4] 2> 16921 T516 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 16922 T516 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 16922 T516 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 16924 T516 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/collection1/'
> [junit4:junit4] 2> 16925 T516 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/collection1/lib/README' to classloader
> [junit4:junit4] 2> 16926 T516 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 16981 T516 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 17059 T516 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 17062 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 17063 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"recovering",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:30255_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:30255/sp_ffw/f"}
> [junit4:junit4] 2> 17077 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 17077 T499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 17077 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 17077 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 17077 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 17160 T516 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4] 2> 17160 T515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 17168 T516 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4] 2> 17833 T516 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 17848 T516 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 17852 T516 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 17889 T516 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 17895 T516 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 17902 T516 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 17904 T516 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 17906 T516 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/
> [junit4:junit4] 2> 17906 T516 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5925c9a4
> [junit4:junit4] 2> 17907 T516 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4] 2> 17908 T516 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4 forceNew:false
> [junit4:junit4] 2> 17909 T516 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4
> [junit4:junit4] 2> 17910 T516 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/index/
> [junit4:junit4] 2> 17911 T516 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 17913 T516 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/index forceNew:false
> [junit4:junit4] 2> 17931 T516 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2092ab58; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 17931 T516 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 17932 T516 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/index
> [junit4:junit4] 2> 17933 T516 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4] 2> 17935 T516 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 17935 T516 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4] 2> 17936 T516 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 17936 T516 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4] 2> 17937 T516 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 17937 T516 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 17937 T516 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 17938 T516 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 17939 T516 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 17939 T516 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4] 2> 17940 T516 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4] 2> 17940 T516 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 17941 T516 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4] 2> 17941 T516 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4] 2> 17941 T516 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4] 2> 17942 T516 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 17943 T516 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 17943 T516 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 17944 T516 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 17944 T516 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 17945 T516 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 17945 T516 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 17946 T516 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 17947 T516 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 17947 T516 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4] 2> 17948 T516 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4] 2> 17969 T516 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 17976 T516 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4] 2> 17978 T516 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4] 2> 17982 T516 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4
> [junit4:junit4] 2> 17985 T516 oass.SolrIndexSearcher.<init> Opening Searcher@2b5bd32c main
> [junit4:junit4] 2> 17986 T516 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 17986 T516 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 17987 T516 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4] 2> 17995 T516 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4] 2> 18048 T517 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b5bd32c main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 18054 T516 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 18054 T516 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 18585 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 18587 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:55162_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:55162/sp_ffw/f"}
> [junit4:junit4] 2> 18587 T451 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4:junit4] 2> 18587 T451 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
> [junit4:junit4] 2> 18602 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 18602 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 18602 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 18602 T499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 18602 T515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 18602 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 19057 T516 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 19057 T516 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55162/sp_ffw/f collection:collection1 shard:shard2
> [junit4:junit4] 2> 19062 T516 oasc.ZkController.register We are http://127.0.0.1:55162/sp_ffw/f/collection1/ and leader is http://127.0.0.1:37419/sp_ffw/f/collection1/
> [junit4:junit4] 2> 19062 T516 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55162/sp_ffw/f
> [junit4:junit4] 2> 19062 T516 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4] 2> 19062 T516 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4] 2> ASYNC NEW_CORE C15 name=collection1 org.apache.solr.core.SolrCore@41d5df31 url=http://127.0.0.1:55162/sp_ffw/f/collection1 node=127.0.0.1:55162_sp_ffw%2Ff C15_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:55162_sp_ffw%2Ff, base_url=http://127.0.0.1:55162/sp_ffw/f}
> [junit4:junit4] 2> 19063 T518 C15 P55162 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
> [junit4:junit4] 2> 19063 T518 C15 P55162 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4] 2> 19064 T516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 19064 T518 C15 P55162 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4] 2> 19064 T518 C15 P55162 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 19065 T428 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 19066 T518 C15 P55162 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 19066 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 19066 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 19085 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 19087 T428 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
> [junit4:junit4] 2> 19088 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> C14_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:30255_sp_ffw%2Ff, base_url=http://127.0.0.1:30255/sp_ffw/f}
> [junit4:junit4] 2> 19539 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:58138/sp_ffw/f/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4] 2> 19548 T502 C14 P30255 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
> [junit4:junit4] 2> 19566 T502 C14 P30255 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:30255/sp_ffw/f START replicas=[http://127.0.0.1:58138/sp_ffw/f/collection1/] nUpdates=100
> [junit4:junit4] 2> 19567 T502 C14 P30255 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
> [junit4:junit4] 2> 19568 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4] 2> 19568 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4] 2> 19568 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4] 2> 19569 T502 C14 P30255 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4] 2> 19569 T502 C14 P30255 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:58138/sp_ffw/f/collection1/. core=collection1
> [junit4:junit4] 2> 19569 T502 C14 P30255 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> ASYNC NEW_CORE C16 name=collection1 org.apache.solr.core.SolrCore@60a5494 url=http://127.0.0.1:58138/sp_ffw/f/collection1 node=127.0.0.1:58138_sp_ffw%2Ff C16_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58138_sp_ffw%2Ff, base_url=http://127.0.0.1:58138/sp_ffw/f, leader=true}
> [junit4:junit4] 2> 19580 T460 C16 P58138 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
> [junit4:junit4] 2> 19599 T461 C16 P58138 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
> [junit4:junit4] 2> 19600 T461 C16 P58138 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1
> [junit4:junit4] 2> 19604 T461 C16 P58138 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb6de9f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 19605 T461 C16 P58138 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 19635 T461 C16 P58138 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb6de9f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb6de9f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> 19635 T461 C16 P58138 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
> [junit4:junit4] 2> 19637 T461 C16 P58138 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1
> [junit4:junit4] 2> 19637 T461 C16 P58138 oass.SolrIndexSearcher.<init> Opening Searcher@7765731d realtime
> [junit4:junit4] 2> 19638 T461 C16 P58138 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 19638 T461 C16 P58138 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 56
> [junit4:junit4] 2> 19696 T502 C14 P30255 oash.ReplicationHandler.inform Commits will be reserved for 10000
> [junit4:junit4] 2> 19697 T502 C14 P30255 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
> [junit4:junit4] 2> 19723 T502 C14 P30255 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4] 2> 19726 T462 C16 P58138 oash.ReplicationHandler.inform Commits will be reserved for 10000
> [junit4:junit4] 2> 19726 T462 C16 P58138 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
> [junit4:junit4] 2> 19727 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Master's generation: 2
> [junit4:junit4] 2> 19728 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
> [junit4:junit4] 2> 19728 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Starting replication process
> [junit4:junit4] 2> 19731 T462 C16 P58138 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1
> [junit4:junit4] 2> 19732 T462 C16 P58138 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index
> [junit4:junit4] 2> 19732 T462 C16 P58138 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
> [junit4:junit4] 2> 19733 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
> [junit4:junit4] 2> 19734 T502 C14 P30255 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 forceNew:false
> [junit4:junit4] 2> 19735 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
> [junit4:junit4] 2> 19735 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffa2f97; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
> [junit4:junit4] 2> 19749 T462 C16 P58138 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=5
> [junit4:junit4] 2> 19762 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index
> [junit4:junit4] 2> 19763 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
> [junit4:junit4] 2> 19764 T502 C14 P30255 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130205001216565
> [junit4:junit4] 2> 19771 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
> [junit4:junit4] 2> 19773 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
> [junit4:junit4] 2> 19773 T502 C14 P30255 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565
> [junit4:junit4] 2> 19777 T502 C14 P30255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffa2f97; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> 19777 T502 C14 P30255 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
> [junit4:junit4] 2> 19779 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
> [junit4:junit4] 2> 19783 T502 C14 P30255 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
> [junit4:junit4] 2> 19784 T502 C14 P30255 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
> [junit4:junit4] 2> 19784 T502 C14 P30255 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
> [junit4:junit4] 2> 19785 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565
> [junit4:junit4] 2> 19786 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
> [junit4:junit4] 2> 19789 T502 C14 P30255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffa2f97; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> 19790 T502 C14 P30255 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
> [junit4:junit4] 2> 19791 T502 C14 P30255 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
> [junit4:junit4] 2> 19791 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
> [junit4:junit4] 2> 19792 T502 C14 P30255 oass.SolrIndexSearcher.<init> Opening Searcher@2dd212cf main
> [junit4:junit4] 2> 19793 T501 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2dd212cf main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4] 2> 19794 T501 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index
> [junit4:junit4] 2> 19795 T502 C14 P30255 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
> [junit4:junit4] 2> 19798 T502 C14 P30255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffa2f97; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffa2f97; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
> [junit4:junit4] 2> 19799 T502 C14 P30255 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
> [junit4:junit4] 2> 19800 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
> [junit4:junit4] 2> 19800 T502 C14 P30255 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 19800 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565
> [junit4:junit4] 2> 19801 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index
> [junit4:junit4] 2> 19801 T502 C14 P30255 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4] 2> 19801 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4] 2> 19802 T502 C14 P30255 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 19802 T502 C14 P30255 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 19804 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4] 2> 20092 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 20111 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 20112 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard2",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"recovering",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:55162_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:55162/sp_ffw/f"}
> [junit4:junit4] 2> 20118 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:30255_sp_ffw%2Ff",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:30255/sp_ffw/f"}
> [junit4:junit4] 2> 20130 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 20131 T515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 20131 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 20131 T499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 20131 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 20130 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 21095 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 22098 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> C15_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:55162_sp_ffw%2Ff, base_url=http://127.0.0.1:55162/sp_ffw/f}
> [junit4:junit4] 2> 23089 T518 C15 P55162 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:37419/sp_ffw/f/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4] 2> 23089 T518 C15 P55162 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55162/sp_ffw/f START replicas=[http://127.0.0.1:37419/sp_ffw/f/collection1/] nUpdates=100
> [junit4:junit4] 2> 23090 T518 C15 P55162 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
> [junit4:junit4] 2> 23090 T518 C15 P55162 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4] 2> 23090 T518 C15 P55162 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4] 2> 23091 T518 C15 P55162 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4] 2> 23091 T518 C15 P55162 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4] 2> 23091 T518 C15 P55162 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:37419/sp_ffw/f/collection1/. core=collection1
> [junit4:junit4] 2> 23092 T518 C15 P55162 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 23101 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> ASYNC NEW_CORE C17 name=collection1 org.apache.solr.core.SolrCore@ab64f2 url=http:
>
> [...truncated too long message...]
>
> .io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
> [junit4:junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264)
> [junit4:junit4] > at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98)
> [junit4:junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
> [junit4:junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
> [junit4:junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
> [junit4:junit4] > at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
> [junit4:junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
> [junit4:junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
> [junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
> [junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
> [junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
> [junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
> [junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
> [junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
> [junit4:junit4] > ... 5 more
> [junit4:junit4] > Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=939, name=testExecutor-345-thread-5, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
> [junit4:junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:30255/sp_ffw/f
> [junit4:junit4] > at __randomizedtesting.SeedInfo.seed([715CCD8973136CF0]:0)
> [junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:658)
> [junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> [junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> [junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:30255/sp_ffw/f
> [junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:412)
> [junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
> [junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:656)
> [junit4:junit4] > ... 3 more
> [junit4:junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
> [junit4:junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
> [junit4:junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:150)
> [junit4:junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:121)
> [junit4:junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149)
> [junit4:junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
> [junit4:junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264)
> [junit4:junit4] > at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98)
> [junit4:junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
> [junit4:junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
> [junit4:junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
> [junit4:junit4] > at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
> [junit4:junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
> [junit4:junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
> [junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
> [junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
> [junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
> [junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
> [junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
> [junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
> [junit4:junit4] > ... 5 more
> [junit4:junit4] 2> 388062 T428 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4:junit4] 2> 388169 T431 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
> [junit4:junit4] 2> 388258 T499 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4] 2> 388258 T499 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4] 2> 388258 T499 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 388430 T515 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4] 2> 388430 T515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
> [junit4:junit4] 2> 388430 T515 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4] 2> 388430 T515 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {n_f1=PostingsFormat(name=NestedPulsing), foo_b=PostingsFormat(name=Memory doPackFST= true), cat=Lucene41(blocksize=128), foo_d=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), foo_f=PostingsFormat(name=Memory doPackFST= true), n_tl1=PostingsFormat(name=NestedPulsing), n_d1=Lucene41(blocksize=128), rnd_b=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), intDefault=Lucene41(blocksize=128), n_td1=PostingsFormat(name=NestedPulsing), timestamp=Lucene41(blocksize=128), id=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), range_facet_sl=PostingsFormat(name=Memory doPackFST= true), range_facet_si=PostingsFormat(name=NestedPulsing), oddField_s=PostingsFormat(name=Memory doPackFST= true), sequence_i=PostingsFormat(name=Memory doPackFST= true), name=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), foo_i=PostingsFormat(name=NestedPulsing), regex_dup_B_s=Lucene41(blocksize=128), multiDefault=PostingsFormat(name=NestedPulsing), n_tf1=Lucene41(blocksize=128), n_dt1=PostingsFormat(name=NestedPulsing), genre_s=PostingsFormat(name=Memory doPackFST= true), author_t=PostingsFormat(name=NestedPulsing), n_ti1=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), range_facet_l=Lucene41(blocksize=128), text=PostingsFormat(name=Memory doPackFST= true), _version_=Lucene41(blocksize=128), val_i=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), SubjectTerms_mfacet=Lucene41(blocksize=128), series_t=PostingsFormat(name=NestedPulsing), a_t=Lucene41(blocksize=128), n_tdt1=Lucene41(blocksize=128), regex_dup_A_s=PostingsFormat(name=Memory doPackFST= true), price=PostingsFormat(name=Memory doPackFST= true), other_tl1=Lucene41(blocksize=128), n_l1=Lucene41(blocksize=128), a_si=PostingsFormat(name=NestedPulsing), inStock=PostingsFormat(name=Memory doPackFST= true)}, sim=DefaultSimilarity, locale=et, timezone=ECT
> [junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=2,free=327414984,total=475004928
> [junit4:junit4] 2> NOTE: All tests run in this JVM: [RequestHandlersTest, TestFiltering, TestRandomFaceting, TestDefaultSimilarityFactory, BinaryUpdateRequestHandlerTest, DistributedSpellCheckComponentTest, TestGroupingSearch, JsonLoaderTest, BasicDistributedZkTest]
> [junit4:junit4] Completed on J0 in 388.65s, 1 test, 1 error <<< FAILURES!
>
> [...truncated 582 lines...]
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:346: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:178: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:428: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:841: There were test failures: 249 suites, 1038 tests, 1 error, 23 ignored (5 assumptions)
>
> Total time: 39 minutes 26 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3708 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3708/
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=935, name=testExecutor-345-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=935, name=testExecutor-345-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:30255/sp_ffw/f
at __randomizedtesting.SeedInfo.seed([715CCD8973136CF0]:0)
at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:658)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:30255/sp_ffw/f
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:412)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:656)
... 3 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:150)
at java.net.SocketInputStream.read(SocketInputStream.java:121)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264)
at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
... 5 more
Build Log:
[...truncated 8817 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4] 2> 0 T428 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /sp_ffw/f
[junit4:junit4] 2> 4 T428 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1360019516837
[junit4:junit4] 2> 11 T428 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 15 T429 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 73 T429 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 74 T429 oaz.Environment.logEnv Server environment:host.name=lucene.zones.apache.org
[junit4:junit4] 2> 74 T429 oaz.Environment.logEnv Server environment:java.version=1.7.0_09
[junit4:junit4] 2> 74 T429 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4] 2> 74 T429 oaz.Environment.logEnv Server environment:java.home=/usr/local/openjdk7/jre
[junit4:junit4] 2> 74 T429 oaz.Environment.logEnv Server environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpclient-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpcore-4.1.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpmime-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 75 T429 oaz.Environment.logEnv Server environment:java.library.path=/usr/local/openjdk7/jre/lib/amd64/server:/usr/local/openjdk7/jre/lib/amd64:/usr/local/openjdk7/jre/../lib/amd64:/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4] 2> 75 T429 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4] 2> 75 T429 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4] 2> 75 T429 oaz.Environment.logEnv Server environment:os.name=FreeBSD
[junit4:junit4] 2> 75 T429 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4] 2> 76 T429 oaz.Environment.logEnv Server environment:os.version=9.0-RELEASE
[junit4:junit4] 2> 76 T429 oaz.Environment.logEnv Server environment:user.name=hudson
[junit4:junit4] 2> 76 T429 oaz.Environment.logEnv Server environment:user.home=/home/hudson
[junit4:junit4] 2> 76 T429 oaz.Environment.logEnv Server environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 109 T429 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 109 T429 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 109 T429 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 115 T429 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 116 T428 oasc.ZkTestServer.run start zk server on port:45780
[junit4:junit4] 2> 179 T428 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 180 T428 oaz.Environment.logEnv Client environment:host.name=lucene.zones.apache.org
[junit4:junit4] 2> 180 T428 oaz.Environment.logEnv Client environment:java.version=1.7.0_09
[junit4:junit4] 2> 180 T428 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4] 2> 180 T428 oaz.Environment.logEnv Client environment:java.home=/usr/local/openjdk7/jre
[junit4:junit4] 2> 181 T428 oaz.Environment.logEnv Client environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpclient-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpcore-4.1.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpmime-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 182 T428 oaz.Environment.logEnv Client environment:java.library.path=/usr/local/openjdk7/jre/lib/amd64/server:/usr/local/openjdk7/jre/lib/amd64:/usr/local/openjdk7/jre/../lib/amd64:/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4] 2> 182 T428 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4] 2> 182 T428 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4] 2> 183 T429 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 183 T428 oaz.Environment.logEnv Client environment:os.name=FreeBSD
[junit4:junit4] 2> 183 T428 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4] 2> 183 T428 oaz.Environment.logEnv Client environment:os.version=9.0-RELEASE
[junit4:junit4] 2> 183 T428 oaz.Environment.logEnv Client environment:user.name=hudson
[junit4:junit4] 2> 184 T428 oaz.Environment.logEnv Client environment:user.home=/home/hudson
[junit4:junit4] 2> 184 T428 oaz.Environment.logEnv Client environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 187 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@b2da32d
[junit4:junit4] 2> 246 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 263 T432 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 266 T432 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 267 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:21112
[junit4:junit4] 2> 284 T430 oazs.NIOServerCnxn.doIO WARNING Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4:junit4] 2> 285 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:21112 (no session established for client)
[junit4:junit4] 2> 285 T432 oaz.ClientCnxn$SendThread.run Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
[junit4:junit4] 2> 2163 T432 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2164 T432 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 2164 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:19269
[junit4:junit4] 2> 2178 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:19269
[junit4:junit4] 2> 2194 T434 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 2235 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720000 with negotiated timeout 10000 for client /140.211.11.196:19269
[junit4:junit4] 2> 2236 T432 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720000, negotiated timeout = 10000
[junit4:junit4] 2> 2240 T433 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b2da32d name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2240 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2245 T428 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 2329 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720000
[junit4:junit4] 2> 2331 T433 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2331 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720000 closed
[junit4:junit4] 2> 2331 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:19269 which had sessionid 0x13ca77aee720000
[junit4:junit4] 2> 2331 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@79ba1ec8
[junit4:junit4] 2> 2332 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2333 T436 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2333 T436 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 2334 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49718
[junit4:junit4] 2> 2334 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49718
[junit4:junit4] 2> 2336 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720001 with negotiated timeout 10000 for client /140.211.11.196:49718
[junit4:junit4] 2> 2336 T436 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720001, negotiated timeout = 10000
[junit4:junit4] 2> 2337 T437 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79ba1ec8 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2337 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2343 T428 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 2349 T428 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 2360 T428 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 2364 T428 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 2369 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 2397 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 2413 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 2414 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 2521 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 2522 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 2528 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 2529 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 2535 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 2535 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 2542 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 2542 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 2549 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 2549 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 2555 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 2556 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 2562 T428 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 2563 T428 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 2569 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720001
[junit4:junit4] 2> 2570 T437 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2570 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720001 closed
[junit4:junit4] 2> 2570 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:49718 which had sessionid 0x13ca77aee720001
[junit4:junit4] 2> 2769 T428 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 2773 T428 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:64828
[junit4:junit4] 2> 2774 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2774 T428 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2775 T428 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403
[junit4:junit4] 2> 2775 T428 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/solr.xml
[junit4:junit4] 2> 2776 T428 oasc.CoreContainer.<init> New CoreContainer 1882182574
[junit4:junit4] 2> 2777 T428 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/'
[junit4:junit4] 2> 2777 T428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/'
[junit4:junit4] 2> 2839 T428 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 2839 T428 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2840 T428 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2840 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2841 T428 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2841 T428 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2842 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2842 T428 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2843 T428 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2843 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2871 T428 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 2895 T428 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45780/solr
[junit4:junit4] 2> 2921 T428 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2922 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@31415815
[junit4:junit4] 2> 2923 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2923 T447 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2924 T447 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 2924 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:24071
[junit4:junit4] 2> 2925 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:24071
[junit4:junit4] 2> 2926 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720002 with negotiated timeout 20000 for client /140.211.11.196:24071
[junit4:junit4] 2> 2926 T447 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720002, negotiated timeout = 20000
[junit4:junit4] 2> 2927 T448 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31415815 name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2927 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2929 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720002
[junit4:junit4] 2> 2930 T448 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2930 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:24071 which had sessionid 0x13ca77aee720002
[junit4:junit4] 2> 2930 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720002 closed
[junit4:junit4] 2> 2936 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 2955 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@56fe2145
[junit4:junit4] 2> 2956 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2957 T449 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2957 T449 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 2958 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49673
[junit4:junit4] 2> 2958 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49673
[junit4:junit4] 2> 2960 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720003 with negotiated timeout 20000 for client /140.211.11.196:49673
[junit4:junit4] 2> 2960 T449 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720003, negotiated timeout = 20000
[junit4:junit4] 2> 2960 T450 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56fe2145 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2960 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2982 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2994 T428 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 2998 T428 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64828_sp_ffw%2Ff
[junit4:junit4] 2> 3004 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:64828_sp_ffw%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:64828_sp_ffw%2Ff
[junit4:junit4] 2> 3006 T428 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64828_sp_ffw%2Ff
[junit4:junit4] 2> 3012 T428 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 3047 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 3048 T428 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 3053 T428 oasc.Overseer.start Overseer (id=89130239068864515-127.0.0.1:64828_sp_ffw%2Ff-n_0000000000) starting
[junit4:junit4] 2> 3055 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3086 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3088 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3102 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3104 T452 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 3115 T428 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 3119 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3144 T451 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 3161 T453 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/collection1
[junit4:junit4] 2> 3161 T453 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 3162 T453 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 3162 T453 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 3165 T453 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/collection1/'
[junit4:junit4] 2> 3166 T453 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/collection1/lib/README' to classloader
[junit4:junit4] 2> 3167 T453 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 3246 T453 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 3326 T453 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 3427 T453 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 3435 T453 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4143 T453 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 4156 T453 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 4160 T453 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 4187 T453 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 4194 T453 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 4200 T453 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 4202 T453 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 4204 T453 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1360019519403/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/
[junit4:junit4] 2> 4209 T453 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5925c9a4
[junit4:junit4] 2> 4209 T453 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 4211 T453 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data forceNew:false
[junit4:junit4] 2> 4211 T453 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data
[junit4:junit4] 2> 4212 T453 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/index/
[junit4:junit4] 2> 4212 T453 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 4213 T453 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/index forceNew:false
[junit4:junit4] 2> 4220 T453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1713586c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 4220 T453 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 4221 T453 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data/index
[junit4:junit4] 2> 4222 T453 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 4226 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 4226 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 4226 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 4227 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 4228 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 4228 T453 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 4229 T453 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 4229 T453 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 4230 T453 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 4230 T453 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 4231 T453 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 4232 T453 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 4232 T453 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 4233 T453 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 4233 T453 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 4234 T453 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 4234 T453 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 4235 T453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 4235 T453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 4236 T453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 4236 T453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 4237 T453 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 4237 T453 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 4237 T453 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 4238 T453 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 4239 T453 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 4252 T453 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 4257 T453 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 4258 T453 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 4261 T453 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/control/data
[junit4:junit4] 2> 4263 T453 oass.SolrIndexSearcher.<init> Opening Searcher@78d4654e main
[junit4:junit4] 2> 4289 T453 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 4289 T453 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 4290 T453 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 4309 T453 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 4362 T454 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@78d4654e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 4367 T453 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 4368 T453 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 4369 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 4654 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4655 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:64828_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:64828/sp_ffw/f"}
[junit4:junit4] 2> 4656 T451 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 4691 T451 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 4692 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 4729 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5382 T453 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 5382 T453 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:64828/sp_ffw/f collection:control_collection shard:shard1
[junit4:junit4] 2> 5393 T453 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 5410 T453 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 5432 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 5433 T453 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 5434 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5444 T453 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 5445 T453 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 5445 T453 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:64828/sp_ffw/f/collection1/
[junit4:junit4] 2> 5446 T453 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 5446 T453 oasc.SyncStrategy.syncToMe http://127.0.0.1:64828/sp_ffw/f/collection1/ has no replicas
[junit4:junit4] 2> 5446 T453 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:64828/sp_ffw/f/collection1/
[junit4:junit4] 2> 5446 T453 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 5454 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6236 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6312 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 6377 T453 oasc.ZkController.register We are http://127.0.0.1:64828/sp_ffw/f/collection1/ and leader is http://127.0.0.1:64828/sp_ffw/f/collection1/
[junit4:junit4] 2> 6381 T453 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:64828/sp_ffw/f
[junit4:junit4] 2> 6381 T453 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 6381 T453 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 6382 T453 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6385 T453 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6386 T428 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 6387 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 6388 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 6404 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 6421 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@771cc1d1
[junit4:junit4] 2> 6422 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 6423 T455 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 6424 T455 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 6424 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29639
[junit4:junit4] 2> 6424 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29639
[junit4:junit4] 2> 6426 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720004 with negotiated timeout 10000 for client /140.211.11.196:29639
[junit4:junit4] 2> 6426 T455 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720004, negotiated timeout = 10000
[junit4:junit4] 2> 6426 T456 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@771cc1d1 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 6427 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 6428 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 6433 T428 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 6622 T428 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 6625 T428 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58138
[junit4:junit4] 2> 6626 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 6626 T428 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 6627 T428 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266
[junit4:junit4] 2> 6627 T428 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/solr.xml
[junit4:junit4] 2> 6628 T428 oasc.CoreContainer.<init> New CoreContainer 247900808
[junit4:junit4] 2> 6628 T428 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/'
[junit4:junit4] 2> 6629 T428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/'
[junit4:junit4] 2> 6689 T428 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 6690 T428 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 6691 T428 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 6691 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 6691 T428 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 6692 T428 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 6692 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 6693 T428 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 6693 T428 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 6694 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 6730 T428 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 6752 T428 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45780/solr
[junit4:junit4] 2> 6752 T428 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 6753 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@e24af2d
[junit4:junit4] 2> 6754 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 6755 T466 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 6756 T466 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 6756 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:33189
[junit4:junit4] 2> 6756 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:33189
[junit4:junit4] 2> 6794 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720005 with negotiated timeout 20000 for client /140.211.11.196:33189
[junit4:junit4] 2> 6794 T466 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720005, negotiated timeout = 20000
[junit4:junit4] 2> 6795 T467 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e24af2d name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 6795 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 6797 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720005
[junit4:junit4] 2> 6798 T467 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 6798 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720005 closed
[junit4:junit4] 2> 6799 T430 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13ca77aee720005, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 6799 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 6801 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:33189 which had sessionid 0x13ca77aee720005
[junit4:junit4] 2> 6816 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3151ee66
[junit4:junit4] 2> 6818 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 6818 T468 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 6819 T468 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 6819 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:15764
[junit4:junit4] 2> 6820 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:15764
[junit4:junit4] 2> 6821 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720006 with negotiated timeout 20000 for client /140.211.11.196:15764
[junit4:junit4] 2> 6821 T468 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720006, negotiated timeout = 20000
[junit4:junit4] 2> 6822 T469 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3151ee66 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 6822 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 6823 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6825 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6833 T428 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58138_sp_ffw%2Ff
[junit4:junit4] 2> 6835 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58138_sp_ffw%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58138_sp_ffw%2Ff
[junit4:junit4] 2> 6836 T428 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58138_sp_ffw%2Ff
[junit4:junit4] 2> 6841 T450 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 6841 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6841 T456 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 6851 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 6859 T470 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/collection1
[junit4:junit4] 2> 6859 T470 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 6860 T470 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 6861 T470 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 6863 T470 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/collection1/'
[junit4:junit4] 2> 6864 T470 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/collection1/lib/README' to classloader
[junit4:junit4] 2> 6865 T470 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 6923 T470 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 6999 T470 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 7100 T470 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 7108 T470 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 7759 T470 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 7771 T470 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 7776 T470 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 7802 T470 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 7808 T470 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 7813 T470 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 7815 T470 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 7817 T470 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1360019523266/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/
[junit4:junit4] 2> 7817 T470 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5925c9a4
[junit4:junit4] 2> 7818 T470 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 7819 T470 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1 forceNew:false
[junit4:junit4] 2> 7820 T470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1
[junit4:junit4] 2> 7820 T470 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index/
[junit4:junit4] 2> 7820 T470 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 7822 T470 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index forceNew:false
[junit4:junit4] 2> 7828 T470 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb6de9f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 7829 T470 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 7830 T470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index
[junit4:junit4] 2> 7830 T470 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 7831 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7832 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:64828_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:64828/sp_ffw/f"}
[junit4:junit4] 2> 7832 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 7833 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 7833 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 7834 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 7834 T470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 7835 T470 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 7835 T470 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 7836 T470 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 7836 T470 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 7837 T470 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 7837 T470 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 7838 T470 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 7838 T470 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 7839 T470 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 7839 T470 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 7840 T470 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 7840 T470 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7841 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7842 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7842 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7843 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7844 T470 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7844 T470 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7845 T470 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 7845 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7845 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7846 T470 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 7845 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7847 T470 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 7860 T470 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 7865 T470 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 7866 T470 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 7869 T470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1
[junit4:junit4] 2> 7871 T470 oass.SolrIndexSearcher.<init> Opening Searcher@4f74a09b main
[junit4:junit4] 2> 7872 T470 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 7872 T470 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 7873 T470 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 7880 T470 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 7933 T471 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f74a09b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 7938 T470 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 7939 T470 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9358 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9359 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58138_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58138/sp_ffw/f"}
[junit4:junit4] 2> 9359 T451 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 9359 T451 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 9373 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9375 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9375 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9943 T470 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 9943 T470 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58138/sp_ffw/f collection:collection1 shard:shard1
[junit4:junit4] 2> 9944 T470 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 9963 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 9964 T470 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 9964 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9975 T470 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 9975 T470 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 9975 T470 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58138/sp_ffw/f/collection1/
[junit4:junit4] 2> 9975 T470 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 9976 T470 oasc.SyncStrategy.syncToMe http://127.0.0.1:58138/sp_ffw/f/collection1/ has no replicas
[junit4:junit4] 2> 9976 T470 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58138/sp_ffw/f/collection1/
[junit4:junit4] 2> 9976 T470 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 9983 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720006 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10883 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10907 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10907 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10907 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10960 T470 oasc.ZkController.register We are http://127.0.0.1:58138/sp_ffw/f/collection1/ and leader is http://127.0.0.1:58138/sp_ffw/f/collection1/
[junit4:junit4] 2> 10960 T470 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58138/sp_ffw/f
[junit4:junit4] 2> 10960 T470 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 10960 T470 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 10961 T470 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10963 T470 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10964 T428 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 10965 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 10966 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11158 T428 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 11162 T428 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37419
[junit4:junit4] 2> 11162 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 11163 T428 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 11163 T428 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813
[junit4:junit4] 2> 11164 T428 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/solr.xml
[junit4:junit4] 2> 11164 T428 oasc.CoreContainer.<init> New CoreContainer 157865851
[junit4:junit4] 2> 11165 T428 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/'
[junit4:junit4] 2> 11165 T428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/'
[junit4:junit4] 2> 11221 T428 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 11221 T428 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 11222 T428 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 11222 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 11223 T428 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 11223 T428 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 11224 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 11224 T428 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 11224 T428 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 11225 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 11246 T428 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 11266 T428 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45780/solr
[junit4:junit4] 2> 11267 T428 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 11267 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5bd3155b
[junit4:junit4] 2> 11269 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11269 T481 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 11270 T481 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 11270 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40216
[junit4:junit4] 2> 11270 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40216
[junit4:junit4] 2> 11273 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720007 with negotiated timeout 20000 for client /140.211.11.196:40216
[junit4:junit4] 2> 11273 T481 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720007, negotiated timeout = 20000
[junit4:junit4] 2> 11273 T482 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bd3155b name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11273 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11275 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720007
[junit4:junit4] 2> 11286 T482 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 11286 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:40216 which had sessionid 0x13ca77aee720007
[junit4:junit4] 2> 11286 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720007 closed
[junit4:junit4] 2> 11287 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 11298 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@152e63d8
[junit4:junit4] 2> 11299 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11300 T483 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 11300 T483 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 11300 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:54741
[junit4:junit4] 2> 11301 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:54741
[junit4:junit4] 2> 11302 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720008 with negotiated timeout 20000 for client /140.211.11.196:54741
[junit4:junit4] 2> 11302 T483 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720008, negotiated timeout = 20000
[junit4:junit4] 2> 11303 T484 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@152e63d8 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11303 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11304 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11306 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11313 T428 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37419_sp_ffw%2Ff
[junit4:junit4] 2> 11314 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37419_sp_ffw%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37419_sp_ffw%2Ff
[junit4:junit4] 2> 11315 T428 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37419_sp_ffw%2Ff
[junit4:junit4] 2> 11319 T469 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 11320 T456 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 11320 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11320 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11320 T450 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 11320 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11325 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 11333 T485 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/collection1
[junit4:junit4] 2> 11333 T485 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 11334 T485 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 11334 T485 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 11336 T485 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/collection1/'
[junit4:junit4] 2> 11338 T485 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/collection1/lib/README' to classloader
[junit4:junit4] 2> 11338 T485 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 11393 T485 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 11467 T485 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 11568 T485 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 11576 T485 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 12240 T485 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 12252 T485 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 12256 T485 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 12283 T485 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12289 T485 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12294 T485 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12296 T485 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12298 T485 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1360019527813/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/
[junit4:junit4] 2> 12298 T485 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5925c9a4
[junit4:junit4] 2> 12299 T485 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 12299 T485 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2 forceNew:false
[junit4:junit4] 2> 12300 T485 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2
[junit4:junit4] 2> 12300 T485 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/index/
[junit4:junit4] 2> 12301 T485 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 12302 T485 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/index forceNew:false
[junit4:junit4] 2> 12313 T485 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@475d785c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 12313 T485 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 12314 T485 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2/index
[junit4:junit4] 2> 12315 T485 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 12317 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 12317 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 12317 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 12318 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 12319 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 12319 T485 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 12319 T485 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 12320 T485 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 12320 T485 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 12321 T485 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 12322 T485 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 12322 T485 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 12323 T485 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 12323 T485 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 12323 T485 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 12324 T485 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 12324 T485 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12325 T485 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12326 T485 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12326 T485 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12327 T485 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12327 T485 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12328 T485 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12328 T485 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 12329 T485 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 12330 T485 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 12342 T485 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 12347 T485 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 12348 T485 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 12351 T485 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty2
[junit4:junit4] 2> 12353 T485 oass.SolrIndexSearcher.<init> Opening Searcher@713d0cf main
[junit4:junit4] 2> 12354 T485 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 12354 T485 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 12355 T485 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 12362 T485 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 12414 T486 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@713d0cf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 12420 T485 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 12420 T485 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12423 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12424 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:58138_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58138/sp_ffw/f"}
[junit4:junit4] 2> 12435 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:37419_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:37419/sp_ffw/f"}
[junit4:junit4] 2> 12435 T451 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 12435 T451 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 12447 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12447 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12447 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12447 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13423 T485 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 13423 T485 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37419/sp_ffw/f collection:collection1 shard:shard2
[junit4:junit4] 2> 13424 T485 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 13469 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:delete cxid:0x42 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 13470 T485 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 13471 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:create cxid:0x43 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13481 T485 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 13481 T485 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 13481 T485 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37419/sp_ffw/f/collection1/
[junit4:junit4] 2> 13481 T485 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 13482 T485 oasc.SyncStrategy.syncToMe http://127.0.0.1:37419/sp_ffw/f/collection1/ has no replicas
[junit4:junit4] 2> 13482 T485 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37419/sp_ffw/f/collection1/
[junit4:junit4] 2> 13482 T485 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 13487 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee720008 type:create cxid:0x4c zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13958 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13978 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13978 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13978 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13978 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14000 T485 oasc.ZkController.register We are http://127.0.0.1:37419/sp_ffw/f/collection1/ and leader is http://127.0.0.1:37419/sp_ffw/f/collection1/
[junit4:junit4] 2> 14000 T485 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37419/sp_ffw/f
[junit4:junit4] 2> 14000 T485 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 14000 T485 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 14001 T485 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14003 T485 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14004 T428 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 14005 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14005 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14191 T428 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14194 T428 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30255
[junit4:junit4] 2> 14195 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14195 T428 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14196 T428 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853
[junit4:junit4] 2> 14196 T428 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/solr.xml
[junit4:junit4] 2> 14197 T428 oasc.CoreContainer.<init> New CoreContainer 363940238
[junit4:junit4] 2> 14197 T428 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/'
[junit4:junit4] 2> 14198 T428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/'
[junit4:junit4] 2> 14253 T428 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 14253 T428 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14254 T428 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14254 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14254 T428 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14255 T428 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14255 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14256 T428 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14256 T428 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14257 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14280 T428 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14300 T428 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45780/solr
[junit4:junit4] 2> 14301 T428 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14301 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5c65b07d
[junit4:junit4] 2> 14302 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14303 T496 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14304 T496 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 14304 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:12017
[junit4:junit4] 2> 14305 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:12017
[junit4:junit4] 2> 14307 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee720009 with negotiated timeout 20000 for client /140.211.11.196:12017
[junit4:junit4] 2> 14307 T496 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee720009, negotiated timeout = 20000
[junit4:junit4] 2> 14307 T497 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c65b07d name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14307 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14309 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee720009
[junit4:junit4] 2> 14322 T497 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14322 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:12017 which had sessionid 0x13ca77aee720009
[junit4:junit4] 2> 14322 T428 oaz.ZooKeeper.close Session: 0x13ca77aee720009 closed
[junit4:junit4] 2> 14323 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 14337 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@21b9d8f4
[junit4:junit4] 2> 14338 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14338 T498 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14338 T498 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 14339 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:15905
[junit4:junit4] 2> 14339 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:15905
[junit4:junit4] 2> 14340 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee72000a with negotiated timeout 20000 for client /140.211.11.196:15905
[junit4:junit4] 2> 14340 T498 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee72000a, negotiated timeout = 20000
[junit4:junit4] 2> 14341 T499 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21b9d8f4 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14341 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14342 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14344 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000a type:create cxid:0x2 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14351 T428 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30255_sp_ffw%2Ff
[junit4:junit4] 2> 14352 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000a type:delete cxid:0x4 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:30255_sp_ffw%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:30255_sp_ffw%2Ff
[junit4:junit4] 2> 14353 T428 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30255_sp_ffw%2Ff
[junit4:junit4] 2> 14356 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14357 T456 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14357 T469 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14357 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14357 T450 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14358 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14358 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14359 T484 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14363 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14371 T500 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/collection1
[junit4:junit4] 2> 14371 T500 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14372 T500 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14372 T500 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14374 T500 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/collection1/'
[junit4:junit4] 2> 14376 T500 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/collection1/lib/README' to classloader
[junit4:junit4] 2> 14376 T500 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14431 T500 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14506 T500 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14607 T500 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14615 T500 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15272 T500 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15285 T500 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15289 T500 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15315 T500 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15321 T500 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15326 T500 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15328 T500 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15330 T500 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1360019530853/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/
[junit4:junit4] 2> 15330 T500 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5925c9a4
[junit4:junit4] 2> 15331 T500 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 15331 T500 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3 forceNew:false
[junit4:junit4] 2> 15332 T500 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
[junit4:junit4] 2> 15332 T500 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index/
[junit4:junit4] 2> 15333 T500 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15334 T500 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index forceNew:false
[junit4:junit4] 2> 15341 T500 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57b3153c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15341 T500 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15342 T500 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index
[junit4:junit4] 2> 15342 T500 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 15345 T500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15345 T500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 15345 T500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15346 T500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 15346 T500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15347 T500 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15347 T500 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15348 T500 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15348 T500 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15349 T500 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 15349 T500 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 15350 T500 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15351 T500 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 15351 T500 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 15351 T500 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 15352 T500 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15352 T500 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15353 T500 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15353 T500 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15354 T500 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15355 T500 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15355 T500 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15356 T500 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15356 T500 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15357 T500 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 15357 T500 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 15370 T500 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15375 T500 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 15376 T500 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 15379 T500 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
[junit4:junit4] 2> 15381 T500 oass.SolrIndexSearcher.<init> Opening Searcher@58c9d231 main
[junit4:junit4] 2> 15382 T500 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15382 T500 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15383 T500 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 15390 T500 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 15446 T501 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@58c9d231 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15452 T500 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15452 T500 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15492 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15494 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:37419_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:37419/sp_ffw/f"}
[junit4:junit4] 2> 15499 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:30255_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30255/sp_ffw/f"}
[junit4:junit4] 2> 15499 T451 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15500 T451 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 15518 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15518 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15518 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15518 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15518 T499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16455 T500 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16455 T500 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30255/sp_ffw/f collection:collection1 shard:shard1
[junit4:junit4] 2> 16486 T500 oasc.ZkController.register We are http://127.0.0.1:30255/sp_ffw/f/collection1/ and leader is http://127.0.0.1:58138/sp_ffw/f/collection1/
[junit4:junit4] 2> 16486 T500 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30255/sp_ffw/f
[junit4:junit4] 2> 16486 T500 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16487 T500 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C14 name=collection1 org.apache.solr.core.SolrCore@3e2cc207 url=http://127.0.0.1:30255/sp_ffw/f/collection1 node=127.0.0.1:30255_sp_ffw%2Ff C14_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:30255_sp_ffw%2Ff, base_url=http://127.0.0.1:30255/sp_ffw/f}
[junit4:junit4] 2> 16494 T502 C14 P30255 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16494 T500 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16495 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16495 T502 C14 P30255 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16495 T502 C14 P30255 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16496 T428 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 16496 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16497 T502 C14 P30255 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16497 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16694 T428 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16697 T428 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55162
[junit4:junit4] 2> 16698 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16698 T428 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16699 T428 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349
[junit4:junit4] 2> 16699 T428 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/solr.xml
[junit4:junit4] 2> 16700 T428 oasc.CoreContainer.<init> New CoreContainer 63645884
[junit4:junit4] 2> 16700 T428 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/'
[junit4:junit4] 2> 16701 T428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/'
[junit4:junit4] 2> 16769 T428 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 16770 T428 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 16770 T428 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 16771 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 16771 T428 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 16772 T428 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 16772 T428 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 16773 T428 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 16773 T428 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 16774 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 16796 T428 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16816 T428 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45780/solr
[junit4:junit4] 2> 16817 T428 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16817 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3d5bc62e
[junit4:junit4] 2> 16818 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16819 T512 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16820 T512 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 16820 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:47360
[junit4:junit4] 2> 16821 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:47360
[junit4:junit4] 2> 16855 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee72000b with negotiated timeout 20000 for client /140.211.11.196:47360
[junit4:junit4] 2> 16856 T512 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee72000b, negotiated timeout = 20000
[junit4:junit4] 2> 16856 T513 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d5bc62e name:ZooKeeperConnection Watcher:127.0.0.1:45780 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16856 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16858 T435 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca77aee72000b
[junit4:junit4] 2> 16871 T513 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16871 T430 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:47360 which had sessionid 0x13ca77aee72000b
[junit4:junit4] 2> 16871 T428 oaz.ZooKeeper.close Session: 0x13ca77aee72000b closed
[junit4:junit4] 2> 16872 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 16883 T428 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45780/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3155ba4
[junit4:junit4] 2> 16884 T428 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16884 T514 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:45780. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16885 T514 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:45780, initiating session
[junit4:junit4] 2> 16885 T430 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49058
[junit4:junit4] 2> 16886 T430 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49058
[junit4:junit4] 2> 16887 T434 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca77aee72000c with negotiated timeout 20000 for client /140.211.11.196:49058
[junit4:junit4] 2> 16887 T514 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:45780, sessionid = 0x13ca77aee72000c, negotiated timeout = 20000
[junit4:junit4] 2> 16887 T515 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3155ba4 name:ZooKeeperConnection Watcher:127.0.0.1:45780/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16888 T428 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16889 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000c type:create cxid:0x1 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16890 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000c type:create cxid:0x2 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16898 T428 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55162_sp_ffw%2Ff
[junit4:junit4] 2> 16899 T435 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca77aee72000c type:delete cxid:0x4 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55162_sp_ffw%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55162_sp_ffw%2Ff
[junit4:junit4] 2> 16900 T428 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55162_sp_ffw%2Ff
[junit4:junit4] 2> 16904 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16905 T456 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16905 T450 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16905 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16905 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16905 T499 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16905 T469 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16906 T499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16906 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16908 T484 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16912 T428 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 16920 T516 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/collection1
[junit4:junit4] 2> 16921 T516 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 16922 T516 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 16922 T516 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 16924 T516 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/collection1/'
[junit4:junit4] 2> 16925 T516 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/collection1/lib/README' to classloader
[junit4:junit4] 2> 16926 T516 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 16981 T516 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 17059 T516 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17062 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17063 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:30255_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30255/sp_ffw/f"}
[junit4:junit4] 2> 17077 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17077 T499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17077 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17077 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17077 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17160 T516 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17160 T515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17168 T516 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17833 T516 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17848 T516 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17852 T516 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17889 T516 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17895 T516 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17902 T516 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17904 T516 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17906 T516 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1360019533349/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/
[junit4:junit4] 2> 17906 T516 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5925c9a4
[junit4:junit4] 2> 17907 T516 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 17908 T516 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4 forceNew:false
[junit4:junit4] 2> 17909 T516 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4
[junit4:junit4] 2> 17910 T516 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/index/
[junit4:junit4] 2> 17911 T516 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17913 T516 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/index forceNew:false
[junit4:junit4] 2> 17931 T516 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2092ab58; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17931 T516 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17932 T516 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4/index
[junit4:junit4] 2> 17933 T516 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 17935 T516 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17935 T516 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 17936 T516 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17936 T516 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 17937 T516 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17937 T516 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17937 T516 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17938 T516 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17939 T516 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17939 T516 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 17940 T516 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 17940 T516 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17941 T516 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 17941 T516 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 17941 T516 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 17942 T516 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17943 T516 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17943 T516 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17944 T516 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17944 T516 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17945 T516 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17945 T516 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17946 T516 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17947 T516 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 17947 T516 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 17948 T516 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 17969 T516 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17976 T516 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 17978 T516 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 17982 T516 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty4
[junit4:junit4] 2> 17985 T516 oass.SolrIndexSearcher.<init> Opening Searcher@2b5bd32c main
[junit4:junit4] 2> 17986 T516 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17986 T516 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17987 T516 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 17995 T516 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 18048 T517 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b5bd32c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 18054 T516 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 18054 T516 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18585 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18587 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:55162_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55162/sp_ffw/f"}
[junit4:junit4] 2> 18587 T451 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 18587 T451 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 18602 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18602 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18602 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18602 T499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18602 T515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18602 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19057 T516 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 19057 T516 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55162/sp_ffw/f collection:collection1 shard:shard2
[junit4:junit4] 2> 19062 T516 oasc.ZkController.register We are http://127.0.0.1:55162/sp_ffw/f/collection1/ and leader is http://127.0.0.1:37419/sp_ffw/f/collection1/
[junit4:junit4] 2> 19062 T516 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55162/sp_ffw/f
[junit4:junit4] 2> 19062 T516 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 19062 T516 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C15 name=collection1 org.apache.solr.core.SolrCore@41d5df31 url=http://127.0.0.1:55162/sp_ffw/f/collection1 node=127.0.0.1:55162_sp_ffw%2Ff C15_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:55162_sp_ffw%2Ff, base_url=http://127.0.0.1:55162/sp_ffw/f}
[junit4:junit4] 2> 19063 T518 C15 P55162 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 19063 T518 C15 P55162 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 19064 T516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19064 T518 C15 P55162 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 19064 T518 C15 P55162 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19065 T428 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 19066 T518 C15 P55162 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19066 T428 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 19066 T428 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19085 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19087 T428 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 19088 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C14_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:30255_sp_ffw%2Ff, base_url=http://127.0.0.1:30255/sp_ffw/f}
[junit4:junit4] 2> 19539 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:58138/sp_ffw/f/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19548 T502 C14 P30255 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 19566 T502 C14 P30255 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:30255/sp_ffw/f START replicas=[http://127.0.0.1:58138/sp_ffw/f/collection1/] nUpdates=100
[junit4:junit4] 2> 19567 T502 C14 P30255 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19568 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19568 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19568 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19569 T502 C14 P30255 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19569 T502 C14 P30255 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:58138/sp_ffw/f/collection1/. core=collection1
[junit4:junit4] 2> 19569 T502 C14 P30255 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C16 name=collection1 org.apache.solr.core.SolrCore@60a5494 url=http://127.0.0.1:58138/sp_ffw/f/collection1 node=127.0.0.1:58138_sp_ffw%2Ff C16_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58138_sp_ffw%2Ff, base_url=http://127.0.0.1:58138/sp_ffw/f, leader=true}
[junit4:junit4] 2> 19580 T460 C16 P58138 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 19599 T461 C16 P58138 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 19600 T461 C16 P58138 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1
[junit4:junit4] 2> 19604 T461 C16 P58138 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb6de9f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19605 T461 C16 P58138 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19635 T461 C16 P58138 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb6de9f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb6de9f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19635 T461 C16 P58138 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19637 T461 C16 P58138 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1
[junit4:junit4] 2> 19637 T461 C16 P58138 oass.SolrIndexSearcher.<init> Opening Searcher@7765731d realtime
[junit4:junit4] 2> 19638 T461 C16 P58138 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19638 T461 C16 P58138 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 56
[junit4:junit4] 2> 19696 T502 C14 P30255 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19697 T502 C14 P30255 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 19723 T502 C14 P30255 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19726 T462 C16 P58138 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19726 T462 C16 P58138 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 19727 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19728 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19728 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19731 T462 C16 P58138 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1
[junit4:junit4] 2> 19732 T462 C16 P58138 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty1/index
[junit4:junit4] 2> 19732 T462 C16 P58138 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 19733 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19734 T502 C14 P30255 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 forceNew:false
[junit4:junit4] 2> 19735 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
[junit4:junit4] 2> 19735 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffa2f97; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 19749 T462 C16 P58138 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=5
[junit4:junit4] 2> 19762 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index
[junit4:junit4] 2> 19763 T502 C14 P30255 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19764 T502 C14 P30255 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130205001216565
[junit4:junit4] 2> 19771 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
[junit4:junit4] 2> 19773 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
[junit4:junit4] 2> 19773 T502 C14 P30255 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565
[junit4:junit4] 2> 19777 T502 C14 P30255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffa2f97; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19777 T502 C14 P30255 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19779 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
[junit4:junit4] 2> 19783 T502 C14 P30255 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19784 T502 C14 P30255 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19784 T502 C14 P30255 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 19785 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565
[junit4:junit4] 2> 19786 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
[junit4:junit4] 2> 19789 T502 C14 P30255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffa2f97; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19790 T502 C14 P30255 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19791 T502 C14 P30255 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19791 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
[junit4:junit4] 2> 19792 T502 C14 P30255 oass.SolrIndexSearcher.<init> Opening Searcher@2dd212cf main
[junit4:junit4] 2> 19793 T501 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2dd212cf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19794 T501 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index
[junit4:junit4] 2> 19795 T502 C14 P30255 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 19798 T502 C14 P30255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffa2f97; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ffa2f97; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 19799 T502 C14 P30255 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 19800 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3
[junit4:junit4] 2> 19800 T502 C14 P30255 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19800 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index.20130205001216565
[junit4:junit4] 2> 19801 T502 C14 P30255 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1360019516837/jetty3/index
[junit4:junit4] 2> 19801 T502 C14 P30255 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19801 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19802 T502 C14 P30255 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19802 T502 C14 P30255 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19804 T502 C14 P30255 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20092 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20111 T451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20112 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:55162_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55162/sp_ffw/f"}
[junit4:junit4] 2> 20118 T451 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:30255_sp_ffw%2Ff",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30255/sp_ffw/f"}
[junit4:junit4] 2> 20130 T456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20131 T515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20131 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20131 T499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20131 T469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20130 T450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21095 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22098 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C15_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:55162_sp_ffw%2Ff, base_url=http://127.0.0.1:55162/sp_ffw/f}
[junit4:junit4] 2> 23089 T518 C15 P55162 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:37419/sp_ffw/f/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 23089 T518 C15 P55162 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55162/sp_ffw/f START replicas=[http://127.0.0.1:37419/sp_ffw/f/collection1/] nUpdates=100
[junit4:junit4] 2> 23090 T518 C15 P55162 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 23090 T518 C15 P55162 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 23090 T518 C15 P55162 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 23091 T518 C15 P55162 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 23091 T518 C15 P55162 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 23091 T518 C15 P55162 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:37419/sp_ffw/f/collection1/. core=collection1
[junit4:junit4] 2> 23092 T518 C15 P55162 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23101 T428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C17 name=collection1 org.apache.solr.core.SolrCore@ab64f2 url=http:
[...truncated too long message...]
.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
[junit4:junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264)
[junit4:junit4] > at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98)
[junit4:junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
[junit4:junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
[junit4:junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
[junit4:junit4] > at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
[junit4:junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
[junit4:junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
[junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4] > ... 5 more
[junit4:junit4] > Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=939, name=testExecutor-345-thread-5, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:30255/sp_ffw/f
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([715CCD8973136CF0]:0)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:658)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:30255/sp_ffw/f
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:412)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:656)
[junit4:junit4] > ... 3 more
[junit4:junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4:junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4:junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:150)
[junit4:junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:121)
[junit4:junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149)
[junit4:junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
[junit4:junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264)
[junit4:junit4] > at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98)
[junit4:junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
[junit4:junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
[junit4:junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
[junit4:junit4] > at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
[junit4:junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
[junit4:junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
[junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4] > ... 5 more
[junit4:junit4] 2> 388062 T428 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 388169 T431 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 388258 T499 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 388258 T499 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 388258 T499 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 388430 T515 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 388430 T515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 388430 T515 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 388430 T515 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {n_f1=PostingsFormat(name=NestedPulsing), foo_b=PostingsFormat(name=Memory doPackFST= true), cat=Lucene41(blocksize=128), foo_d=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), foo_f=PostingsFormat(name=Memory doPackFST= true), n_tl1=PostingsFormat(name=NestedPulsing), n_d1=Lucene41(blocksize=128), rnd_b=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), intDefault=Lucene41(blocksize=128), n_td1=PostingsFormat(name=NestedPulsing), timestamp=Lucene41(blocksize=128), id=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), range_facet_sl=PostingsFormat(name=Memory doPackFST= true), range_facet_si=PostingsFormat(name=NestedPulsing), oddField_s=PostingsFormat(name=Memory doPackFST= true), sequence_i=PostingsFormat(name=Memory doPackFST= true), name=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), foo_i=PostingsFormat(name=NestedPulsing), regex_dup_B_s=Lucene41(blocksize=128), multiDefault=PostingsFormat(name=NestedPulsing), n_tf1=Lucene41(blocksize=128), n_dt1=PostingsFormat(name=NestedPulsing), genre_s=PostingsFormat(name=Memory doPackFST= true), author_t=PostingsFormat(name=NestedPulsing), n_ti1=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), range_facet_l=Lucene41(blocksize=128), text=PostingsFormat(name=Memory doPackFST= true), _version_=Lucene41(blocksize=128), val_i=Pulsing41(freqCutoff=13 minBlockSize=38 maxBlockSize=83), SubjectTerms_mfacet=Lucene41(blocksize=128), series_t=PostingsFormat(name=NestedPulsing), a_t=Lucene41(blocksize=128), n_tdt1=Lucene41(blocksize=128), regex_dup_A_s=PostingsFormat(name=Memory doPackFST= true), price=PostingsFormat(name=Memory doPackFST= true), other_tl1=Lucene41(blocksize=128), n_l1=Lucene41(blocksize=128), a_si=PostingsFormat(name=NestedPulsing), inStock=PostingsFormat(name=Memory doPackFST= true)}, sim=DefaultSimilarity, locale=et, timezone=ECT
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=2,free=327414984,total=475004928
[junit4:junit4] 2> NOTE: All tests run in this JVM: [RequestHandlersTest, TestFiltering, TestRandomFaceting, TestDefaultSimilarityFactory, BinaryUpdateRequestHandlerTest, DistributedSpellCheckComponentTest, TestGroupingSearch, JsonLoaderTest, BasicDistributedZkTest]
[junit4:junit4] Completed on J0 in 388.65s, 1 test, 1 error <<< FAILURES!
[...truncated 582 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:841: There were test failures: 249 suites, 1038 tests, 1 error, 23 ignored (5 assumptions)
Total time: 39 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3707 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3707/
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
parsing error
Stack Trace:
org.apache.solr.common.SolrException: parsing error
at __randomizedtesting.SeedInfo.seed([62599A281191218A:E3BF143066CE41B6]:0)
at org.apache.solr.client.solrj.impl.BinaryResponseParser.processResponse(BinaryResponseParser.java:43)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:387)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:168)
at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:146)
at org.apache.solr.cloud.BasicDistributedZkTest.testCoreUnloadAndLeaders(BasicDistributedZkTest.java:611)
at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:337)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.net.SocketException: Socket closed
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:150)
at java.net.SocketInputStream.read(SocketInputStream.java:121)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
at org.apache.http.impl.io.AbstractSessionInputBuffer.read(AbstractSessionInputBuffer.java:195)
at org.apache.http.impl.io.ContentLengthInputStream.read(ContentLengthInputStream.java:176)
at org.apache.http.conn.EofSensorInputStream.read(EofSensorInputStream.java:138)
at org.apache.solr.common.util.FastInputStream.readWrappedStream(FastInputStream.java:80)
at org.apache.solr.common.util.FastInputStream.refill(FastInputStream.java:89)
at org.apache.solr.common.util.FastInputStream.readByte(FastInputStream.java:192)
at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:107)
at org.apache.solr.client.solrj.impl.BinaryResponseParser.processResponse(BinaryResponseParser.java:41)
... 48 more
Build Log:
[...truncated 8746 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4] 2> 0 T79 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /gd_w/gh
[junit4:junit4] 2> 8 T79 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1359986689674
[junit4:junit4] 2> 10 T79 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 10 T80 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 18 T80 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 19 T80 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 19 T80 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 20 T80 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 21 T80 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 111 T79 oasc.ZkTestServer.run start zk server on port:29524
[junit4:junit4] 2> 117 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@55cc8bbe
[junit4:junit4] 2> 118 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 118 T85 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 119 T85 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 120 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34695
[junit4:junit4] 2> 120 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34695
[junit4:junit4] 2> 121 T83 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 125 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca58606970000 with negotiated timeout 10000 for client /140.211.11.196:34695
[junit4:junit4] 2> 125 T85 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca58606970000, negotiated timeout = 10000
[junit4:junit4] 2> 126 T86 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55cc8bbe name:ZooKeeperConnection Watcher:127.0.0.1:29524 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 126 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 127 T79 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 136 T84 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca58606970000
[junit4:junit4] 2> 137 T86 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 137 T79 oaz.ZooKeeper.close Session: 0x13ca58606970000 closed
[junit4:junit4] 2> 138 T81 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34695 which had sessionid 0x13ca58606970000
[junit4:junit4] 2> 138 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1de43fc7
[junit4:junit4] 2> 139 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 140 T87 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 141 T87 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 141 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:14236
[junit4:junit4] 2> 141 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:14236
[junit4:junit4] 2> 143 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca58606970001 with negotiated timeout 10000 for client /140.211.11.196:14236
[junit4:junit4] 2> 143 T87 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca58606970001, negotiated timeout = 10000
[junit4:junit4] 2> 144 T88 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1de43fc7 name:ZooKeeperConnection Watcher:127.0.0.1:29524/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 144 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 145 T79 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 149 T79 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 158 T79 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 161 T79 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 165 T79 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 166 T79 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 179 T79 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 181 T79 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 289 T79 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 290 T79 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 294 T79 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 295 T79 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 306 T79 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 308 T79 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 312 T79 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 314 T79 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 318 T79 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 320 T79 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 325 T79 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 325 T79 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 329 T79 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 330 T79 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 334 T84 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca58606970001
[junit4:junit4] 2> 335 T88 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 336 T81 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:14236 which had sessionid 0x13ca58606970001
[junit4:junit4] 2> 335 T79 oaz.ZooKeeper.close Session: 0x13ca58606970001 closed
[junit4:junit4] 2> 1082 T79 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 1339 T79 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:44201
[junit4:junit4] 2> 1375 T79 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1375 T79 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1376 T79 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359986690002
[junit4:junit4] 2> 1376 T79 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359986690002/solr.xml
[junit4:junit4] 2> 1377 T79 oasc.CoreContainer.<init> New CoreContainer 496953775
[junit4:junit4] 2> 1377 T79 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359986690002/'
[junit4:junit4] 2> 1378 T79 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359986690002/'
[junit4:junit4] 2> 1417 T79 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 1418 T79 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1418 T79 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1419 T79 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1419 T79 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1419 T79 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1420 T79 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1420 T79 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1421 T79 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1421 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1439 T79 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 1455 T79 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29524/solr
[junit4:junit4] 2> 1456 T79 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1456 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@42db0359
[junit4:junit4] 2> 1457 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1459 T99 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1460 T99 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 1460 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:39110
[junit4:junit4] 2> 1461 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:39110
[junit4:junit4] 2> 1467 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca58606970002 with negotiated timeout 20000 for client /140.211.11.196:39110
[junit4:junit4] 2> 1467 T99 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca58606970002, negotiated timeout = 20000
[junit4:junit4] 2> 1468 T100 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42db0359 name:ZooKeeperConnection Watcher:127.0.0.1:29524 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1468 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1470 T84 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca58606970002
[junit4:junit4] 2> 1476 T100 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1476 T81 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:39110 which had sessionid 0x13ca58606970002
[junit4:junit4] 2> 1476 T79 oaz.ZooKeeper.close Session: 0x13ca58606970002 closed
[junit4:junit4] 2> 1477 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 1487 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2fad4ba4
[junit4:junit4] 2> 1487 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1488 T101 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1489 T101 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 1489 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:27981
[junit4:junit4] 2> 1489 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:27981
[junit4:junit4] 2> 1491 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca58606970003 with negotiated timeout 20000 for client /140.211.11.196:27981
[junit4:junit4] 2> 1491 T101 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca58606970003, negotiated timeout = 20000
[junit4:junit4] 2> 1492 T102 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fad4ba4 name:ZooKeeperConnection Watcher:127.0.0.1:29524/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1492 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1494 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1502 T79 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1505 T79 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44201_gd_w%2Fgh
[junit4:junit4] 2> 1506 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:44201_gd_w%2Fgh Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:44201_gd_w%2Fgh
[junit4:junit4] 2> 1507 T79 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44201_gd_w%2Fgh
[junit4:junit4] 2> 1512 T79 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1527 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 1528 T79 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1531 T79 oasc.Overseer.start Overseer (id=89128087695327235-127.0.0.1:44201_gd_w%2Fgh-n_0000000000) starting
[junit4:junit4] 2> 1532 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1541 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1542 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1543 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1552 T104 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1553 T79 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1556 T79 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1558 T103 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1562 T105 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359986690002/collection1
[junit4:junit4] 2> 1563 T105 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1563 T105 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1564 T105 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1566 T105 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359986690002/collection1/'
[junit4:junit4] 2> 1567 T105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359986690002/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1567 T105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359986690002/collection1/lib/README' to classloader
[junit4:junit4] 2> 1616 T105 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1679 T105 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1780 T105 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1801 T105 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 2499 T105 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2517 T105 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2522 T105 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2543 T105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2548 T105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2552 T105 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2555 T105 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2558 T105 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359986690002/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/control/data/
[junit4:junit4] 2> 2559 T105 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36325789
[junit4:junit4] 2> 2560 T105 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 2584 T105 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/control/data forceNew:false
[junit4:junit4] 2> 2585 T105 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/control/data
[junit4:junit4] 2> 2585 T105 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/control/data/index/
[junit4:junit4] 2> 2586 T105 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2587 T105 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/control/data/index forceNew:false
[junit4:junit4] 2> 2597 T105 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@796b0a2d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 2597 T105 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 2598 T105 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/control/data/index
[junit4:junit4] 2> 2599 T105 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 2676 T105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2676 T105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 2677 T105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2683 T105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 2722 T105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2722 T105 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2725 T105 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2730 T105 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2745 T105 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2788 T105 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 2790 T105 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 2794 T105 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2795 T105 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 2795 T105 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 2795 T105 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 2796 T105 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2797 T105 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2798 T105 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2799 T105 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2800 T105 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2801 T105 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2802 T105 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2803 T105 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2804 T105 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2819 T105 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 2834 T105 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 2843 T105 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2846 T105 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 2848 T105 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 2850 T105 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/control/data
[junit4:junit4] 2> 2851 T105 oass.SolrIndexSearcher.<init> Opening Searcher@5da4c884 main
[junit4:junit4] 2> 2874 T105 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2874 T105 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2875 T105 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 2920 T105 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 3017 T106 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5da4c884 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 3030 T105 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 3030 T105 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3031 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 3069 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3070 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:44201_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44201/gd_w/gh"}
[junit4:junit4] 2> 3071 T103 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 3094 T103 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 3095 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 3120 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4036 T105 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 4036 T105 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44201/gd_w/gh collection:control_collection shard:shard1
[junit4:junit4] 2> 4051 T105 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 4070 T105 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 4113 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 4114 T105 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 4115 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4125 T105 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 4125 T105 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 4126 T105 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44201/gd_w/gh/collection1/
[junit4:junit4] 2> 4126 T105 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 4127 T105 oasc.SyncStrategy.syncToMe http://127.0.0.1:44201/gd_w/gh/collection1/ has no replicas
[junit4:junit4] 2> 4127 T105 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44201/gd_w/gh/collection1/
[junit4:junit4] 2> 4127 T105 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 4133 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4625 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4646 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4708 T105 oasc.ZkController.register We are http://127.0.0.1:44201/gd_w/gh/collection1/ and leader is http://127.0.0.1:44201/gd_w/gh/collection1/
[junit4:junit4] 2> 4713 T105 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44201/gd_w/gh
[junit4:junit4] 2> 4713 T105 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 4714 T105 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 4714 T105 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 4718 T105 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4720 T79 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 4721 T79 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4835 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4862 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 4881 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5286fcc4
[junit4:junit4] 2> 4882 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4883 T107 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4884 T107 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 4884 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:26484
[junit4:junit4] 2> 4884 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:26484
[junit4:junit4] 2> 4886 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca58606970004 with negotiated timeout 10000 for client /140.211.11.196:26484
[junit4:junit4] 2> 4886 T107 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca58606970004, negotiated timeout = 10000
[junit4:junit4] 2> 4887 T108 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5286fcc4 name:ZooKeeperConnection Watcher:127.0.0.1:29524/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4887 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4889 T79 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4894 T79 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 5081 T79 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 5086 T79 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:36837
[junit4:junit4] 2> 5087 T79 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 5088 T79 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 5089 T79 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359986694559
[junit4:junit4] 2> 5090 T79 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359986694559/solr.xml
[junit4:junit4] 2> 5091 T79 oasc.CoreContainer.<init> New CoreContainer 885644617
[junit4:junit4] 2> 5092 T79 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359986694559/'
[junit4:junit4] 2> 5093 T79 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359986694559/'
[junit4:junit4] 2> 5177 T79 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 5177 T79 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 5178 T79 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 5179 T79 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 5179 T79 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 5180 T79 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 5180 T79 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 5181 T79 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 5182 T79 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 5182 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 5207 T79 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 5229 T79 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29524/solr
[junit4:junit4] 2> 5230 T79 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 5230 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@16db431a
[junit4:junit4] 2> 5232 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5232 T118 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5233 T118 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 5234 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16881
[junit4:junit4] 2> 5234 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16881
[junit4:junit4] 2> 5236 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca58606970005 with negotiated timeout 20000 for client /140.211.11.196:16881
[junit4:junit4] 2> 5237 T118 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca58606970005, negotiated timeout = 20000
[junit4:junit4] 2> 5237 T119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16db431a name:ZooKeeperConnection Watcher:127.0.0.1:29524 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5238 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5240 T84 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca58606970005
[junit4:junit4] 2> 5241 T119 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 5241 T81 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:16881 which had sessionid 0x13ca58606970005
[junit4:junit4] 2> 5241 T79 oaz.ZooKeeper.close Session: 0x13ca58606970005 closed
[junit4:junit4] 2> 5242 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 5256 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@8279c5e
[junit4:junit4] 2> 5257 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5258 T120 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5259 T120 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 5259 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:29257
[junit4:junit4] 2> 5259 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:29257
[junit4:junit4] 2> 5261 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca58606970006 with negotiated timeout 20000 for client /140.211.11.196:29257
[junit4:junit4] 2> 5261 T120 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca58606970006, negotiated timeout = 20000
[junit4:junit4] 2> 5262 T121 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8279c5e name:ZooKeeperConnection Watcher:127.0.0.1:29524/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5262 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5264 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5266 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5268 T79 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36837_gd_w%2Fgh
[junit4:junit4] 2> 5269 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:36837_gd_w%2Fgh Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:36837_gd_w%2Fgh
[junit4:junit4] 2> 5270 T79 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36837_gd_w%2Fgh
[junit4:junit4] 2> 5273 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5274 T108 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5282 T102 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5288 T79 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5297 T122 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359986694559/collection1
[junit4:junit4] 2> 5298 T122 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5299 T122 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5299 T122 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5301 T122 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359986694559/collection1/'
[junit4:junit4] 2> 5303 T122 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359986694559/collection1/lib/README' to classloader
[junit4:junit4] 2> 5304 T122 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359986694559/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5383 T122 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5464 T122 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5566 T122 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5595 T122 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6159 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6162 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:44201_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44201/gd_w/gh"}
[junit4:junit4] 2> 6224 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6224 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6224 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6316 T122 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6334 T122 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6339 T122 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6370 T122 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6377 T122 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6383 T122 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6387 T122 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6390 T122 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359986694559/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1/
[junit4:junit4] 2> 6391 T122 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36325789
[junit4:junit4] 2> 6393 T122 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 6394 T122 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1 forceNew:false
[junit4:junit4] 2> 6395 T122 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1
[junit4:junit4] 2> 6395 T122 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1/index/
[junit4:junit4] 2> 6396 T122 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6397 T122 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1/index forceNew:false
[junit4:junit4] 2> 6407 T122 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@396cd7c2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6408 T122 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6409 T122 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1/index
[junit4:junit4] 2> 6409 T122 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 6413 T122 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6413 T122 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 6414 T122 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6415 T122 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 6416 T122 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6416 T122 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6417 T122 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6420 T122 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6422 T122 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6424 T122 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 6426 T122 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 6427 T122 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6429 T122 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 6429 T122 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 6430 T122 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 6432 T122 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6434 T122 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6436 T122 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6438 T122 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6440 T122 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6442 T122 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6444 T122 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6446 T122 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6448 T122 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6450 T122 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 6452 T122 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 6465 T122 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6470 T122 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 6473 T122 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 6476 T122 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1
[junit4:junit4] 2> 6478 T122 oass.SolrIndexSearcher.<init> Opening Searcher@7aea68c0 main
[junit4:junit4] 2> 6479 T122 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6480 T122 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6481 T122 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 6495 T122 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 6563 T123 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7aea68c0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6584 T122 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6584 T122 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7778 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7780 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36837_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36837/gd_w/gh"}
[junit4:junit4] 2> 7780 T103 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 7780 T103 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 7806 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7806 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7806 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8589 T122 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 8589 T122 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36837/gd_w/gh collection:collection1 shard:shard1
[junit4:junit4] 2> 8590 T122 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 8635 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970006 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 8636 T122 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 8636 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970006 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8646 T122 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 8647 T122 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 8647 T122 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36837/gd_w/gh/collection1/
[junit4:junit4] 2> 8647 T122 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 8648 T122 oasc.SyncStrategy.syncToMe http://127.0.0.1:36837/gd_w/gh/collection1/ has no replicas
[junit4:junit4] 2> 8648 T122 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36837/gd_w/gh/collection1/
[junit4:junit4] 2> 8649 T122 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 8654 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970006 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9312 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9339 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9339 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9339 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9378 T122 oasc.ZkController.register We are http://127.0.0.1:36837/gd_w/gh/collection1/ and leader is http://127.0.0.1:36837/gd_w/gh/collection1/
[junit4:junit4] 2> 9378 T122 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36837/gd_w/gh
[junit4:junit4] 2> 9378 T122 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 9379 T122 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 9379 T122 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9382 T122 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9384 T79 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 9385 T79 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 9385 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 9574 T79 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 9578 T79 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:23227
[junit4:junit4] 2> 9579 T79 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 9580 T79 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 9580 T79 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359986699069
[junit4:junit4] 2> 9581 T79 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359986699069/solr.xml
[junit4:junit4] 2> 9581 T79 oasc.CoreContainer.<init> New CoreContainer 303487423
[junit4:junit4] 2> 9582 T79 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359986699069/'
[junit4:junit4] 2> 9583 T79 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359986699069/'
[junit4:junit4] 2> 9641 T79 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 9641 T79 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 9642 T79 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 9643 T79 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 9643 T79 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 9644 T79 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 9644 T79 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 9645 T79 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 9645 T79 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 9646 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 9670 T79 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 9692 T79 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29524/solr
[junit4:junit4] 2> 9693 T79 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 9694 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5c055c1e
[junit4:junit4] 2> 9695 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 9695 T133 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 9696 T133 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 9697 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:19140
[junit4:junit4] 2> 9697 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:19140
[junit4:junit4] 2> 9699 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca58606970007 with negotiated timeout 20000 for client /140.211.11.196:19140
[junit4:junit4] 2> 9699 T133 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca58606970007, negotiated timeout = 20000
[junit4:junit4] 2> 9700 T134 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c055c1e name:ZooKeeperConnection Watcher:127.0.0.1:29524 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 9700 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 9702 T84 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca58606970007
[junit4:junit4] 2> 9703 T134 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 9703 T81 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:19140 which had sessionid 0x13ca58606970007
[junit4:junit4] 2> 9703 T79 oaz.ZooKeeper.close Session: 0x13ca58606970007 closed
[junit4:junit4] 2> 9704 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 9716 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@24f076a0
[junit4:junit4] 2> 9717 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 9718 T135 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 9718 T135 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 9719 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:30928
[junit4:junit4] 2> 9719 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:30928
[junit4:junit4] 2> 9721 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca58606970008 with negotiated timeout 20000 for client /140.211.11.196:30928
[junit4:junit4] 2> 9721 T135 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca58606970008, negotiated timeout = 20000
[junit4:junit4] 2> 9721 T136 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24f076a0 name:ZooKeeperConnection Watcher:127.0.0.1:29524/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 9722 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 9724 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9725 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9727 T79 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23227_gd_w%2Fgh
[junit4:junit4] 2> 9728 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970008 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:23227_gd_w%2Fgh Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:23227_gd_w%2Fgh
[junit4:junit4] 2> 9729 T79 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:23227_gd_w%2Fgh
[junit4:junit4] 2> 9738 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9738 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9738 T108 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9739 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9740 T102 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9741 T121 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9743 T79 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9752 T137 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359986699069/collection1
[junit4:junit4] 2> 9752 T137 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9753 T137 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9753 T137 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9755 T137 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359986699069/collection1/'
[junit4:junit4] 2> 9757 T137 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359986699069/collection1/lib/README' to classloader
[junit4:junit4] 2> 9758 T137 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359986699069/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9822 T137 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 9903 T137 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10004 T137 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10025 T137 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10664 T137 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10676 T137 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10679 T137 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10701 T137 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10706 T137 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10710 T137 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10712 T137 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10714 T137 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359986699069/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2/
[junit4:junit4] 2> 10715 T137 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36325789
[junit4:junit4] 2> 10715 T137 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 10716 T137 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2 forceNew:false
[junit4:junit4] 2> 10717 T137 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2
[junit4:junit4] 2> 10717 T137 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2/index/
[junit4:junit4] 2> 10717 T137 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10718 T137 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2/index forceNew:false
[junit4:junit4] 2> 10723 T137 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@547b471e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10724 T137 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10725 T137 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2/index
[junit4:junit4] 2> 10725 T137 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 10728 T137 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10728 T137 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 10728 T137 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10729 T137 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 10729 T137 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10730 T137 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10730 T137 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10731 T137 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10732 T137 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10734 T137 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 10736 T137 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 10737 T137 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10739 T137 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 10739 T137 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 10740 T137 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 10742 T137 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10744 T137 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10745 T137 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10747 T137 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10749 T137 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10751 T137 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10753 T137 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10755 T137 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10757 T137 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 10759 T137 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 10761 T137 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 10774 T137 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10779 T137 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 10781 T137 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 10784 T137 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2
[junit4:junit4] 2> 10786 T137 oass.SolrIndexSearcher.<init> Opening Searcher@69b92fd3 main
[junit4:junit4] 2> 10787 T137 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10788 T137 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10789 T137 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 10795 T137 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 10847 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10849 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36837_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36837/gd_w/gh"}
[junit4:junit4] 2> 10853 T138 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@69b92fd3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10855 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10855 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10855 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10855 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10862 T137 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10862 T137 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12369 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12371 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:23227_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:23227/gd_w/gh"}
[junit4:junit4] 2> 12371 T103 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 12371 T103 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 12412 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12412 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12412 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12412 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12868 T137 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 12868 T137 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:23227/gd_w/gh collection:collection1 shard:shard2
[junit4:junit4] 2> 12870 T137 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 12890 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970008 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 12891 T137 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 12892 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970008 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12903 T137 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 12903 T137 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 12903 T137 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:23227/gd_w/gh/collection1/
[junit4:junit4] 2> 12904 T137 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 12904 T137 oasc.SyncStrategy.syncToMe http://127.0.0.1:23227/gd_w/gh/collection1/ has no replicas
[junit4:junit4] 2> 12904 T137 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:23227/gd_w/gh/collection1/
[junit4:junit4] 2> 12905 T137 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 12914 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca58606970008 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13918 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13937 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13937 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13937 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13937 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13997 T137 oasc.ZkController.register We are http://127.0.0.1:23227/gd_w/gh/collection1/ and leader is http://127.0.0.1:23227/gd_w/gh/collection1/
[junit4:junit4] 2> 13997 T137 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:23227/gd_w/gh
[junit4:junit4] 2> 13997 T137 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 13998 T137 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 13998 T137 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14000 T137 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14002 T79 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 14002 T79 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14003 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14216 T79 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14220 T79 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:26927
[junit4:junit4] 2> 14221 T79 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14221 T79 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14222 T79 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359986703684
[junit4:junit4] 2> 14222 T79 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359986703684/solr.xml
[junit4:junit4] 2> 14223 T79 oasc.CoreContainer.<init> New CoreContainer 956099114
[junit4:junit4] 2> 14224 T79 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359986703684/'
[junit4:junit4] 2> 14224 T79 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359986703684/'
[junit4:junit4] 2> 14299 T79 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 14300 T79 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14300 T79 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14301 T79 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14301 T79 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14302 T79 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14303 T79 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14303 T79 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14304 T79 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14304 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14330 T79 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14355 T79 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29524/solr
[junit4:junit4] 2> 14355 T79 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14356 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@20885af
[junit4:junit4] 2> 14357 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14358 T148 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14359 T148 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 14359 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:30584
[junit4:junit4] 2> 14360 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:30584
[junit4:junit4] 2> 14362 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca58606970009 with negotiated timeout 20000 for client /140.211.11.196:30584
[junit4:junit4] 2> 14362 T148 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca58606970009, negotiated timeout = 20000
[junit4:junit4] 2> 14363 T149 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20885af name:ZooKeeperConnection Watcher:127.0.0.1:29524 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14363 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14365 T84 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca58606970009
[junit4:junit4] 2> 14367 T149 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14367 T81 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:30584 which had sessionid 0x13ca58606970009
[junit4:junit4] 2> 14367 T79 oaz.ZooKeeper.close Session: 0x13ca58606970009 closed
[junit4:junit4] 2> 14368 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 14380 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@404c6509
[junit4:junit4] 2> 14381 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14381 T150 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14382 T150 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 14382 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:19456
[junit4:junit4] 2> 14383 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:19456
[junit4:junit4] 2> 14385 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca5860697000a with negotiated timeout 20000 for client /140.211.11.196:19456
[junit4:junit4] 2> 14385 T150 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca5860697000a, negotiated timeout = 20000
[junit4:junit4] 2> 14385 T151 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@404c6509 name:ZooKeeperConnection Watcher:127.0.0.1:29524/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14386 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14387 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca5860697000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14388 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca5860697000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14390 T79 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:26927_gd_w%2Fgh
[junit4:junit4] 2> 14391 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca5860697000a type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:26927_gd_w%2Fgh Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:26927_gd_w%2Fgh
[junit4:junit4] 2> 14397 T79 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:26927_gd_w%2Fgh
[junit4:junit4] 2> 14400 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14400 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14400 T136 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14400 T108 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14401 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14401 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14402 T102 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14404 T121 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14405 T79 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14424 T152 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359986703684/collection1
[junit4:junit4] 2> 14425 T152 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14426 T152 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14426 T152 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14428 T152 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359986703684/collection1/'
[junit4:junit4] 2> 14430 T152 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359986703684/collection1/lib/README' to classloader
[junit4:junit4] 2> 14431 T152 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359986703684/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14495 T152 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14578 T152 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14679 T152 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14697 T152 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15427 T152 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15444 T152 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15448 T152 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15451 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15454 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:23227_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:23227/gd_w/gh"}
[junit4:junit4] 2> 15462 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15462 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15462 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15462 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15462 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15488 T152 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15495 T152 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15502 T152 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15505 T152 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15508 T152 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359986703684/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/
[junit4:junit4] 2> 15509 T152 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36325789
[junit4:junit4] 2> 15510 T152 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 15511 T152 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3 forceNew:false
[junit4:junit4] 2> 15512 T152 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3
[junit4:junit4] 2> 15512 T152 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index/
[junit4:junit4] 2> 15513 T152 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15514 T152 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index forceNew:false
[junit4:junit4] 2> 15521 T152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@60912875; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15522 T152 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15523 T152 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index
[junit4:junit4] 2> 15523 T152 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 15527 T152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15528 T152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 15528 T152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15529 T152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 15530 T152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15530 T152 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15531 T152 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15533 T152 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15534 T152 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15535 T152 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 15537 T152 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 15537 T152 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15539 T152 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 15539 T152 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 15540 T152 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 15541 T152 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15542 T152 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15544 T152 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15545 T152 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15546 T152 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15547 T152 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15549 T152 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15550 T152 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15551 T152 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15553 T152 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 15554 T152 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 15569 T152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15574 T152 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 15576 T152 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 15579 T152 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3
[junit4:junit4] 2> 15581 T152 oass.SolrIndexSearcher.<init> Opening Searcher@1ce2dd88 main
[junit4:junit4] 2> 15583 T152 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15583 T152 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15584 T152 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 15593 T152 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 15657 T153 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ce2dd88 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15673 T152 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15673 T152 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16974 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16976 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:26927_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:26927/gd_w/gh"}
[junit4:junit4] 2> 16976 T103 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 16977 T103 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16995 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16995 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16995 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16995 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16995 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17678 T152 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 17678 T152 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:26927/gd_w/gh collection:collection1 shard:shard1
[junit4:junit4] 2> 17682 T152 oasc.ZkController.register We are http://127.0.0.1:26927/gd_w/gh/collection1/ and leader is http://127.0.0.1:36837/gd_w/gh/collection1/
[junit4:junit4] 2> 17683 T152 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:26927/gd_w/gh
[junit4:junit4] 2> 17683 T152 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 17684 T152 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@65c4d40c url=http://127.0.0.1:26927/gd_w/gh/collection1 node=127.0.0.1:26927_gd_w%2Fgh C2_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:26927_gd_w%2Fgh, base_url=http://127.0.0.1:26927/gd_w/gh}
[junit4:junit4] 2> 17690 T154 C2 P26927 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 17691 T152 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17691 T154 C2 P26927 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17692 T154 C2 P26927 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17692 T154 C2 P26927 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17693 T79 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 17693 T79 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17694 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17697 T154 C2 P26927 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17972 T79 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 17976 T79 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48723
[junit4:junit4] 2> 17977 T79 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 17977 T79 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 17978 T79 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359986707385
[junit4:junit4] 2> 17978 T79 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359986707385/solr.xml
[junit4:junit4] 2> 17979 T79 oasc.CoreContainer.<init> New CoreContainer 374310541
[junit4:junit4] 2> 17980 T79 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359986707385/'
[junit4:junit4] 2> 17981 T79 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359986707385/'
[junit4:junit4] 2> 18069 T79 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 18070 T79 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 18070 T79 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 18071 T79 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 18071 T79 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 18072 T79 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 18072 T79 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 18073 T79 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 18074 T79 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 18074 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 18103 T79 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 18130 T79 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29524/solr
[junit4:junit4] 2> 18130 T79 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 18131 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@299c282e
[junit4:junit4] 2> 18132 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 18133 T164 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 18134 T164 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 18134 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28359
[junit4:junit4] 2> 18135 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28359
[junit4:junit4] 2> 18137 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca5860697000b with negotiated timeout 20000 for client /140.211.11.196:28359
[junit4:junit4] 2> 18137 T164 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca5860697000b, negotiated timeout = 20000
[junit4:junit4] 2> 18138 T165 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@299c282e name:ZooKeeperConnection Watcher:127.0.0.1:29524 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 18138 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 18140 T84 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca5860697000b
[junit4:junit4] 2> 18155 T165 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 18154 T79 oaz.ZooKeeper.close Session: 0x13ca5860697000b closed
[junit4:junit4] 2> 18155 T81 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28359 which had sessionid 0x13ca5860697000b
[junit4:junit4] 2> 18155 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 18168 T79 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29524/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@25f2e25b
[junit4:junit4] 2> 18169 T79 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 18170 T166 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29524. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 18170 T166 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29524, initiating session
[junit4:junit4] 2> 18170 T81 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64502
[junit4:junit4] 2> 18171 T81 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64502
[junit4:junit4] 2> 18173 T83 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca5860697000c with negotiated timeout 20000 for client /140.211.11.196:64502
[junit4:junit4] 2> 18173 T166 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29524, sessionid = 0x13ca5860697000c, negotiated timeout = 20000
[junit4:junit4] 2> 18173 T167 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@25f2e25b name:ZooKeeperConnection Watcher:127.0.0.1:29524/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 18174 T79 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 18175 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca5860697000c type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18177 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca5860697000c type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18184 T79 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48723_gd_w%2Fgh
[junit4:junit4] 2> 18185 T84 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca5860697000c type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48723_gd_w%2Fgh Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48723_gd_w%2Fgh
[junit4:junit4] 2> 18187 T79 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48723_gd_w%2Fgh
[junit4:junit4] 2> 18191 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18191 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18192 T136 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18192 T108 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18192 T151 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18193 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18193 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18193 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18195 T121 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18195 T102 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18197 T79 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 18206 T168 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359986707385/collection1
[junit4:junit4] 2> 18207 T168 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 18208 T168 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 18208 T168 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 18210 T168 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359986707385/collection1/'
[junit4:junit4] 2> 18212 T168 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359986707385/collection1/lib/README' to classloader
[junit4:junit4] 2> 18213 T168 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359986707385/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 18338 T168 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 18437 T168 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18502 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18503 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:26927_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:26927/gd_w/gh"}
[junit4:junit4] 2> 18522 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18522 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18522 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18522 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18522 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18538 T168 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18538 T167 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18582 T168 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 19649 T168 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19661 T168 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19665 T168 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19683 T168 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19699 T168 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19704 T168 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19706 T168 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19708 T168 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359986707385/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/
[junit4:junit4] 2> 19708 T168 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36325789
[junit4:junit4] 2> 19709 T168 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 19711 T168 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4 forceNew:false
[junit4:junit4] 2> 19712 T168 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4
[junit4:junit4] 2> 19712 T168 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index/
[junit4:junit4] 2> 19713 T168 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19714 T168 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index forceNew:false
[junit4:junit4] 2> 19719 T168 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3aac2343; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19719 T168 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19720 T168 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index
[junit4:junit4] 2> 19721 T168 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 19723 T168 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19724 T168 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 19724 T168 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19724 T168 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 19725 T168 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19725 T168 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19726 T168 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19727 T168 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19728 T168 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19728 T168 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 19729 T168 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 19730 T168 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19731 T168 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 19731 T168 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 19731 T168 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 19732 T168 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19733 T168 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19734 T168 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19735 T168 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19736 T168 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19737 T168 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19737 T168 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19738 T168 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19739 T168 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19740 T168 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 19741 T168 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 19752 T168 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19756 T168 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 19758 T168 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 19760 T168 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4
[junit4:junit4] 2> 19761 T168 oass.SolrIndexSearcher.<init> Opening Searcher@4cabd349 main
[junit4:junit4] 2> 19762 T168 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19763 T168 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19764 T168 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 19770 T168 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 19825 T169 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4cabd349 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19834 T168 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 19835 T168 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20028 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20029 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:48723_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48723/gd_w/gh"}
[junit4:junit4] 2> 20029 T103 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 20029 T103 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 20042 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20042 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20042 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20042 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20042 T167 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20042 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20837 T168 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 20837 T168 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48723/gd_w/gh collection:collection1 shard:shard2
[junit4:junit4] 2> 20842 T168 oasc.ZkController.register We are http://127.0.0.1:48723/gd_w/gh/collection1/ and leader is http://127.0.0.1:23227/gd_w/gh/collection1/
[junit4:junit4] 2> 20842 T168 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48723/gd_w/gh
[junit4:junit4] 2> 20843 T168 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 20843 T168 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@25bd6851 url=http://127.0.0.1:48723/gd_w/gh/collection1 node=127.0.0.1:48723_gd_w%2Fgh C3_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48723_gd_w%2Fgh, base_url=http://127.0.0.1:48723/gd_w/gh}
[junit4:junit4] 2> 20844 T170 C3 P48723 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 20844 T168 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20845 T170 C3 P48723 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 20845 T170 C3 P48723 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 20845 T170 C3 P48723 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20846 T79 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 20847 T79 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 20847 T170 C3 P48723 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20847 T79 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20867 T79 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20870 T79 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 20871 T79 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21547 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21549 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:48723_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48723/gd_w/gh"}
[junit4:junit4] 2> 21566 T167 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21566 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21566 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21566 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21566 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21566 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:26927_gd_w%2Fgh, base_url=http://127.0.0.1:26927/gd_w/gh}
[junit4:junit4] 2> 21612 T154 C2 P26927 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:36837/gd_w/gh/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 21623 T154 C2 P26927 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 21645 T154 C2 P26927 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:26927/gd_w/gh START replicas=[http://127.0.0.1:36837/gd_w/gh/collection1/] nUpdates=100
[junit4:junit4] 2> 21661 T154 C2 P26927 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 21662 T154 C2 P26927 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 21662 T154 C2 P26927 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 21663 T154 C2 P26927 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 21663 T154 C2 P26927 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 21663 T154 C2 P26927 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:36837/gd_w/gh/collection1/. core=collection1
[junit4:junit4] 2> 21664 T154 C2 P26927 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@29301a2f url=http://127.0.0.1:36837/gd_w/gh/collection1 node=127.0.0.1:36837_gd_w%2Fgh C4_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:36837_gd_w%2Fgh, base_url=http://127.0.0.1:36837/gd_w/gh, leader=true}
[junit4:junit4] 2> 21729 T112 C4 P36837 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=7
[junit4:junit4] 2> 21747 T113 C4 P36837 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 21748 T113 C4 P36837 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1
[junit4:junit4] 2> 21753 T113 C4 P36837 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@396cd7c2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21753 T113 C4 P36837 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21758 T113 C4 P36837 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@396cd7c2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@396cd7c2; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 21758 T113 C4 P36837 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 21760 T113 C4 P36837 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1
[junit4:junit4] 2> 21760 T113 C4 P36837 oass.SolrIndexSearcher.<init> Opening Searcher@2829abfd realtime
[junit4:junit4] 2> 21761 T113 C4 P36837 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21761 T113 C4 P36837 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 39
[junit4:junit4] 2> 21827 T154 C2 P26927 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 21828 T154 C2 P26927 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 21858 T154 C2 P26927 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 21873 T79 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21932 T114 C4 P36837 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 21933 T114 C4 P36837 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=72
[junit4:junit4] 2> 21935 T154 C2 P26927 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 21935 T154 C2 P26927 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 21936 T154 C2 P26927 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 21940 T114 C4 P36837 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1
[junit4:junit4] 2> 21941 T114 C4 P36837 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty1/index
[junit4:junit4] 2> 21941 T114 C4 P36837 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 21943 T154 C2 P26927 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 21945 T154 C2 P26927 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index.20130204080511608 forceNew:false
[junit4:junit4] 2> 21945 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3
[junit4:junit4] 2> 21946 T154 C2 P26927 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index.20130204080511608 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c55252c; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 21962 T114 C4 P36837 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=5
[junit4:junit4] 2> 21978 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index
[junit4:junit4] 2> 21978 T154 C2 P26927 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 21979 T154 C2 P26927 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130204080511608
[junit4:junit4] 2> 21986 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3
[junit4:junit4] 2> 21987 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3
[junit4:junit4] 2> 21988 T154 C2 P26927 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index.20130204080511608
[junit4:junit4] 2> 21992 T154 C2 P26927 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index.20130204080511608 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c55252c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 21993 T154 C2 P26927 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 21995 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3
[junit4:junit4] 2> 22000 T154 C2 P26927 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22000 T154 C2 P26927 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22000 T154 C2 P26927 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 22002 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index.20130204080511608
[junit4:junit4] 2> 22003 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3
[junit4:junit4] 2> 22007 T154 C2 P26927 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index.20130204080511608 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c55252c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22007 T154 C2 P26927 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22008 T154 C2 P26927 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 22009 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3
[junit4:junit4] 2> 22009 T154 C2 P26927 oass.SolrIndexSearcher.<init> Opening Searcher@1ce00c07 main
[junit4:junit4] 2> 22013 T153 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ce00c07 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22014 T153 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index
[junit4:junit4] 2> 22015 T154 C2 P26927 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 22018 T154 C2 P26927 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index.20130204080511608 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c55252c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index.20130204080511608 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c55252c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 22019 T154 C2 P26927 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 22020 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3
[junit4:junit4] 2> 22021 T154 C2 P26927 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22021 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index.20130204080511608
[junit4:junit4] 2> 22021 T154 C2 P26927 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty3/index
[junit4:junit4] 2> 22022 T154 C2 P26927 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 22022 T154 C2 P26927 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 22022 T154 C2 P26927 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 22023 T154 C2 P26927 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22025 T154 C2 P26927 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 22877 T79 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23073 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23075 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:26927_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:26927/gd_w/gh"}
[junit4:junit4] 2> 23090 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23090 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23090 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23090 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23090 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23090 T167 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> C3_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48723_gd_w%2Fgh, base_url=http://127.0.0.1:48723/gd_w/gh}
[junit4:junit4] 2> 23871 T170 C3 P48723 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:23227/gd_w/gh/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 23871 T170 C3 P48723 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48723/gd_w/gh START replicas=[http://127.0.0.1:23227/gd_w/gh/collection1/] nUpdates=100
[junit4:junit4] 2> 23872 T170 C3 P48723 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 23872 T170 C3 P48723 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 23873 T170 C3 P48723 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 23873 T170 C3 P48723 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 23873 T170 C3 P48723 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 23874 T170 C3 P48723 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:23227/gd_w/gh/collection1/. core=collection1
[junit4:junit4] 2> 23875 T170 C3 P48723 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23881 T79 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@3a7780f0 url=http://127.0.0.1:23227/gd_w/gh/collection1 node=127.0.0.1:23227_gd_w%2Fgh C5_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:23227_gd_w%2Fgh, base_url=http://127.0.0.1:23227/gd_w/gh, leader=true}
[junit4:junit4] 2> 23887 T127 C5 P23227 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 23898 T128 C5 P23227 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 23900 T128 C5 P23227 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2
[junit4:junit4] 2> 23905 T128 C5 P23227 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@547b471e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 23906 T128 C5 P23227 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 23911 T128 C5 P23227 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@547b471e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@547b471e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 23912 T128 C5 P23227 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 23913 T128 C5 P23227 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2
[junit4:junit4] 2> 23914 T128 C5 P23227 oass.SolrIndexSearcher.<init> Opening Searcher@4b712592 realtime
[junit4:junit4] 2> 23915 T128 C5 P23227 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23915 T128 C5 P23227 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 17
[junit4:junit4] 2> 23917 T170 C3 P48723 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 23918 T170 C3 P48723 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 23922 T129 C5 P23227 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 23923 T129 C5 P23227 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 23924 T170 C3 P48723 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 23924 T170 C3 P48723 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 23925 T170 C3 P48723 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 23928 T129 C5 P23227 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2
[junit4:junit4] 2> 23929 T129 C5 P23227 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty2/index
[junit4:junit4] 2> 23930 T129 C5 P23227 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 23931 T170 C3 P48723 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 23933 T170 C3 P48723 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index.20130204080513597 forceNew:false
[junit4:junit4] 2> 23934 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4
[junit4:junit4] 2> 23935 T170 C3 P48723 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index.20130204080513597 lockFactory=org.apache.lucene.store.NativeFSLockFactory@538f7b25; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4] 2> 23940 T129 C5 P23227 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 23942 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index
[junit4:junit4] 2> 23942 T170 C3 P48723 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 23943 T170 C3 P48723 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130204080513597
[junit4:junit4] 2> 23945 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4
[junit4:junit4] 2> 23945 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4
[junit4:junit4] 2> 23946 T170 C3 P48723 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index.20130204080513597
[junit4:junit4] 2> 23950 T170 C3 P48723 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index.20130204080513597 lockFactory=org.apache.lucene.store.NativeFSLockFactory@538f7b25; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 23951 T170 C3 P48723 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 23953 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4
[junit4:junit4] 2> 23953 T170 C3 P48723 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 23954 T170 C3 P48723 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 23954 T170 C3 P48723 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 23955 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index.20130204080513597
[junit4:junit4] 2> 23956 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4
[junit4:junit4] 2> 23960 T170 C3 P48723 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index.20130204080513597 lockFactory=org.apache.lucene.store.NativeFSLockFactory@538f7b25; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 23961 T170 C3 P48723 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 23961 T170 C3 P48723 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 23962 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4
[junit4:junit4] 2> 23963 T170 C3 P48723 oass.SolrIndexSearcher.<init> Opening Searcher@781f9364 main
[junit4:junit4] 2> 23966 T169 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@781f9364 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 23967 T169 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index
[junit4:junit4] 2> 23968 T170 C3 P48723 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 23972 T170 C3 P48723 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index.20130204080513597 lockFactory=org.apache.lucene.store.NativeFSLockFactory@538f7b25; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index.20130204080513597 lockFactory=org.apache.lucene.store.NativeFSLockFactory@538f7b25; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 23972 T170 C3 P48723 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 23974 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4
[junit4:junit4] 2> 23974 T170 C3 P48723 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23975 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index.20130204080513597
[junit4:junit4] 2> 23975 T170 C3 P48723 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359986689673/jetty4/index
[junit4:junit4] 2> 23975 T170 C3 P48723 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 23975 T170 C3 P48723 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 23976 T170 C3 P48723 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 23976 T170 C3 P48723 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 23978 T170 C3 P48723 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 24596 T103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24598 T103 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:48723_gd_w%2Fgh",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48723/gd_w/gh"}
[junit4:junit4] 2> 24618 T167 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24619 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24619 T136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24618 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24618 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24618 T102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24884 T79 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24885 T79 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@4ec065f7 url=http://127.0.0.1:44201/gd_w/gh/collection1 node=127.0.0.1:44201_gd_w%2Fgh C6_STATE=coll:control_collection core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:44201_gd_w%2Fgh, base_url=http://127.0.0.
[...truncated too long message...]
lr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] > Caused by: java.net.SocketException: Socket closed
[junit4:junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4:junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:150)
[junit4:junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:121)
[junit4:junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149)
[junit4:junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
[junit4:junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.read(AbstractSessionInputBuffer.java:195)
[junit4:junit4] > at org.apache.http.impl.io.ContentLengthInputStream.read(ContentLengthInputStream.java:176)
[junit4:junit4] > at org.apache.http.conn.EofSensorInputStream.read(EofSensorInputStream.java:138)
[junit4:junit4] > at org.apache.solr.common.util.FastInputStream.readWrappedStream(FastInputStream.java:80)
[junit4:junit4] > at org.apache.solr.common.util.FastInputStream.refill(FastInputStream.java:89)
[junit4:junit4] > at org.apache.solr.common.util.FastInputStream.readByte(FastInputStream.java:192)
[junit4:junit4] > at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:107)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.BinaryResponseParser.processResponse(BinaryResponseParser.java:41)
[junit4:junit4] > ... 48 more
[junit4:junit4] 2> 284628 T79 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {n_f1=Lucene41(blocksize=128), foo_b=PostingsFormat(name=Asserting), cat=Pulsing41(freqCutoff=9 minBlockSize=41 maxBlockSize=141), foo_d=PostingsFormat(name=Memory doPackFST= true), foo_f=PostingsFormat(name=Asserting), n_tl1=Lucene41(blocksize=128), n_d1=Pulsing41(freqCutoff=9 minBlockSize=41 maxBlockSize=141), rnd_b=PostingsFormat(name=Memory doPackFST= true), intDefault=Lucene41(blocksize=128), n_td1=Lucene41(blocksize=128), timestamp=Pulsing41(freqCutoff=9 minBlockSize=41 maxBlockSize=141), id=PostingsFormat(name=Memory doPackFST= true), range_facet_sl=PostingsFormat(name=Memory doPackFST= true), range_facet_si=Pulsing41(freqCutoff=9 minBlockSize=41 maxBlockSize=141), oddField_s=PostingsFormat(name=Memory doPackFST= true), sequence_i=PostingsFormat(name=Memory doPackFST= true), name=PostingsFormat(name=Memory doPackFST= true), foo_i=Lucene41(blocksize=128), regex_dup_B_s=Pulsing41(freqCutoff=9 minBlockSize=41 maxBlockSize=141), multiDefault=Pulsing41(freqCutoff=9 minBlockSize=41 maxBlockSize=141), n_tf1=Pulsing41(freqCutoff=9 minBlockSize=41 maxBlockSize=141), n_dt1=Lucene41(blocksize=128), genre_s=PostingsFormat(name=Memory doPackFST= true), author_t=Lucene41(blocksize=128), n_ti1=PostingsFormat(name=Memory doPackFST= true), range_facet_l=Pulsing41(freqCutoff=9 minBlockSize=41 maxBlockSize=141), text=PostingsFormat(name=Asserting), _version_=Lucene41(blocksize=128), val_i=PostingsFormat(name=Memory doPackFST= true), SubjectTerms_mfacet=Lucene41(blocksize=128), series_t=Lucene41(blocksize=128), a_t=Pulsing41(freqCutoff=9 minBlockSize=41 maxBlockSize=141), n_tdt1=Lucene41(blocksize=128), regex_dup_A_s=PostingsFormat(name=Asserting), price=PostingsFormat(name=Asserting), other_tl1=Lucene41(blocksize=128), n_l1=Pulsing41(freqCutoff=9 minBlockSize=41 maxBlockSize=141), a_si=Lucene41(blocksize=128), inStock=PostingsFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=zh_HK, timezone=Canada/Saskatchewan
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=1,free=206252408,total=472907776
[junit4:junit4] 2> NOTE: All tests run in this JVM: [UpdateRequestProcessorFactoryTest, TestZkChroot, PreAnalyzedFieldTest, SampleTest, TestPerFieldSimilarity, SpellCheckComponentTest, BasicDistributedZkTest]
[junit4:junit4] Completed on J0 in 285.06s, 1 test, 1 error <<< FAILURES!
[...truncated 671 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:841: There were test failures: 249 suites, 1038 tests, 1 error, 23 ignored (5 assumptions)
Total time: 41 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3706 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3706/
2 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([D57BB880CB873303]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([D57BB880CB873303]:0)
Build Log:
[...truncated 9395 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4] 2> 1 T392 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 7 T392 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1359964174397
[junit4:junit4] 2> 18 T392 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 26 T393 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 116 T393 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 116 T393 oaz.Environment.logEnv Server environment:host.name=lucene.zones.apache.org
[junit4:junit4] 2> 116 T393 oaz.Environment.logEnv Server environment:java.version=1.7.0_09
[junit4:junit4] 2> 116 T393 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4] 2> 116 T393 oaz.Environment.logEnv Server environment:java.home=/usr/local/openjdk7/jre
[junit4:junit4] 2> 116 T393 oaz.Environment.logEnv Server environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpclient-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpcore-4.1.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpmime-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 118 T393 oaz.Environment.logEnv Server environment:java.library.path=/usr/local/openjdk7/jre/lib/amd64/server:/usr/local/openjdk7/jre/lib/amd64:/usr/local/openjdk7/jre/../lib/amd64:/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4] 2> 118 T393 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4] 2> 118 T393 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4] 2> 118 T393 oaz.Environment.logEnv Server environment:os.name=FreeBSD
[junit4:junit4] 2> 119 T393 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4] 2> 119 T393 oaz.Environment.logEnv Server environment:os.version=9.0-RELEASE
[junit4:junit4] 2> 119 T393 oaz.Environment.logEnv Server environment:user.name=hudson
[junit4:junit4] 2> 119 T393 oaz.Environment.logEnv Server environment:user.home=/home/hudson
[junit4:junit4] 2> 119 T393 oaz.Environment.logEnv Server environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 170 T393 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 170 T393 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 170 T393 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 178 T393 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 227 T392 oasc.ZkTestServer.run start zk server on port:57486
[junit4:junit4] 2> 287 T393 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 354 T392 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 355 T392 oaz.Environment.logEnv Client environment:host.name=lucene.zones.apache.org
[junit4:junit4] 2> 355 T392 oaz.Environment.logEnv Client environment:java.version=1.7.0_09
[junit4:junit4] 2> 355 T392 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4] 2> 356 T392 oaz.Environment.logEnv Client environment:java.home=/usr/local/openjdk7/jre
[junit4:junit4] 2> 356 T392 oaz.Environment.logEnv Client environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpclient-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpcore-4.1.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/httpmime-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 358 T392 oaz.Environment.logEnv Client environment:java.library.path=/usr/local/openjdk7/jre/lib/amd64/server:/usr/local/openjdk7/jre/lib/amd64:/usr/local/openjdk7/jre/../lib/amd64:/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4] 2> 359 T392 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4] 2> 359 T392 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4] 2> 359 T392 oaz.Environment.logEnv Client environment:os.name=FreeBSD
[junit4:junit4] 2> 360 T392 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4] 2> 360 T392 oaz.Environment.logEnv Client environment:os.version=9.0-RELEASE
[junit4:junit4] 2> 361 T392 oaz.Environment.logEnv Client environment:user.name=hudson
[junit4:junit4] 2> 361 T392 oaz.Environment.logEnv Client environment:user.home=/home/hudson
[junit4:junit4] 2> 361 T392 oaz.Environment.logEnv Client environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 368 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@236a9eb8
[junit4:junit4] 2> 477 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 490 T398 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 493 T398 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 493 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57487
[junit4:junit4] 2> 527 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57487
[junit4:junit4] 2> 545 T396 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 587 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a0000 with negotiated timeout 10000 for client /140.211.11.196:57487
[junit4:junit4] 2> 588 T398 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a0000, negotiated timeout = 10000
[junit4:junit4] 2> 596 T399 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@236a9eb8 name:ZooKeeperConnection Watcher:127.0.0.1:57486 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 596 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 602 T392 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 688 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca42e798a0000
[junit4:junit4] 2> 690 T399 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 690 T392 oaz.ZooKeeper.close Session: 0x13ca42e798a0000 closed
[junit4:junit4] 2> 690 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@79399317
[junit4:junit4] 2> 691 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:57487 which had sessionid 0x13ca42e798a0000
[junit4:junit4] 2> 691 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 692 T400 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 693 T400 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 693 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57488
[junit4:junit4] 2> 693 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57488
[junit4:junit4] 2> 695 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a0001 with negotiated timeout 10000 for client /140.211.11.196:57488
[junit4:junit4] 2> 695 T400 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a0001, negotiated timeout = 10000
[junit4:junit4] 2> 695 T401 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79399317 name:ZooKeeperConnection Watcher:127.0.0.1:57486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 696 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 703 T392 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 710 T392 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 715 T392 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 719 T392 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 725 T392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 728 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 740 T392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 743 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 850 T392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 851 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 856 T392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 857 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 862 T392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 863 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 868 T392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 869 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 874 T392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 875 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 880 T392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 881 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 886 T392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 887 T392 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 892 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca42e798a0001
[junit4:junit4] 2> 893 T401 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 893 T392 oaz.ZooKeeper.close Session: 0x13ca42e798a0001 closed
[junit4:junit4] 2> 893 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:57488 which had sessionid 0x13ca42e798a0001
[junit4:junit4] 2> 1085 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 1097 T392 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:57489
[junit4:junit4] 2> 1098 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1098 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1099 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359964175283
[junit4:junit4] 2> 1100 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359964175283/solr.xml
[junit4:junit4] 2> 1101 T392 oasc.CoreContainer.<init> New CoreContainer 281542132
[junit4:junit4] 2> 1102 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359964175283/'
[junit4:junit4] 2> 1102 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359964175283/'
[junit4:junit4] 2> 1165 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 1166 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1166 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1167 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1167 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1167 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1168 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1168 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1169 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1169 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1195 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 1219 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57486/solr
[junit4:junit4] 2> 1250 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1250 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6f255853
[junit4:junit4] 2> 1251 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1252 T411 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1253 T411 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 1253 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57490
[junit4:junit4] 2> 1254 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57490
[junit4:junit4] 2> 1255 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a0002 with negotiated timeout 20000 for client /140.211.11.196:57490
[junit4:junit4] 2> 1255 T411 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a0002, negotiated timeout = 20000
[junit4:junit4] 2> 1256 T412 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f255853 name:ZooKeeperConnection Watcher:127.0.0.1:57486 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1256 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1258 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca42e798a0002
[junit4:junit4] 2> 1259 T412 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1259 T392 oaz.ZooKeeper.close Session: 0x13ca42e798a0002 closed
[junit4:junit4] 2> 1260 T394 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13ca42e798a0002, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 1261 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:57490 which had sessionid 0x13ca42e798a0002
[junit4:junit4] 2> 1265 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 1288 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@36e1d274
[junit4:junit4] 2> 1289 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1290 T413 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1291 T413 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 1291 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57491
[junit4:junit4] 2> 1291 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57491
[junit4:junit4] 2> 1319 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a0003 with negotiated timeout 20000 for client /140.211.11.196:57491
[junit4:junit4] 2> 1319 T413 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a0003, negotiated timeout = 20000
[junit4:junit4] 2> 1320 T414 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36e1d274 name:ZooKeeperConnection Watcher:127.0.0.1:57486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1320 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1357 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1368 T392 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1372 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57489_
[junit4:junit4] 2> 1378 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57489_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57489_
[junit4:junit4] 2> 1426 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57489_
[junit4:junit4] 2> 1432 T392 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1507 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 1509 T392 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1544 T392 oasc.Overseer.start Overseer (id=89126612155105283-127.0.0.1:57489_-n_0000000000) starting
[junit4:junit4] 2> 1545 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1568 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1570 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1580 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1588 T416 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1589 T392 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1593 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1615 T415 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1626 T417 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359964175283/collection1
[junit4:junit4] 2> 1626 T417 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1627 T417 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1628 T417 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1630 T417 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359964175283/collection1/'
[junit4:junit4] 2> 1632 T417 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359964175283/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1632 T417 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359964175283/collection1/lib/README' to classloader
[junit4:junit4] 2> 1719 T417 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1804 T417 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1906 T417 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1913 T417 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 2666 T417 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2679 T417 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2683 T417 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2706 T417 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2712 T417 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2718 T417 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2720 T417 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2722 T417 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359964175283/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/control/data/
[junit4:junit4] 2> 2722 T417 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5c1a7261
[junit4:junit4] 2> 2723 T417 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 2763 T417 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/control/data forceNew:false
[junit4:junit4] 2> 2763 T417 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/control/data
[junit4:junit4] 2> 2764 T417 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/control/data/index/
[junit4:junit4] 2> 2765 T417 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2766 T417 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/control/data/index forceNew:false
[junit4:junit4] 2> 2788 T417 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@46615a78),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 2789 T417 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 2790 T417 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/control/data/index
[junit4:junit4] 2> 2790 T417 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 2792 T417 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2792 T417 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 2792 T417 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2793 T417 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 2793 T417 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2794 T417 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2794 T417 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2794 T417 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2795 T417 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2795 T417 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 2796 T417 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 2796 T417 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2797 T417 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 2797 T417 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 2797 T417 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 2798 T417 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2798 T417 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2799 T417 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2799 T417 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2799 T417 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2800 T417 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2800 T417 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2801 T417 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2801 T417 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 2802 T417 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 2802 T417 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 2818 T417 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2823 T417 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 2825 T417 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 2828 T417 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/control/data
[junit4:junit4] 2> 2830 T417 oass.SolrIndexSearcher.<init> Opening Searcher@46183eec main
[junit4:junit4] 2> 2831 T417 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2831 T417 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2832 T417 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 2840 T417 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 2899 T418 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@46183eec main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2904 T417 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2904 T417 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2905 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 3126 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3128 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:57489_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57489"}
[junit4:junit4] 2> 3128 T415 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 3158 T415 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 3160 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 3204 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3918 T417 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 3918 T417 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57489 collection:control_collection shard:shard1
[junit4:junit4] 2> 3928 T417 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 3949 T417 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 4002 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 4003 T417 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 4004 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4015 T417 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 4015 T417 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 4016 T417 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57489/collection1/
[junit4:junit4] 2> 4016 T417 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 4017 T417 oasc.SyncStrategy.syncToMe http://127.0.0.1:57489/collection1/ has no replicas
[junit4:junit4] 2> 4017 T417 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57489/collection1/
[junit4:junit4] 2> 4017 T417 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 4030 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4715 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4772 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4809 T417 oasc.ZkController.register We are http://127.0.0.1:57489/collection1/ and leader is http://127.0.0.1:57489/collection1/
[junit4:junit4] 2> 4809 T417 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57489
[junit4:junit4] 2> 4810 T417 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 4810 T417 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 4810 T417 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 4814 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4816 T392 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 4816 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4817 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4830 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 4848 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@418e4ed7
[junit4:junit4] 2> 4850 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4850 T419 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4851 T419 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 4852 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57492
[junit4:junit4] 2> 4852 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57492
[junit4:junit4] 2> 4854 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a0004 with negotiated timeout 10000 for client /140.211.11.196:57492
[junit4:junit4] 2> 4854 T419 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a0004, negotiated timeout = 10000
[junit4:junit4] 2> 4855 T420 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@418e4ed7 name:ZooKeeperConnection Watcher:127.0.0.1:57486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4855 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4857 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4863 T392 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 5076 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 5079 T392 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:57493
[junit4:junit4] 2> 5079 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 5080 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 5081 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359964179253
[junit4:junit4] 2> 5081 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359964179253/solr.xml
[junit4:junit4] 2> 5082 T392 oasc.CoreContainer.<init> New CoreContainer 2016950128
[junit4:junit4] 2> 5082 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359964179253/'
[junit4:junit4] 2> 5083 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359964179253/'
[junit4:junit4] 2> 5165 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 5166 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 5166 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 5167 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 5167 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 5168 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 5168 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 5169 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 5169 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 5170 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 5198 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 5223 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57486/solr
[junit4:junit4] 2> 5223 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 5224 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@54fc0a39
[junit4:junit4] 2> 5225 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5226 T430 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5227 T430 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 5227 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57494
[junit4:junit4] 2> 5227 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57494
[junit4:junit4] 2> 5230 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a0005 with negotiated timeout 20000 for client /140.211.11.196:57494
[junit4:junit4] 2> 5230 T430 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a0005, negotiated timeout = 20000
[junit4:junit4] 2> 5231 T431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54fc0a39 name:ZooKeeperConnection Watcher:127.0.0.1:57486 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5231 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5233 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca42e798a0005
[junit4:junit4] 2> 5234 T431 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 5234 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:57494 which had sessionid 0x13ca42e798a0005
[junit4:junit4] 2> 5234 T392 oaz.ZooKeeper.close Session: 0x13ca42e798a0005 closed
[junit4:junit4] 2> 5235 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 5249 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5a3bf049
[junit4:junit4] 2> 5251 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5252 T432 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5253 T432 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 5253 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57495
[junit4:junit4] 2> 5254 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57495
[junit4:junit4] 2> 5255 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a0006 with negotiated timeout 20000 for client /140.211.11.196:57495
[junit4:junit4] 2> 5256 T432 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a0006, negotiated timeout = 20000
[junit4:junit4] 2> 5256 T433 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a3bf049 name:ZooKeeperConnection Watcher:127.0.0.1:57486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5256 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5258 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5260 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5262 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57493_
[junit4:junit4] 2> 5263 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57493_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57493_
[junit4:junit4] 2> 5270 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57493_
[junit4:junit4] 2> 5298 T414 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5298 T420 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5299 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5314 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5330 T434 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359964179253/collection1
[junit4:junit4] 2> 5331 T434 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5332 T434 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5333 T434 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5336 T434 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359964179253/collection1/'
[junit4:junit4] 2> 5338 T434 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359964179253/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5339 T434 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359964179253/collection1/lib/README' to classloader
[junit4:junit4] 2> 5432 T434 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5521 T434 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5623 T434 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5630 T434 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6294 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6295 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:57489_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57489"}
[junit4:junit4] 2> 6360 T434 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6363 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6363 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6363 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6376 T434 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6380 T434 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6425 T434 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6432 T434 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6437 T434 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6440 T434 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6442 T434 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359964179253/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1/
[junit4:junit4] 2> 6443 T434 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5c1a7261
[junit4:junit4] 2> 6443 T434 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 6444 T434 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1 forceNew:false
[junit4:junit4] 2> 6445 T434 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1
[junit4:junit4] 2> 6445 T434 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1/index/
[junit4:junit4] 2> 6446 T434 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6446 T434 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1/index forceNew:false
[junit4:junit4] 2> 6472 T434 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b20f25),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6472 T434 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6473 T434 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1/index
[junit4:junit4] 2> 6473 T434 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 6476 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6476 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 6476 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6477 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 6477 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6477 T434 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6478 T434 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6478 T434 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6479 T434 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6480 T434 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 6480 T434 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 6481 T434 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6481 T434 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 6481 T434 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 6482 T434 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 6482 T434 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6483 T434 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6484 T434 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6484 T434 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6485 T434 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6485 T434 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6486 T434 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6486 T434 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6487 T434 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 6487 T434 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 6488 T434 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 6505 T434 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6512 T434 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 6515 T434 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 6518 T434 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1
[junit4:junit4] 2> 6520 T434 oass.SolrIndexSearcher.<init> Opening Searcher@45249b94 main
[junit4:junit4] 2> 6521 T434 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6521 T434 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6522 T434 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 6581 T434 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 6733 T435 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@45249b94 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6738 T434 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6739 T434 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7909 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7910 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57493_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57493"}
[junit4:junit4] 2> 7911 T415 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 7911 T415 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 7965 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7965 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7965 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8743 T434 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 8743 T434 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57493 collection:collection1 shard:shard1
[junit4:junit4] 2> 8745 T434 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 8768 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0006 type:delete cxid:0x45 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 8769 T434 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 8770 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0006 type:create cxid:0x46 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8779 T434 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 8779 T434 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 8780 T434 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57493/collection1/
[junit4:junit4] 2> 8780 T434 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 8780 T434 oasc.SyncStrategy.syncToMe http://127.0.0.1:57493/collection1/ has no replicas
[junit4:junit4] 2> 8780 T434 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57493/collection1/
[junit4:junit4] 2> 8781 T434 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 8788 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0006 type:create cxid:0x50 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9477 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9499 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9499 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9499 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9505 T434 oasc.ZkController.register We are http://127.0.0.1:57493/collection1/ and leader is http://127.0.0.1:57493/collection1/
[junit4:junit4] 2> 9505 T434 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57493
[junit4:junit4] 2> 9505 T434 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 9506 T434 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 9506 T434 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9515 T434 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9517 T392 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 9518 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 9519 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 9764 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 9767 T392 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:57496
[junit4:junit4] 2> 9768 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 9769 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 9770 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359964183926
[junit4:junit4] 2> 9770 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359964183926/solr.xml
[junit4:junit4] 2> 9770 T392 oasc.CoreContainer.<init> New CoreContainer 1572554169
[junit4:junit4] 2> 9771 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359964183926/'
[junit4:junit4] 2> 9772 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359964183926/'
[junit4:junit4] 2> 9844 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 9845 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 9846 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 9846 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 9847 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 9847 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 9847 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 9848 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 9848 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 9849 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 9878 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 9904 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57486/solr
[junit4:junit4] 2> 9905 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 9906 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@68f8529f
[junit4:junit4] 2> 9907 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 9907 T445 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 9908 T445 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 9909 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57497
[junit4:junit4] 2> 9909 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57497
[junit4:junit4] 2> 9912 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a0007 with negotiated timeout 20000 for client /140.211.11.196:57497
[junit4:junit4] 2> 9912 T445 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a0007, negotiated timeout = 20000
[junit4:junit4] 2> 9912 T446 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68f8529f name:ZooKeeperConnection Watcher:127.0.0.1:57486 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 9913 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 9915 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca42e798a0007
[junit4:junit4] 2> 9917 T446 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 9917 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:57497 which had sessionid 0x13ca42e798a0007
[junit4:junit4] 2> 9917 T392 oaz.ZooKeeper.close Session: 0x13ca42e798a0007 closed
[junit4:junit4] 2> 9918 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 9932 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@749bfdca
[junit4:junit4] 2> 9933 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 9934 T447 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 9935 T447 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 9935 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57498
[junit4:junit4] 2> 9935 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57498
[junit4:junit4] 2> 9937 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a0008 with negotiated timeout 20000 for client /140.211.11.196:57498
[junit4:junit4] 2> 9937 T447 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a0008, negotiated timeout = 20000
[junit4:junit4] 2> 9938 T448 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@749bfdca name:ZooKeeperConnection Watcher:127.0.0.1:57486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 9938 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 9939 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9941 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9944 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57496_
[junit4:junit4] 2> 9945 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0008 type:delete cxid:0x4 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57496_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57496_
[junit4:junit4] 2> 9951 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57496_
[junit4:junit4] 2> 9955 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9956 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9956 T414 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9957 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9959 T420 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9960 T433 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9965 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9975 T449 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359964183926/collection1
[junit4:junit4] 2> 9975 T449 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9977 T449 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9977 T449 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9979 T449 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359964183926/collection1/'
[junit4:junit4] 2> 9981 T449 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359964183926/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9981 T449 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359964183926/collection1/lib/README' to classloader
[junit4:junit4] 2> 10045 T449 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 10121 T449 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10222 T449 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10232 T449 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10982 T449 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10997 T449 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 11003 T449 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 11019 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11022 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57493_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57493"}
[junit4:junit4] 2> 11041 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11041 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11041 T448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11041 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11048 T449 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 11055 T449 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 11062 T449 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11064 T449 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11067 T449 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359964183926/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2/
[junit4:junit4] 2> 11067 T449 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5c1a7261
[junit4:junit4] 2> 11068 T449 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 11069 T449 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2 forceNew:false
[junit4:junit4] 2> 11070 T449 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2
[junit4:junit4] 2> 11070 T449 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2/index/
[junit4:junit4] 2> 11070 T449 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 11071 T449 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2/index forceNew:false
[junit4:junit4] 2> 11077 T449 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64eb9eaf),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 11078 T449 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 11079 T449 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2/index
[junit4:junit4] 2> 11079 T449 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 11082 T449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 11082 T449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 11082 T449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 11083 T449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 11084 T449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 11084 T449 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 11084 T449 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 11085 T449 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 11086 T449 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 11087 T449 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 11087 T449 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 11088 T449 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 11089 T449 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 11089 T449 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 11090 T449 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 11090 T449 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 11091 T449 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11092 T449 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11092 T449 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11093 T449 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11094 T449 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11094 T449 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11095 T449 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11096 T449 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 11096 T449 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 11097 T449 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 11111 T449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 11118 T449 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 11120 T449 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 11124 T449 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2
[junit4:junit4] 2> 11126 T449 oass.SolrIndexSearcher.<init> Opening Searcher@14647a74 main
[junit4:junit4] 2> 11127 T449 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 11127 T449 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 11128 T449 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 11139 T449 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 11202 T450 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14647a74 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 11210 T449 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 11210 T449 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12552 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12553 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57496_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57496"}
[junit4:junit4] 2> 12554 T415 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 12554 T415 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 12565 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12565 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12565 T448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12565 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13214 T449 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 13214 T449 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57496 collection:collection1 shard:shard2
[junit4:junit4] 2> 13216 T449 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 13238 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0008 type:delete cxid:0x44 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 13240 T449 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 13241 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0008 type:create cxid:0x45 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13246 T449 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 13246 T449 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 13247 T449 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57496/collection1/
[junit4:junit4] 2> 13247 T449 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 13247 T449 oasc.SyncStrategy.syncToMe http://127.0.0.1:57496/collection1/ has no replicas
[junit4:junit4] 2> 13248 T449 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57496/collection1/
[junit4:junit4] 2> 13248 T449 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 13254 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a0008 type:create cxid:0x4e zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14081 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14111 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14113 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14114 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14114 T448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14131 T449 oasc.ZkController.register We are http://127.0.0.1:57496/collection1/ and leader is http://127.0.0.1:57496/collection1/
[junit4:junit4] 2> 14131 T449 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57496
[junit4:junit4] 2> 14131 T449 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 14132 T449 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 14132 T449 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14135 T449 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14137 T392 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 14137 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14138 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14358 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14362 T392 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:57499
[junit4:junit4] 2> 14363 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14363 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14364 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359964188544
[junit4:junit4] 2> 14364 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359964188544/solr.xml
[junit4:junit4] 2> 14364 T392 oasc.CoreContainer.<init> New CoreContainer 1347951050
[junit4:junit4] 2> 14365 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359964188544/'
[junit4:junit4] 2> 14366 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359964188544/'
[junit4:junit4] 2> 14436 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 14436 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14437 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14437 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14438 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14438 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14439 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14439 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14440 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14440 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14463 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14487 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57486/solr
[junit4:junit4] 2> 14487 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14488 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@17dc56b4
[junit4:junit4] 2> 14489 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14490 T460 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14491 T460 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 14491 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57500
[junit4:junit4] 2> 14491 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57500
[junit4:junit4] 2> 14494 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a0009 with negotiated timeout 20000 for client /140.211.11.196:57500
[junit4:junit4] 2> 14494 T460 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a0009, negotiated timeout = 20000
[junit4:junit4] 2> 14494 T461 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17dc56b4 name:ZooKeeperConnection Watcher:127.0.0.1:57486 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14494 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14497 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca42e798a0009
[junit4:junit4] 2> 14510 T461 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14510 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:57500 which had sessionid 0x13ca42e798a0009
[junit4:junit4] 2> 14510 T392 oaz.ZooKeeper.close Session: 0x13ca42e798a0009 closed
[junit4:junit4] 2> 14511 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 14525 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7373b483
[junit4:junit4] 2> 14526 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14527 T462 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14527 T462 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 14528 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57501
[junit4:junit4] 2> 14528 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57501
[junit4:junit4] 2> 14530 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a000a with negotiated timeout 20000 for client /140.211.11.196:57501
[junit4:junit4] 2> 14530 T462 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a000a, negotiated timeout = 20000
[junit4:junit4] 2> 14530 T463 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7373b483 name:ZooKeeperConnection Watcher:127.0.0.1:57486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14530 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14532 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14535 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14538 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57499_
[junit4:junit4] 2> 14539 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a000a type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57499_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57499_
[junit4:junit4] 2> 14540 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57499_
[junit4:junit4] 2> 14544 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14544 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14545 T448 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14546 T448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14546 T414 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14546 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14548 T420 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14549 T433 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14553 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14562 T464 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359964188544/collection1
[junit4:junit4] 2> 14563 T464 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14564 T464 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14564 T464 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14568 T464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359964188544/collection1/'
[junit4:junit4] 2> 14569 T464 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359964188544/collection1/lib/README' to classloader
[junit4:junit4] 2> 14570 T464 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359964188544/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14627 T464 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14721 T464 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14823 T464 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14830 T464 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15440 T464 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15449 T464 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15452 T464 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15490 T464 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15499 T464 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15507 T464 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15510 T464 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15513 T464 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359964188544/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/
[junit4:junit4] 2> 15513 T464 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5c1a7261
[junit4:junit4] 2> 15514 T464 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 15515 T464 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3 forceNew:false
[junit4:junit4] 2> 15516 T464 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3
[junit4:junit4] 2> 15516 T464 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index/
[junit4:junit4] 2> 15517 T464 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15518 T464 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index forceNew:false
[junit4:junit4] 2> 15550 T464 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ff29305),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15551 T464 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15552 T464 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index
[junit4:junit4] 2> 15552 T464 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 15555 T464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15555 T464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 15555 T464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15556 T464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 15557 T464 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15557 T464 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15557 T464 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15558 T464 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15559 T464 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15560 T464 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 15560 T464 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 15561 T464 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15562 T464 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 15562 T464 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 15563 T464 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 15563 T464 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15564 T464 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15565 T464 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15565 T464 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15566 T464 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15566 T464 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15567 T464 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15568 T464 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15569 T464 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15569 T464 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 15570 T464 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 15586 T464 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15594 T464 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 15596 T464 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 15599 T464 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3
[junit4:junit4] 2> 15601 T464 oass.SolrIndexSearcher.<init> Opening Searcher@6a9d8d3f main
[junit4:junit4] 2> 15603 T464 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15603 T464 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15604 T464 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 15614 T464 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 15625 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15626 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57496_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57496"}
[junit4:junit4] 2> 15646 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15647 T448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15647 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15646 T463 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15646 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15682 T465 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6a9d8d3f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15689 T464 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15689 T464 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17172 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17173 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57499_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57499"}
[junit4:junit4] 2> 17173 T415 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 17173 T415 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 17192 T448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17192 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17192 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17193 T463 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17192 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17694 T464 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 17694 T464 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57499 collection:collection1 shard:shard1
[junit4:junit4] 2> 17707 T464 oasc.ZkController.register We are http://127.0.0.1:57499/collection1/ and leader is http://127.0.0.1:57493/collection1/
[junit4:junit4] 2> 17707 T464 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57499
[junit4:junit4] 2> 17707 T464 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 17708 T464 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C66 name=collection1 org.apache.solr.core.SolrCore@329bfb6c url=http://127.0.0.1:57499/collection1 node=127.0.0.1:57499_ C66_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:57499_, base_url=http://127.0.0.1:57499}
[junit4:junit4] 2> 17715 T466 C66 P57499 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 17716 T466 C66 P57499 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17716 T464 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17716 T466 C66 P57499 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17716 T466 C66 P57499 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17718 T392 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 17718 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17719 T466 C66 P57499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17719 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17939 T392 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 17942 T392 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:57503
[junit4:junit4] 2> 17943 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 17944 T392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 17945 T392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359964192127
[junit4:junit4] 2> 17945 T392 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359964192127/solr.xml
[junit4:junit4] 2> 17946 T392 oasc.CoreContainer.<init> New CoreContainer 365908951
[junit4:junit4] 2> 17947 T392 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359964192127/'
[junit4:junit4] 2> 17948 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359964192127/'
[junit4:junit4] 2> 18012 T392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
[junit4:junit4] 2> 18012 T392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 18013 T392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 18013 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 18014 T392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 18014 T392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 18015 T392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 18015 T392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 18016 T392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 18016 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
[junit4:junit4] 2> 18041 T392 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 18079 T392 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57486/solr
[junit4:junit4] 2> 18080 T392 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 18081 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@27835573
[junit4:junit4] 2> 18082 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 18082 T476 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 18083 T476 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 18084 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57504
[junit4:junit4] 2> 18084 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57504
[junit4:junit4] 2> 18091 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a000b with negotiated timeout 20000 for client /140.211.11.196:57504
[junit4:junit4] 2> 18091 T476 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a000b, negotiated timeout = 20000
[junit4:junit4] 2> 18092 T477 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27835573 name:ZooKeeperConnection Watcher:127.0.0.1:57486 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 18092 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 18094 T397 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca42e798a000b
[junit4:junit4] 2> 18095 T394 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:57504 which had sessionid 0x13ca42e798a000b
[junit4:junit4] 2> 18096 T477 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 18096 T392 oaz.ZooKeeper.close Session: 0x13ca42e798a000b closed
[junit4:junit4] 2> 18096 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
[junit4:junit4] 2> 18112 T392 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57486/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@15ec85e2
[junit4:junit4] 2> 18113 T392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 18114 T478 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:57486. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 18114 T478 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:57486, initiating session
[junit4:junit4] 2> 18115 T394 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:57505
[junit4:junit4] 2> 18115 T394 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:57505
[junit4:junit4] 2> 18117 T396 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca42e798a000c with negotiated timeout 20000 for client /140.211.11.196:57505
[junit4:junit4] 2> 18117 T478 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:57486, sessionid = 0x13ca42e798a000c, negotiated timeout = 20000
[junit4:junit4] 2> 18117 T479 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15ec85e2 name:ZooKeeperConnection Watcher:127.0.0.1:57486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 18117 T392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 18119 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a000c type:create cxid:0x1 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18123 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a000c type:create cxid:0x2 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18125 T392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57503_
[junit4:junit4] 2> 18126 T397 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca42e798a000c type:delete cxid:0x4 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57503_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57503_
[junit4:junit4] 2> 18128 T392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57503_
[junit4:junit4] 2> 18136 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18136 T463 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18136 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18137 T448 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18138 T414 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18138 T448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18138 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18140 T463 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18141 T433 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18141 T420 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18146 T392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 18157 T480 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359964192127/collection1
[junit4:junit4] 2> 18158 T480 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 18159 T480 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 18160 T480 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 18162 T480 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359964192127/collection1/'
[junit4:junit4] 2> 18164 T480 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359964192127/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 18165 T480 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359964192127/collection1/lib/README' to classloader
[junit4:junit4] 2> 18229 T480 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 18313 T480 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18414 T480 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18422 T480 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 18702 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18706 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57499_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57499"}
[junit4:junit4] 2> 18745 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18745 T479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18745 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18745 T463 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18745 T448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18745 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19200 T480 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19213 T480 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19217 T480 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19242 T480 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19248 T480 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19253 T480 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19255 T480 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19257 T480 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359964192127/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty4/
[junit4:junit4] 2> 19257 T480 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5c1a7261
[junit4:junit4] 2> 19258 T480 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 19259 T480 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty4 forceNew:false
[junit4:junit4] 2> 19259 T480 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty4
[junit4:junit4] 2> 19259 T480 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty4/index/
[junit4:junit4] 2> 19260 T480 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19261 T480 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty4/index forceNew:false
[junit4:junit4] 2> 19273 T480 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@791e2d7d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19274 T480 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19274 T480 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty4/index
[junit4:junit4] 2> 19275 T480 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 19276 T480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19276 T480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 19277 T480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19277 T480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 19277 T480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19278 T480 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19278 T480 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19279 T480 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19279 T480 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19279 T480 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 19280 T480 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 19280 T480 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19281 T480 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 19281 T480 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 19281 T480 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 19281 T480 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19282 T480 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19282 T480 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19283 T480 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19283 T480 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19283 T480 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19284 T480 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19284 T480 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19285 T480 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 19285 T480 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 19285 T480 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 19296 T480 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19300 T480 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 19302 T480 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4] 2> 19305 T480 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty4
[junit4:junit4] 2> 19306 T480 oass.SolrIndexSearcher.<init> Opening Searcher@3fdd7b0f main
[junit4:junit4] 2> 19308 T480 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19308 T480 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19308 T480 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 19316 T480 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 19362 T481 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3fdd7b0f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19366 T480 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 19366 T480 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20255 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20257 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57503_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57503"}
[junit4:junit4] 2> 20257 T415 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 20257 T415 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 20296 T479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20296 T463 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20296 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20296 T448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20296 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20296 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20370 T480 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 20370 T480 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57503 collection:collection1 shard:shard2
[junit4:junit4] 2> 20376 T480 oasc.ZkController.register We are http://127.0.0.1:57503/collection1/ and leader is http://127.0.0.1:57496/collection1/
[junit4:junit4] 2> 20376 T480 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57503
[junit4:junit4] 2> 20377 T480 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 20377 T480 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C67 name=collection1 org.apache.solr.core.SolrCore@1e455cba url=http://127.0.0.1:57503/collection1 node=127.0.0.1:57503_ C67_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:57503_, base_url=http://127.0.0.1:57503}
[junit4:junit4] 2> 20377 T482 C67 P57503 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 20378 T482 C67 P57503 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 20378 T482 C67 P57503 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 20378 T482 C67 P57503 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20378 T480 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20381 T482 C67 P57503 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20382 T392 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 20382 T392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 20383 T392 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20410 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20413 T392 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 20415 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C66_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:57499_, base_url=http://127.0.0.1:57499}
[junit4:junit4] 2> 20768 T466 C66 P57499 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:57493/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20778 T466 C66 P57499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 20797 T466 C66 P57499 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:57499 START replicas=[http://127.0.0.1:57493/collection1/] nUpdates=100
[junit4:junit4] 2> 20798 T466 C66 P57499 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20798 T466 C66 P57499 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20799 T466 C66 P57499 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20799 T466 C66 P57499 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20799 T466 C66 P57499 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20800 T466 C66 P57499 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:57493/collection1/. core=collection1
[junit4:junit4] 2> 20800 T466 C66 P57499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C68 name=collection1 org.apache.solr.core.SolrCore@b3fb8af url=http://127.0.0.1:57493/collection1 node=127.0.0.1:57493_ C68_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:57493_, base_url=http://127.0.0.1:57493, leader=true}
[junit4:junit4] 2> 20816 T424 C68 P57493 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 20838 T425 C68 P57493 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 20840 T425 C68 P57493 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1
[junit4:junit4] 2> 20844 T425 C68 P57493 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b20f25),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20845 T425 C68 P57493 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20852 T425 C68 P57493 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b20f25),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b20f25),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20853 T425 C68 P57493 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20855 T425 C68 P57493 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1
[junit4:junit4] 2> 20855 T425 C68 P57493 oass.SolrIndexSearcher.<init> Opening Searcher@4d2457b1 realtime
[junit4:junit4] 2> 20856 T425 C68 P57493 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20857 T425 C68 P57493 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 37
[junit4:junit4] 2> 20859 T466 C66 P57499 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20859 T466 C66 P57499 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 20892 T466 C66 P57499 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20897 T426 C68 P57493 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20898 T426 C68 P57493 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 20899 T466 C66 P57499 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 20899 T466 C66 P57499 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20900 T466 C66 P57499 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20903 T426 C68 P57493 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1
[junit4:junit4] 2> 20904 T426 C68 P57493 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty1/index
[junit4:junit4] 2> 20904 T426 C68 P57493 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 20905 T466 C66 P57499 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20907 T466 C66 P57499 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index.20130204074955295 forceNew:false
[junit4:junit4] 2> 20907 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3
[junit4:junit4] 2> 20908 T466 C66 P57499 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index.20130204074955295 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e872d2f) fullCopy=true
[junit4:junit4] 2> 20925 T426 C68 P57493 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=7
[junit4:junit4] 2> 20947 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index
[junit4:junit4] 2> 20947 T466 C66 P57499 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20948 T466 C66 P57499 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130204074955295
[junit4:junit4] 2> 20950 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3
[junit4:junit4] 2> 20951 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3
[junit4:junit4] 2> 20951 T466 C66 P57499 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index.20130204074955295
[junit4:junit4] 2> 20955 T466 C66 P57499 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index.20130204074955295 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e872d2f),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20956 T466 C66 P57499 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20958 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3
[junit4:junit4] 2> 20962 T466 C66 P57499 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20963 T466 C66 P57499 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20963 T466 C66 P57499 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 20964 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index.20130204074955295
[junit4:junit4] 2> 20965 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3
[junit4:junit4] 2> 20969 T466 C66 P57499 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index.20130204074955295 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e872d2f),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20969 T466 C66 P57499 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20969 T466 C66 P57499 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20970 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3
[junit4:junit4] 2> 20970 T466 C66 P57499 oass.SolrIndexSearcher.<init> Opening Searcher@7f1654e7 main
[junit4:junit4] 2> 20972 T465 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f1654e7 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 20973 T465 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index
[junit4:junit4] 2> 20973 T466 C66 P57499 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 20976 T466 C66 P57499 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index.20130204074955295 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e872d2f),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index.20130204074955295 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e872d2f),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 20977 T466 C66 P57499 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 20978 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3
[junit4:junit4] 2> 20978 T466 C66 P57499 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20979 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index.20130204074955295
[junit4:junit4] 2> 20979 T466 C66 P57499 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty3/index
[junit4:junit4] 2> 20979 T466 C66 P57499 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20979 T466 C66 P57499 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20980 T466 C66 P57499 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20980 T466 C66 P57499 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20982 T466 C66 P57499 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 21418 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21809 T415 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21811 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57503_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57503"}
[junit4:junit4] 2> 21824 T415 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57499_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57499"}
[junit4:junit4] 2> 21837 T479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21837 T420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21837 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21837 T448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21837 T463 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21837 T414 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22421 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23425 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C67_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:57503_, base_url=http://127.0.0.1:57503}
[junit4:junit4] 2> 24414 T482 C67 P57503 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:57496/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 24414 T482 C67 P57503 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:57503 START replicas=[http://127.0.0.1:57496/collection1/] nUpdates=100
[junit4:junit4] 2> 24415 T482 C67 P57503 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 24415 T482 C67 P57503 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 24415 T482 C67 P57503 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 24415 T482 C67 P57503 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 24416 T482 C67 P57503 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 24416 T482 C67 P57503 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:57496/collection1/. core=collection1
[junit4:junit4] 2> 24417 T482 C67 P57503 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 24428 T392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C69 name=collection1 org.apache.solr.core.SolrCore@4f903ce5 url=http://127.0.0.1:57496/collection1 node=127.0.0.1:57496_ C69_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:57496_, base_url=http://127.0.0.1:57496, leader=true}
[junit4:junit4] 2> 24433 T439 C69 P57496 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 24439 T440 C69 P57496 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4] 2> 24440 T440 C69 P57496 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2
[junit4:junit4] 2> 24444 T440 C69 P57496 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64eb9eaf),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 24445 T440 C69 P57496 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 24449 T440 C69 P57496 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64eb9eaf),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64eb9eaf),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24449 T440 C69 P57496 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24450 T440 C69 P57496 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359964174397/jetty2
[junit4:junit4] 2> 24451 T440 C69 P57496 oass.SolrIndexSearcher.<init> Opening Searcher@1f14c6d0 realtime
[junit4:junit4] 2> 24451 T440 C69 P57496 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24452 T440 C69 P57496 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 24453 T482 C67 P57503 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24454 T482 C67 P57503 oash.SnapPuller.<init> No value set f
[...truncated too long message...]
ad.run(Thread.java:722)
[junit4:junit4] 2> 17) Thread[id=421, name=HashSessionScavenger-10, state=TIMED_WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.lang.Object.wait(Native Method)
[junit4:junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4:junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4:junit4] 2> 18) Thread[id=496, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[D57BB880CB873303]-SendThread(localhost:57486), state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:82)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 19) Thread[id=478, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[D57BB880CB873303]-SendThread(localhost:57486), state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:82)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 20) Thread[id=422, name=qtp934902858-422 Acceptor0 SocketConnector@127.0.0.1:57493, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.net.PlainSocketImpl.socketAccept(Native Method)
[junit4:junit4] 2> at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
[junit4:junit4] 2> at java.net.ServerSocket.implAccept(ServerSocket.java:522)
[junit4:junit4] 2> at java.net.ServerSocket.accept(ServerSocket.java:490)
[junit4:junit4] 2> at org.eclipse.jetty.server.bio.SocketConnector.accept(SocketConnector.java:117)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 21) Thread[id=447, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[D57BB880CB873303]-SendThread(localhost:57486), state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:102)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 22) Thread[id=538, name=searcherExecutor-441-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 23) Thread[id=462, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[D57BB880CB873303]-SendThread(localhost:57486), state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
[junit4:junit4] 2> at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
[junit4:junit4] 2> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4:junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 24) Thread[id=541, name=searcherExecutor-449-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {n_f1=PostingsFormat(name=Direct), foo_b=Lucene41(blocksize=128), foo_d=PostingsFormat(name=MockSep), foo_f=Lucene41(blocksize=128), n_tl1=PostingsFormat(name=Direct), n_d1=MockFixedIntBlock(blockSize=1134), rnd_b=PostingsFormat(name=MockSep), intDefault=PostingsFormat(name=Direct), n_td1=PostingsFormat(name=Direct), timestamp=MockFixedIntBlock(blockSize=1134), id=PostingsFormat(name=MockSep), range_facet_sl=PostingsFormat(name=MockSep), range_facet_si=MockFixedIntBlock(blockSize=1134), oddField_s=PostingsFormat(name=MockSep), foo_i=PostingsFormat(name=Direct), multiDefault=MockFixedIntBlock(blockSize=1134), n_tf1=MockFixedIntBlock(blockSize=1134), n_dt1=PostingsFormat(name=Direct), n_ti1=PostingsFormat(name=MockSep), range_facet_l=MockFixedIntBlock(blockSize=1134), text=Lucene41(blocksize=128), _version_=PostingsFormat(name=Direct), val_i=PostingsFormat(name=MockSep), SubjectTerms_mfacet=PostingsFormat(name=Direct), a_t=MockFixedIntBlock(blockSize=1134), n_tdt1=PostingsFormat(name=Direct), other_tl1=PostingsFormat(name=Direct), n_l1=MockFixedIntBlock(blockSize=1134), a_si=PostingsFormat(name=Direct)}, sim=DefaultSimilarity, locale=ar_SA, timezone=Atlantic/Faeroe
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=26,free=99856064,total=260046848
[junit4:junit4] 2> NOTE: All tests run in this JVM: [CSVRequestHandlerTest, TestBinaryResponseWriter, TestIndexingPerformance, TestFastOutputStream, TestSearchPerf, ResourceLoaderTest, JSONWriterTest, FileBasedSpellCheckerTest, TestBadConfig, TestExtendedDismaxParser, SuggesterFSTTest, DateMathParserTest, TestReload, SolrCoreCheckLockOnStartupTest, DefaultValueUpdateProcessorTest, TestCoreContainer, JsonLoaderTest, NumericFieldsTest, NotRequiredUniqueKeyTest, ExternalFileFieldSortTest, TestRandomFaceting, DistributedTermsComponentTest, SuggesterWFSTTest, TestSolrQueryParser, BinaryUpdateRequestHandlerTest, BasicDistributedZkTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZkTest -Dtests.seed=D57BB880CB873303 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_SA -Dtests.timezone=Atlantic/Faeroe -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 0.00s J0 | BasicDistributedZkTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([D57BB880CB873303]:0)
[junit4:junit4] Completed on J0 in 7223.50s, 1 test, 2 errors <<< FAILURES!
[...truncated 116 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:346: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:178: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:428: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:841: There were test failures: 249 suites, 1038 tests, 1 suite-level error, 1 error, 146 ignored (4 assumptions)
Total time: 146 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3705 - Still Failing
Posted by Dawid Weiss <da...@cs.put.poznan.pl>.
Very weird.
On Mon, Feb 4, 2013 at 12:46 AM, Mark Miller <ma...@gmail.com> wrote:
> It looks like this thing hung doing a security check….
>
> [junit4:junit4] 2> 21) Thread[id=499, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[437C1ACFB7351B0A], state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
> [junit4:junit4] 2> at java.security.AccessController.getStackAccessControlContext(Native Method)
> [junit4:junit4] 2> at java.security.AccessController.checkPermission(AccessController.java:534)
> [junit4:junit4] 2> at java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
> [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.checkShutdownAccess(ThreadPoolExecutor.java:711)
> [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.shutdownNow(ThreadPoolExecutor.java:1387)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3705 - Still Failing
Posted by Mark Miller <ma...@gmail.com>.
It looks like this thing hung doing a security check….
[junit4:junit4] 2> 21) Thread[id=499, name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[437C1ACFB7351B0A], state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4:junit4] 2> at java.security.AccessController.getStackAccessControlContext(Native Method)
[junit4:junit4] 2> at java.security.AccessController.checkPermission(AccessController.java:534)
[junit4:junit4] 2> at java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.checkShutdownAccess(ThreadPoolExecutor.java:711)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.shutdownNow(ThreadPoolExecutor.java:1387)
[junit4:junit4] 2> at org.apache.solr.common.util.ExecutorUtil.shutdownNowAndAwaitTermination(ExecutorUtil.java:43)
[junit4:junit4] 2> at org.apache.solr.update.UpdateShardHandler.close(UpdateShardHandler.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ZkController.close(ZkController.java:359)
[junit4:junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:777)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.destroy(SolrDispatchFilter.java:122)
[junit4:junit4] 2> at org.apache.solr.cloud.ChaosMonkey.stopJettySolrRunner(ChaosMonkey.java:202)
[junit4:junit4] 2> at org.apache.solr.cloud.ChaosMonkey.stop(ChaosMonkey.java:509)
[junit4:junit4] 2> at org.apache.solr.cloud.AbstractFullDistribZkTestBase.destroyServers(AbstractFullDistribZkTestBase.java:1329)
[junit4:junit4] 2> at org.apache.solr.BaseDistributedSearchTestCase.tearDown(BaseDistributedSearchTestCase.java:280)
[junit4:junit4] 2> at org.apache.solr.cloud.AbstractDistribZkTestBase.tearDown(AbstractDistribZkTestBase.java:219)
[junit4:junit4] 2> at org.apache.solr.cloud.AbstractFullDistribZkTestBase.tearDown(AbstractFullDistribZkTestBase.java:1310)
[junit4:junit4] 2> at org.apache.solr.cloud.BasicDistributedZkTest.tearDown(BasicDistributedZkTest.java:1370)
On Feb 3, 2013, at 6:15 PM, Apache Jenkins Server <je...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3705/
>
> 2 tests failed.
> FAILED: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
>
> Error Message:
> Test abandoned because suite timeout was reached.
>
> Stack Trace:
> java.lang.Exception: Test abandoned because suite timeout was reached.
> at __randomizedtesting.SeedInfo.seed([437C1ACFB7351B0A]:0)
>
>
> FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest
>
> Error Message:
> Suite timeout exceeded (>= 7200000 msec).
>
> Stack Trace:
> java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
> at __randomizedtesting.SeedInfo.seed([437C1ACFB7351B0A]:0)
>
>
>
>
> Build Log:
> [...truncated 9446 lines...]
> [junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
> [junit4:junit4] 2> 1 T499 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /lt_/
> [junit4:junit4] 2> 6 T499 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
> [junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1359926089911
> [junit4:junit4] 2> 7 T499 oasc.ZkTestServer.run STARTING ZK TEST SERVER
> [junit4:junit4] 2> 8 T500 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
> [junit4:junit4] 2> 10 T500 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
> [junit4:junit4] 2> 10 T500 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
> [junit4:junit4] 2> 10 T500 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
> [junit4:junit4] 2> 11 T500 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
> [junit4:junit4] 2> 11 T500 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/zookeeper/server1/data/version-2/snapshot.0
> [junit4:junit4] 2> 109 T499 oasc.ZkTestServer.run start zk server on port:43537
> [junit4:junit4] 2> 109 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@40f81bb4
> [junit4:junit4] 2> 110 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 111 T505 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 112 T505 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 112 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:43538
> [junit4:junit4] 2> 112 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:43538
> [junit4:junit4] 2> 113 T503 oazsp.FileTxnLog.append Creating new log file: log.1
> [junit4:junit4] 2> 117 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0000 with negotiated timeout 10000 for client /140.211.11.196:43538
> [junit4:junit4] 2> 117 T505 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0000, negotiated timeout = 10000
> [junit4:junit4] 2> 117 T506 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40f81bb4 name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 117 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 118 T499 oascc.SolrZkClient.makePath makePath: /solr
> [junit4:junit4] 2> 121 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0000
> [junit4:junit4] 2> 133 T506 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 133 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0000 closed
> [junit4:junit4] 2> 134 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:43538 which had sessionid 0x13ca1e958bc0000
> [junit4:junit4] 2> 134 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@70df8d56
> [junit4:junit4] 2> 135 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 135 T507 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 136 T507 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 136 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:43539
> [junit4:junit4] 2> 136 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:43539
> [junit4:junit4] 2> 160 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0001 with negotiated timeout 10000 for client /140.211.11.196:43539
> [junit4:junit4] 2> 160 T507 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0001, negotiated timeout = 10000
> [junit4:junit4] 2> 160 T508 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70df8d56 name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 160 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 161 T499 oascc.SolrZkClient.makePath makePath: /collections/collection1
> [junit4:junit4] 2> 166 T499 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
> [junit4:junit4] 2> 175 T499 oascc.SolrZkClient.makePath makePath: /collections/control_collection
> [junit4:junit4] 2> 178 T499 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
> [junit4:junit4] 2> 182 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
> [junit4:junit4] 2> 183 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
> [junit4:junit4] 2> 196 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
> [junit4:junit4] 2> 197 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
> [junit4:junit4] 2> 302 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
> [junit4:junit4] 2> 302 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
> [junit4:junit4] 2> 306 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
> [junit4:junit4] 2> 307 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
> [junit4:junit4] 2> 310 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
> [junit4:junit4] 2> 311 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
> [junit4:junit4] 2> 315 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
> [junit4:junit4] 2> 315 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
> [junit4:junit4] 2> 319 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4] 2> 320 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4] 2> 323 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
> [junit4:junit4] 2> 324 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
> [junit4:junit4] 2> 327 T499 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
> [junit4:junit4] 2> 328 T499 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
> [junit4:junit4] 2> 331 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0001
> [junit4:junit4] 2> 338 T508 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 338 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:43539 which had sessionid 0x13ca1e958bc0001
> [junit4:junit4] 2> 338 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0001 closed
> [junit4:junit4] 2> 486 T499 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4] 2> 490 T499 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25591
> [junit4:junit4] 2> 490 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 491 T499 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 491 T499 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243
> [junit4:junit4] 2> 492 T499 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/solr.xml
> [junit4:junit4] 2> 492 T499 oasc.CoreContainer.<init> New CoreContainer 2073771471
> [junit4:junit4] 2> 492 T499 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/'
> [junit4:junit4] 2> 493 T499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/'
> [junit4:junit4] 2> 562 T499 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
> [junit4:junit4] 2> 562 T499 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 563 T499 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 563 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 564 T499 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 564 T499 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 565 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 565 T499 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 566 T499 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 566 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 590 T499 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4] 2> 610 T499 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:43537/solr
> [junit4:junit4] 2> 610 T499 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 611 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3daa432
> [junit4:junit4] 2> 612 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 612 T518 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 613 T518 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 614 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:55204
> [junit4:junit4] 2> 614 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:55204
> [junit4:junit4] 2> 619 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0002 with negotiated timeout 20000 for client /140.211.11.196:55204
> [junit4:junit4] 2> 619 T518 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0002, negotiated timeout = 20000
> [junit4:junit4] 2> 619 T519 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3daa432 name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 619 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 621 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0002
> [junit4:junit4] 2> 622 T519 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 622 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:55204 which had sessionid 0x13ca1e958bc0002
> [junit4:junit4] 2> 622 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0002 closed
> [junit4:junit4] 2> 623 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
> [junit4:junit4] 2> 637 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7eb5d65e
> [junit4:junit4] 2> 638 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 638 T520 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 639 T520 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 639 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45054
> [junit4:junit4] 2> 639 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45054
> [junit4:junit4] 2> 641 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0003 with negotiated timeout 20000 for client /140.211.11.196:45054
> [junit4:junit4] 2> 641 T520 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0003, negotiated timeout = 20000
> [junit4:junit4] 2> 641 T521 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7eb5d65e name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 641 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 644 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 652 T499 oascc.SolrZkClient.makePath makePath: /live_nodes
> [junit4:junit4] 2> 654 T499 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25591_lt_
> [junit4:junit4] 2> 655 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:25591_lt_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:25591_lt_
> [junit4:junit4] 2> 657 T499 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25591_lt_
> [junit4:junit4] 2> 667 T499 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
> [junit4:junit4] 2> 680 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
> [junit4:junit4] 2> 681 T499 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
> [junit4:junit4] 2> 685 T499 oasc.Overseer.start Overseer (id=89124116228734979-127.0.0.1:25591_lt_-n_0000000000) starting
> [junit4:junit4] 2> 685 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 691 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 693 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 699 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 701 T523 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
> [junit4:junit4] 2> 702 T499 oascc.SolrZkClient.makePath makePath: /clusterstate.json
> [junit4:junit4] 2> 705 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 708 T522 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
> [junit4:junit4] 2> 720 T524 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/collection1
> [junit4:junit4] 2> 720 T524 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
> [junit4:junit4] 2> 721 T524 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 722 T524 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
> [junit4:junit4] 2> 724 T524 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/collection1/'
> [junit4:junit4] 2> 725 T524 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/collection1/lib/README' to classloader
> [junit4:junit4] 2> 726 T524 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 782 T524 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 854 T524 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 955 T524 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4] 2> 961 T524 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4] 2> 1569 T524 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 1577 T524 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 1580 T524 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 1596 T524 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 1600 T524 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 1603 T524 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 1605 T524 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 1606 T524 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1359926090243/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/
> [junit4:junit4] 2> 1606 T524 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36298619
> [junit4:junit4] 2> 1607 T524 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4] 2> 1630 T524 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data forceNew:false
> [junit4:junit4] 2> 1630 T524 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data
> [junit4:junit4] 2> 1630 T524 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index/
> [junit4:junit4] 2> 1631 T524 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 1632 T524 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index forceNew:false
> [junit4:junit4] 2> 1638 T524 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@708ce5ef; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 1638 T524 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 1639 T524 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index
> [junit4:junit4] 2> 1639 T524 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4] 2> 1641 T524 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 1641 T524 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4] 2> 1641 T524 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 1641 T524 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4] 2> 1642 T524 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 1642 T524 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 1642 T524 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 1642 T524 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 1643 T524 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 1643 T524 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4] 2> 1644 T524 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4] 2> 1644 T524 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 1644 T524 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4] 2> 1644 T524 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4] 2> 1645 T524 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4] 2> 1645 T524 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 1645 T524 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 1646 T524 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 1646 T524 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 1646 T524 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 1647 T524 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 1647 T524 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 1647 T524 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 1648 T524 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 1648 T524 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4] 2> 1648 T524 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4] 2> 1657 T524 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 1660 T524 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4] 2> 1661 T524 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4] 2> 1663 T524 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data
> [junit4:junit4] 2> 1664 T524 oass.SolrIndexSearcher.<init> Opening Searcher@4b06504d main
> [junit4:junit4] 2> 1665 T524 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 1665 T524 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 1665 T524 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4] 2> 1682 T524 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4] 2> 1728 T525 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4b06504d main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 1732 T524 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 1732 T524 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 1732 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
> [junit4:junit4] 2> 2212 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 2213 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"control_collection",
> [junit4:junit4] 2> "node_name":"127.0.0.1:25591_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:25591/lt_"}
> [junit4:junit4] 2> 2213 T522 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
> [junit4:junit4] 2> 2226 T522 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 2226 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
> [junit4:junit4] 2> 2245 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4] 2> 2741 T524 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 2741 T524 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25591/lt_ collection:control_collection shard:shard1
> [junit4:junit4] 2> 2742 T524 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
> [junit4:junit4] 2> 2759 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
> [junit4:junit4] 2> 2760 T524 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4] 2> 2760 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 2771 T524 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4] 2> 2771 T524 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4] 2> 2771 T524 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:25591/lt_/collection1/
> [junit4:junit4] 2> 2772 T524 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4] 2> 2772 T524 oasc.SyncStrategy.syncToMe http://127.0.0.1:25591/lt_/collection1/ has no replicas
> [junit4:junit4] 2> 2772 T524 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:25591/lt_/collection1/
> [junit4:junit4] 2> 2772 T524 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
> [junit4:junit4] 2> 2777 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 3751 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 3802 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4] 2> 3851 T524 oasc.ZkController.register We are http://127.0.0.1:25591/lt_/collection1/ and leader is http://127.0.0.1:25591/lt_/collection1/
> [junit4:junit4] 2> 3851 T524 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25591/lt_
> [junit4:junit4] 2> 3851 T524 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4] 2> 3851 T524 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 3852 T524 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 3854 T524 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 3855 T499 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 3856 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 3857 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 3873 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:
> [junit4:junit4] 2> 3890 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@417dbcb6
> [junit4:junit4] 2> 3891 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 3892 T526 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 3892 T526 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 3893 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40197
> [junit4:junit4] 2> 3893 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40197
> [junit4:junit4] 2> 3895 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0004 with negotiated timeout 10000 for client /140.211.11.196:40197
> [junit4:junit4] 2> 3895 T526 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0004, negotiated timeout = 10000
> [junit4:junit4] 2> 3895 T527 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@417dbcb6 name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 3895 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 3897 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 3901 T499 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
> [junit4:junit4] 2> 4069 T499 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4] 2> 4073 T499 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:59558
> [junit4:junit4] 2> 4073 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 4074 T499 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 4074 T499 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806
> [junit4:junit4] 2> 4075 T499 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/solr.xml
> [junit4:junit4] 2> 4075 T499 oasc.CoreContainer.<init> New CoreContainer 2041002222
> [junit4:junit4] 2> 4076 T499 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/'
> [junit4:junit4] 2> 4076 T499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/'
> [junit4:junit4] 2> 4131 T499 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
> [junit4:junit4] 2> 4132 T499 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 4132 T499 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 4132 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 4133 T499 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 4133 T499 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 4134 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 4134 T499 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 4135 T499 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 4135 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 4157 T499 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4] 2> 4176 T499 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:43537/solr
> [junit4:junit4] 2> 4176 T499 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 4177 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@14c6f4dd
> [junit4:junit4] 2> 4178 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 4178 T537 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 4179 T537 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 4180 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:35606
> [junit4:junit4] 2> 4180 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:35606
> [junit4:junit4] 2> 4182 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0005 with negotiated timeout 20000 for client /140.211.11.196:35606
> [junit4:junit4] 2> 4182 T537 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0005, negotiated timeout = 20000
> [junit4:junit4] 2> 4182 T538 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14c6f4dd name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 4183 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 4184 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0005
> [junit4:junit4] 2> 4193 T538 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 4193 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:35606 which had sessionid 0x13ca1e958bc0005
> [junit4:junit4] 2> 4193 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0005 closed
> [junit4:junit4] 2> 4194 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
> [junit4:junit4] 2> 4205 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4d111d50
> [junit4:junit4] 2> 4206 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 4207 T539 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 4207 T539 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 4208 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25987
> [junit4:junit4] 2> 4208 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25987
> [junit4:junit4] 2> 4209 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0006 with negotiated timeout 20000 for client /140.211.11.196:25987
> [junit4:junit4] 2> 4209 T539 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0006, negotiated timeout = 20000
> [junit4:junit4] 2> 4210 T540 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d111d50 name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 4210 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 4211 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 4213 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 4214 T499 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59558_lt_
> [junit4:junit4] 2> 4215 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:59558_lt_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:59558_lt_
> [junit4:junit4] 2> 4222 T499 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59558_lt_
> [junit4:junit4] 2> 4225 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
> [junit4:junit4] 2> 4226 T527 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4] 2> 4228 T521 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4] 2> 4230 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 4238 T541 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/collection1
> [junit4:junit4] 2> 4238 T541 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 4239 T541 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 4239 T541 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 4241 T541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/collection1/'
> [junit4:junit4] 2> 4242 T541 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/collection1/lib/README' to classloader
> [junit4:junit4] 2> 4243 T541 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 4295 T541 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 4366 T541 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 4467 T541 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4] 2> 4473 T541 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4] 2> 5077 T541 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 5084 T541 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 5087 T541 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 5102 T541 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 5106 T541 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 5109 T541 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 5111 T541 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 5112 T541 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1359926093806/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/
> [junit4:junit4] 2> 5112 T541 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36298619
> [junit4:junit4] 2> 5112 T541 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4] 2> 5113 T541 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1 forceNew:false
> [junit4:junit4] 2> 5113 T541 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
> [junit4:junit4] 2> 5114 T541 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index/
> [junit4:junit4] 2> 5114 T541 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 5115 T541 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index forceNew:false
> [junit4:junit4] 2> 5119 T541 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bf4515f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 5120 T541 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 5120 T541 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index
> [junit4:junit4] 2> 5121 T541 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4] 2> 5122 T541 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 5122 T541 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4] 2> 5123 T541 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 5123 T541 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4] 2> 5123 T541 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 5124 T541 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 5124 T541 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 5124 T541 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 5125 T541 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 5125 T541 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4] 2> 5126 T541 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4] 2> 5126 T541 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 5126 T541 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4] 2> 5127 T541 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4] 2> 5127 T541 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4] 2> 5127 T541 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 5128 T541 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 5128 T541 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 5129 T541 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 5129 T541 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 5129 T541 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 5130 T541 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 5130 T541 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 5131 T541 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 5131 T541 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4] 2> 5132 T541 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4] 2> 5140 T541 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 5143 T541 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4] 2> 5144 T541 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4] 2> 5146 T541 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
> [junit4:junit4] 2> 5147 T541 oass.SolrIndexSearcher.<init> Opening Searcher@2aa0240c main
> [junit4:junit4] 2> 5148 T541 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 5148 T541 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 5148 T541 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4] 2> 5153 T541 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4] 2> 5196 T542 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2aa0240c main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 5200 T541 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 5200 T541 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 5317 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 5318 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"control_collection",
> [junit4:junit4] 2> "node_name":"127.0.0.1:25591_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:25591/lt_"}
> [junit4:junit4] 2> 5322 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:59558_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:59558/lt_"}
> [junit4:junit4] 2> 5322 T522 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
> [junit4:junit4] 2> 5323 T522 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 5334 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 5334 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 5334 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 6203 T541 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 6203 T541 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59558/lt_ collection:collection1 shard:shard1
> [junit4:junit4] 2> 6204 T541 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
> [junit4:junit4] 2> 6224 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:delete cxid:0x43 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
> [junit4:junit4] 2> 6225 T541 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4] 2> 6225 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:create cxid:0x44 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 6236 T541 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4] 2> 6236 T541 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4] 2> 6237 T541 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59558/lt_/collection1/
> [junit4:junit4] 2> 6237 T541 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4] 2> 6237 T541 oasc.SyncStrategy.syncToMe http://127.0.0.1:59558/lt_/collection1/ has no replicas
> [junit4:junit4] 2> 6237 T541 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59558/lt_/collection1/
> [junit4:junit4] 2> 6238 T541 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
> [junit4:junit4] 2> 6243 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0006 type:create cxid:0x4e zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 6848 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 6892 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 6892 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 6892 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 6916 T541 oasc.ZkController.register We are http://127.0.0.1:59558/lt_/collection1/ and leader is http://127.0.0.1:59558/lt_/collection1/
> [junit4:junit4] 2> 6916 T541 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59558/lt_
> [junit4:junit4] 2> 6916 T541 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4] 2> 6916 T541 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 6917 T541 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 6919 T541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 6920 T499 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 6920 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 6921 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 7104 T499 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4] 2> 7107 T499 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:39198
> [junit4:junit4] 2> 7108 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 7108 T499 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 7109 T499 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841
> [junit4:junit4] 2> 7109 T499 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/solr.xml
> [junit4:junit4] 2> 7110 T499 oasc.CoreContainer.<init> New CoreContainer 1233522068
> [junit4:junit4] 2> 7110 T499 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/'
> [junit4:junit4] 2> 7111 T499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/'
> [junit4:junit4] 2> 7165 T499 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
> [junit4:junit4] 2> 7166 T499 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 7166 T499 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 7167 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 7167 T499 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 7168 T499 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 7168 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 7169 T499 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 7169 T499 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 7170 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 7193 T499 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4] 2> 7212 T499 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:43537/solr
> [junit4:junit4] 2> 7213 T499 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 7213 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@499a601e
> [junit4:junit4] 2> 7215 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 7215 T552 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 7216 T552 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 7216 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59693
> [junit4:junit4] 2> 7217 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59693
> [junit4:junit4] 2> 7219 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0007 with negotiated timeout 20000 for client /140.211.11.196:59693
> [junit4:junit4] 2> 7219 T552 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0007, negotiated timeout = 20000
> [junit4:junit4] 2> 7219 T553 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@499a601e name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 7220 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 7221 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0007
> [junit4:junit4] 2> 7232 T553 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 7232 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:59693 which had sessionid 0x13ca1e958bc0007
> [junit4:junit4] 2> 7232 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0007 closed
> [junit4:junit4] 2> 7233 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
> [junit4:junit4] 2> 7247 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@11b5f02e
> [junit4:junit4] 2> 7248 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 7248 T554 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 7249 T554 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 7249 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28727
> [junit4:junit4] 2> 7249 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28727
> [junit4:junit4] 2> 7251 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0008 with negotiated timeout 20000 for client /140.211.11.196:28727
> [junit4:junit4] 2> 7251 T554 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0008, negotiated timeout = 20000
> [junit4:junit4] 2> 7251 T555 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11b5f02e name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 7251 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 7253 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 7254 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:create cxid:0x2 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 7256 T499 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39198_lt_
> [junit4:junit4] 2> 7257 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:delete cxid:0x4 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39198_lt_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39198_lt_
> [junit4:junit4] 2> 7265 T499 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39198_lt_
> [junit4:junit4] 2> 7268 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 7268 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 7268 T540 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4] 2> 7269 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 7270 T521 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4] 2> 7271 T527 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4] 2> 7273 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 7281 T556 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/collection1
> [junit4:junit4] 2> 7281 T556 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 7282 T556 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 7282 T556 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 7284 T556 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/collection1/'
> [junit4:junit4] 2> 7285 T556 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 7286 T556 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/collection1/lib/README' to classloader
> [junit4:junit4] 2> 7339 T556 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 7411 T556 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 7512 T556 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4] 2> 7518 T556 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4] 2> 8112 T556 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 8120 T556 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 8123 T556 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 8140 T556 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 8144 T556 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 8147 T556 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 8149 T556 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 8150 T556 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1359926096841/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/
> [junit4:junit4] 2> 8150 T556 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36298619
> [junit4:junit4] 2> 8150 T556 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4] 2> 8151 T556 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2 forceNew:false
> [junit4:junit4] 2> 8151 T556 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
> [junit4:junit4] 2> 8152 T556 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index/
> [junit4:junit4] 2> 8152 T556 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 8153 T556 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index forceNew:false
> [junit4:junit4] 2> 8158 T556 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@254256b1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 8158 T556 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 8159 T556 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index
> [junit4:junit4] 2> 8159 T556 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4] 2> 8161 T556 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 8161 T556 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4] 2> 8161 T556 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 8161 T556 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4] 2> 8162 T556 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 8162 T556 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 8162 T556 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 8163 T556 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 8163 T556 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 8164 T556 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4] 2> 8164 T556 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4] 2> 8164 T556 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 8165 T556 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4] 2> 8165 T556 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4] 2> 8165 T556 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4] 2> 8166 T556 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 8166 T556 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 8167 T556 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 8167 T556 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 8167 T556 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 8168 T556 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 8168 T556 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 8169 T556 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 8169 T556 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 8169 T556 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4] 2> 8170 T556 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4] 2> 8178 T556 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 8181 T556 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4] 2> 8182 T556 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4] 2> 8184 T556 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
> [junit4:junit4] 2> 8185 T556 oass.SolrIndexSearcher.<init> Opening Searcher@550b9e33 main
> [junit4:junit4] 2> 8186 T556 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 8186 T556 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 8187 T556 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4] 2> 8192 T556 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4] 2> 8243 T557 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@550b9e33 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 8247 T556 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 8247 T556 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 8406 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 8406 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:59558_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:59558/lt_"}
> [junit4:junit4] 2> 8411 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:39198_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:39198/lt_"}
> [junit4:junit4] 2> 8411 T522 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4:junit4] 2> 8411 T522 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
> [junit4:junit4] 2> 8423 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 8423 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 8423 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 8423 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 9250 T556 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 9250 T556 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39198/lt_ collection:collection1 shard:shard2
> [junit4:junit4] 2> 9251 T556 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
> [junit4:junit4] 2> 9275 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:delete cxid:0x42 zxid:0x7c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
> [junit4:junit4] 2> 9281 T556 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
> [junit4:junit4] 2> 9281 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:create cxid:0x43 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 9284 T556 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4] 2> 9285 T556 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4] 2> 9285 T556 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39198/lt_/collection1/
> [junit4:junit4] 2> 9285 T556 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4] 2> 9285 T556 oasc.SyncStrategy.syncToMe http://127.0.0.1:39198/lt_/collection1/ has no replicas
> [junit4:junit4] 2> 9286 T556 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39198/lt_/collection1/
> [junit4:junit4] 2> 9286 T556 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
> [junit4:junit4] 2> 9298 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc0008 type:create cxid:0x4c zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 9937 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 9976 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 9977 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 9977 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 9976 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 9980 T556 oasc.ZkController.register We are http://127.0.0.1:39198/lt_/collection1/ and leader is http://127.0.0.1:39198/lt_/collection1/
> [junit4:junit4] 2> 9980 T556 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39198/lt_
> [junit4:junit4] 2> 9980 T556 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4] 2> 9980 T556 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 9981 T556 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 9986 T556 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 9993 T499 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 9994 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 9995 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 10200 T499 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4] 2> 10204 T499 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48808
> [junit4:junit4] 2> 10204 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 10205 T499 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 10205 T499 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918
> [junit4:junit4] 2> 10206 T499 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/solr.xml
> [junit4:junit4] 2> 10206 T499 oasc.CoreContainer.<init> New CoreContainer 1199416839
> [junit4:junit4] 2> 10207 T499 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/'
> [junit4:junit4] 2> 10207 T499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/'
> [junit4:junit4] 2> 10262 T499 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
> [junit4:junit4] 2> 10263 T499 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 10263 T499 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 10264 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 10264 T499 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 10264 T499 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 10265 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 10265 T499 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 10266 T499 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 10266 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 10291 T499 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4] 2> 10313 T499 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:43537/solr
> [junit4:junit4] 2> 10314 T499 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 10314 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@15f0b12d
> [junit4:junit4] 2> 10315 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 10316 T567 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 10317 T567 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 10317 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49643
> [junit4:junit4] 2> 10318 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49643
> [junit4:junit4] 2> 10319 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc0009 with negotiated timeout 20000 for client /140.211.11.196:49643
> [junit4:junit4] 2> 10320 T567 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc0009, negotiated timeout = 20000
> [junit4:junit4] 2> 10320 T568 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15f0b12d name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 10320 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 10322 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc0009
> [junit4:junit4] 2> 10323 T568 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 10323 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:49643 which had sessionid 0x13ca1e958bc0009
> [junit4:junit4] 2> 10323 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc0009 closed
> [junit4:junit4] 2> 10324 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
> [junit4:junit4] 2> 10337 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@39cc1709
> [junit4:junit4] 2> 10338 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 10339 T569 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 10339 T569 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 10340 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:19439
> [junit4:junit4] 2> 10340 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:19439
> [junit4:junit4] 2> 10348 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc000a with negotiated timeout 20000 for client /140.211.11.196:19439
> [junit4:junit4] 2> 10348 T569 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc000a, negotiated timeout = 20000
> [junit4:junit4] 2> 10348 T570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39cc1709 name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 10349 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 10350 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000a type:create cxid:0x1 zxid:0x8d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 10351 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000a type:create cxid:0x2 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 10353 T499 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48808_lt_
> [junit4:junit4] 2> 10354 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000a type:delete cxid:0x4 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48808_lt_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48808_lt_
> [junit4:junit4] 2> 10362 T499 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48808_lt_
> [junit4:junit4] 2> 10364 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 10365 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 10365 T555 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 10365 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 10366 T540 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 10366 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 10367 T521 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 10367 T527 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 10371 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 10380 T571 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/collection1
> [junit4:junit4] 2> 10380 T571 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 10381 T571 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 10381 T571 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 10383 T571 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/collection1/'
> [junit4:junit4] 2> 10384 T571 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 10385 T571 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/collection1/lib/README' to classloader
> [junit4:junit4] 2> 10440 T571 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 10526 T571 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 10627 T571 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4] 2> 10634 T571 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4] 2> 11264 T571 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 11289 T571 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 11293 T571 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 11312 T571 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 11317 T571 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 11322 T571 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 11323 T571 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 11325 T571 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1359926099918/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/
> [junit4:junit4] 2> 11325 T571 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36298619
> [junit4:junit4] 2> 11326 T571 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4] 2> 11327 T571 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3 forceNew:false
> [junit4:junit4] 2> 11327 T571 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
> [junit4:junit4] 2> 11328 T571 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index/
> [junit4:junit4] 2> 11328 T571 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 11329 T571 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index forceNew:false
> [junit4:junit4] 2> 11335 T571 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61c28a10; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 11336 T571 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 11337 T571 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index
> [junit4:junit4] 2> 11337 T571 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4] 2> 11340 T571 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 11340 T571 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4] 2> 11340 T571 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 11341 T571 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4] 2> 11341 T571 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 11342 T571 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 11342 T571 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 11343 T571 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 11343 T571 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 11344 T571 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4] 2> 11345 T571 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4] 2> 11345 T571 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 11346 T571 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4] 2> 11346 T571 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4] 2> 11346 T571 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4] 2> 11347 T571 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 11348 T571 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 11348 T571 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 11349 T571 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 11349 T571 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 11350 T571 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 11351 T571 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 11351 T571 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 11352 T571 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 11353 T571 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4] 2> 11353 T571 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4] 2> 11366 T571 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 11371 T571 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4] 2> 11372 T571 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4] 2> 11375 T571 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
> [junit4:junit4] 2> 11376 T571 oass.SolrIndexSearcher.<init> Opening Searcher@5b2f54cd main
> [junit4:junit4] 2> 11377 T571 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 11378 T571 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 11378 T571 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4] 2> 11385 T571 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4] 2> 11443 T572 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5b2f54cd main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 11450 T571 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 11450 T571 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 11496 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 11497 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard2",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:39198_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:39198/lt_"}
> [junit4:junit4] 2> 11502 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:48808_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:48808/lt_"}
> [junit4:junit4] 2> 11503 T522 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4:junit4] 2> 11503 T522 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 11514 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 11514 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 11514 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 11514 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 11514 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 12453 T571 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 12453 T571 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48808/lt_ collection:collection1 shard:shard1
> [junit4:junit4] 2> 12483 T571 oasc.ZkController.register We are http://127.0.0.1:48808/lt_/collection1/ and leader is http://127.0.0.1:59558/lt_/collection1/
> [junit4:junit4] 2> 12484 T571 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48808/lt_
> [junit4:junit4] 2> 12484 T571 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4] 2> 12484 T571 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4] 2> ASYNC NEW_CORE C67 name=collection1 org.apache.solr.core.SolrCore@6fbe4c22 url=http://127.0.0.1:48808/lt_/collection1 node=127.0.0.1:48808_lt_ C67_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48808_lt_, base_url=http://127.0.0.1:48808/lt_}
> [junit4:junit4] 2> 12491 T573 C67 P48808 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
> [junit4:junit4] 2> 12491 T571 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 12492 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4] 2> 12493 T573 C67 P48808 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4] 2> 12493 T573 C67 P48808 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 12493 T499 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 12494 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 12494 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 12495 T573 C67 P48808 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 12691 T499 oejs.Server.doStart jetty-8.1.8.v20121106
> [junit4:junit4] 2> 12694 T499 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:56235
> [junit4:junit4] 2> 12695 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 12695 T499 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 12696 T499 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423
> [junit4:junit4] 2> 12696 T499 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/solr.xml
> [junit4:junit4] 2> 12696 T499 oasc.CoreContainer.<init> New CoreContainer 8126726
> [junit4:junit4] 2> 12697 T499 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/'
> [junit4:junit4] 2> 12697 T499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/'
> [junit4:junit4] 2> 12752 T499 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 60000
> [junit4:junit4] 2> 12753 T499 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 12753 T499 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 12754 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 12754 T499 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 12754 T499 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 12755 T499 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 12755 T499 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 12756 T499 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 12756 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=60000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 12780 T499 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4] 2> 12799 T499 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:43537/solr
> [junit4:junit4] 2> 12800 T499 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 12800 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6678bc7
> [junit4:junit4] 2> 12801 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 12802 T583 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 12802 T583 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 12803 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45364
> [junit4:junit4] 2> 12803 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45364
> [junit4:junit4] 2> 12805 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc000b with negotiated timeout 20000 for client /140.211.11.196:45364
> [junit4:junit4] 2> 12805 T583 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc000b, negotiated timeout = 20000
> [junit4:junit4] 2> 12806 T584 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6678bc7 name:ZooKeeperConnection Watcher:127.0.0.1:43537 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 12806 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 12807 T504 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13ca1e958bc000b
> [junit4:junit4] 2> 12819 T584 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4] 2> 12819 T501 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45364 which had sessionid 0x13ca1e958bc000b
> [junit4:junit4] 2> 12819 T499 oaz.ZooKeeper.close Session: 0x13ca1e958bc000b closed
> [junit4:junit4] 2> 12820 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=60000&connTimeout=15000
> [junit4:junit4] 2> 12834 T499 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:43537/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@48a02f43
> [junit4:junit4] 2> 12835 T499 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 12835 T585 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:43537. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
> [junit4:junit4] 2> 12836 T585 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:43537, initiating session
> [junit4:junit4] 2> 12836 T501 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34033
> [junit4:junit4] 2> 12836 T501 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34033
> [junit4:junit4] 2> 12838 T503 oazs.ZooKeeperServer.finishSessionInit Established session 0x13ca1e958bc000c with negotiated timeout 20000 for client /140.211.11.196:34033
> [junit4:junit4] 2> 12838 T585 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:43537, sessionid = 0x13ca1e958bc000c, negotiated timeout = 20000
> [junit4:junit4] 2> 12838 T586 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48a02f43 name:ZooKeeperConnection Watcher:127.0.0.1:43537/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 12838 T499 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 12840 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000c type:create cxid:0x1 zxid:0x9f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 12841 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000c type:create cxid:0x2 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4] 2> 12843 T499 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56235_lt_
> [junit4:junit4] 2> 12844 T504 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ca1e958bc000c type:delete cxid:0x4 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56235_lt_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56235_lt_
> [junit4:junit4] 2> 12851 T499 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56235_lt_
> [junit4:junit4] 2> 12854 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 12854 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 12854 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 12855 T555 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 12855 T540 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 12855 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 12855 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 12857 T521 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 12858 T570 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 12858 T527 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 12860 T499 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 12867 T587 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/collection1
> [junit4:junit4] 2> 12867 T587 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 12868 T587 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 12868 T587 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 12870 T587 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/collection1/'
> [junit4:junit4] 2> 12871 T587 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/collection1/lib/README' to classloader
> [junit4:junit4] 2> 12872 T587 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 12925 T587 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 12997 T587 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 13029 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 13030 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"recovering",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:48808_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:48808/lt_"}
> [junit4:junit4] 2> 13036 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 13036 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 13036 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 13036 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 13036 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 13098 T587 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4] 2> 13098 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 13105 T587 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4] 2> 13728 T587 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 13740 T587 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 13744 T587 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 13763 T587 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 13768 T587 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 13773 T587 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 13774 T587 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 13776 T587 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1359926102423/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/
> [junit4:junit4] 2> 13776 T587 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36298619
> [junit4:junit4] 2> 13777 T587 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
> [junit4:junit4] 2> 13778 T587 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4 forceNew:false
> [junit4:junit4] 2> 13779 T587 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
> [junit4:junit4] 2> 13779 T587 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index/
> [junit4:junit4] 2> 13779 T587 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 13781 T587 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index forceNew:false
> [junit4:junit4] 2> 13787 T587 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3df9fbf9; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 13788 T587 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 13789 T587 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index
> [junit4:junit4] 2> 13789 T587 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
> [junit4:junit4] 2> 13791 T587 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 13792 T587 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4] 2> 13792 T587 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 13792 T587 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
> [junit4:junit4] 2> 13793 T587 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 13793 T587 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 13794 T587 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 13794 T587 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 13795 T587 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 13796 T587 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
> [junit4:junit4] 2> 13796 T587 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4] 2> 13797 T587 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 13798 T587 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4] 2> 13798 T587 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4] 2> 13798 T587 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4] 2> 13799 T587 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 13799 T587 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 13800 T587 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 13801 T587 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 13801 T587 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 13802 T587 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 13803 T587 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 13803 T587 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 13804 T587 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4] 2> 13804 T587 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4] 2> 13805 T587 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4] 2> 13818 T587 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 13823 T587 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
> [junit4:junit4] 2> 13825 T587 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
> [junit4:junit4] 2> 13827 T587 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
> [junit4:junit4] 2> 13829 T587 oass.SolrIndexSearcher.<init> Opening Searcher@7ec4e721 main
> [junit4:junit4] 2> 13830 T587 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 13830 T587 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 13831 T587 oashc.SpellCheckComponent.inform Initializing spell checkers
> [junit4:junit4] 2> 13838 T587 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> [junit4:junit4] 2> 13893 T588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ec4e721 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 13900 T587 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 13900 T587 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 14548 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 14549 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:56235_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:56235/lt_"}
> [junit4:junit4] 2> 14550 T522 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
> [junit4:junit4] 2> 14550 T522 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
> [junit4:junit4] 2> 14563 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 14563 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 14563 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 14563 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 14563 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 14563 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 14903 T587 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 14903 T587 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56235/lt_ collection:collection1 shard:shard2
> [junit4:junit4] 2> 14907 T587 oasc.ZkController.register We are http://127.0.0.1:56235/lt_/collection1/ and leader is http://127.0.0.1:39198/lt_/collection1/
> [junit4:junit4] 2> 14907 T587 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56235/lt_
> [junit4:junit4] 2> 14907 T587 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4] 2> 14908 T587 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4] 2> ASYNC NEW_CORE C68 name=collection1 org.apache.solr.core.SolrCore@56dc599f url=http://127.0.0.1:56235/lt_/collection1 node=127.0.0.1:56235_lt_ C68_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:56235_lt_, base_url=http://127.0.0.1:56235/lt_}
> [junit4:junit4] 2> 14909 T589 C68 P56235 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
> [junit4:junit4] 2> 14909 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4] 2> 14910 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 14910 T589 C68 P56235 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4] 2> 14910 T589 C68 P56235 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 14911 T499 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 14911 T499 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 14912 T589 C68 P56235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 14912 T499 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 14938 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 14940 T499 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
> [junit4:junit4] 2> 14941 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> C67_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48808_lt_, base_url=http://127.0.0.1:48808/lt_}
> [junit4:junit4] 2> 15545 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:59558/lt_/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4] 2> 15555 T573 C67 P48808 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
> [junit4:junit4] 2> 15576 T573 C67 P48808 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48808/lt_ START replicas=[http://127.0.0.1:59558/lt_/collection1/] nUpdates=100
> [junit4:junit4] 2> 15586 T573 C67 P48808 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
> [junit4:junit4] 2> 15587 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4] 2> 15587 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4] 2> 15588 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4] 2> 15588 T573 C67 P48808 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4] 2> 15588 T573 C67 P48808 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:59558/lt_/collection1/. core=collection1
> [junit4:junit4] 2> 15588 T573 C67 P48808 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> ASYNC NEW_CORE C69 name=collection1 org.apache.solr.core.SolrCore@7a561b47 url=http://127.0.0.1:59558/lt_/collection1 node=127.0.0.1:59558_lt_ C69_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59558_lt_, base_url=http://127.0.0.1:59558/lt_, leader=true}
> [junit4:junit4] 2> 15604 T531 C69 P59558 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 15611 T532 C69 P59558 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
> [junit4:junit4] 2> 15612 T532 C69 P59558 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
> [junit4:junit4] 2> 15616 T532 C69 P59558 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bf4515f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 15617 T532 C69 P59558 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 15621 T532 C69 P59558 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bf4515f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bf4515f; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> 15621 T532 C69 P59558 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
> [junit4:junit4] 2> 15622 T532 C69 P59558 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
> [junit4:junit4] 2> 15623 T532 C69 P59558 oass.SolrIndexSearcher.<init> Opening Searcher@65c40485 realtime
> [junit4:junit4] 2> 15623 T532 C69 P59558 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 15624 T532 C69 P59558 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 14
> [junit4:junit4] 2> 15625 T573 C67 P48808 oash.ReplicationHandler.inform Commits will be reserved for 10000
> [junit4:junit4] 2> 15625 T573 C67 P48808 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
> [junit4:junit4] 2> 15653 T573 C67 P48808 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4] 2> 15656 T533 C69 P59558 oash.ReplicationHandler.inform Commits will be reserved for 10000
> [junit4:junit4] 2> 15657 T533 C69 P59558 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
> [junit4:junit4] 2> 15658 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Master's generation: 2
> [junit4:junit4] 2> 15658 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
> [junit4:junit4] 2> 15658 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Starting replication process
> [junit4:junit4] 2> 15662 T533 C69 P59558 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
> [junit4:junit4] 2> 15663 T533 C69 P59558 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1/index
> [junit4:junit4] 2> 15663 T533 C69 P59558 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
> [junit4:junit4] 2> 15664 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
> [junit4:junit4] 2> 15665 T573 C67 P48808 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 forceNew:false
> [junit4:junit4] 2> 15666 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
> [junit4:junit4] 2> 15667 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2db7be4d; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
> [junit4:junit4] 2> 15681 T533 C69 P59558 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=6
> [junit4:junit4] 2> 15688 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index
> [junit4:junit4] 2> 15689 T573 C67 P48808 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
> [junit4:junit4] 2> 15689 T573 C67 P48808 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130203221505568
> [junit4:junit4] 2> 15691 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
> [junit4:junit4] 2> 15692 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
> [junit4:junit4] 2> 15692 T573 C67 P48808 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568
> [junit4:junit4] 2> 15696 T573 C67 P48808 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2db7be4d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> 15696 T573 C67 P48808 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
> [junit4:junit4] 2> 15698 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
> [junit4:junit4] 2> 15703 T573 C67 P48808 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
> [junit4:junit4] 2> 15703 T573 C67 P48808 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
> [junit4:junit4] 2> 15703 T573 C67 P48808 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
> [junit4:junit4] 2> 15704 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568
> [junit4:junit4] 2> 15705 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
> [junit4:junit4] 2> 15709 T573 C67 P48808 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2db7be4d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> 15709 T573 C67 P48808 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
> [junit4:junit4] 2> 15710 T573 C67 P48808 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
> [junit4:junit4] 2> 15710 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
> [junit4:junit4] 2> 15711 T573 C67 P48808 oass.SolrIndexSearcher.<init> Opening Searcher@3c2d6104 main
> [junit4:junit4] 2> 15717 T572 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3c2d6104 main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4] 2> 15718 T572 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index
> [junit4:junit4] 2> 15719 T573 C67 P48808 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
> [junit4:junit4] 2> 15776 T573 C67 P48808 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2db7be4d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2db7be4d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
> [junit4:junit4] 2> 15777 T573 C67 P48808 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
> [junit4:junit4] 2> 15778 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
> [junit4:junit4] 2> 15778 T573 C67 P48808 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 15779 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index.20130203221505568
> [junit4:junit4] 2> 15779 T573 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3/index
> [junit4:junit4] 2> 15779 T573 C67 P48808 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4] 2> 15779 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4] 2> 15780 T573 C67 P48808 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 15780 T573 C67 P48808 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 15806 T573 C67 P48808 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4] 2> 15943 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 16069 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 16070 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard2",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"recovering",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:56235_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:56235/lt_"}
> [junit4:junit4] 2> 16078 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:48808_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:48808/lt_"}
> [junit4:junit4] 2> 16095 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 16095 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 16095 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 16095 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 16095 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 16095 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 16946 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 17950 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> C68_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:56235_lt_, base_url=http://127.0.0.1:56235/lt_}
> [junit4:junit4] 2> 18942 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:39198/lt_/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4] 2> 18942 T589 C68 P56235 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56235/lt_ START replicas=[http://127.0.0.1:39198/lt_/collection1/] nUpdates=100
> [junit4:junit4] 2> 18943 T589 C68 P56235 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
> [junit4:junit4] 2> 18943 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4] 2> 18943 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4] 2> 18943 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4] 2> 18944 T589 C68 P56235 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4] 2> 18945 T589 C68 P56235 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:39198/lt_/collection1/. core=collection1
> [junit4:junit4] 2> 18945 T589 C68 P56235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 18953 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> ASYNC NEW_CORE C70 name=collection1 org.apache.solr.core.SolrCore@b2471fb url=http://127.0.0.1:39198/lt_/collection1 node=127.0.0.1:39198_lt_ C70_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:39198_lt_, base_url=http://127.0.0.1:39198/lt_, leader=true}
> [junit4:junit4] 2> 18955 T546 C70 P39198 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 18965 T547 C70 P39198 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
> [junit4:junit4] 2> 18966 T547 C70 P39198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
> [junit4:junit4] 2> 18970 T547 C70 P39198 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@254256b1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 18971 T547 C70 P39198 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 18982 T547 C70 P39198 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@254256b1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@254256b1; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> 18982 T547 C70 P39198 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
> [junit4:junit4] 2> 18984 T547 C70 P39198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
> [junit4:junit4] 2> 18984 T547 C70 P39198 oass.SolrIndexSearcher.<init> Opening Searcher@4aef3675 realtime
> [junit4:junit4] 2> 18985 T547 C70 P39198 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 18985 T547 C70 P39198 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 20
> [junit4:junit4] 2> 18986 T589 C68 P56235 oash.ReplicationHandler.inform Commits will be reserved for 10000
> [junit4:junit4] 2> 18986 T589 C68 P56235 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4] 2> 18989 T548 C70 P39198 oash.ReplicationHandler.inform Commits will be reserved for 10000
> [junit4:junit4] 2> 18989 T548 C70 P39198 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
> [junit4:junit4] 2> 18990 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Master's generation: 2
> [junit4:junit4] 2> 18991 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
> [junit4:junit4] 2> 18991 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Starting replication process
> [junit4:junit4] 2> 18994 T548 C70 P39198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
> [junit4:junit4] 2> 18994 T548 C70 P39198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2/index
> [junit4:junit4] 2> 18995 T548 C70 P39198 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
> [junit4:junit4] 2> 18996 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
> [junit4:junit4] 2> 18997 T589 C68 P56235 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 forceNew:false
> [junit4:junit4] 2> 18998 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
> [junit4:junit4] 2> 18999 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6d976e; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
> [junit4:junit4] 2> 19002 T548 C70 P39198 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
> [junit4:junit4] 2> 19004 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index
> [junit4:junit4] 2> 19004 T589 C68 P56235 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
> [junit4:junit4] 2> 19005 T589 C68 P56235 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130203221508900
> [junit4:junit4] 2> 19006 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
> [junit4:junit4] 2> 19007 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
> [junit4:junit4] 2> 19007 T589 C68 P56235 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900
> [junit4:junit4] 2> 19011 T589 C68 P56235 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6d976e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> 19012 T589 C68 P56235 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
> [junit4:junit4] 2> 19014 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
> [junit4:junit4] 2> 19014 T589 C68 P56235 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
> [junit4:junit4] 2> 19014 T589 C68 P56235 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
> [junit4:junit4] 2> 19014 T589 C68 P56235 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
> [junit4:junit4] 2> 19015 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900
> [junit4:junit4] 2> 19016 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
> [junit4:junit4] 2> 19021 T589 C68 P56235 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6d976e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> 19021 T589 C68 P56235 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
> [junit4:junit4] 2> 19021 T589 C68 P56235 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
> [junit4:junit4] 2> 19022 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
> [junit4:junit4] 2> 19022 T589 C68 P56235 oass.SolrIndexSearcher.<init> Opening Searcher@692cbe60 main
> [junit4:junit4] 2> 19024 T588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@692cbe60 main{StandardDirectoryReader(segments_2:1:nrt)}
> [junit4:junit4] 2> 19025 T588 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index
> [junit4:junit4] 2> 19025 T589 C68 P56235 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
> [junit4:junit4] 2> 19030 T589 C68 P56235 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6d976e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f6d976e; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
> [junit4:junit4] 2> 19030 T589 C68 P56235 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
> [junit4:junit4] 2> 19032 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
> [junit4:junit4] 2> 19032 T589 C68 P56235 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 19032 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index.20130203221508900
> [junit4:junit4] 2> 19033 T589 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4/index
> [junit4:junit4] 2> 19033 T589 C68 P56235 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4] 2> 19033 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4] 2> 19033 T589 C68 P56235 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 19033 T589 C68 P56235 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 19035 T589 C68 P56235 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4] 2> 19115 T522 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 19116 T522 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "numShards":"2",
> [junit4:junit4] 2> "shard":"shard2",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:56235_lt_",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:56235/lt_"}
> [junit4:junit4] 2> 19130 T570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 19131 T527 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 19130 T555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 19130 T521 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 19130 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 19130 T540 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 19956 T499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 19957 T499 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
> [junit4:junit4] 2> ASYNC NEW_CORE C71 name=collection1 org.apache.solr.core.SolrCore@6a68c9a1 url=http://127.0.0.1:25591/lt_/collection1 node=127.0.0.1:25591_lt_ C71_STATE=coll:control_collection core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:25591_lt_, base_url=http://127.0.0.1:25591/lt_, leader=true}
> [junit4:junit4] 2> 19971 T511 C71 P25591 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data
> [junit4:junit4] 2> 19975 T511 C71 P25591 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@708ce5ef; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4] 2> 19976 T511 C71 P25591 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4] 2> 19977 T511 C71 P25591 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/control/data
> [junit4:junit4] 2> 19978 T511 C71 P25591 oass.SolrIndexSearcher.<init> Opening Searcher@159adcf5 realtime
> [junit4:junit4] 2> 19979 T511 C71 P25591 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1425985880586190848)} 0 10
> [junit4:junit4] 2> 19995 T549 C70 P39198 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty2
> [junit4:junit4] 2> 20000 T534 C69 P59558 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty1
> [junit4:junit4] 2> C68_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:56235_lt_, base_url=http://127.0.0.1:56235/lt_}
> [junit4:junit4] 2> 20010 T576 C68 P56235 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty4
> [junit4:junit4] 2> 20011 T576 C68 P56235 /update {update.distrib=FROMLEADER&_version_=-1425985880611356672&update.from=http://127.0.0.1:39198/lt_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1425985880611356672)} 0 3
> [junit4:junit4] 2> C67_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48808_lt_, base_url=http://127.0.0.1:48808/lt_}
> [junit4:junit4] 2> 20014 T560 C67 P48808 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1359926089911/jetty3
> [junit4:junit4] 2> 20015 T560 C67 P48808 /update {update.distrib=FROMLEADER&_version_=-1425985880617648128&update.from=http://127.0.0.1:59558/lt_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1425985880617648128)} 0 3
> [junit4:junit4] 2> 20016 T534 C69 P59558 /update {update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1425985880617648128)} 0 18
> [junit4:junit4] 2> 20017 T549 C70 P39198 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1425985880611356672)} 0 25
> [junit4:junit4] 2> 20027 T511 C71 P25591 /update {wt=javabin&version=2} {add=[1 (1425985880641765376)]} 0 5
> [junit4:junit4] 2> 20054 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1425985880659591168)]} 0 6
> [junit4:junit4] 2> 20055 T534 C69 P59558 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1425985880659591168)]} 0 16
> [junit4:junit4] 2> 20056 T549 C70 P39198 /update {wt=javabin&version=2} {add=[1]} 0 26
> [junit4:junit4] 2> 20062 T511 C71 P25591 /update {wt=javabin&version=2} {add=[2 (1425985880681611264)]} 0 2
> [junit4:junit4] 2> 20079 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1425985880689999872)]} 0 5
> [junit4:junit4] 2> 20080 T550 C70 P39198 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1425985880689999872)]} 0 13
> [junit4:junit4] 2> 20081 T535 C69 P59558 /update {wt=javabin&version=2} {add=[2]} 0 16
> [junit4:junit4] 2> 20087 T511 C71 P25591 /update {wt=javabin&version=2} {add=[3 (1425985880707825664)]} 0 3
> [junit4:junit4] 2> 20101 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1425985880717262848)]} 0 3
> [junit4:junit4] 2> 20102 T550 C70 P39198 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1425985880717262848)]} 0 9
> [junit4:junit4] 2> 20103 T535 C69 P59558 /update {wt=javabin&version=2} {add=[3]} 0 13
> [junit4:junit4] 2> 20109 T511 C71 P25591 /update {wt=javabin&version=2} {add=[4 (1425985880730894336)]} 0 3
> [junit4:junit4] 2> 20124 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1425985880740331520)]} 0 3
> [junit4:junit4] 2> 20125 T534 C69 P59558 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1425985880740331520)]} 0 10
> [junit4:junit4] 2> 20126 T549 C70 P39198 /update {wt=javabin&version=2} {add=[4]} 0 14
> [junit4:junit4] 2> 20132 T511 C71 P25591 /update {wt=javabin&version=2} {add=[5 (1425985880755011584)]} 0 3
> [junit4:junit4] 2> 20146 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1425985880764448768)]} 0 3
> [junit4:junit4] 2> 20147 T550 C70 P39198 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1425985880764448768)]} 0 9
> [junit4:junit4] 2> 20148 T535 C69 P59558 /update {wt=javabin&version=2} {add=[5]} 0 12
> [junit4:junit4] 2> 20154 T511 C71 P25591 /update {wt=javabin&version=2} {add=[6 (1425985880778080256)]} 0 3
> [junit4:junit4] 2> 20168 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1425985880787517440)]} 0 3
> [junit4:junit4] 2> 20169 T550 C70 P39198 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1425985880787517440)]} 0 9
> [junit4:junit4] 2> 20170 T535 C69 P59558 /update {wt=javabin&version=2} {add=[6]} 0 13
> [junit4:junit4] 2> 20176 T511 C71 P25591 /update {wt=javabin&version=2} {add=[7 (1425985880801148928)]} 0 3
> [junit4:junit4] 2> 20189 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1425985880807440384)]} 0 3
> [junit4:junit4] 2> 20190 T549 C70 P39198 /update {wt=javabin&version=2} {add=[7 (1425985880807440384)]} 0 11
> [junit4:junit4] 2> 20196 T511 C71 P25591 /update {wt=javabin&version=2} {add=[8 (1425985880822120448)]} 0 3
> [junit4:junit4] 2> 20211 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1425985880831557632)]} 0 3
> [junit4:junit4] 2> 20212 T534 C69 P59558 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1425985880831557632)]} 0 10
> [junit4:junit4] 2> 20213 T549 C70 P39198 /update {wt=javabin&version=2} {add=[8]} 0 14
> [junit4:junit4] 2> 20219 T511 C71 P25591 /update {wt=javabin&version=2} {add=[9 (1425985880846237696)]} 0 3
> [junit4:junit4] 2> 20233 T576 C68 P56235 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1425985880855674880)]} 0 3
> [junit4:junit4] 2> 20233 T550 C70 P39198 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1425985880855674880)]} 0 8
> [junit4:junit4] 2> 20234 T535 C69 P59558 /update {wt=javabin&version=2} {add=[9]} 0 12
> [junit4:junit4] 2> 20261 T511 C71 P25591 /update {wt=javabin&version=2} {add=[10 (1425985880869306368)]} 0 23
> [junit4:junit4] 2> 20276 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1425985880900763648)]} 0 3
> [junit4:junit4] 2> 20276 T534 C69 P59558 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1425985880900763648)]} 0 8
> [junit4:junit4] 2> 20277 T549 C70 P39198 /update {wt=javabin&version=2} {add=[10]} 0 12
> [junit4:junit4] 2> 20284 T511 C71 P25591 /update {wt=javabin&version=2} {add=[11 (1425985880913346560)]} 0 4
> [junit4:junit4] 2> 20298 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1425985880923832320)]} 0 3
> [junit4:junit4] 2> 20299 T534 C69 P59558 /update {distrib.from=http://127.0.0.1:39198/lt_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1425985880923832320)]} 0 9
> [junit4:junit4] 2> 20299 T549 C70 P39198 /update {wt=javabin&version=2} {add=[11]} 0 12
> [junit4:junit4] 2> 20306 T511 C71 P25591 /update {wt=javabin&version=2} {add=[12 (1425985880937463808)]} 0 3
> [junit4:junit4] 2> 20320 T560 C67 P48808 /update {distrib.from=http://127.0.0.1:59558/lt_/collection1/&update.distrib=FROMLEADER&wt=
>
> [...truncated too long message...]
>
> rdownChained.java:50)
> [junit4:junit4] 2> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> [junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> [junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> [junit4:junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> [junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> [junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4] 2> 22) Thread[id=572, name=searcherExecutor-469-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
> [junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
> [junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
> [junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
> [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
> [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> [junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4] 2> 23) Thread[id=629, name=searcherExecutor-496-thread-1, state=WAITING, group=TGRP-BasicDistributedZkTest]
> [junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
> [junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
> [junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
> [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
> [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> [junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {n_f1=PostingsFormat(name=SimpleText), foo_b=PostingsFormat(name=MockSep), foo_d=MockVariableIntBlock(baseBlockSize=77), foo_f=PostingsFormat(name=MockSep), n_tl1=PostingsFormat(name=SimpleText), n_d1=MockFixedIntBlock(blockSize=1003), rnd_b=MockVariableIntBlock(baseBlockSize=77), intDefault=MockFixedIntBlock(blockSize=1003), n_td1=PostingsFormat(name=SimpleText), timestamp=MockFixedIntBlock(blockSize=1003), id=MockVariableIntBlock(baseBlockSize=77), range_facet_sl=PostingsFormat(name=MockSep), range_facet_si=PostingsFormat(name=SimpleText), oddField_s=PostingsFormat(name=MockSep), foo_i=PostingsFormat(name=SimpleText), multiDefault=PostingsFormat(name=SimpleText), n_tf1=MockFixedIntBlock(blockSize=1003), n_dt1=PostingsFormat(name=SimpleText), n_ti1=MockVariableIntBlock(baseBlockSize=77), range_facet_l=MockFixedIntBlock(blockSize=1003), text=PostingsFormat(name=MockSep), _version_=MockFixedIntBlock(blockSize=1003), val_i=MockVariableIntBlock(baseBlockSize=77), SubjectTerms_mfacet=MockFixedIntBlock(blockSize=1003), a_t=MockFixedIntBlock(blockSize=1003), n_tdt1=MockFixedIntBlock(blockSize=1003), other_tl1=MockFixedIntBlock(blockSize=1003), n_l1=MockFixedIntBlock(blockSize=1003), a_si=PostingsFormat(name=SimpleText)}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ro, timezone=Europe/Malta
> [junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=25,free=255086936,total=470810624
> [junit4:junit4] 2> NOTE: All tests run in this JVM: [QueryElevationComponentTest, SystemInfoHandlerTest, JSONWriterTest, CopyFieldTest, DateFieldTest, TestSuggestSpellingConverter, TestSearchPerf, DirectSolrConnectionTest, NumericFieldsTest, TestReload, SOLR749Test, IndexBasedSpellCheckerTest, SolrCmdDistributorTest, TestFuzzyAnalyzedSuggestions, FastVectorHighlighterTest, PreAnalyzedFieldTest, TestRangeQuery, TestComponentsName, LeaderElectionIntegrationTest, TestDefaultSimilarityFactory, TestPerFieldSimilarity, DirectUpdateHandlerOptimizeTest, NoCacheHeaderTest, TermsComponentTest, DefaultValueUpdateProcessorTest, TestSolrIndexConfig, TestPHPSerializedResponseWriter, SpellCheckComponentTest, TestBinaryResponseWriter, TestIndexingPerformance, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, TestStressVersions, AlternateDirectoryTest, TestSolr4Spatial, UpdateRequestProcessorFactoryTest, TestPseudoReturnFields, AutoCommitTest, TestNumberUtils, TestFastOutputStream, BasicDistributedZkTest]
> [junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZkTest -Dtests.seed=437C1ACFB7351B0A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ro -Dtests.timezone=Europe/Malta -Dtests.file.encoding=US-ASCII
> [junit4:junit4] ERROR 0.00s J0 | BasicDistributedZkTest (suite) <<<
> [junit4:junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
> [junit4:junit4] > at __randomizedtesting.SeedInfo.seed([437C1ACFB7351B0A]:0)
> [junit4:junit4] Completed on J0 in 7223.60s, 1 test, 2 errors <<< FAILURES!
>
> [...truncated 74 lines...]
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:346: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:178: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:428: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1176: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:841: There were test failures: 249 suites, 1038 tests, 1 suite-level error, 1 error, 66 ignored (5 assumptions)
>
> Total time: 144 minutes 57 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org