You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/08 13:49:46 UTC
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build #
4592 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4592/
Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:54705/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:54705/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([4CA49739C934E04:852CC76BEBCC2E38]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:85)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9368 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T1235 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 3 T1235 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362746475972
[junit4:junit4] 2> 4 T1235 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 4 T1236 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 5 T1236 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 5 T1236 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 5 T1236 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 5 T1236 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 6 T1236 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 104 T1235 oasc.ZkTestServer.run start zk server on port:55525
[junit4:junit4] 2> 105 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1180cad
[junit4:junit4] 2> 105 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 106 T1241 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 106 T1241 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 106 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47781
[junit4:junit4] 2> 106 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47781
[junit4:junit4] 2> 107 T1239 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 125 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c60000 with negotiated timeout 10000 for client /127.0.0.1:47781
[junit4:junit4] 2> 125 T1241 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c60000, negotiated timeout = 10000
[junit4:junit4] 2> 125 T1242 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1180cad name:ZooKeeperConnection Watcher:127.0.0.1:55525 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 126 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 126 T1235 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 129 T1240 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a0505c60000
[junit4:junit4] 2> 129 T1242 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 130 T1237 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47781 which had sessionid 0x13d4a0505c60000
[junit4:junit4] 2> 129 T1235 oaz.ZooKeeper.close Session: 0x13d4a0505c60000 closed
[junit4:junit4] 2> 130 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1dfeebe
[junit4:junit4] 2> 131 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 131 T1243 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 131 T1243 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 131 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47782
[junit4:junit4] 2> 132 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47782
[junit4:junit4] 2> 132 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c60001 with negotiated timeout 10000 for client /127.0.0.1:47782
[junit4:junit4] 2> 132 T1243 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c60001, negotiated timeout = 10000
[junit4:junit4] 2> 132 T1244 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dfeebe name:ZooKeeperConnection Watcher:127.0.0.1:55525/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 133 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 133 T1235 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 135 T1235 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 136 T1235 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 138 T1235 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 139 T1235 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 140 T1235 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 143 T1235 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 143 T1235 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 146 T1235 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 146 T1235 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 148 T1235 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 148 T1235 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 150 T1235 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 150 T1235 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 152 T1235 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 152 T1235 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 154 T1235 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 154 T1235 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 156 T1235 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 156 T1235 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 158 T1235 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 158 T1235 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 160 T1240 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a0505c60001
[junit4:junit4] 2> 160 T1244 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 160 T1237 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47782 which had sessionid 0x13d4a0505c60001
[junit4:junit4] 2> 160 T1235 oaz.ZooKeeper.close Session: 0x13d4a0505c60001 closed
[junit4:junit4] 2> 218 T1235 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 226 T1235 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35875
[junit4:junit4] 2> 227 T1235 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 227 T1235 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 227 T1235 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362746476129
[junit4:junit4] 2> 228 T1235 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362746476129/solr.xml
[junit4:junit4] 2> 228 T1235 oasc.CoreContainer.<init> New CoreContainer 6226171
[junit4:junit4] 2> 229 T1235 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362746476129/'
[junit4:junit4] 2> 229 T1235 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362746476129/'
[junit4:junit4] 2> 246 T1235 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 247 T1235 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 247 T1235 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 247 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 248 T1235 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 248 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 248 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 249 T1235 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 249 T1235 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 249 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 256 T1235 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 274 T1235 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55525/solr
[junit4:junit4] 2> 275 T1235 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 275 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@e6f63f
[junit4:junit4] 2> 276 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 276 T1254 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 277 T1254 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 277 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47783
[junit4:junit4] 2> 277 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47783
[junit4:junit4] 2> 278 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c60002 with negotiated timeout 20000 for client /127.0.0.1:47783
[junit4:junit4] 2> 278 T1254 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c60002, negotiated timeout = 20000
[junit4:junit4] 2> 278 T1255 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e6f63f name:ZooKeeperConnection Watcher:127.0.0.1:55525 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 279 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 280 T1240 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a0505c60002
[junit4:junit4] 2> 280 T1255 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 280 T1237 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47783 which had sessionid 0x13d4a0505c60002
[junit4:junit4] 2> 280 T1235 oaz.ZooKeeper.close Session: 0x13d4a0505c60002 closed
[junit4:junit4] 2> 281 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 283 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@15f1535
[junit4:junit4] 2> 284 T1256 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 284 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 285 T1256 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 285 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47784
[junit4:junit4] 2> 285 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47784
[junit4:junit4] 2> 285 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c60003 with negotiated timeout 20000 for client /127.0.0.1:47784
[junit4:junit4] 2> 285 T1256 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c60003, negotiated timeout = 20000
[junit4:junit4] 2> 286 T1257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15f1535 name:ZooKeeperConnection Watcher:127.0.0.1:55525/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 286 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 287 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 288 T1235 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 290 T1235 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35875_
[junit4:junit4] 2> 290 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35875_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35875_
[junit4:junit4] 2> 291 T1235 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35875_
[junit4:junit4] 2> 293 T1235 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 298 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 298 T1235 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 301 T1235 oasc.Overseer.start Overseer (id=89308953049432067-127.0.0.1:35875_-n_0000000000) starting
[junit4:junit4] 2> 301 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 302 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 303 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 303 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 304 T1259 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 304 T1235 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 306 T1235 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 307 T1235 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 309 T1258 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 312 T1260 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362746476129/collection1
[junit4:junit4] 2> 312 T1260 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 313 T1260 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 313 T1260 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 315 T1260 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362746476129/collection1/'
[junit4:junit4] 2> 316 T1260 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362746476129/collection1/lib/README' to classloader
[junit4:junit4] 2> 316 T1260 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362746476129/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 347 T1260 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 393 T1260 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 394 T1260 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 398 T1260 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 842 T1260 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 854 T1260 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 856 T1260 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 866 T1260 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 869 T1260 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 874 T1260 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 875 T1260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 876 T1260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 876 T1260 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 877 T1260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 877 T1260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 878 T1260 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362746476129/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/control/data/
[junit4:junit4] 2> 878 T1260 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff01e
[junit4:junit4] 2> 878 T1260 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 879 T1260 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/control/data forceNew: false
[junit4:junit4] 2> 880 T1260 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/control/data/index/
[junit4:junit4] 2> 880 T1260 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 880 T1260 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/control/data/index forceNew: false
[junit4:junit4] 2> 884 T1260 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@ef4e40; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 884 T1260 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 886 T1260 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 886 T1260 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 887 T1260 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 887 T1260 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 888 T1260 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 888 T1260 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 888 T1260 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 888 T1260 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 889 T1260 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 891 T1260 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 894 T1260 oass.SolrIndexSearcher.<init> Opening Searcher@132a79a main
[junit4:junit4] 2> 895 T1260 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 895 T1260 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 899 T1260 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 900 T1260 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 900 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 900 T1261 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@132a79a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1811 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1812 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35875",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:35875_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"control_collection"}
[junit4:junit4] 2> 1812 T1258 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1812 T1258 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1813 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1816 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1902 T1260 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1902 T1260 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35875 collection:control_collection shard:shard1
[junit4:junit4] 2> 1903 T1260 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1908 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 1909 T1260 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1909 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1910 T1260 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1911 T1260 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1911 T1260 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35875/collection1/
[junit4:junit4] 2> 1911 T1260 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1911 T1260 oasc.SyncStrategy.syncToMe http://127.0.0.1:35875/collection1/ has no replicas
[junit4:junit4] 2> 1911 T1260 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35875/collection1/
[junit4:junit4] 2> 1912 T1260 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1914 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3319 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3325 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3369 T1260 oasc.ZkController.register We are http://127.0.0.1:35875/collection1/ and leader is http://127.0.0.1:35875/collection1/
[junit4:junit4] 2> 3369 T1260 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35875
[junit4:junit4] 2> 3369 T1260 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3369 T1260 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3369 T1260 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3371 T1260 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3371 T1235 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3372 T1235 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3372 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3375 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3376 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@11919b3
[junit4:junit4] 2> 3377 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3377 T1262 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3377 T1262 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 3377 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47789
[junit4:junit4] 2> 3378 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47789
[junit4:junit4] 2> 3378 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c60004 with negotiated timeout 10000 for client /127.0.0.1:47789
[junit4:junit4] 2> 3378 T1262 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c60004, negotiated timeout = 10000
[junit4:junit4] 2> 3379 T1263 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11919b3 name:ZooKeeperConnection Watcher:127.0.0.1:55525/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3379 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3381 T1235 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3382 T1235 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3440 T1235 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3449 T1235 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44824
[junit4:junit4] 2> 3449 T1235 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3450 T1235 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3450 T1235 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350
[junit4:junit4] 2> 3450 T1235 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/solr.xml
[junit4:junit4] 2> 3451 T1235 oasc.CoreContainer.<init> New CoreContainer 10724263
[junit4:junit4] 2> 3451 T1235 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/'
[junit4:junit4] 2> 3452 T1235 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/'
[junit4:junit4] 2> 3469 T1235 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3469 T1235 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3469 T1235 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3470 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3470 T1235 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3470 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3471 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3471 T1235 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3471 T1235 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3472 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3478 T1235 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3489 T1235 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55525/solr
[junit4:junit4] 2> 3490 T1235 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3490 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1db0664
[junit4:junit4] 2> 3491 T1273 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3491 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3492 T1273 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 3492 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47790
[junit4:junit4] 2> 3492 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47790
[junit4:junit4] 2> 3493 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c60005 with negotiated timeout 20000 for client /127.0.0.1:47790
[junit4:junit4] 2> 3493 T1273 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c60005, negotiated timeout = 20000
[junit4:junit4] 2> 3494 T1274 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1db0664 name:ZooKeeperConnection Watcher:127.0.0.1:55525 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3494 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3495 T1240 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a0505c60005
[junit4:junit4] 2> 3496 T1274 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3496 T1237 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47790 which had sessionid 0x13d4a0505c60005
[junit4:junit4] 2> 3496 T1235 oaz.ZooKeeper.close Session: 0x13d4a0505c60005 closed
[junit4:junit4] 2> 3496 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3499 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c24969
[junit4:junit4] 2> 3500 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3500 T1275 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3500 T1275 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 3500 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47791
[junit4:junit4] 2> 3501 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47791
[junit4:junit4] 2> 3501 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c60006 with negotiated timeout 20000 for client /127.0.0.1:47791
[junit4:junit4] 2> 3501 T1275 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c60006, negotiated timeout = 20000
[junit4:junit4] 2> 3502 T1276 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c24969 name:ZooKeeperConnection Watcher:127.0.0.1:55525/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3502 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3503 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3503 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3505 T1235 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4507 T1235 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44824_
[junit4:junit4] 2> 4508 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:44824_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:44824_
[junit4:junit4] 2> 4509 T1235 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44824_
[junit4:junit4] 2> 4511 T1257 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4511 T1263 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4511 T1276 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4511 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4516 T1277 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/collection1
[junit4:junit4] 2> 4516 T1277 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4517 T1277 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4517 T1277 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4518 T1277 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/collection1/'
[junit4:junit4] 2> 4518 T1277 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/collection1/lib/README' to classloader
[junit4:junit4] 2> 4519 T1277 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4554 T1277 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 4595 T1277 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4596 T1277 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4600 T1277 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4829 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4830 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35875",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:35875_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"control_collection"}
[junit4:junit4] 2> 4833 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4833 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4833 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5031 T1277 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5037 T1277 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5040 T1277 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5048 T1277 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5051 T1277 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5054 T1277 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5059 T1277 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5059 T1277 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5059 T1277 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5060 T1277 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5061 T1277 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5061 T1277 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1/
[junit4:junit4] 2> 5061 T1277 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff01e
[junit4:junit4] 2> 5061 T1277 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 5062 T1277 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1 forceNew: false
[junit4:junit4] 2> 5062 T1277 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1/index/
[junit4:junit4] 2> 5062 T1277 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5063 T1277 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1/index forceNew: false
[junit4:junit4] 2> 5066 T1277 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@cee915; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5066 T1277 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5067 T1277 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5067 T1277 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5068 T1277 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5068 T1277 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5069 T1277 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5069 T1277 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5069 T1277 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5069 T1277 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5070 T1277 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5072 T1277 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5075 T1277 oass.SolrIndexSearcher.<init> Opening Searcher@16bb14 main
[junit4:junit4] 2> 5076 T1277 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5076 T1277 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5080 T1278 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16bb14 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5081 T1277 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5081 T1277 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6336 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6337 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44824",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:44824_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 6337 T1258 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6338 T1258 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6341 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6341 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6341 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7082 T1277 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7083 T1277 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44824 collection:collection1 shard:shard1
[junit4:junit4] 2> 7083 T1277 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7088 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7089 T1277 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7089 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7090 T1277 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7091 T1277 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7091 T1277 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44824/collection1/
[junit4:junit4] 2> 7091 T1277 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7091 T1277 oasc.SyncStrategy.syncToMe http://127.0.0.1:44824/collection1/ has no replicas
[junit4:junit4] 2> 7091 T1277 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44824/collection1/
[junit4:junit4] 2> 7092 T1277 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7094 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7845 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7853 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7853 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7853 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7897 T1277 oasc.ZkController.register We are http://127.0.0.1:44824/collection1/ and leader is http://127.0.0.1:44824/collection1/
[junit4:junit4] 2> 7898 T1277 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44824
[junit4:junit4] 2> 7898 T1277 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 7898 T1277 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 7898 T1277 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7900 T1277 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7900 T1235 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 7901 T1235 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 7901 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 7967 T1235 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 7968 T1235 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54705
[junit4:junit4] 2> 7969 T1235 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 7969 T1235 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 7970 T1235 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362746483873
[junit4:junit4] 2> 7970 T1235 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362746483873/solr.xml
[junit4:junit4] 2> 7970 T1235 oasc.CoreContainer.<init> New CoreContainer 28723463
[junit4:junit4] 2> 7971 T1235 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362746483873/'
[junit4:junit4] 2> 7971 T1235 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362746483873/'
[junit4:junit4] 2> 7988 T1235 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 7989 T1235 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 7989 T1235 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 7989 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 7990 T1235 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 7990 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 7990 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 7991 T1235 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 7991 T1235 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 7991 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 7998 T1235 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8014 T1235 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55525/solr
[junit4:junit4] 2> 8014 T1235 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8015 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@b6c930
[junit4:junit4] 2> 8015 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8016 T1288 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8016 T1288 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 8016 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47797
[junit4:junit4] 2> 8017 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47797
[junit4:junit4] 2> 8017 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c60007 with negotiated timeout 20000 for client /127.0.0.1:47797
[junit4:junit4] 2> 8018 T1288 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c60007, negotiated timeout = 20000
[junit4:junit4] 2> 8018 T1289 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b6c930 name:ZooKeeperConnection Watcher:127.0.0.1:55525 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8018 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8019 T1240 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a0505c60007
[junit4:junit4] 2> 8020 T1289 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8019 T1235 oaz.ZooKeeper.close Session: 0x13d4a0505c60007 closed
[junit4:junit4] 2> 8020 T1237 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47797 which had sessionid 0x13d4a0505c60007
[junit4:junit4] 2> 8020 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8023 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@71fd67
[junit4:junit4] 2> 8024 T1290 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8024 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8024 T1290 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 8024 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47798
[junit4:junit4] 2> 8025 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47798
[junit4:junit4] 2> 8025 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c60008 with negotiated timeout 20000 for client /127.0.0.1:47798
[junit4:junit4] 2> 8025 T1290 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c60008, negotiated timeout = 20000
[junit4:junit4] 2> 8026 T1291 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71fd67 name:ZooKeeperConnection Watcher:127.0.0.1:55525/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8026 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8027 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8027 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8028 T1235 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9030 T1235 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54705_
[junit4:junit4] 2> 9031 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54705_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54705_
[junit4:junit4] 2> 9032 T1235 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54705_
[junit4:junit4] 2> 9034 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9034 T1263 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9034 T1257 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9034 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9034 T1291 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9035 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9035 T1276 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9040 T1292 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362746483873/collection1
[junit4:junit4] 2> 9040 T1292 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9041 T1292 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9041 T1292 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9042 T1292 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362746483873/collection1/'
[junit4:junit4] 2> 9042 T1292 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362746483873/collection1/lib/README' to classloader
[junit4:junit4] 2> 9042 T1292 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362746483873/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9075 T1292 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 9114 T1292 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9115 T1292 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9119 T1292 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9357 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9358 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44824",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:44824_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 9361 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9361 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9361 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9361 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9569 T1292 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9575 T1292 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9578 T1292 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9587 T1292 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9590 T1292 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9593 T1292 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9594 T1292 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9594 T1292 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9595 T1292 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9595 T1292 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9596 T1292 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9596 T1292 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362746483873/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty2/
[junit4:junit4] 2> 9596 T1292 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff01e
[junit4:junit4] 2> 9596 T1292 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 9597 T1292 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty2 forceNew: false
[junit4:junit4] 2> 9597 T1292 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty2/index/
[junit4:junit4] 2> 9597 T1292 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9598 T1292 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty2/index forceNew: false
[junit4:junit4] 2> 9603 T1292 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e2502; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9603 T1292 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9604 T1292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9605 T1292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9605 T1292 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9605 T1292 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9606 T1292 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9606 T1292 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9606 T1292 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9607 T1292 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9607 T1292 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9609 T1292 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9612 T1292 oass.SolrIndexSearcher.<init> Opening Searcher@1c0db12 main
[junit4:junit4] 2> 9613 T1292 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9613 T1292 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9617 T1293 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c0db12 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9618 T1292 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9618 T1292 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10868 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10869 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54705",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:54705_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 10869 T1258 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 10869 T1258 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 10872 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10872 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10872 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10872 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11619 T1292 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11620 T1292 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54705 collection:collection1 shard:shard2
[junit4:junit4] 2> 11620 T1292 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 11624 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 11625 T1292 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11625 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11626 T1292 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11627 T1292 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11627 T1292 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54705/collection1/
[junit4:junit4] 2> 11627 T1292 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11628 T1292 oasc.SyncStrategy.syncToMe http://127.0.0.1:54705/collection1/ has no replicas
[junit4:junit4] 2> 11628 T1292 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54705/collection1/
[junit4:junit4] 2> 11628 T1292 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 11630 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12376 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12382 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12382 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12382 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12382 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12383 T1292 oasc.ZkController.register We are http://127.0.0.1:54705/collection1/ and leader is http://127.0.0.1:54705/collection1/
[junit4:junit4] 2> 12383 T1292 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54705
[junit4:junit4] 2> 12384 T1292 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 12384 T1292 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 12384 T1292 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12385 T1292 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12386 T1235 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 12386 T1235 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12387 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12452 T1235 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12454 T1235 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33615
[junit4:junit4] 2> 12455 T1235 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12455 T1235 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12455 T1235 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362746488358
[junit4:junit4] 2> 12456 T1235 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362746488358/solr.xml
[junit4:junit4] 2> 12456 T1235 oasc.CoreContainer.<init> New CoreContainer 26821542
[junit4:junit4] 2> 12456 T1235 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362746488358/'
[junit4:junit4] 2> 12457 T1235 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362746488358/'
[junit4:junit4] 2> 12474 T1235 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12474 T1235 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12475 T1235 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12475 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12475 T1235 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12476 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12476 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12476 T1235 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12477 T1235 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12477 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12484 T1235 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12495 T1235 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55525/solr
[junit4:junit4] 2> 12496 T1235 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12496 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1834c34
[junit4:junit4] 2> 12497 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12497 T1303 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12498 T1303 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 12498 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47833
[junit4:junit4] 2> 12498 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47833
[junit4:junit4] 2> 12499 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c60009 with negotiated timeout 20000 for client /127.0.0.1:47833
[junit4:junit4] 2> 12499 T1303 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c60009, negotiated timeout = 20000
[junit4:junit4] 2> 12499 T1304 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1834c34 name:ZooKeeperConnection Watcher:127.0.0.1:55525 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12499 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12501 T1240 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a0505c60009
[junit4:junit4] 2> 12501 T1237 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47833 which had sessionid 0x13d4a0505c60009
[junit4:junit4] 2> 12501 T1304 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12501 T1235 oaz.ZooKeeper.close Session: 0x13d4a0505c60009 closed
[junit4:junit4] 2> 12502 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12504 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@ddbe8b
[junit4:junit4] 2> 12505 T1305 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12505 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12506 T1305 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 12506 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47834
[junit4:junit4] 2> 12506 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47834
[junit4:junit4] 2> 12507 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c6000a with negotiated timeout 20000 for client /127.0.0.1:47834
[junit4:junit4] 2> 12507 T1305 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c6000a, negotiated timeout = 20000
[junit4:junit4] 2> 12507 T1306 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ddbe8b name:ZooKeeperConnection Watcher:127.0.0.1:55525/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12507 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12508 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c6000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12509 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c6000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12510 T1235 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13512 T1235 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33615_
[junit4:junit4] 2> 13513 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c6000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33615_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33615_
[junit4:junit4] 2> 13514 T1235 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33615_
[junit4:junit4] 2> 13516 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13517 T1291 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13517 T1276 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13517 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13517 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13517 T1263 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13518 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13518 T1306 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13518 T1257 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13523 T1307 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362746488358/collection1
[junit4:junit4] 2> 13523 T1307 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13524 T1307 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13524 T1307 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13525 T1307 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362746488358/collection1/'
[junit4:junit4] 2> 13525 T1307 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362746488358/collection1/lib/README' to classloader
[junit4:junit4] 2> 13525 T1307 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362746488358/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13557 T1307 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 13596 T1307 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13597 T1307 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13602 T1307 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13886 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13887 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54705",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:54705_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 13889 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13889 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13889 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13889 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13890 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14066 T1307 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14072 T1307 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14075 T1307 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14084 T1307 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14087 T1307 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14090 T1307 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14090 T1307 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14091 T1307 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14091 T1307 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14092 T1307 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14092 T1307 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14092 T1307 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362746488358/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3/
[junit4:junit4] 2> 14093 T1307 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff01e
[junit4:junit4] 2> 14093 T1307 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 14093 T1307 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3 forceNew: false
[junit4:junit4] 2> 14094 T1307 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3/index/
[junit4:junit4] 2> 14094 T1307 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14094 T1307 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3/index forceNew: false
[junit4:junit4] 2> 14097 T1307 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ae9c90; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14098 T1307 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14103 T1307 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14103 T1307 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14103 T1307 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14104 T1307 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14104 T1307 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14104 T1307 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14105 T1307 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14105 T1307 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14105 T1307 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14108 T1307 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14111 T1307 oass.SolrIndexSearcher.<init> Opening Searcher@179fdd6 main
[junit4:junit4] 2> 14111 T1307 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14112 T1307 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14116 T1308 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@179fdd6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14117 T1307 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14117 T1307 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15393 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15394 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33615",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:33615_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 15394 T1258 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15394 T1258 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 15398 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15398 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15398 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15398 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15398 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16119 T1307 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16119 T1307 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33615 collection:collection1 shard:shard1
[junit4:junit4] 2> 16121 T1307 oasc.ZkController.register We are http://127.0.0.1:33615/collection1/ and leader is http://127.0.0.1:44824/collection1/
[junit4:junit4] 2> 16121 T1307 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33615
[junit4:junit4] 2> 16122 T1307 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16122 T1307 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C95 name=collection1 org.apache.solr.core.SolrCore@1af7d43 url=http://127.0.0.1:33615/collection1 node=127.0.0.1:33615_ C95_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:33615, core=collection1, node_name=127.0.0.1:33615_, state=down, collection=collection1}
[junit4:junit4] 2> 16122 T1309 C95 P33615 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16123 T1307 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16123 T1309 C95 P33615 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16123 T1309 C95 P33615 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16123 T1309 C95 P33615 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16124 T1235 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 16124 T1235 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16124 T1309 C95 P33615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16124 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16192 T1235 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16195 T1235 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:42272
[junit4:junit4] 2> 16195 T1235 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16196 T1235 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16196 T1235 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362746492095
[junit4:junit4] 2> 16196 T1235 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362746492095/solr.xml
[junit4:junit4] 2> 16197 T1235 oasc.CoreContainer.<init> New CoreContainer 27252939
[junit4:junit4] 2> 16197 T1235 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362746492095/'
[junit4:junit4] 2> 16198 T1235 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362746492095/'
[junit4:junit4] 2> 16215 T1235 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 16215 T1235 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 16216 T1235 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 16216 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 16216 T1235 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 16217 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 16217 T1235 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 16217 T1235 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 16218 T1235 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 16218 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 16225 T1235 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16247 T1235 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:55525/solr
[junit4:junit4] 2> 16248 T1235 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16248 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1feec2c
[junit4:junit4] 2> 16249 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16249 T1319 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16250 T1319 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 16250 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47840
[junit4:junit4] 2> 16250 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47840
[junit4:junit4] 2> 16251 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c6000b with negotiated timeout 20000 for client /127.0.0.1:47840
[junit4:junit4] 2> 16251 T1319 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c6000b, negotiated timeout = 20000
[junit4:junit4] 2> 16252 T1320 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1feec2c name:ZooKeeperConnection Watcher:127.0.0.1:55525 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16252 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16253 T1240 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a0505c6000b
[junit4:junit4] 2> 16253 T1320 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16253 T1237 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47840 which had sessionid 0x13d4a0505c6000b
[junit4:junit4] 2> 16253 T1235 oaz.ZooKeeper.close Session: 0x13d4a0505c6000b closed
[junit4:junit4] 2> 16254 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 16257 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@fe705e
[junit4:junit4] 2> 16258 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16258 T1321 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16258 T1321 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 16258 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47841
[junit4:junit4] 2> 16259 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47841
[junit4:junit4] 2> 16259 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c6000c with negotiated timeout 20000 for client /127.0.0.1:47841
[junit4:junit4] 2> 16259 T1321 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c6000c, negotiated timeout = 20000
[junit4:junit4] 2> 16260 T1322 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fe705e name:ZooKeeperConnection Watcher:127.0.0.1:55525/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16260 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16261 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c6000c type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16261 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c6000c type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16262 T1235 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 16901 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16902 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33615",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:33615_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 16905 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16906 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16905 T1322 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16906 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16906 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16906 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17128 T1269 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&core=collection1&action=PREPRECOVERY&coreNodeName=127.0.0.1:33615__collection1&checkLive=true&state=recovering&wt=javabin&onlyIfLeader=true&nodeName=127.0.0.1:33615_} status=0 QTime=1000
[junit4:junit4] 2> 17264 T1235 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42272_
[junit4:junit4] 2> 17265 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c6000c type:delete cxid:0xd zxid:0xa9 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42272_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42272_
[junit4:junit4] 2> 17265 T1235 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42272_
[junit4:junit4] 2> 17267 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17267 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17267 T1306 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17267 T1322 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17268 T1291 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17267 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17268 T1263 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17268 T1322 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17268 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17268 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17269 T1257 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17269 T1276 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17274 T1323 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362746492095/collection1
[junit4:junit4] 2> 17274 T1323 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17275 T1323 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17275 T1323 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17276 T1323 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362746492095/collection1/'
[junit4:junit4] 2> 17277 T1323 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362746492095/collection1/lib/README' to classloader
[junit4:junit4] 2> 17277 T1323 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362746492095/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17316 T1323 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 17358 T1323 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17359 T1323 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17363 T1323 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17807 T1323 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17813 T1323 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17815 T1323 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17824 T1323 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17827 T1323 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17829 T1323 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17830 T1323 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17830 T1323 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17831 T1323 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17831 T1323 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17832 T1323 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17832 T1323 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362746492095/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4/
[junit4:junit4] 2> 17832 T1323 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff01e
[junit4:junit4] 2> 17832 T1323 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 17833 T1323 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4 forceNew: false
[junit4:junit4] 2> 17833 T1323 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4/index/
[junit4:junit4] 2> 17833 T1323 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17834 T1323 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4/index forceNew: false
[junit4:junit4] 2> 17836 T1323 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12fc6f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17836 T1323 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17838 T1323 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17838 T1323 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17838 T1323 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17839 T1323 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17839 T1323 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17840 T1323 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17840 T1323 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17840 T1323 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17841 T1323 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17843 T1323 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17846 T1323 oass.SolrIndexSearcher.<init> Opening Searcher@2b05f6 main
[junit4:junit4] 2> 17847 T1323 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17847 T1323 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17851 T1324 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b05f6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17853 T1323 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 17853 T1323 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18410 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18411 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42272",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:42272_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 18411 T1258 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 18411 T1258 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 18414 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18414 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18414 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18414 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18414 T1322 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18414 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18854 T1323 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 18854 T1323 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:42272 collection:collection1 shard:shard2
[junit4:junit4] 2> 18858 T1323 oasc.ZkController.register We are http://127.0.0.1:42272/collection1/ and leader is http://127.0.0.1:54705/collection1/
[junit4:junit4] 2> 18858 T1323 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42272
[junit4:junit4] 2> 18858 T1323 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 18858 T1323 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C96 name=collection1 org.apache.solr.core.SolrCore@1b983fa url=http://127.0.0.1:42272/collection1 node=127.0.0.1:42272_ C96_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:42272, core=collection1, node_name=127.0.0.1:42272_, state=down, collection=collection1}
[junit4:junit4] 2> 18859 T1325 C96 P42272 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 18860 T1325 C96 P42272 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 18860 T1323 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18860 T1325 C96 P42272 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 18860 T1325 C96 P42272 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18861 T1235 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 18861 T1325 C96 P42272 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18861 T1235 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 18862 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18865 T1235 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18866 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18870 T1272 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/onenodecollectioncore
[junit4:junit4] 2> 18870 T1272 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 18871 T1272 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 18871 T1272 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 18872 T1272 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 18873 T1272 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 18874 T1272 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 18875 T1272 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/onenodecollectioncore/'
[junit4:junit4] 2> 18913 T1272 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 18958 T1272 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18960 T1272 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18964 T1272 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> C95_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:33615, core=collection1, shard=shard1, node_name=127.0.0.1:33615_, state=recovering, collection=collection1}
[junit4:junit4] 2> 19129 T1309 C95 P33615 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:44824/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19129 T1309 C95 P33615 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:33615 START replicas=[http://127.0.0.1:44824/collection1/] nUpdates=100
[junit4:junit4] 2> 19130 T1309 C95 P33615 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19131 T1309 C95 P33615 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19131 T1309 C95 P33615 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19131 T1309 C95 P33615 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19132 T1309 C95 P33615 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19132 T1309 C95 P33615 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:44824/collection1/. core=collection1
[junit4:junit4] 2> 19132 T1309 C95 P33615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C97 name=collection1 org.apache.solr.core.SolrCore@66c76e url=http://127.0.0.1:44824/collection1 node=127.0.0.1:44824_ C97_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:44824, core=collection1, shard=shard1, node_name=127.0.0.1:44824_, state=active, collection=collection1, leader=true}
[junit4:junit4] 2> 19137 T1270 C97 P44824 REQ /get {getVersions=100&version=2&distrib=false&qt=/get&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 19154 T1271 C97 P44824 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19156 T1271 C97 P44824 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@cee915; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19157 T1271 C97 P44824 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19165 T1271 C97 P44824 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@cee915; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@cee915; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19165 T1271 C97 P44824 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19166 T1271 C97 P44824 oass.SolrIndexSearcher.<init> Opening Searcher@1e11b83 realtime
[junit4:junit4] 2> 19166 T1271 C97 P44824 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19166 T1271 C97 P44824 /update {version=2&softCommit=false&waitSearcher=true&openSearcher=false&commit_end_point=true&wt=javabin&commit=true} {commit=} 0 12
[junit4:junit4] 2> 19168 T1309 C95 P33615 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19168 T1309 C95 P33615 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19173 T1270 C97 P44824 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19173 T1270 C97 P44824 REQ /replication {version=2&qt=/replication&command=indexversion&wt=javabin} status=0 QTime=4
[junit4:junit4] 2> 19174 T1309 C95 P33615 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19174 T1309 C95 P33615 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19174 T1309 C95 P33615 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19176 T1271 C97 P44824 REQ /replication {version=2&qt=/replication&command=filelist&generation=2&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 19176 T1309 C95 P33615 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19177 T1309 C95 P33615 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3/index.20130308114135145 forceNew: false
[junit4:junit4] 2> 19177 T1309 C95 P33615 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3/index.20130308114135145 lockFactory=org.apache.lucene.store.NativeFSLockFactory@8d12c4; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 19180 T1269 C97 P44824 REQ /replication {checksum=true&file=segments_2&qt=/replication&command=filecontent&generation=2&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 19181 T1309 C95 P33615 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19196 T1309 C95 P33615 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19196 T1309 C95 P33615 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19198 T1309 C95 P33615 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ae9c90; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ae9c90; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19199 T1309 C95 P33615 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19199 T1309 C95 P33615 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19200 T1309 C95 P33615 oass.SolrIndexSearcher.<init> Opening Searcher@104b8b1 main
[junit4:junit4] 2> 19201 T1308 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@104b8b1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19201 T1309 C95 P33615 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty3/index.20130308114135145 lockFactory=org.apache.lucene.store.NativeFSLockFactory@8d12c4; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4] 2> 19202 T1309 C95 P33615 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19203 T1309 C95 P33615 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19203 T1309 C95 P33615 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19203 T1309 C95 P33615 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19205 T1309 C95 P33615 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19426 T1272 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19437 T1272 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19440 T1272 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19449 T1272 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19453 T1272 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19456 T1272 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19457 T1272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19457 T1272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19457 T1272 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19458 T1272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19459 T1272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19459 T1272 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362746479350/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362746475972/onenodecollection/
[junit4:junit4] 2> 19459 T1272 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff01e
[junit4:junit4] 2> 19460 T1272 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 19460 T1272 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362746475972/onenodecollection forceNew: false
[junit4:junit4] 2> 19461 T1272 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362746475972/onenodecollection/index/
[junit4:junit4] 2> 19461 T1272 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362746475972/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19461 T1272 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362746475972/onenodecollection/index forceNew: false
[junit4:junit4] 2> 19486 T1272 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/solrtest-BasicDistributedZk2Test-1362746475972/onenodecollection/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e53f19; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19486 T1272 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19488 T1272 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19488 T1272 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19489 T1272 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19489 T1272 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19490 T1272 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19490 T1272 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19490 T1272 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19491 T1272 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19491 T1272 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19493 T1272 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19496 T1272 oass.SolrIndexSearcher.<init> Opening Searcher@e9623a main
[junit4:junit4] 2> 19497 T1272 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19497 T1272 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19501 T1328 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@e9623a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19501 T1272 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 19918 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19919 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42272",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:42272_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 19922 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33615",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:33615_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 19924 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44824",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:44824_",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"onenodecollection"}
[junit4:junit4] 2> 19925 T1258 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 19925 T1258 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 19928 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19928 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19928 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19928 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19928 T1322 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19928 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20503 T1272 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 20504 T1272 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:44824 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 20505 T1272 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 20510 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:delete cxid:0xa8 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 20511 T1272 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 20511 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:create cxid:0xa9 zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20513 T1272 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 20513 T1272 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 20513 T1272 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44824/onenodecollectioncore/
[junit4:junit4] 2> 20514 T1272 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 20514 T1272 oasc.SyncStrategy.syncToMe http://127.0.0.1:44824/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 20515 T1272 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44824/onenodecollectioncore/
[junit4:junit4] 2> 20515 T1272 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 20518 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:create cxid:0xb3 zxid:0xc9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20865 T1285 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&core=collection1&action=PREPRECOVERY&coreNodeName=127.0.0.1:42272__collection1&checkLive=true&state=recovering&wt=javabin&onlyIfLeader=true&nodeName=127.0.0.1:42272_} status=0 QTime=2000
[junit4:junit4] 2> 21434 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21595 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21595 T1322 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21595 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21595 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21595 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21595 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21622 T1272 oasc.ZkController.register We are http://127.0.0.1:44824/onenodecollectioncore/ and leader is http://127.0.0.1:44824/onenodecollectioncore/
[junit4:junit4] 2> 21622 T1272 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:44824
[junit4:junit4] 2> 21623 T1272 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 21623 T1272 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 21625 T1272 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21625 T1272 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&name=onenodecollectioncore&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362746475972/onenodecollection&action=CREATE&numShards=1&roles=none&wt=javabin&collection=onenodecollection} status=0 QTime=2755
[junit4:junit4] 2> 21626 T1235 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21627 T1235 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22628 T1235 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C96_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:42272, core=collection1, shard=shard2, node_name=127.0.0.1:42272_, state=recovering, collection=collection1}
[junit4:junit4] 2> 22866 T1325 C96 P42272 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:54705/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 22867 T1325 C96 P42272 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:42272 START replicas=[http://127.0.0.1:54705/collection1/] nUpdates=100
[junit4:junit4] 2> 22867 T1325 C96 P42272 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 22867 T1325 C96 P42272 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 22867 T1325 C96 P42272 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 22868 T1325 C96 P42272 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 22868 T1325 C96 P42272 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 22868 T1325 C96 P42272 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:54705/collection1/. core=collection1
[junit4:junit4] 2> 22868 T1325 C96 P42272 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C98 name=collection1 org.apache.solr.core.SolrCore@e3774e url=http://127.0.0.1:54705/collection1 node=127.0.0.1:54705_ C98_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:54705, core=collection1, shard=shard2, node_name=127.0.0.1:54705_, state=active, collection=collection1, leader=true}
[junit4:junit4] 2> 22877 T1286 C98 P54705 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22879 T1286 C98 P54705 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e2502; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22880 T1284 C98 P54705 REQ /get {getVersions=100&version=2&distrib=false&qt=/get&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 22880 T1286 C98 P54705 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22885 T1286 C98 P54705 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e2502; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e2502; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22885 T1286 C98 P54705 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22886 T1286 C98 P54705 oass.SolrIndexSearcher.<init> Opening Searcher@1019f70 realtime
[junit4:junit4] 2> 22886 T1286 C98 P54705 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22886 T1286 C98 P54705 /update {version=2&softCommit=false&waitSearcher=true&openSearcher=false&commit_end_point=true&wt=javabin&commit=true} {commit=} 0 9
[junit4:junit4] 2> 22887 T1325 C96 P42272 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22887 T1325 C96 P42272 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 22889 T1285 C98 P54705 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22889 T1285 C98 P54705 REQ /replication {version=2&qt=/replication&command=indexversion&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 22889 T1325 C96 P42272 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 22890 T1325 C96 P42272 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 22890 T1325 C96 P42272 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 22892 T1284 C98 P54705 REQ /replication {version=2&qt=/replication&command=filelist&generation=2&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 22892 T1325 C96 P42272 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 22893 T1325 C96 P42272 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4/index.20130308114138860 forceNew: false
[junit4:junit4] 2> 22893 T1325 C96 P42272 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4/index.20130308114138860 lockFactory=org.apache.lucene.store.NativeFSLockFactory@43534e; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 22895 T1286 C98 P54705 REQ /replication {checksum=true&file=segments_2&qt=/replication&command=filecontent&generation=2&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 22901 T1325 C96 P42272 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 22915 T1325 C96 P42272 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22916 T1325 C96 P42272 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22917 T1325 C96 P42272 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12fc6f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@12fc6f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22917 T1325 C96 P42272 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22918 T1325 C96 P42272 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 22918 T1325 C96 P42272 oass.SolrIndexSearcher.<init> Opening Searcher@d31e7 main
[junit4:junit4] 2> 22919 T1324 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d31e7 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22919 T1325 C96 P42272 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty4/index.20130308114138860 lockFactory=org.apache.lucene.store.NativeFSLockFactory@43534e; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4] 2> 22920 T1325 C96 P42272 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 22920 T1325 C96 P42272 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 22920 T1325 C96 P42272 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 22920 T1325 C96 P42272 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22922 T1325 C96 P42272 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23100 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23101 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44824",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:44824_",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"onenodecollection"}
[junit4:junit4] 2> 23103 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42272",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:42272_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 23125 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23125 T1263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23125 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23125 T1322 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23125 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23125 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23629 T1235 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23630 T1235 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 23630 T1235 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23635 T1284 oejs.Response.sendError WARNING Committed before 404 Can not find: /onenodecollectioncore/update
[junit4:junit4] 2> 23635 T1235 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:55525 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@b6e0c9
[junit4:junit4] 2> 23636 T1284 oejs.ServletHandler.doHandle WARNING /onenodecollectioncore/update java.lang.IllegalStateException: Committed
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.resetBuffer(Response.java:1136)
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.sendError(Response.java:314)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$Servlet404.service(JettySolrRunner.java:465)
[junit4:junit4] 2> at javax.servlet.http.HttpServlet.service(HttpServlet.java:770)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1336)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:379)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 23636 T1235 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 23636 T1331 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:55525. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 23637 T1331 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:55525, initiating session
[junit4:junit4] 2> 23637 T1237 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47854
[junit4:junit4] 2> 23637 T1237 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47854
[junit4:junit4] 2> 23639 T1239 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a0505c6000d with negotiated timeout 10000 for client /127.0.0.1:47854
[junit4:junit4] 2> 23639 T1331 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:55525, sessionid = 0x13d4a0505c6000d, negotiated timeout = 10000
[junit4:junit4] 2> 23639 T1332 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b6e0c9 name:ZooKeeperConnection Watcher:127.0.0.1:55525 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 23639 T1235 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 23672 T1240 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a0505c6000d
[junit4:junit4] 2> 23673 T1332 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 23673 T1237 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47854 which had sessionid 0x13d4a0505c6000d
[junit4:junit4] 2> 23673 T1235 oaz.ZooKeeper.close Session: 0x13d4a0505c6000d closed
[junit4:junit4] 2> 23674 T1240 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a0505c60004
[junit4:junit4] 2> 23674 T1263 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 23674 T1235 oaz.ZooKeeper.close Session: 0x13d4a0505c60004 closed
[junit4:junit4] 2> 23674 T1237 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47789 which had sessionid 0x13d4a0505c60004
[junit4:junit4] 2> 23677 T1235 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 35875
[junit4:junit4] 2> 23677 T1235 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=6226171
[junit4:junit4] 2> 24630 T1258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24631 T1258 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35875",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:35875__collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "node_name":"127.0.0.1:35875_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"control_collection"}
[junit4:junit4] 2> 24745 T1322 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24745 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24745 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24745 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24745 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26680 T1235 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@17e634d
[junit4:junit4] 2> 26684 T1235 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 26684 T1235 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 26685 T1235 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 26685 T1235 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 26685 T1235 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 26686 T1235 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/control/data
[junit4:junit4] 2> 26686 T1235 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/control/data
[junit4:junit4] 2> 26687 T1235 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/control/data/index
[junit4:junit4] 2> 26687 T1235 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/control/data/index
[junit4:junit4] 2> 26688 T1258 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89308953049432067-127.0.0.1:35875_-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 26688 T1240 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a0505c60003
[junit4:junit4] 2> 26690 T1237 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47784 which had sessionid 0x13d4a0505c60003
[junit4:junit4] 2> 26690 T1235 oaz.ZooKeeper.close Session: 0x13d4a0505c60003 closed
[junit4:junit4] 2> 26691 T1276 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 26691 T1291 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 26691 T1322 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 26691 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 26692 T1306 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 26691 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 26692 T1322 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 26692 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 26693 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:delete cxid:0xc3 zxid:0xe4 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 26694 T1276 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 26695 T1276 oasc.Overseer.start Overseer (id=89308953049432070-127.0.0.1:44824_-n_0000000001) starting
[junit4:junit4] 2> 26695 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:create cxid:0xc8 zxid:0xe6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26696 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:create cxid:0xc9 zxid:0xe7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26697 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:create cxid:0xca zxid:0xe8 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26698 T1240 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a0505c60006 type:create cxid:0xcb zxid:0xe9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 26698 T1334 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 26699 T1333 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 26712 T1235 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 26765 T1235 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 44824
[junit4:junit4] 2> 26765 T1235 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=10724263
[junit4:junit4] 2> 27990 T1257 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27990 T1257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 27990 T1257 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27991 T1257 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 28201 T1333 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 28202 T1333 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44824",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:44824__onenodecollectioncore",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "node_name":"127.0.0.1:44824_",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"onenodecollection"}
[junit4:junit4] 2> 28205 T1333 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44824",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:44824__collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "node_name":"127.0.0.1:44824_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 28225 T1291 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 28225 T1276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 28225 T1322 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 28225 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 29767 T1235 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@66c76e
[junit4:junit4] 2> 29773 T1235 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 29773 T1235 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 29773 T1235 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 29774 T1235 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 29775 T1235 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 29776 T1235 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1
[junit4:junit4] 2> 29776 T1235 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1
[junit4:junit4] 2> 29777 T1235 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1/index
[junit4:junit4] 2> 29777 T1235 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362746475971/jetty1/index
[junit4:junit4] 2> 29778 T1235 oasc.SolrCore.close [onenodecollectioncore] CLOSING SolrCore org.apache.solr.core.SolrCore@11a1662
[junit4:junit4] 2> 29785 T1235 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 29786 T1235 oasu.SolrCoreState.decrefSolrCoreState C
[...truncated too long message...]
rg.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:85)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 33190 T1235 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 33195 T1234 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 33277 T1306 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 33277 T1306 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 33277 T1306 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 33278 T1306 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 34032 T1238 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 34371 T1322 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 34372 T1322 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 34372 T1322 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 34372 T1322 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ar_EG, timezone=Atlantic/Azores
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=71038232,total=171823104
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestJmxIntegration, RequiredFieldsTest, FieldMutatingUpdateProcessorTest, TestOmitPositions, TestIndexingPerformance, TestXIncludeConfig, ResourceLoaderTest, SolrRequestParserTest, TestLFUCache, TestIBSimilarityFactory, ConvertedLegacyTest, TestQueryTypes, RequestHandlersTest, IndexSchemaRuntimeFieldTest, TestLRUCache, CircularListTest, SolrPluginUtilsTest, TestCSVResponseWriter, TestDynamicFieldResource, StatsComponentTest, QueryEqualityTest, LeaderElectionIntegrationTest, ZkControllerTest, DirectSolrConnectionTest, JSONWriterTest, MinimalSchemaTest, TestFastWriter, TestSolrDeletionPolicy1, ResponseLogComponentTest, TestSolrCoreProperties, CSVRequestHandlerTest, SuggesterTSTTest, TestFunctionQuery, TestWriterPerf, TestPHPSerializedResponseWriter, TestAnalyzedSuggestions, UUIDFieldTest, LegacyHTMLStripCharFilterTest, TestHashPartitioner, PolyFieldTest, ScriptEngineTest, TestRemoteStreaming, TestFastLRUCache, TestDistributedGrouping, TestLMDirichletSimilarityFactory, TestDynamicFieldCollectionResource, SpatialFilterTest, FieldAnalysisRequestHandlerTest, TestExtendedDismaxParser, TestQuerySenderListener, RecoveryZkTest, PluginInfoTest, TestFiltering, TestFieldTypeCollectionResource, BasicDistributedZkTest, SchemaVersionSpecificBehaviorTest, SpellCheckCollatorTest, PrimUtilsTest, BadComponentTest, DistributedSpellCheckComponentTest, SystemInfoHandlerTest, AnalysisAfterCoreReloadTest, CurrencyFieldOpenExchangeTest, ZkSolrClientTest, SolrIndexSplitterTest, SOLR749Test, BasicDistributedZk2Test]
[junit4:junit4] Completed on J0 in 34.48s, 1 test, 1 error <<< FAILURES!
[...truncated 440 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 268 suites, 1130 tests, 1 error, 9 ignored (3 assumptions)
Total time: 42 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b79) - Build #
4595 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4595/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseConcMarkSweepGC
2 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:60615/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:60615/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([4A042BA04CD5AB10:CBE2A5B83B8ACB2C]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:85)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([4A042BA04CD5AB10:CBE2A5B83B8ACB2C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9248 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 1 T1442 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 5 T1442 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362762310587
[junit4:junit4] 2> 6 T1442 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 7 T1443 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 9 T1443 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 9 T1443 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 10 T1443 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 10 T1443 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 12 T1443 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 107 T1442 oasc.ZkTestServer.run start zk server on port:56131
[junit4:junit4] 2> 107 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4db46d22
[junit4:junit4] 2> 108 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 111 T1448 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 112 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48920
[junit4:junit4] 2> 112 T1448 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 112 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48920
[junit4:junit4] 2> 113 T1446 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 902 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c10000 with negotiated timeout 10000 for client /127.0.0.1:48920
[junit4:junit4] 2> 902 T1448 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c10000, negotiated timeout = 10000
[junit4:junit4] 2> 903 T1449 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4db46d22 name:ZooKeeperConnection Watcher:127.0.0.1:56131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 903 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 903 T1442 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 909 T1447 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4af6a3c10000
[junit4:junit4] 2> 910 T1449 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 910 T1442 oaz.ZooKeeper.close Session: 0x13d4af6a3c10000 closed
[junit4:junit4] 2> 912 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@43739ae4
[junit4:junit4] 2> 911 T1444 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48920 which had sessionid 0x13d4af6a3c10000
[junit4:junit4] 2> 912 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 913 T1450 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 914 T1450 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 914 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48921
[junit4:junit4] 2> 914 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48921
[junit4:junit4] 2> 915 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c10001 with negotiated timeout 10000 for client /127.0.0.1:48921
[junit4:junit4] 2> 915 T1450 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c10001, negotiated timeout = 10000
[junit4:junit4] 2> 916 T1451 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43739ae4 name:ZooKeeperConnection Watcher:127.0.0.1:56131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 916 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 916 T1442 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 919 T1442 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 925 T1442 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 933 T1442 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 942 T1442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 943 T1442 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 950 T1442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 951 T1442 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 955 T1442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 956 T1442 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 959 T1442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 959 T1442 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 961 T1442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 962 T1442 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 966 T1442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 967 T1442 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 969 T1442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 970 T1442 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 980 T1442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 981 T1442 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 985 T1442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 986 T1442 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 990 T1447 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4af6a3c10001
[junit4:junit4] 2> 991 T1444 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48921 which had sessionid 0x13d4af6a3c10001
[junit4:junit4] 2> 991 T1451 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 991 T1442 oaz.ZooKeeper.close Session: 0x13d4af6a3c10001 closed
[junit4:junit4] 2> 1084 T1442 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 1105 T1442 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35213
[junit4:junit4] 2> 1110 T1442 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1111 T1442 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1111 T1442 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362762311573
[junit4:junit4] 2> 1112 T1442 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362762311573/solr.xml
[junit4:junit4] 2> 1112 T1442 oasc.CoreContainer.<init> New CoreContainer 1738502269
[junit4:junit4] 2> 1113 T1442 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362762311573/'
[junit4:junit4] 2> 1113 T1442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362762311573/'
[junit4:junit4] 2> 1132 T1442 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1132 T1442 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1133 T1442 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1133 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1134 T1442 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1134 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1134 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1135 T1442 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1135 T1442 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1135 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1144 T1442 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 1157 T1442 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56131/solr
[junit4:junit4] 2> 1158 T1442 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1159 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4b98e7eb
[junit4:junit4] 2> 1160 T1462 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1160 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1160 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48922
[junit4:junit4] 2> 1160 T1462 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 1161 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48922
[junit4:junit4] 2> 1161 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c10002 with negotiated timeout 20000 for client /127.0.0.1:48922
[junit4:junit4] 2> 1162 T1462 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c10002, negotiated timeout = 20000
[junit4:junit4] 2> 1162 T1463 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b98e7eb name:ZooKeeperConnection Watcher:127.0.0.1:56131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1162 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1163 T1447 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4af6a3c10002
[junit4:junit4] 2> 1164 T1444 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48922 which had sessionid 0x13d4af6a3c10002
[junit4:junit4] 2> 1164 T1463 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1164 T1442 oaz.ZooKeeper.close Session: 0x13d4af6a3c10002 closed
[junit4:junit4] 2> 1165 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1168 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@31aaba4a
[junit4:junit4] 2> 1169 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1170 T1464 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1170 T1464 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 1170 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48923
[junit4:junit4] 2> 1171 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48923
[junit4:junit4] 2> 1172 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c10003 with negotiated timeout 20000 for client /127.0.0.1:48923
[junit4:junit4] 2> 1173 T1464 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c10003, negotiated timeout = 20000
[junit4:junit4] 2> 1173 T1465 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31aaba4a name:ZooKeeperConnection Watcher:127.0.0.1:56131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1173 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1175 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1176 T1442 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1178 T1442 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35213_
[junit4:junit4] 2> 1179 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35213_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35213_
[junit4:junit4] 2> 1179 T1442 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35213_
[junit4:junit4] 2> 1182 T1442 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1186 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 1187 T1442 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1190 T1442 oasc.Overseer.start Overseer (id=89309990787022851-127.0.0.1:35213_-n_0000000000) starting
[junit4:junit4] 2> 1190 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1191 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1192 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1192 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1193 T1467 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1193 T1442 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1199 T1442 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1201 T1442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1203 T1466 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1207 T1468 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362762311573/collection1
[junit4:junit4] 2> 1207 T1468 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1208 T1468 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1208 T1468 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1210 T1468 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362762311573/collection1/'
[junit4:junit4] 2> 1211 T1468 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362762311573/collection1/lib/README' to classloader
[junit4:junit4] 2> 1211 T1468 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362762311573/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1251 T1468 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 1280 T1468 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1281 T1468 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1285 T1468 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1684 T1468 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1693 T1468 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1696 T1468 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1709 T1468 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1713 T1468 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1725 T1468 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1726 T1468 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1727 T1468 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1727 T1468 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1728 T1468 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1728 T1468 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1728 T1468 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362762311573/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/control/data/
[junit4:junit4] 2> 1729 T1468 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c76976
[junit4:junit4] 2> 1729 T1468 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 1730 T1468 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/control/data forceNew: false
[junit4:junit4] 2> 1730 T1468 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/control/data/index/
[junit4:junit4] 2> 1732 T1468 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1733 T1468 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/control/data/index forceNew: false
[junit4:junit4] 2> 1737 T1468 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/control/data/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1738 T1468 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1740 T1468 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1740 T1468 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1741 T1468 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1741 T1468 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1742 T1468 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1742 T1468 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1743 T1468 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1743 T1468 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1747 T1468 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1750 T1468 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1752 T1468 oass.SolrIndexSearcher.<init> Opening Searcher@5d44c10b main
[junit4:junit4] 2> 1753 T1468 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1753 T1468 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1756 T1469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5d44c10b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1756 T1468 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1757 T1468 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1757 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2706 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2707 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:35213_",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35213",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"1"}
[junit4:junit4] 2> 2707 T1466 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2708 T1466 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2708 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2716 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2761 T1468 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2761 T1468 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35213 collection:control_collection shard:shard1
[junit4:junit4] 2> 2762 T1468 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2770 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2770 T1468 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2771 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2773 T1468 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2773 T1468 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2773 T1468 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35213/collection1/
[junit4:junit4] 2> 2774 T1468 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2774 T1468 oasc.SyncStrategy.syncToMe http://127.0.0.1:35213/collection1/ has no replicas
[junit4:junit4] 2> 2774 T1468 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35213/collection1/
[junit4:junit4] 2> 2774 T1468 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2779 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4224 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4247 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4294 T1468 oasc.ZkController.register We are http://127.0.0.1:35213/collection1/ and leader is http://127.0.0.1:35213/collection1/
[junit4:junit4] 2> 4294 T1468 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35213
[junit4:junit4] 2> 4294 T1468 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 4294 T1468 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 4294 T1468 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 4296 T1468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4297 T1442 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 4297 T1442 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4298 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4302 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 4303 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@20e2331
[junit4:junit4] 2> 4304 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4305 T1470 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4306 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48925
[junit4:junit4] 2> 4307 T1470 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 4307 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48925
[junit4:junit4] 2> 4308 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c10004 with negotiated timeout 10000 for client /127.0.0.1:48925
[junit4:junit4] 2> 4309 T1470 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c10004, negotiated timeout = 10000
[junit4:junit4] 2> 4310 T1471 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20e2331 name:ZooKeeperConnection Watcher:127.0.0.1:56131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4310 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4330 T1442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4333 T1442 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4446 T1442 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4466 T1442 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41095
[junit4:junit4] 2> 4467 T1442 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4468 T1442 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4468 T1442 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914
[junit4:junit4] 2> 4469 T1442 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/solr.xml
[junit4:junit4] 2> 4469 T1442 oasc.CoreContainer.<init> New CoreContainer 1591680149
[junit4:junit4] 2> 4470 T1442 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/'
[junit4:junit4] 2> 4470 T1442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/'
[junit4:junit4] 2> 4497 T1442 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4498 T1442 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4498 T1442 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4499 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4499 T1442 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4500 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4500 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4501 T1442 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4501 T1442 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4506 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4516 T1442 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4531 T1442 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56131/solr
[junit4:junit4] 2> 4532 T1442 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4532 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5e95ee18
[junit4:junit4] 2> 4533 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4533 T1483 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4534 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48926
[junit4:junit4] 2> 4534 T1483 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 4535 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48926
[junit4:junit4] 2> 4536 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c10005 with negotiated timeout 20000 for client /127.0.0.1:48926
[junit4:junit4] 2> 4536 T1483 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c10005, negotiated timeout = 20000
[junit4:junit4] 2> 4537 T1484 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e95ee18 name:ZooKeeperConnection Watcher:127.0.0.1:56131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4537 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4650 T1447 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4af6a3c10005
[junit4:junit4] 2> 4651 T1444 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48926 which had sessionid 0x13d4af6a3c10005
[junit4:junit4] 2> 4651 T1484 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4651 T1442 oaz.ZooKeeper.close Session: 0x13d4af6a3c10005 closed
[junit4:junit4] 2> 4652 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4656 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@54cdb688
[junit4:junit4] 2> 4666 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4672 T1485 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4673 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48927
[junit4:junit4] 2> 4673 T1485 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 4674 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48927
[junit4:junit4] 2> 4675 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c10006 with negotiated timeout 20000 for client /127.0.0.1:48927
[junit4:junit4] 2> 4675 T1485 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c10006, negotiated timeout = 20000
[junit4:junit4] 2> 4676 T1486 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54cdb688 name:ZooKeeperConnection Watcher:127.0.0.1:56131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4676 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4677 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4678 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4680 T1442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5685 T1442 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41095_
[junit4:junit4] 2> 5686 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41095_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41095_
[junit4:junit4] 2> 5686 T1442 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41095_
[junit4:junit4] 2> 5688 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5694 T1471 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5695 T1465 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5696 T1486 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5702 T1487 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/collection1
[junit4:junit4] 2> 5702 T1487 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5713 T1487 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5713 T1487 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5717 T1487 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/collection1/'
[junit4:junit4] 2> 5717 T1487 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/collection1/lib/README' to classloader
[junit4:junit4] 2> 5718 T1487 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5752 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5753 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:35213_",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35213",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"1"}
[junit4:junit4] 2> 5757 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5757 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5757 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5781 T1487 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 5824 T1487 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5825 T1487 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5830 T1487 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6339 T1487 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6349 T1487 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6352 T1487 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6376 T1487 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6380 T1487 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6384 T1487 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6385 T1487 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6385 T1487 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6385 T1487 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6386 T1487 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6387 T1487 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6387 T1487 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty1/
[junit4:junit4] 2> 6387 T1487 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c76976
[junit4:junit4] 2> 6388 T1487 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 6388 T1487 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty1 forceNew: false
[junit4:junit4] 2> 6389 T1487 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty1/index/
[junit4:junit4] 2> 6389 T1487 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6389 T1487 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty1/index forceNew: false
[junit4:junit4] 2> 6393 T1487 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6393 T1487 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6395 T1487 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6396 T1487 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6396 T1487 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6397 T1487 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6397 T1487 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6397 T1487 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6398 T1487 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6398 T1487 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6398 T1487 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6402 T1487 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6411 T1487 oass.SolrIndexSearcher.<init> Opening Searcher@36e6fe0e main
[junit4:junit4] 2> 6412 T1487 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6412 T1487 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6416 T1487 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6417 T1487 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6418 T1488 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@36e6fe0e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 7261 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7262 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:41095_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41095",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"2"}
[junit4:junit4] 2> 7262 T1466 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 7263 T1466 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 7268 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7268 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7268 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7419 T1487 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7419 T1487 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41095 collection:collection1 shard:shard2
[junit4:junit4] 2> 7420 T1487 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 7429 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7429 T1487 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7430 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7436 T1487 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7436 T1487 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7436 T1487 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41095/collection1/
[junit4:junit4] 2> 7437 T1487 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7437 T1487 oasc.SyncStrategy.syncToMe http://127.0.0.1:41095/collection1/ has no replicas
[junit4:junit4] 2> 7437 T1487 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41095/collection1/
[junit4:junit4] 2> 7437 T1487 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 7441 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8773 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8794 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8795 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8795 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8797 T1487 oasc.ZkController.register We are http://127.0.0.1:41095/collection1/ and leader is http://127.0.0.1:41095/collection1/
[junit4:junit4] 2> 8797 T1487 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41095
[junit4:junit4] 2> 8797 T1487 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8797 T1487 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8797 T1487 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8799 T1487 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8800 T1442 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8801 T1442 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8801 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8898 T1442 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8901 T1442 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60615
[junit4:junit4] 2> 8902 T1442 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8903 T1442 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8903 T1442 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362762319386
[junit4:junit4] 2> 8903 T1442 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362762319386/solr.xml
[junit4:junit4] 2> 8904 T1442 oasc.CoreContainer.<init> New CoreContainer 1062327232
[junit4:junit4] 2> 8904 T1442 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362762319386/'
[junit4:junit4] 2> 8905 T1442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362762319386/'
[junit4:junit4] 2> 8952 T1442 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8953 T1442 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8953 T1442 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8953 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8954 T1442 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8954 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8955 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8956 T1442 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8956 T1442 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8957 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8966 T1442 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8979 T1442 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56131/solr
[junit4:junit4] 2> 8980 T1442 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8980 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d2b79bc
[junit4:junit4] 2> 8984 T1498 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8984 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8985 T1498 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 8985 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48928
[junit4:junit4] 2> 8985 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48928
[junit4:junit4] 2> 8986 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c10007 with negotiated timeout 20000 for client /127.0.0.1:48928
[junit4:junit4] 2> 8986 T1498 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c10007, negotiated timeout = 20000
[junit4:junit4] 2> 8987 T1499 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d2b79bc name:ZooKeeperConnection Watcher:127.0.0.1:56131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8987 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8990 T1447 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4af6a3c10007
[junit4:junit4] 2> 8991 T1444 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48928 which had sessionid 0x13d4af6a3c10007
[junit4:junit4] 2> 8990 T1442 oaz.ZooKeeper.close Session: 0x13d4af6a3c10007 closed
[junit4:junit4] 2> 8991 T1499 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8991 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8995 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@61a3edd0
[junit4:junit4] 2> 8997 T1500 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8997 T1500 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 8997 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48929
[junit4:junit4] 2> 8998 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48929
[junit4:junit4] 2> 8997 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8999 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c10008 with negotiated timeout 20000 for client /127.0.0.1:48929
[junit4:junit4] 2> 8999 T1500 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c10008, negotiated timeout = 20000
[junit4:junit4] 2> 8999 T1501 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61a3edd0 name:ZooKeeperConnection Watcher:127.0.0.1:56131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8999 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 9000 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9001 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9003 T1442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10012 T1442 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60615_
[junit4:junit4] 2> 10013 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60615_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60615_
[junit4:junit4] 2> 10014 T1442 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60615_
[junit4:junit4] 2> 10016 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10016 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10017 T1501 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10017 T1465 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10018 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10019 T1471 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10019 T1486 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10023 T1502 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362762319386/collection1
[junit4:junit4] 2> 10023 T1502 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 10023 T1502 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 10024 T1502 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 10024 T1502 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362762319386/collection1/'
[junit4:junit4] 2> 10025 T1502 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362762319386/collection1/lib/README' to classloader
[junit4:junit4] 2> 10025 T1502 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362762319386/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 10056 T1502 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 10102 T1502 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10110 T1502 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10117 T1502 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10307 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10308 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:41095_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41095",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"2"}
[junit4:junit4] 2> 10312 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10312 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10312 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10312 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10652 T1502 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10659 T1502 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10661 T1502 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10685 T1502 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10690 T1502 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10696 T1502 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10697 T1502 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10698 T1502 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10698 T1502 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10710 T1502 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10711 T1502 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10711 T1502 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362762319386/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty2/
[junit4:junit4] 2> 10711 T1502 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c76976
[junit4:junit4] 2> 10712 T1502 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 10712 T1502 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty2 forceNew: false
[junit4:junit4] 2> 10713 T1502 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty2/index/
[junit4:junit4] 2> 10713 T1502 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10714 T1502 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty2/index forceNew: false
[junit4:junit4] 2> 10718 T1502 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10718 T1502 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10723 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10724 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10724 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10725 T1502 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10726 T1502 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10726 T1502 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10726 T1502 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10727 T1502 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10727 T1502 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10731 T1502 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10736 T1502 oass.SolrIndexSearcher.<init> Opening Searcher@11a1503e main
[junit4:junit4] 2> 10737 T1502 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10737 T1502 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10742 T1503 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11a1503e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10744 T1502 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10744 T1502 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11820 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11821 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:60615_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60615",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"2"}
[junit4:junit4] 2> 11821 T1466 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11821 T1466 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11826 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11826 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11826 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11826 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12747 T1502 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 12747 T1502 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60615 collection:collection1 shard:shard1
[junit4:junit4] 2> 12748 T1502 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 12769 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4] 2> 12769 T1502 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 12770 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12771 T1502 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 12771 T1502 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 12771 T1502 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60615/collection1/
[junit4:junit4] 2> 12771 T1502 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 12772 T1502 oasc.SyncStrategy.syncToMe http://127.0.0.1:60615/collection1/ has no replicas
[junit4:junit4] 2> 12772 T1502 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60615/collection1/
[junit4:junit4] 2> 12772 T1502 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 12776 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13332 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13340 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13341 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13340 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13341 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13382 T1502 oasc.ZkController.register We are http://127.0.0.1:60615/collection1/ and leader is http://127.0.0.1:60615/collection1/
[junit4:junit4] 2> 13382 T1502 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60615
[junit4:junit4] 2> 13382 T1502 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 13383 T1502 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 13383 T1502 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13385 T1502 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13386 T1442 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 13387 T1442 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 13387 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 13501 T1442 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 13539 T1442 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35271
[junit4:junit4] 2> 13540 T1442 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 13540 T1442 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 13541 T1442 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362762323973
[junit4:junit4] 2> 13541 T1442 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362762323973/solr.xml
[junit4:junit4] 2> 13542 T1442 oasc.CoreContainer.<init> New CoreContainer 1966634438
[junit4:junit4] 2> 13542 T1442 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362762323973/'
[junit4:junit4] 2> 13543 T1442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362762323973/'
[junit4:junit4] 2> 13568 T1442 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 13569 T1442 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 13569 T1442 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 13570 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 13570 T1442 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 13571 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 13571 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 13571 T1442 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 13572 T1442 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 13572 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 13581 T1442 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 13612 T1442 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56131/solr
[junit4:junit4] 2> 13613 T1442 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 13613 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6350c64c
[junit4:junit4] 2> 13618 T1513 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 13618 T1513 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 13618 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48932
[junit4:junit4] 2> 13619 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48932
[junit4:junit4] 2> 13619 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13620 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c10009 with negotiated timeout 20000 for client /127.0.0.1:48932
[junit4:junit4] 2> 13620 T1513 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c10009, negotiated timeout = 20000
[junit4:junit4] 2> 13621 T1514 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6350c64c name:ZooKeeperConnection Watcher:127.0.0.1:56131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13621 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13624 T1447 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4af6a3c10009
[junit4:junit4] 2> 13625 T1444 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48932 which had sessionid 0x13d4af6a3c10009
[junit4:junit4] 2> 13625 T1442 oaz.ZooKeeper.close Session: 0x13d4af6a3c10009 closed
[junit4:junit4] 2> 13626 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 13629 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@16f45782
[junit4:junit4] 2> 13630 T1514 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 13631 T1515 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 13632 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48933
[junit4:junit4] 2> 13632 T1515 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 13633 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48933
[junit4:junit4] 2> 13633 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c1000a with negotiated timeout 20000 for client /127.0.0.1:48933
[junit4:junit4] 2> 13634 T1515 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c1000a, negotiated timeout = 20000
[junit4:junit4] 2> 13650 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13651 T1516 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16f45782 name:ZooKeeperConnection Watcher:127.0.0.1:56131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13651 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13652 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c1000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13654 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c1000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13655 T1442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14659 T1442 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35271_
[junit4:junit4] 2> 14659 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c1000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35271_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35271_
[junit4:junit4] 2> 14660 T1442 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35271_
[junit4:junit4] 2> 14662 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14662 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14663 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14664 T1465 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14664 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14665 T1516 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14665 T1486 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14666 T1501 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14666 T1471 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14674 T1517 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362762323973/collection1
[junit4:junit4] 2> 14674 T1517 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14680 T1517 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14681 T1517 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14682 T1517 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362762323973/collection1/'
[junit4:junit4] 2> 14683 T1517 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362762323973/collection1/lib/README' to classloader
[junit4:junit4] 2> 14684 T1517 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362762323973/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14732 T1517 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 14793 T1517 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14795 T1517 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14798 T1517 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 14848 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14849 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:60615_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60615",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"2"}
[junit4:junit4] 2> 14868 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14868 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14868 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14868 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14868 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15320 T1517 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15329 T1517 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15333 T1517 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15349 T1517 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15355 T1517 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15362 T1517 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15364 T1517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15364 T1517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15364 T1517 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15365 T1517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15365 T1517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15366 T1517 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362762323973/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3/
[junit4:junit4] 2> 15366 T1517 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c76976
[junit4:junit4] 2> 15366 T1517 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 15367 T1517 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3 forceNew: false
[junit4:junit4] 2> 15367 T1517 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3/index/
[junit4:junit4] 2> 15367 T1517 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15368 T1517 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3/index forceNew: false
[junit4:junit4] 2> 15371 T1517 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15372 T1517 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15374 T1517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15375 T1517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15375 T1517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15376 T1517 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15376 T1517 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15377 T1517 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15377 T1517 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15378 T1517 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15378 T1517 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15381 T1517 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15384 T1517 oass.SolrIndexSearcher.<init> Opening Searcher@557f1d4f main
[junit4:junit4] 2> 15384 T1517 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15384 T1517 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15388 T1518 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@557f1d4f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15392 T1517 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15392 T1517 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16379 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16380 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:35271_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35271",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"2"}
[junit4:junit4] 2> 16380 T1466 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 16380 T1466 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 16384 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16384 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16384 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16384 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16384 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16394 T1517 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16395 T1517 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35271 collection:collection1 shard:shard2
[junit4:junit4] 2> 16399 T1517 oasc.ZkController.register We are http://127.0.0.1:35271/collection1/ and leader is http://127.0.0.1:41095/collection1/
[junit4:junit4] 2> 16399 T1517 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35271
[junit4:junit4] 2> 16399 T1517 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16400 T1517 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C109 name=collection1 org.apache.solr.core.SolrCore@363da19f url=http://127.0.0.1:35271/collection1 node=127.0.0.1:35271_ C109_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:35271_, collection=collection1, core=collection1, base_url=http://127.0.0.1:35271, state=down}
[junit4:junit4] 2> 16403 T1519 C109 P35271 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16403 T1519 C109 P35271 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16403 T1519 C109 P35271 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16403 T1517 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16403 T1519 C109 P35271 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16404 T1442 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 16405 T1442 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16406 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16413 T1519 C109 P35271 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16503 T1442 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16509 T1442 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58606
[junit4:junit4] 2> 16510 T1442 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16514 T1442 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16515 T1442 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362762326989
[junit4:junit4] 2> 16515 T1442 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362762326989/solr.xml
[junit4:junit4] 2> 16516 T1442 oasc.CoreContainer.<init> New CoreContainer 340628315
[junit4:junit4] 2> 16516 T1442 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362762326989/'
[junit4:junit4] 2> 16517 T1442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362762326989/'
[junit4:junit4] 2> 16544 T1442 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 16545 T1442 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 16545 T1442 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 16546 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 16546 T1442 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 16547 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 16547 T1442 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 16547 T1442 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 16548 T1442 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 16548 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 16557 T1442 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16570 T1442 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56131/solr
[junit4:junit4] 2> 16571 T1442 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16571 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@489df485
[junit4:junit4] 2> 16572 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16573 T1529 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16573 T1529 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 16573 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48936
[junit4:junit4] 2> 16574 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48936
[junit4:junit4] 2> 16575 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c1000b with negotiated timeout 20000 for client /127.0.0.1:48936
[junit4:junit4] 2> 16575 T1529 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c1000b, negotiated timeout = 20000
[junit4:junit4] 2> 16577 T1530 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@489df485 name:ZooKeeperConnection Watcher:127.0.0.1:56131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16577 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16579 T1447 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4af6a3c1000b
[junit4:junit4] 2> 16580 T1444 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48936 which had sessionid 0x13d4af6a3c1000b
[junit4:junit4] 2> 16580 T1530 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16580 T1442 oaz.ZooKeeper.close Session: 0x13d4af6a3c1000b closed
[junit4:junit4] 2> 16581 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 16584 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@469ae8c9
[junit4:junit4] 2> 16586 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16589 T1531 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16589 T1531 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 16589 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48937
[junit4:junit4] 2> 16589 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48937
[junit4:junit4] 2> 16590 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c1000c with negotiated timeout 20000 for client /127.0.0.1:48937
[junit4:junit4] 2> 16590 T1531 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c1000c, negotiated timeout = 20000
[junit4:junit4] 2> 16591 T1532 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@469ae8c9 name:ZooKeeperConnection Watcher:127.0.0.1:56131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16591 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16592 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c1000c type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16593 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c1000c type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16597 T1442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17604 T1442 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58606_
[junit4:junit4] 2> 17605 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c1000c type:delete cxid:0xb zxid:0xa5 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58606_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58606_
[junit4:junit4] 2> 17615 T1442 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58606_
[junit4:junit4] 2> 17621 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17621 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17622 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17623 T1516 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17623 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17623 T1501 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17623 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17624 T1532 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17625 T1471 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17625 T1465 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17625 T1486 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17632 T1533 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362762326989/collection1
[junit4:junit4] 2> 17634 T1533 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17635 T1533 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17635 T1533 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17636 T1533 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362762326989/collection1/'
[junit4:junit4] 2> 17637 T1533 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362762326989/collection1/lib/README' to classloader
[junit4:junit4] 2> 17637 T1533 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362762326989/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17676 T1533 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 17734 T1533 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17737 T1533 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17743 T1533 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17897 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17897 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:35271_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35271",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "numShards":"2"}
[junit4:junit4] 2> 17902 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17902 T1532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17902 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17902 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17902 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17902 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18221 T1533 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 18228 T1533 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 18231 T1533 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 18272 T1533 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 18277 T1533 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 18282 T1533 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 18283 T1533 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 18283 T1533 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 18284 T1533 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 18285 T1533 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 18285 T1533 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 18285 T1533 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362762326989/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4/
[junit4:junit4] 2> 18286 T1533 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c76976
[junit4:junit4] 2> 18286 T1533 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 18287 T1533 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4 forceNew: false
[junit4:junit4] 2> 18287 T1533 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4/index/
[junit4:junit4] 2> 18288 T1533 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 18288 T1533 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4/index forceNew: false
[junit4:junit4] 2> 18292 T1533 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 18292 T1533 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 18294 T1533 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 18295 T1533 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 18295 T1533 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 18296 T1533 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 18297 T1533 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 18297 T1533 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 18297 T1533 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 18298 T1533 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 18298 T1533 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 18302 T1533 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 18319 T1533 oass.SolrIndexSearcher.<init> Opening Searcher@43bc7f7d main
[junit4:junit4] 2> 18320 T1533 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 18320 T1533 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 18325 T1534 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@43bc7f7d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 18327 T1533 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 18327 T1533 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18422 T1477 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {onlyIfLeader=true&checkLive=true&wt=javabin&coreNodeName=127.0.0.1:35271__collection1&version=2&nodeName=127.0.0.1:35271_&core=collection1&state=recovering&action=PREPRECOVERY} status=0 QTime=2000
[junit4:junit4] 2> 19416 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19417 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:58606_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58606",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"2"}
[junit4:junit4] 2> 19417 T1466 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 19417 T1466 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 19421 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19421 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19422 T1532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19422 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19422 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19424 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20329 T1533 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 20330 T1533 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58606 collection:collection1 shard:shard1
[junit4:junit4] 2> 20336 T1533 oasc.ZkController.register We are http://127.0.0.1:58606/collection1/ and leader is http://127.0.0.1:60615/collection1/
[junit4:junit4] 2> 20336 T1533 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58606
[junit4:junit4] 2> 20336 T1533 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 20336 T1533 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C110 name=collection1 org.apache.solr.core.SolrCore@3e86617e url=http://127.0.0.1:58606/collection1 node=127.0.0.1:58606_ C110_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:58606_, collection=collection1, core=collection1, base_url=http://127.0.0.1:58606, state=down}
[junit4:junit4] 2> 20337 T1535 C110 P58606 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 20337 T1533 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20338 T1535 C110 P58606 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 20339 T1442 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 20338 T1535 C110 P58606 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 20339 T1442 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 20340 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20340 T1535 C110 P58606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20342 T1535 C110 P58606 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20345 T1442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20347 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20353 T1479 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/onenodecollectioncore
[junit4:junit4] 2> 20353 T1479 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 20354 T1479 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 20355 T1479 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 20356 T1479 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 20357 T1479 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 20359 T1479 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 20361 T1479 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/onenodecollectioncore/'
[junit4:junit4] 2> 20399 T1479 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> C109_STATE=coll:collection1 core:collection1 props:{shard=shard2, node_name=127.0.0.1:35271_, collection=collection1, core=collection1, base_url=http://127.0.0.1:35271, state=recovering}
[junit4:junit4] 2> 20428 T1519 C109 P35271 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:41095/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20429 T1519 C109 P35271 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35271 START replicas=[http://127.0.0.1:41095/collection1/] nUpdates=100
[junit4:junit4] 2> 20429 T1519 C109 P35271 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20429 T1519 C109 P35271 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20429 T1519 C109 P35271 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20430 T1519 C109 P35271 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20430 T1519 C109 P35271 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20430 T1519 C109 P35271 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:41095/collection1/. core=collection1
[junit4:junit4] 2> 20430 T1519 C109 P35271 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C111 name=collection1 org.apache.solr.core.SolrCore@201be07f url=http://127.0.0.1:41095/collection1 node=127.0.0.1:41095_ C111_STATE=coll:collection1 core:collection1 props:{shard=shard2, node_name=127.0.0.1:41095_, collection=collection1, core=collection1, base_url=http://127.0.0.1:41095, state=active, leader=true}
[junit4:junit4] 2> 20444 T1477 C111 P41095 REQ /get {getVersions=100&wt=javabin&version=2&distrib=false&qt=/get} status=0 QTime=1
[junit4:junit4] 2> 20445 T1478 C111 P41095 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 20446 T1479 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 20447 T1479 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 20448 T1478 C111 P41095 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20449 T1478 C111 P41095 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20452 T1479 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 20461 T1478 C111 P41095 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty1/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty1/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20462 T1478 C111 P41095 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20463 T1478 C111 P41095 oass.SolrIndexSearcher.<init> Opening Searcher@b90abc8 realtime
[junit4:junit4] 2> 20463 T1478 C111 P41095 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20463 T1478 C111 P41095 /update {commit=true&waitSearcher=true&openSearcher=false&wt=javabin&version=2&softCommit=false&commit_end_point=true} {commit=} 0 18
[junit4:junit4] 2> 20464 T1519 C109 P35271 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20465 T1519 C109 P35271 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20468 T1475 C111 P41095 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20468 T1475 C111 P41095 REQ /replication {wt=javabin&version=2&command=indexversion&qt=/replication} status=0 QTime=2
[junit4:junit4] 2> 20469 T1519 C109 P35271 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 20469 T1519 C109 P35271 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20469 T1519 C109 P35271 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20472 T1482 C111 P41095 REQ /replication {generation=2&wt=javabin&version=2&command=filelist&qt=/replication} status=0 QTime=0
[junit4:junit4] 2> 20473 T1519 C109 P35271 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20474 T1519 C109 P35271 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3/index.20130309040531054 forceNew: false
[junit4:junit4] 2> 20474 T1519 C109 P35271 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3/index.20130309040531054 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7ab92dec fullCopy=false
[junit4:junit4] 2> 20477 T1477 C111 P41095 REQ /replication {generation=2&wt=filestream&file=segments_2&command=filecontent&qt=/replication&checksum=true} status=0 QTime=0
[junit4:junit4] 2> 20479 T1519 C109 P35271 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20492 T1519 C109 P35271 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20493 T1519 C109 P35271 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20495 T1519 C109 P35271 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20503 T1519 C109 P35271 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20503 T1519 C109 P35271 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20503 T1519 C109 P35271 oass.SolrIndexSearcher.<init> Opening Searcher@6ccfa328 main
[junit4:junit4] 2> 20504 T1518 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6ccfa328 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 20505 T1519 C109 P35271 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty3/index.20130309040531054 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7ab92dec
[junit4:junit4] 2> 20506 T1519 C109 P35271 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20506 T1519 C109 P35271 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20506 T1519 C109 P35271 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20506 T1519 C109 P35271 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20508 T1519 C109 P35271 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20928 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20929 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:58606_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58606",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "numShards":"2"}
[junit4:junit4] 2> 20932 T1479 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 20932 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:35271_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35271",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"2"}
[junit4:junit4] 2> 20937 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20937 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20937 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20937 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20937 T1532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20937 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20937 T1479 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 20942 T1479 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 20956 T1479 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 20964 T1479 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 20969 T1479 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 20971 T1479 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 20971 T1479 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 20972 T1479 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 20973 T1479 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 20974 T1479 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 20974 T1479 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362762314914/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362762310587/onenodecollection/
[junit4:junit4] 2> 20974 T1479 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c76976
[junit4:junit4] 2> 20975 T1479 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 20975 T1479 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362762310587/onenodecollection forceNew: false
[junit4:junit4] 2> 20976 T1479 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362762310587/onenodecollection/index/
[junit4:junit4] 2> 20976 T1479 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362762310587/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 20976 T1479 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362762310587/onenodecollection/index forceNew: false
[junit4:junit4] 2> 20993 T1479 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-BasicDistributedZk2Test-1362762310587/onenodecollection/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20994 T1479 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20996 T1479 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 20997 T1479 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 20997 T1479 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 20998 T1479 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 20999 T1479 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 20999 T1479 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 20999 T1479 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 21000 T1479 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 21000 T1479 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 21004 T1479 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 21009 T1479 oass.SolrIndexSearcher.<init> Opening Searcher@7064f278 main
[junit4:junit4] 2> 21010 T1479 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 21010 T1479 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 21016 T1538 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@7064f278 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 21016 T1479 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 21347 T1496 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {onlyIfLeader=true&checkLive=true&wt=javabin&coreNodeName=127.0.0.1:58606__collection1&version=2&nodeName=127.0.0.1:58606_&core=collection1&state=recovering&action=PREPRECOVERY} status=0 QTime=1000
[junit4:junit4] 2> 22445 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22446 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:41095_",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41095",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"1"}
[junit4:junit4] 2> 22446 T1466 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 22446 T1466 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 22453 T1532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22453 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22453 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22454 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22453 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22454 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23019 T1479 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 23020 T1479 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:41095 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 23021 T1479 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 23031 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:delete cxid:0xaa zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 23032 T1479 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 23033 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:create cxid:0xab zxid:0xc6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 23035 T1479 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 23035 T1479 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 23035 T1479 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41095/onenodecollectioncore/
[junit4:junit4] 2> 23035 T1479 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 23036 T1479 oasc.SyncStrategy.syncToMe http://127.0.0.1:41095/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 23036 T1479 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41095/onenodecollectioncore/
[junit4:junit4] 2> 23036 T1479 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 23040 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:create cxid:0xb5 zxid:0xca txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> C110_STATE=coll:collection1 core:collection1 props:{shard=shard1, node_name=127.0.0.1:58606_, collection=collection1, core=collection1, base_url=http://127.0.0.1:58606, state=recovering}
[junit4:junit4] 2> 23349 T1535 C110 P58606 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60615/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 23349 T1535 C110 P58606 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:58606 START replicas=[http://127.0.0.1:60615/collection1/] nUpdates=100
[junit4:junit4] 2> 23349 T1535 C110 P58606 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 23349 T1535 C110 P58606 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 23349 T1535 C110 P58606 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 23350 T1535 C110 P58606 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 23350 T1535 C110 P58606 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 23350 T1535 C110 P58606 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60615/collection1/. core=collection1
[junit4:junit4] 2> 23350 T1535 C110 P58606 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C112 name=collection1 org.apache.solr.core.SolrCore@70cd4316 url=http://127.0.0.1:60615/collection1 node=127.0.0.1:60615_ C112_STATE=coll:collection1 core:collection1 props:{shard=shard1, node_name=127.0.0.1:60615_, collection=collection1, core=collection1, base_url=http://127.0.0.1:60615, state=active, leader=true}
[junit4:junit4] 2> 23358 T1494 C112 P60615 REQ /get {getVersions=100&wt=javabin&version=2&distrib=false&qt=/get} status=0 QTime=0
[junit4:junit4] 2> 23359 T1497 C112 P60615 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23361 T1497 C112 P60615 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 23362 T1497 C112 P60615 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 23371 T1497 C112 P60615 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty2/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty2/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 23372 T1497 C112 P60615 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 23373 T1497 C112 P60615 oass.SolrIndexSearcher.<init> Opening Searcher@1f91131 realtime
[junit4:junit4] 2> 23373 T1497 C112 P60615 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23373 T1497 C112 P60615 /update {commit=true&waitSearcher=true&openSearcher=false&wt=javabin&version=2&softCommit=false&commit_end_point=true} {commit=} 0 14
[junit4:junit4] 2> 23374 T1535 C110 P58606 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 23374 T1535 C110 P58606 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 23376 T1495 C112 P60615 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 23376 T1495 C112 P60615 REQ /replication {wt=javabin&version=2&command=indexversion&qt=/replication} status=0 QTime=1
[junit4:junit4] 2> 23377 T1535 C110 P58606 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 23377 T1535 C110 P58606 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 23377 T1535 C110 P58606 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 23379 T1494 C112 P60615 REQ /replication {generation=2&wt=javabin&version=2&command=filelist&qt=/replication} status=0 QTime=0
[junit4:junit4] 2> 23380 T1535 C110 P58606 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 23381 T1535 C110 P58606 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4/index.20130309040533961 forceNew: false
[junit4:junit4] 2> 23381 T1535 C110 P58606 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4/index.20130309040533961 lockFactory=org.apache.lucene.store.NativeFSLockFactory@32d5a95c fullCopy=false
[junit4:junit4] 2> 23384 T1497 C112 P60615 REQ /replication {generation=2&wt=filestream&file=segments_2&command=filecontent&qt=/replication&checksum=true} status=0 QTime=0
[junit4:junit4] 2> 23386 T1535 C110 P58606 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 23392 T1535 C110 P58606 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 23392 T1535 C110 P58606 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 23394 T1535 C110 P58606 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4/index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4/index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 23395 T1535 C110 P58606 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 23395 T1535 C110 P58606 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 23396 T1535 C110 P58606 oass.SolrIndexSearcher.<init> Opening Searcher@3e426c79 main
[junit4:junit4] 2> 23397 T1534 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e426c79 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 23397 T1535 C110 P58606 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/jetty4/index.20130309040533961 lockFactory=org.apache.lucene.store.NativeFSLockFactory@32d5a95c
[junit4:junit4] 2> 23398 T1535 C110 P58606 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 23398 T1535 C110 P58606 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 23398 T1535 C110 P58606 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 23398 T1535 C110 P58606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 23400 T1535 C110 P58606 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23960 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23966 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:58606_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58606",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"2"}
[junit4:junit4] 2> 23992 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23992 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23992 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23992 T1532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23992 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23992 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23996 T1479 oasc.ZkController.register We are http://127.0.0.1:41095/onenodecollectioncore/ and leader is http://127.0.0.1:41095/onenodecollectioncore/
[junit4:junit4] 2> 23996 T1479 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:41095
[junit4:junit4] 2> 23997 T1479 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 23997 T1479 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 24000 T1479 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24001 T1479 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {roles=none&name=onenodecollectioncore&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362762310587/onenodecollection&wt=javabin&collection=onenodecollection&version=2&numShards=1&action=CREATE} status=0 QTime=3648
[junit4:junit4] 2> 24010 T1442 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 24012 T1442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25013 T1442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25516 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25517 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:41095_",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41095",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"1"}
[junit4:junit4] 2> 25527 T1532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25527 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25527 T1471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25530 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25530 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25530 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26015 T1442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26016 T1442 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 26016 T1442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 26025 T1496 oejs.Response.sendError WARNING Committed before 404 Can not find: /onenodecollectioncore/update
[junit4:junit4] 2> 26025 T1442 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56131 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@17f300d2
[junit4:junit4] 2> 26025 T1496 oejs.ServletHandler.doHandle WARNING /onenodecollectioncore/update java.lang.IllegalStateException: Committed
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.resetBuffer(Response.java:1136)
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.sendError(Response.java:314)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$Servlet404.service(JettySolrRunner.java:465)
[junit4:junit4] 2> at javax.servlet.http.HttpServlet.service(HttpServlet.java:770)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1336)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:379)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 26026 T1442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 26027 T1541 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56131. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 26027 T1541 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56131, initiating session
[junit4:junit4] 2> 26027 T1444 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48950
[junit4:junit4] 2> 26028 T1444 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48950
[junit4:junit4] 2> 26029 T1446 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4af6a3c1000d with negotiated timeout 10000 for client /127.0.0.1:48950
[junit4:junit4] 2> 26029 T1541 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56131, sessionid = 0x13d4af6a3c1000d, negotiated timeout = 10000
[junit4:junit4] 2> 26029 T1542 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17f300d2 name:ZooKeeperConnection Watcher:127.0.0.1:56131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 26029 T1442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 26068 T1447 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4af6a3c1000d
[junit4:junit4] 2> 26068 T1542 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 26069 T1444 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48950 which had sessionid 0x13d4af6a3c1000d
[junit4:junit4] 2> 26068 T1442 oaz.ZooKeeper.close Session: 0x13d4af6a3c1000d closed
[junit4:junit4] 2> 26069 T1447 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4af6a3c10004
[junit4:junit4] 2> 26070 T1471 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 26070 T1442 oaz.ZooKeeper.close Session: 0x13d4af6a3c10004 closed
[junit4:junit4] 2> 26070 T1444 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48925 which had sessionid 0x13d4af6a3c10004
[junit4:junit4] 2> 26072 T1442 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 35213
[junit4:junit4] 2> 26072 T1442 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1738502269
[junit4:junit4] 2> 27035 T1466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27036 T1466 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:35213__collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:35213_",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35213",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 27039 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 27039 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 27039 T1532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 27040 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 27040 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 28074 T1442 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@20615758
[junit4:junit4] 2> 28078 T1442 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 28079 T1442 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 28079 T1442 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 28079 T1442 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 28080 T1442 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 28081 T1442 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/control/data
[junit4:junit4] 2> 28081 T1442 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/control/data
[junit4:junit4] 2> 28082 T1442 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/control/data/index
[junit4:junit4] 2> 28082 T1442 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362762310587/control/data/index
[junit4:junit4] 2> 28083 T1466 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89309990787022851-127.0.0.1:35213_-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 28084 T1447 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4af6a3c10003
[junit4:junit4] 2> 28085 T1532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 28085 T1516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 28085 T1444 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48923 which had sessionid 0x13d4af6a3c10003
[junit4:junit4] 2> 28085 T1465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 28085 T1442 oaz.ZooKeeper.close Session: 0x13d4af6a3c10003 closed
[junit4:junit4] 2> 28085 T1465 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 28086 T1465 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 28086 T1501 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 28086 T1501 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 28086 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:delete cxid:0xc2 zxid:0xe5 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 28086 T1465 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 28087 T1516 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 28087 T1486 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 28088 T1532 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 28089 T1486 oasc.Overseer.start Overseer (id=89309990787022854-127.0.0.1:41095_-n_0000000001) starting
[junit4:junit4] 2> 28090 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:create cxid:0xc7 zxid:0xe7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 28091 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:create cxid:0xc8 zxid:0xe8 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 28092 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:create cxid:0xc9 zxid:0xe9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 28094 T1447 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4af6a3c10006 type:create cxid:0xca zxid:0xea txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 28095 T1544 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 28095 T1486 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 28095 T1486 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 28097 T1543 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 28107 T1442 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 28159 T1442 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 41095
[junit4:junit4] 2> 28159 T1442 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1591680149
[junit4:junit4] 2> 29600 T1543 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 29600 T1543 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:41095__onenodecollectioncore",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:41095_",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41095",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 29603 T1543 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:41095__collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:41095_",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41095",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 29652 T1516
[...truncated too long message...]
"base_url":"http://127.0.0.1:59990",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=4A042BA04CD5AB10 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ja -Dtests.timezone=America/St_Thomas -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 140s J1 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([4A042BA04CD5AB10:CBE2A5B83B8ACB2C]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 139586 T1553 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 139605 T1552 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 140675 T1631 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 140676 T1631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 140676 T1631 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 140676 T1631 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ja, timezone=America/St_Thomas
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=47838896,total=130613248
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestRangeQuery, QueryParsingTest, TestRandomDVFaceting, SolrCoreCheckLockOnStartupTest, TestDFRSimilarityFactory, TestFieldCollectionResource, FastVectorHighlighterTest, TestComponentsName, ClusterStateTest, FileUtilsTest, MoreLikeThisHandlerTest, DOMUtilTest, TestReload, TestPropInject, DocumentBuilderTest, FullSolrCloudDistribCmdsTest, TestBinaryResponseWriter, TestCSVLoader, ReturnFieldsTest, TestUpdate, TestDynamicFieldCollectionResource, TestValueSourceCache, LoggingHandlerTest, SimplePostToolTest, UniqFieldsUpdateProcessorFactoryTest, ZkNodePropsTest, SimpleFacetsTest, BadIndexSchemaTest, TestUtils, HighlighterConfigTest, SoftAutoCommitTest, DefaultValueUpdateProcessorTest, AliasIntegrationTest, ClusterStateUpdateTest, TestStressVersions, OverseerCollectionProcessorTest, MultiTermTest, URLClassifyProcessorTest, DateMathParserTest, TestElisionMultitermQuery, TestSolrXMLSerializer, NumericFieldsTest, TestRealTimeGet, TestZkChroot, TestSystemIdResolver, DirectUpdateHandlerTest, TestSuggestSpellingConverter, IndexReaderFactoryTest, XsltUpdateRequestHandlerTest, CopyFieldTest, OutputWriterTest, TermVectorComponentDistributedTest, SpellPossibilityIteratorTest, TestFastOutputStream, TestBinaryField, OpenExchangeRatesOrgProviderTest, TestSort, PeerSyncTest, TestWordDelimiterFilterFactory, SampleTest, SuggesterTest, TestCodecSupport, SortByFunctionTest, TermVectorComponentTest, TestMergePolicyConfig, TestDefaultSimilarityFactory, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest]
[junit4:junit4] Completed on J1 in 140.88s, 1 test, 1 failure <<< FAILURES!
[...truncated 405 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 268 suites, 1130 tests, 1 error, 1 failure, 9 ignored (3 assumptions)
Total time: 38 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build #
4594 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4594/
Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseParallelGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:51940/_/ih/onenodecollectioncore returned non ok status:404, message:Can not find: /_/ih/onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:51940/_/ih/onenodecollectioncore returned non ok status:404, message:Can not find: /_/ih/onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([5B6FFDBB68970E29:DA8973A31FC86E15]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:85)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([5B6FFDBB68970E29:DA8973A31FC86E15]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9272 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T1593 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_/ih
[junit4:junit4] 2> 4 T1593 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362757290814
[junit4:junit4] 2> 5 T1593 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 6 T1594 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 7 T1594 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 7 T1594 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 7 T1594 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 10 T1594 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 10 T1594 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 106 T1593 oasc.ZkTestServer.run start zk server on port:57457
[junit4:junit4] 2> 107 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@eec28c
[junit4:junit4] 2> 107 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 107 T1599 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 108 T1599 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 108 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35962
[junit4:junit4] 2> 108 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35962
[junit4:junit4] 2> 109 T1597 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 156 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b440000 with negotiated timeout 10000 for client /127.0.0.1:35962
[junit4:junit4] 2> 156 T1599 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b440000, negotiated timeout = 10000
[junit4:junit4] 2> 157 T1600 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@eec28c name:ZooKeeperConnection Watcher:127.0.0.1:57457 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 157 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 157 T1593 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 161 T1598 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4aaa0b440000
[junit4:junit4] 2> 161 T1600 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 162 T1595 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35962 which had sessionid 0x13d4aaa0b440000
[junit4:junit4] 2> 161 T1593 oaz.ZooKeeper.close Session: 0x13d4aaa0b440000 closed
[junit4:junit4] 2> 162 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@292a21
[junit4:junit4] 2> 163 T1601 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 163 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 164 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35963
[junit4:junit4] 2> 164 T1601 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 164 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35963
[junit4:junit4] 2> 165 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b440001 with negotiated timeout 10000 for client /127.0.0.1:35963
[junit4:junit4] 2> 165 T1601 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b440001, negotiated timeout = 10000
[junit4:junit4] 2> 165 T1602 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@292a21 name:ZooKeeperConnection Watcher:127.0.0.1:57457/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 165 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 166 T1593 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 170 T1593 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 173 T1593 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 176 T1593 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 180 T1593 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 181 T1593 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 186 T1593 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 188 T1593 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 193 T1593 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 194 T1593 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 197 T1593 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 198 T1593 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 202 T1593 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 202 T1593 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 204 T1593 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 205 T1593 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 206 T1593 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 207 T1593 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 209 T1593 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 209 T1593 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 210 T1593 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 211 T1593 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 212 T1598 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4aaa0b440001
[junit4:junit4] 2> 213 T1593 oaz.ZooKeeper.close Session: 0x13d4aaa0b440001 closed
[junit4:junit4] 2> 213 T1595 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35963 which had sessionid 0x13d4aaa0b440001
[junit4:junit4] 2> 213 T1602 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 264 T1593 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 267 T1593 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49293
[junit4:junit4] 2> 268 T1593 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 268 T1593 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 268 T1593 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362757291022
[junit4:junit4] 2> 269 T1593 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362757291022/solr.xml
[junit4:junit4] 2> 269 T1593 oasc.CoreContainer.<init> New CoreContainer 23567779
[junit4:junit4] 2> 270 T1593 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362757291022/'
[junit4:junit4] 2> 270 T1593 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362757291022/'
[junit4:junit4] 2> 286 T1593 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 287 T1593 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 287 T1593 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 287 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 287 T1593 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 288 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 288 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 288 T1593 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 289 T1593 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 289 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 303 T1593 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 316 T1593 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57457/solr
[junit4:junit4] 2> 316 T1593 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 316 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@17e1dac
[junit4:junit4] 2> 317 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 317 T1612 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 318 T1612 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 318 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35964
[junit4:junit4] 2> 319 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35964
[junit4:junit4] 2> 319 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b440002 with negotiated timeout 20000 for client /127.0.0.1:35964
[junit4:junit4] 2> 319 T1612 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b440002, negotiated timeout = 20000
[junit4:junit4] 2> 320 T1613 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17e1dac name:ZooKeeperConnection Watcher:127.0.0.1:57457 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 320 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 321 T1598 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4aaa0b440002
[junit4:junit4] 2> 321 T1613 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 321 T1595 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35964 which had sessionid 0x13d4aaa0b440002
[junit4:junit4] 2> 321 T1593 oaz.ZooKeeper.close Session: 0x13d4aaa0b440002 closed
[junit4:junit4] 2> 322 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 324 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@660736
[junit4:junit4] 2> 325 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 325 T1614 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 326 T1614 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 326 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35965
[junit4:junit4] 2> 326 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35965
[junit4:junit4] 2> 327 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b440003 with negotiated timeout 20000 for client /127.0.0.1:35965
[junit4:junit4] 2> 327 T1614 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b440003, negotiated timeout = 20000
[junit4:junit4] 2> 327 T1615 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@660736 name:ZooKeeperConnection Watcher:127.0.0.1:57457/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 327 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 328 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 329 T1593 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 331 T1593 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49293__%2Fih
[junit4:junit4] 2> 331 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49293__%2Fih Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49293__%2Fih
[junit4:junit4] 2> 332 T1593 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49293__%2Fih
[junit4:junit4] 2> 333 T1593 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 338 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 339 T1593 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 341 T1593 oasc.Overseer.start Overseer (id=89309661811179523-127.0.0.1:49293__%2Fih-n_0000000000) starting
[junit4:junit4] 2> 342 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 343 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 343 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 344 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 344 T1617 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 345 T1593 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 347 T1593 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 348 T1593 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 350 T1616 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 354 T1618 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362757291022/collection1
[junit4:junit4] 2> 354 T1618 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 354 T1618 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 354 T1618 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 355 T1618 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362757291022/collection1/'
[junit4:junit4] 2> 356 T1618 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362757291022/collection1/lib/README' to classloader
[junit4:junit4] 2> 356 T1618 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362757291022/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 384 T1618 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 422 T1618 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 423 T1618 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 427 T1618 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 845 T1618 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 852 T1618 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 854 T1618 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 863 T1618 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 866 T1618 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 868 T1618 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 869 T1618 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 870 T1618 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 870 T1618 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 871 T1618 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 871 T1618 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 871 T1618 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362757291022/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/control/data/
[junit4:junit4] 2> 871 T1618 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32a9c2
[junit4:junit4] 2> 872 T1618 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 879 T1618 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/control/data forceNew: false
[junit4:junit4] 2> 879 T1618 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/control/data/index/
[junit4:junit4] 2> 879 T1618 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 879 T1618 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/control/data/index forceNew: false
[junit4:junit4] 2> 883 T1618 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@564f71; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 883 T1618 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 884 T1618 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 884 T1618 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 885 T1618 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 885 T1618 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 885 T1618 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 886 T1618 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 886 T1618 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 886 T1618 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 887 T1618 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 889 T1618 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 892 T1618 oass.SolrIndexSearcher.<init> Opening Searcher@b7123b main
[junit4:junit4] 2> 892 T1618 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 893 T1618 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 895 T1619 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b7123b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 896 T1618 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 897 T1618 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 897 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 1853 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1854 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:49293__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49293/_/ih"}
[junit4:junit4] 2> 1855 T1616 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1855 T1616 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1856 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1863 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1898 T1618 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1899 T1618 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49293/_/ih collection:control_collection shard:shard1
[junit4:junit4] 2> 1900 T1618 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1908 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 1909 T1618 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1910 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1912 T1618 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1913 T1618 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1913 T1618 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49293/_/ih/collection1/
[junit4:junit4] 2> 1914 T1618 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1914 T1618 oasc.SyncStrategy.syncToMe http://127.0.0.1:49293/_/ih/collection1/ has no replicas
[junit4:junit4] 2> 1914 T1618 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49293/_/ih/collection1/
[junit4:junit4] 2> 1915 T1618 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1921 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3367 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3374 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3427 T1618 oasc.ZkController.register We are http://127.0.0.1:49293/_/ih/collection1/ and leader is http://127.0.0.1:49293/_/ih/collection1/
[junit4:junit4] 2> 3427 T1618 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49293/_/ih
[junit4:junit4] 2> 3427 T1618 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3428 T1618 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3428 T1618 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3429 T1618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3430 T1593 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3430 T1593 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3431 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3434 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3435 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1322f4b
[junit4:junit4] 2> 3436 T1620 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3436 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3436 T1620 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 3437 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35974
[junit4:junit4] 2> 3437 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35974
[junit4:junit4] 2> 3437 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b440004 with negotiated timeout 10000 for client /127.0.0.1:35974
[junit4:junit4] 2> 3437 T1620 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b440004, negotiated timeout = 10000
[junit4:junit4] 2> 3438 T1621 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1322f4b name:ZooKeeperConnection Watcher:127.0.0.1:57457/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3438 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3439 T1593 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3440 T1593 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3498 T1593 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3499 T1593 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55923
[junit4:junit4] 2> 3500 T1593 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3500 T1593 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3501 T1593 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249
[junit4:junit4] 2> 3501 T1593 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/solr.xml
[junit4:junit4] 2> 3502 T1593 oasc.CoreContainer.<init> New CoreContainer 5165244
[junit4:junit4] 2> 3502 T1593 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/'
[junit4:junit4] 2> 3502 T1593 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/'
[junit4:junit4] 2> 3522 T1593 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3522 T1593 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3523 T1593 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3523 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3523 T1593 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3524 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3524 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3524 T1593 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3525 T1593 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3525 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3532 T1593 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3544 T1593 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57457/solr
[junit4:junit4] 2> 3545 T1593 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3545 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@12c9d2f
[junit4:junit4] 2> 3546 T1631 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3546 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3547 T1631 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 3547 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35975
[junit4:junit4] 2> 3547 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35975
[junit4:junit4] 2> 3548 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b440005 with negotiated timeout 20000 for client /127.0.0.1:35975
[junit4:junit4] 2> 3548 T1631 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b440005, negotiated timeout = 20000
[junit4:junit4] 2> 3549 T1632 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12c9d2f name:ZooKeeperConnection Watcher:127.0.0.1:57457 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3549 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3550 T1598 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4aaa0b440005
[junit4:junit4] 2> 3551 T1632 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3551 T1595 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35975 which had sessionid 0x13d4aaa0b440005
[junit4:junit4] 2> 3550 T1593 oaz.ZooKeeper.close Session: 0x13d4aaa0b440005 closed
[junit4:junit4] 2> 3552 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3555 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1be6f0e
[junit4:junit4] 2> 3556 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3556 T1633 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3556 T1633 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 3556 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35976
[junit4:junit4] 2> 3557 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35976
[junit4:junit4] 2> 3557 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b440006 with negotiated timeout 20000 for client /127.0.0.1:35976
[junit4:junit4] 2> 3557 T1633 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b440006, negotiated timeout = 20000
[junit4:junit4] 2> 3558 T1634 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1be6f0e name:ZooKeeperConnection Watcher:127.0.0.1:57457/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3558 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3559 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3559 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3560 T1593 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4563 T1593 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55923__%2Fih
[junit4:junit4] 2> 4564 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55923__%2Fih Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55923__%2Fih
[junit4:junit4] 2> 4565 T1593 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55923__%2Fih
[junit4:junit4] 2> 4569 T1615 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4570 T1634 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4570 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4569 T1621 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4581 T1635 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/collection1
[junit4:junit4] 2> 4582 T1635 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4583 T1635 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4583 T1635 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4584 T1635 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/collection1/'
[junit4:junit4] 2> 4585 T1635 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/collection1/lib/README' to classloader
[junit4:junit4] 2> 4586 T1635 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4641 T1635 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 4677 T1635 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4678 T1635 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4682 T1635 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4879 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4879 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:49293__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49293/_/ih"}
[junit4:junit4] 2> 4883 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4883 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4883 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5063 T1635 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5068 T1635 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5071 T1635 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5086 T1635 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5091 T1635 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5096 T1635 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5097 T1635 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5098 T1635 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5098 T1635 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5100 T1635 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5100 T1635 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5100 T1635 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty1/
[junit4:junit4] 2> 5101 T1635 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32a9c2
[junit4:junit4] 2> 5101 T1635 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 5102 T1635 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty1 forceNew: false
[junit4:junit4] 2> 5103 T1635 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty1/index/
[junit4:junit4] 2> 5103 T1635 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5104 T1635 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty1/index forceNew: false
[junit4:junit4] 2> 5109 T1635 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bc4ff8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5109 T1635 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5112 T1635 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5113 T1635 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5114 T1635 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5115 T1635 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5116 T1635 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5116 T1635 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5117 T1635 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5118 T1635 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5119 T1635 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5126 T1635 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5134 T1635 oass.SolrIndexSearcher.<init> Opening Searcher@62ab06 main
[junit4:junit4] 2> 5135 T1635 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5136 T1635 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5146 T1636 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@62ab06 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5150 T1635 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5150 T1635 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6388 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6389 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:55923__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55923/_/ih"}
[junit4:junit4] 2> 6389 T1616 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6390 T1616 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 6395 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6395 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6395 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7152 T1635 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7152 T1635 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55923/_/ih collection:collection1 shard:shard2
[junit4:junit4] 2> 7153 T1635 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 7157 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7158 T1635 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7158 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7159 T1635 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7160 T1635 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7160 T1635 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55923/_/ih/collection1/
[junit4:junit4] 2> 7160 T1635 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7160 T1635 oasc.SyncStrategy.syncToMe http://127.0.0.1:55923/_/ih/collection1/ has no replicas
[junit4:junit4] 2> 7160 T1635 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55923/_/ih/collection1/
[junit4:junit4] 2> 7160 T1635 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 7163 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7899 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7906 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7906 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7906 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7915 T1635 oasc.ZkController.register We are http://127.0.0.1:55923/_/ih/collection1/ and leader is http://127.0.0.1:55923/_/ih/collection1/
[junit4:junit4] 2> 7915 T1635 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55923/_/ih
[junit4:junit4] 2> 7916 T1635 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 7916 T1635 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 7916 T1635 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7917 T1635 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7918 T1593 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 7919 T1593 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 7920 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 7987 T1593 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 7989 T1593 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51940
[junit4:junit4] 2> 7990 T1593 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 7991 T1593 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 7991 T1593 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362757298734
[junit4:junit4] 2> 7991 T1593 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362757298734/solr.xml
[junit4:junit4] 2> 7992 T1593 oasc.CoreContainer.<init> New CoreContainer 15812563
[junit4:junit4] 2> 7992 T1593 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362757298734/'
[junit4:junit4] 2> 7992 T1593 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362757298734/'
[junit4:junit4] 2> 8009 T1593 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8009 T1593 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8010 T1593 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8010 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8010 T1593 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8011 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8011 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8011 T1593 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8012 T1593 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8012 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8018 T1593 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8030 T1593 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57457/solr
[junit4:junit4] 2> 8030 T1593 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8031 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7d5b2d
[junit4:junit4] 2> 8031 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8032 T1646 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8032 T1646 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 8033 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35981
[junit4:junit4] 2> 8033 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35981
[junit4:junit4] 2> 8034 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b440007 with negotiated timeout 20000 for client /127.0.0.1:35981
[junit4:junit4] 2> 8034 T1646 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b440007, negotiated timeout = 20000
[junit4:junit4] 2> 8035 T1647 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d5b2d name:ZooKeeperConnection Watcher:127.0.0.1:57457 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8035 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8036 T1598 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4aaa0b440007
[junit4:junit4] 2> 8037 T1647 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8037 T1595 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35981 which had sessionid 0x13d4aaa0b440007
[junit4:junit4] 2> 8037 T1593 oaz.ZooKeeper.close Session: 0x13d4aaa0b440007 closed
[junit4:junit4] 2> 8037 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8040 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@16e8bf
[junit4:junit4] 2> 8041 T1648 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8041 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8042 T1648 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 8042 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35982
[junit4:junit4] 2> 8042 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35982
[junit4:junit4] 2> 8043 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b440008 with negotiated timeout 20000 for client /127.0.0.1:35982
[junit4:junit4] 2> 8043 T1648 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b440008, negotiated timeout = 20000
[junit4:junit4] 2> 8043 T1649 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16e8bf name:ZooKeeperConnection Watcher:127.0.0.1:57457/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8043 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8044 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8045 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8046 T1593 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9049 T1593 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51940__%2Fih
[junit4:junit4] 2> 9050 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51940__%2Fih Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51940__%2Fih
[junit4:junit4] 2> 9051 T1593 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51940__%2Fih
[junit4:junit4] 2> 9055 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9056 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9056 T1649 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9056 T1634 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9057 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9058 T1615 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9058 T1621 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9064 T1650 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362757298734/collection1
[junit4:junit4] 2> 9064 T1650 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9065 T1650 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9065 T1650 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9066 T1650 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362757298734/collection1/'
[junit4:junit4] 2> 9066 T1650 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362757298734/collection1/lib/README' to classloader
[junit4:junit4] 2> 9067 T1650 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362757298734/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9097 T1650 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 9146 T1650 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9147 T1650 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9151 T1650 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9411 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9411 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:55923__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55923/_/ih"}
[junit4:junit4] 2> 9414 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9414 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9414 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9414 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9573 T1650 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9578 T1650 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9581 T1650 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9592 T1650 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9594 T1650 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9597 T1650 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9598 T1650 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9599 T1650 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9599 T1650 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9600 T1650 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9600 T1650 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9600 T1650 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362757298734/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty2/
[junit4:junit4] 2> 9600 T1650 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32a9c2
[junit4:junit4] 2> 9601 T1650 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 9601 T1650 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty2 forceNew: false
[junit4:junit4] 2> 9602 T1650 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty2/index/
[junit4:junit4] 2> 9602 T1650 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9602 T1650 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty2/index forceNew: false
[junit4:junit4] 2> 9607 T1650 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@14ca744; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9608 T1650 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9609 T1650 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9609 T1650 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9610 T1650 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9610 T1650 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9611 T1650 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9611 T1650 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9611 T1650 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9611 T1650 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9612 T1650 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9614 T1650 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9617 T1650 oass.SolrIndexSearcher.<init> Opening Searcher@1588ad2 main
[junit4:junit4] 2> 9617 T1650 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9618 T1650 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9621 T1651 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1588ad2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9623 T1650 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9623 T1650 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10918 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10918 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:51940__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51940/_/ih"}
[junit4:junit4] 2> 10919 T1616 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 10919 T1616 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 10923 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10923 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10923 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10923 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11624 T1650 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11625 T1650 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51940/_/ih collection:collection1 shard:shard1
[junit4:junit4] 2> 11625 T1650 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 11629 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4] 2> 11630 T1650 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11630 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11631 T1650 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11631 T1650 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11631 T1650 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51940/_/ih/collection1/
[junit4:junit4] 2> 11632 T1650 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11632 T1650 oasc.SyncStrategy.syncToMe http://127.0.0.1:51940/_/ih/collection1/ has no replicas
[junit4:junit4] 2> 11632 T1650 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51940/_/ih/collection1/
[junit4:junit4] 2> 11632 T1650 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 11634 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12426 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12432 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12432 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12432 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12432 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12438 T1650 oasc.ZkController.register We are http://127.0.0.1:51940/_/ih/collection1/ and leader is http://127.0.0.1:51940/_/ih/collection1/
[junit4:junit4] 2> 12438 T1650 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51940/_/ih
[junit4:junit4] 2> 12438 T1650 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 12438 T1650 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 12438 T1650 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12439 T1650 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12440 T1593 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 12441 T1593 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12441 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12497 T1593 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12499 T1593 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44099
[junit4:junit4] 2> 12500 T1593 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12501 T1593 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12501 T1593 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362757303253
[junit4:junit4] 2> 12501 T1593 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362757303253/solr.xml
[junit4:junit4] 2> 12502 T1593 oasc.CoreContainer.<init> New CoreContainer 32799441
[junit4:junit4] 2> 12502 T1593 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362757303253/'
[junit4:junit4] 2> 12502 T1593 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362757303253/'
[junit4:junit4] 2> 12518 T1593 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12519 T1593 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12519 T1593 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12519 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12520 T1593 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12520 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12520 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12521 T1593 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12521 T1593 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12521 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12527 T1593 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12539 T1593 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57457/solr
[junit4:junit4] 2> 12539 T1593 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12539 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@379a25
[junit4:junit4] 2> 12540 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12540 T1661 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12541 T1661 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 12541 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35988
[junit4:junit4] 2> 12541 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35988
[junit4:junit4] 2> 12542 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b440009 with negotiated timeout 20000 for client /127.0.0.1:35988
[junit4:junit4] 2> 12542 T1661 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b440009, negotiated timeout = 20000
[junit4:junit4] 2> 12542 T1662 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@379a25 name:ZooKeeperConnection Watcher:127.0.0.1:57457 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12543 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12544 T1598 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4aaa0b440009
[junit4:junit4] 2> 12544 T1662 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12544 T1595 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35988 which had sessionid 0x13d4aaa0b440009
[junit4:junit4] 2> 12544 T1593 oaz.ZooKeeper.close Session: 0x13d4aaa0b440009 closed
[junit4:junit4] 2> 12545 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12548 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@15c48c5
[junit4:junit4] 2> 12548 T1663 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12548 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12549 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35989
[junit4:junit4] 2> 12549 T1663 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 12549 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35989
[junit4:junit4] 2> 12550 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b44000a with negotiated timeout 20000 for client /127.0.0.1:35989
[junit4:junit4] 2> 12550 T1663 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b44000a, negotiated timeout = 20000
[junit4:junit4] 2> 12550 T1664 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15c48c5 name:ZooKeeperConnection Watcher:127.0.0.1:57457/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12551 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12552 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b44000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12553 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b44000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12555 T1593 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13557 T1593 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44099__%2Fih
[junit4:junit4] 2> 13557 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b44000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:44099__%2Fih Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:44099__%2Fih
[junit4:junit4] 2> 13558 T1593 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44099__%2Fih
[junit4:junit4] 2> 13560 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13560 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13560 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13561 T1664 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13561 T1621 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13561 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13562 T1649 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13562 T1634 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13563 T1615 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13567 T1665 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362757303253/collection1
[junit4:junit4] 2> 13567 T1665 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13568 T1665 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13568 T1665 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13569 T1665 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362757303253/collection1/'
[junit4:junit4] 2> 13569 T1665 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362757303253/collection1/lib/README' to classloader
[junit4:junit4] 2> 13569 T1665 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362757303253/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13596 T1665 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 13632 T1665 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13633 T1665 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13636 T1665 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13936 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13936 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:51940__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51940/_/ih"}
[junit4:junit4] 2> 13939 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13939 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13939 T1664 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13939 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13939 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14038 T1665 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14045 T1665 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14048 T1665 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14058 T1665 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14061 T1665 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14064 T1665 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14065 T1665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14066 T1665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14066 T1665 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14067 T1665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14067 T1665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14067 T1665 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362757303253/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3/
[junit4:junit4] 2> 14068 T1665 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32a9c2
[junit4:junit4] 2> 14068 T1665 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 14069 T1665 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3 forceNew: false
[junit4:junit4] 2> 14069 T1665 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3/index/
[junit4:junit4] 2> 14069 T1665 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14070 T1665 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3/index forceNew: false
[junit4:junit4] 2> 14074 T1665 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1876b3a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14074 T1665 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14076 T1665 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14076 T1665 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14076 T1665 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14077 T1665 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14078 T1665 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14078 T1665 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14078 T1665 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14079 T1665 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14079 T1665 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14082 T1665 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14084 T1665 oass.SolrIndexSearcher.<init> Opening Searcher@2560d1 main
[junit4:junit4] 2> 14085 T1665 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14085 T1665 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14090 T1666 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2560d1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14092 T1665 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14092 T1665 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15443 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15445 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:44099__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44099/_/ih"}
[junit4:junit4] 2> 15445 T1616 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15445 T1616 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 15450 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15450 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15450 T1664 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15450 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15450 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16095 T1665 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16095 T1665 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44099/_/ih collection:collection1 shard:shard2
[junit4:junit4] 2> 16098 T1665 oasc.ZkController.register We are http://127.0.0.1:44099/_/ih/collection1/ and leader is http://127.0.0.1:55923/_/ih/collection1/
[junit4:junit4] 2> 16098 T1665 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44099/_/ih
[junit4:junit4] 2> 16098 T1665 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16098 T1665 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C157 name=collection1 org.apache.solr.core.SolrCore@e3df78 url=http://127.0.0.1:44099/_/ih/collection1 node=127.0.0.1:44099__%2Fih C157_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:44099__%2Fih, core=collection1, state=down, collection=collection1, base_url=http://127.0.0.1:44099/_/ih}
[junit4:junit4] 2> 16099 T1667 C157 P44099 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16099 T1665 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16100 T1667 C157 P44099 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16100 T1667 C157 P44099 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16100 T1667 C157 P44099 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16100 T1593 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 16101 T1593 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16101 T1667 C157 P44099 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16101 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16166 T1593 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16168 T1593 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:32915
[junit4:junit4] 2> 16169 T1593 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16169 T1593 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16170 T1593 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362757306913
[junit4:junit4] 2> 16170 T1593 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362757306913/solr.xml
[junit4:junit4] 2> 16170 T1593 oasc.CoreContainer.<init> New CoreContainer 26598534
[junit4:junit4] 2> 16171 T1593 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362757306913/'
[junit4:junit4] 2> 16171 T1593 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362757306913/'
[junit4:junit4] 2> 16188 T1593 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 16189 T1593 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 16189 T1593 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 16190 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 16190 T1593 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 16190 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 16191 T1593 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 16191 T1593 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 16191 T1593 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 16192 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 16198 T1593 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16211 T1593 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57457/solr
[junit4:junit4] 2> 16211 T1593 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16212 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@162428b
[junit4:junit4] 2> 16212 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16213 T1677 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16213 T1677 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 16214 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35997
[junit4:junit4] 2> 16214 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35997
[junit4:junit4] 2> 16215 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b44000b with negotiated timeout 20000 for client /127.0.0.1:35997
[junit4:junit4] 2> 16215 T1677 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b44000b, negotiated timeout = 20000
[junit4:junit4] 2> 16215 T1678 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@162428b name:ZooKeeperConnection Watcher:127.0.0.1:57457 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16215 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16216 T1598 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4aaa0b44000b
[junit4:junit4] 2> 16217 T1678 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16217 T1595 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:35997 which had sessionid 0x13d4aaa0b44000b
[junit4:junit4] 2> 16216 T1593 oaz.ZooKeeper.close Session: 0x13d4aaa0b44000b closed
[junit4:junit4] 2> 16217 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 16220 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@86cb2c
[junit4:junit4] 2> 16221 T1679 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16221 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16221 T1679 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 16221 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:35998
[junit4:junit4] 2> 16221 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:35998
[junit4:junit4] 2> 16222 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b44000c with negotiated timeout 20000 for client /127.0.0.1:35998
[junit4:junit4] 2> 16222 T1679 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b44000c, negotiated timeout = 20000
[junit4:junit4] 2> 16222 T1680 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@86cb2c name:ZooKeeperConnection Watcher:127.0.0.1:57457/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16223 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16224 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b44000c type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16225 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b44000c type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16226 T1593 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 16956 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16957 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:44099__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44099/_/ih"}
[junit4:junit4] 2> 16966 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16966 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16966 T1664 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16966 T1680 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16966 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16966 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17105 T1630 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {state=recovering&coreNodeName=127.0.0.1:44099__%252Fih_collection1&core=collection1&wt=javabin&checkLive=true&nodeName=127.0.0.1:44099__%252Fih&version=2&onlyIfLeader=true&action=PREPRECOVERY} status=0 QTime=1000
[junit4:junit4] 2> 17228 T1593 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32915__%2Fih
[junit4:junit4] 2> 17230 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b44000c type:delete cxid:0xd zxid:0xa9 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:32915__%2Fih Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:32915__%2Fih
[junit4:junit4] 2> 17231 T1593 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32915__%2Fih
[junit4:junit4] 2> 17234 T1664 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17234 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17234 T1634 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17235 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17234 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17234 T1615 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17236 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17236 T1680 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17237 T1680 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17237 T1664 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17237 T1621 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17238 T1649 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17246 T1681 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362757306913/collection1
[junit4:junit4] 2> 17247 T1681 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17248 T1681 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17248 T1681 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17250 T1681 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362757306913/collection1/'
[junit4:junit4] 2> 17251 T1681 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362757306913/collection1/lib/README' to classloader
[junit4:junit4] 2> 17251 T1681 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362757306913/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17283 T1681 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 17319 T1681 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17320 T1681 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17324 T1681 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17696 T1681 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17702 T1681 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17704 T1681 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17717 T1681 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17720 T1681 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17731 T1681 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17733 T1681 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17734 T1681 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17734 T1681 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17735 T1681 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17736 T1681 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17736 T1681 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1362757306913/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4/
[junit4:junit4] 2> 17737 T1681 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32a9c2
[junit4:junit4] 2> 17737 T1681 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 17738 T1681 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4 forceNew: false
[junit4:junit4] 2> 17738 T1681 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4/index/
[junit4:junit4] 2> 17739 T1681 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17739 T1681 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4/index forceNew: false
[junit4:junit4] 2> 17743 T1681 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@82288f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17744 T1681 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17747 T1681 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17747 T1681 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17748 T1681 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17749 T1681 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17750 T1681 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17751 T1681 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17751 T1681 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17752 T1681 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17753 T1681 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17758 T1681 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17763 T1681 oass.SolrIndexSearcher.<init> Opening Searcher@163bf6b main
[junit4:junit4] 2> 17763 T1681 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17764 T1681 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17767 T1682 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@163bf6b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17769 T1681 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 17769 T1681 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18473 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18475 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:32915__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32915/_/ih"}
[junit4:junit4] 2> 18475 T1616 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 18475 T1616 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 18481 T1664 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18481 T1680 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18481 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18481 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18481 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18481 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18770 T1681 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 18770 T1681 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:32915/_/ih collection:collection1 shard:shard1
[junit4:junit4] 2> 18774 T1681 oasc.ZkController.register We are http://127.0.0.1:32915/_/ih/collection1/ and leader is http://127.0.0.1:51940/_/ih/collection1/
[junit4:junit4] 2> 18774 T1681 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32915/_/ih
[junit4:junit4] 2> 18775 T1681 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 18775 T1681 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C158 name=collection1 org.apache.solr.core.SolrCore@1b3c93e url=http://127.0.0.1:32915/_/ih/collection1 node=127.0.0.1:32915__%2Fih C158_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:32915__%2Fih, core=collection1, state=down, collection=collection1, base_url=http://127.0.0.1:32915/_/ih}
[junit4:junit4] 2> 18776 T1683 C158 P32915 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 18776 T1681 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18777 T1683 C158 P32915 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 18777 T1683 C158 P32915 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 18778 T1683 C158 P32915 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18778 T1593 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 18779 T1683 C158 P32915 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18779 T1593 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 18780 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18786 T1593 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18788 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18795 T1630 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/onenodecollectioncore
[junit4:junit4] 2> 18796 T1630 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 18797 T1630 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 18798 T1630 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 18799 T1630 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 18800 T1630 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 18804 T1630 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 18805 T1630 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/onenodecollectioncore/'
[junit4:junit4] 2> 18867 T1630 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 18906 T1630 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18906 T1630 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18911 T1630 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> C157_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:44099__%2Fih, core=collection1, state=recovering, collection=collection1, shard=shard2, base_url=http://127.0.0.1:44099/_/ih}
[junit4:junit4] 2> 19106 T1667 C157 P44099 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55923/_/ih/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19106 T1667 C157 P44099 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:44099/_/ih START replicas=[http://127.0.0.1:55923/_/ih/collection1/] nUpdates=100
[junit4:junit4] 2> 19106 T1667 C157 P44099 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19107 T1667 C157 P44099 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19107 T1667 C157 P44099 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19107 T1667 C157 P44099 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19108 T1667 C157 P44099 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19108 T1667 C157 P44099 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55923/_/ih/collection1/. core=collection1
[junit4:junit4] 2> 19108 T1667 C157 P44099 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C159 name=collection1 org.apache.solr.core.SolrCore@392045 url=http://127.0.0.1:55923/_/ih/collection1 node=127.0.0.1:55923__%2Fih C159_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:55923__%2Fih, core=collection1, state=active, collection=collection1, shard=shard2, base_url=http://127.0.0.1:55923/_/ih, leader=true}
[junit4:junit4] 2> 19112 T1629 C159 P55923 REQ /get {wt=javabin&getVersions=100&qt=/get&version=2&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 19113 T1627 C159 P55923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19115 T1627 C159 P55923 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bc4ff8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19115 T1627 C159 P55923 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19126 T1627 C159 P55923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bc4ff8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bc4ff8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19126 T1627 C159 P55923 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19127 T1627 C159 P55923 oass.SolrIndexSearcher.<init> Opening Searcher@4e4d44 realtime
[junit4:junit4] 2> 19127 T1627 C159 P55923 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19128 T1627 C159 P55923 /update {wt=javabin&softCommit=false&commit_end_point=true&openSearcher=false&waitSearcher=true&commit=true&version=2} {commit=} 0 15
[junit4:junit4] 2> 19128 T1667 C157 P44099 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19129 T1667 C157 P44099 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19131 T1628 C159 P55923 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19131 T1628 C159 P55923 REQ /replication {wt=javabin&qt=/replication&command=indexversion&version=2} status=0 QTime=2
[junit4:junit4] 2> 19132 T1667 C157 P44099 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19132 T1667 C157 P44099 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19132 T1667 C157 P44099 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19134 T1627 C159 P55923 REQ /replication {wt=javabin&generation=2&qt=/replication&command=filelist&version=2} status=0 QTime=1
[junit4:junit4] 2> 19134 T1667 C157 P44099 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19135 T1667 C157 P44099 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3/index.20130308164149943 forceNew: false
[junit4:junit4] 2> 19135 T1667 C157 P44099 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3/index.20130308164149943 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1488fd3; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 19138 T1629 C159 P55923 REQ /replication {checksum=true&wt=filestream&generation=2&file=segments_2&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 19139 T1667 C157 P44099 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19146 T1667 C157 P44099 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19147 T1667 C157 P44099 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19148 T1667 C157 P44099 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1876b3a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1876b3a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19148 T1667 C157 P44099 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19149 T1667 C157 P44099 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19149 T1667 C157 P44099 oass.SolrIndexSearcher.<init> Opening Searcher@102975f main
[junit4:junit4] 2> 19150 T1666 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@102975f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19151 T1667 C157 P44099 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty3/index.20130308164149943 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1488fd3; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4] 2> 19151 T1667 C157 P44099 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19152 T1667 C157 P44099 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19152 T1667 C157 P44099 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19152 T1667 C157 P44099 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19154 T1667 C157 P44099 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19339 T1630 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19346 T1630 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19349 T1630 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19358 T1630 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19363 T1630 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19366 T1630 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19367 T1630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19368 T1630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19368 T1630 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19369 T1630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19370 T1630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19371 T1630 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362757294249/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362757290814/onenodecollection/
[junit4:junit4] 2> 19371 T1630 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32a9c2
[junit4:junit4] 2> 19372 T1630 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 19373 T1630 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362757290814/onenodecollection forceNew: false
[junit4:junit4] 2> 19374 T1630 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362757290814/onenodecollection/index/
[junit4:junit4] 2> 19375 T1630 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362757290814/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19375 T1630 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362757290814/onenodecollection/index forceNew: false
[junit4:junit4] 2> 19397 T1630 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/solrtest-BasicDistributedZk2Test-1362757290814/onenodecollection/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b76a1; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19398 T1630 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19399 T1630 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19400 T1630 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19401 T1630 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19401 T1630 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19402 T1630 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19402 T1630 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19403 T1630 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19403 T1630 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19404 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19410 T1630 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19416 T1630 oass.SolrIndexSearcher.<init> Opening Searcher@f63a19 main
[junit4:junit4] 2> 19417 T1630 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19418 T1630 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19423 T1686 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@f63a19 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19425 T1630 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 19988 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19989 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:32915__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32915/_/ih"}
[junit4:junit4] 2> 19994 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:44099__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44099/_/ih"}
[junit4:junit4] 2> 19999 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:55923__%2Fih",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55923/_/ih"}
[junit4:junit4] 2> 19999 T1616 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 19999 T1616 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 20006 T1664 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20006 T1680 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20006 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20007 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20006 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20006 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20426 T1630 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 20426 T1630 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:55923/_/ih collection:onenodecollection shard:shard1
[junit4:junit4] 2> 20427 T1630 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 20431 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440006 type:delete cxid:0xa8 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 20432 T1630 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 20432 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440006 type:create cxid:0xa9 zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20433 T1630 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 20434 T1630 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 20434 T1630 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55923/_/ih/onenodecollectioncore/
[junit4:junit4] 2> 20435 T1630 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 20435 T1630 oasc.SyncStrategy.syncToMe http://127.0.0.1:55923/_/ih/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 20436 T1630 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55923/_/ih/onenodecollectioncore/
[junit4:junit4] 2> 20436 T1630 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 20438 T1598 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4aaa0b440006 type:create cxid:0xb3 zxid:0xc9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20787 T1643 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {state=recovering&coreNodeName=127.0.0.1:32915__%252Fih_collection1&core=collection1&wt=javabin&checkLive=true&nodeName=127.0.0.1:32915__%252Fih&version=2&onlyIfLeader=true&action=PREPRECOVERY} status=0 QTime=2000
[junit4:junit4] 2> 21516 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21521 T1680 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21522 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21522 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21522 T1664 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21521 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21521 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21542 T1630 oasc.ZkController.register We are http://127.0.0.1:55923/_/ih/onenodecollectioncore/ and leader is http://127.0.0.1:55923/_/ih/onenodecollectioncore/
[junit4:junit4] 2> 21543 T1630 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:55923/_/ih
[junit4:junit4] 2> 21543 T1630 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 21544 T1630 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 21546 T1630 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21547 T1630 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {name=onenodecollectioncore&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362757290814/onenodecollection&wt=javabin&collection=onenodecollection&version=2&numShards=1&roles=none&action=CREATE} status=0 QTime=2752
[junit4:junit4] 2> 21548 T1593 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21549 T1593 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22551 T1593 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C158_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:32915__%2Fih, core=collection1, state=recovering, collection=collection1, shard=shard1, base_url=http://127.0.0.1:32915/_/ih}
[junit4:junit4] 2> 22788 T1683 C158 P32915 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51940/_/ih/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 22788 T1683 C158 P32915 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:32915/_/ih START replicas=[http://127.0.0.1:51940/_/ih/collection1/] nUpdates=100
[junit4:junit4] 2> 22789 T1683 C158 P32915 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 22789 T1683 C158 P32915 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 22790 T1683 C158 P32915 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 22790 T1683 C158 P32915 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 22790 T1683 C158 P32915 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 22791 T1683 C158 P32915 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51940/_/ih/collection1/. core=collection1
[junit4:junit4] 2> 22791 T1683 C158 P32915 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C160 name=collection1 org.apache.solr.core.SolrCore@dcbb2b url=http://127.0.0.1:51940/_/ih/collection1 node=127.0.0.1:51940__%2Fih C160_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:51940__%2Fih, core=collection1, state=active, collection=collection1, shard=shard1, base_url=http://127.0.0.1:51940/_/ih, leader=true}
[junit4:junit4] 2> 22797 T1643 C160 P51940 REQ /get {wt=javabin&getVersions=100&qt=/get&version=2&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 22798 T1645 C160 P51940 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22802 T1645 C160 P51940 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@14ca744; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22803 T1645 C160 P51940 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22826 T1645 C160 P51940 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@14ca744; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@14ca744; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22827 T1645 C160 P51940 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22828 T1645 C160 P51940 oass.SolrIndexSearcher.<init> Opening Searcher@15d40b3 realtime
[junit4:junit4] 2> 22828 T1645 C160 P51940 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22829 T1645 C160 P51940 /update {wt=javabin&softCommit=false&commit_end_point=true&openSearcher=false&waitSearcher=true&commit=true&version=2} {commit=} 0 31
[junit4:junit4] 2> 22830 T1683 C158 P32915 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22830 T1683 C158 P32915 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 22832 T1644 C160 P51940 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22833 T1644 C160 P51940 REQ /replication {wt=javabin&qt=/replication&command=indexversion&version=2} status=0 QTime=1
[junit4:junit4] 2> 22834 T1683 C158 P32915 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 22834 T1683 C158 P32915 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 22834 T1683 C158 P32915 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 22837 T1643 C160 P51940 REQ /replication {wt=javabin&generation=2&qt=/replication&command=filelist&version=2} status=0 QTime=1
[junit4:junit4] 2> 22838 T1683 C158 P32915 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 22839 T1683 C158 P32915 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4/index.20130308164153647 forceNew: false
[junit4:junit4] 2> 22840 T1683 C158 P32915 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4/index.20130308164153647 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a5d5d8; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 22843 T1645 C160 P51940 REQ /replication {checksum=true&wt=filestream&generation=2&file=segments_2&qt=/replication&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 22844 T1683 C158 P32915 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 22857 T1683 C158 P32915 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22857 T1683 C158 P32915 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22860 T1683 C158 P32915 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@82288f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@82288f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22860 T1683 C158 P32915 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22861 T1683 C158 P32915 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 22861 T1683 C158 P32915 oass.SolrIndexSearcher.<init> Opening Searcher@187229f main
[junit4:junit4] 2> 22863 T1682 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@187229f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22864 T1683 C158 P32915 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-1362757290814/jetty4/index.20130308164153647 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a5d5d8; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4] 2> 22865 T1683 C158 P32915 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 22865 T1683 C158 P32915 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 22866 T1683 C158 P32915 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 22866 T1683 C158 P32915 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22886 T1683 C158 P32915 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23028 T1616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23029 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:55923__%2Fih",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55923/_/ih"}
[junit4:junit4] 2> 23034 T1616 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "node_name":"127.0.0.1:32915__%2Fih",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32915/_/ih"}
[junit4:junit4] 2> 23038 T1680 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23038 T1615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23038 T1621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23039 T1649 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23038 T1664 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23038 T1634 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23554 T1593 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23555 T1593 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 23556 T1593 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23574 T1643 oejs.Response.sendError WARNING Committed before 404 Can not find: /_/ih/onenodecollectioncore/update
[junit4:junit4] 2> 23574 T1593 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57457 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1249dd1
[junit4:junit4] 2> 23575 T1643 oejs.ServletHandler.doHandle WARNING /_/ih/onenodecollectioncore/update java.lang.IllegalStateException: Committed
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.resetBuffer(Response.java:1136)
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.sendError(Response.java:314)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$Servlet404.service(JettySolrRunner.java:465)
[junit4:junit4] 2> at javax.servlet.http.HttpServlet.service(HttpServlet.java:770)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1336)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:379)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 23575 T1593 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 23575 T1689 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57457. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 23576 T1689 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57457, initiating session
[junit4:junit4] 2> 23576 T1595 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:36022
[junit4:junit4] 2> 23577 T1595 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:36022
[junit4:junit4] 2> 23578 T1597 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4aaa0b44000d with negotiated timeout 10000 for client /127.0.0.1:36022
[junit4:junit4] 2> 23578 T1689 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57457, sessionid = 0x13d4aaa0b44000d, negotiated timeout = 10000
[junit4:junit4] 2> 23579 T1690 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1249dd1 name:ZooKeeperConnection Watcher:127.0.0.1:57457 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 23580 T1593 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> / (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr (7)
[junit4:junit4] 1> /solr/aliases.json (0)
[junit4:junit4] 1> /solr/configs (1)
[junit4:junit4] 1> /solr/configs/conf1 (9)
[junit4:junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details",
[junit4:junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4] 1> "timestamp": 1332070464,
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "base": "USD",
[junit4:junit4] 1> "rates": {
[junit4:junit4] 1> "USD": 1,
[junit4:junit4] 1> "JPY": 81.29,
[junit4:junit4] 1> "EUR": 2.5,
[junit4:junit4] 1> "GBP": 0.5,
[junit4:junit4] 1> "MXN": 2.0
[junit4:junit4] 1> }
[junit4:junit4] 1> }
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89309661811179523-127.0.0.1:49293__%2Fih-n_0000000000"}
[junit4:junit4] 1> /solr/overseer_elect/election (5)
[junit4:junit4] 1> /solr/overseer_elect/election/89309661811179532-127.0.0.1:32915__%2Fih-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89309661811179530-127.0.0.1:44099__%2Fih-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89309661811179526-127.0.0.1:55923__%2Fih-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89309661811179528-127.0.0.1:51940__%2Fih-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89309661811179523-127.0.0.1:49293__%2Fih-n_0000000000 (0)
[junit4:junit4] 1> /solr/clusterstate.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:49293__%2Fih_collection1":{
[junit4:junit4] 1> "node_name":"127.0.0.1:49293__%2Fih",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:49293/_/ih",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "onenodecollection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:55923__%2Fih_onenodecollectioncore":{
[junit4:junit4] 1> "node_name":"127.0.0.1:55923__%2Fih",
[junit4:junit4] 1> "core":"onenodecollectioncore",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"onenodecollection",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "roles":"none",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:55923/_/ih",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "collection1":{
[junit4:junit4] 1> "shards":{
[junit4:junit4] 1> "shard2":{
[junit4:junit4] 1> "range":"0-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "127.0.0.1:55923__%2Fih_collection1":{
[junit4:junit4] 1> "node_name":"127.0.0.1:55923__%2Fih",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:55923/_/ih",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "127.0.0.1:44099__%2Fih_collection1":{
[junit4:junit4] 1> "node_name":"127.0.0.1:44099__%2Fih",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:44099/_/ih"}}},
[junit4:junit4] 1> "shard1":{
[junit4:junit4] 1> "range":"80000000-ffffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "127.0.0.1:51940__%2Fih_collection1":{
[junit4:junit4] 1> "node_name":"127.0.0.1:51940__%2Fih",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:51940/_/ih",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "127.0.0.1:32915__%2Fih_collection1":{
[junit4:junit4] 1> "node_name":"127.0.0.1:32915__%2Fih",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:32915/_/ih"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /solr/live_nodes (5)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:32915__%2Fih (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:44099__%2Fih (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:55923__%2Fih (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:51940__%2Fih (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:49293__%2Fih (0)
[junit4:junit4] 1> /solr/collections (3)
[junit4:junit4] 1> /solr/collections/onenodecollection (2)
[junit4:junit4]
[...truncated too long message...]
tion2":{
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"unloadcollection2",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:57237",
[junit4:junit4] 1> "node_name":"127.0.0.1:57237_",
[junit4:junit4] 1> "collection":"unloadcollection",
[junit4:junit4] 1> "state":"active"}}}}}}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=5B6FFDBB68970E29 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lt -Dtests.timezone=Etc/GMT+5 -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 138s J0 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([5B6FFDBB68970E29:DA8973A31FC86E15]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 137982 T995 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 137990 T994 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 138448 T998 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=SimpleText), range_facet_sl=PostingsFormat(name=TestBloomFilteredLucene41Postings), intDefault=Pulsing41(freqCutoff=13 minBlockSize=20 maxBlockSize=117), multiDefault=Lucene41(blocksize=128), a_t=Pulsing41(freqCutoff=13 minBlockSize=20 maxBlockSize=117), text=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_si=Lucene41(blocksize=128), range_facet_l=Pulsing41(freqCutoff=13 minBlockSize=20 maxBlockSize=117), _version_=Pulsing41(freqCutoff=13 minBlockSize=20 maxBlockSize=117), timestamp=Pulsing41(freqCutoff=13 minBlockSize=20 maxBlockSize=117), other_tl1=Pulsing41(freqCutoff=13 minBlockSize=20 maxBlockSize=117), a_si=Lucene41(blocksize=128)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=lt, timezone=Etc/GMT+5
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=2,free=137020352,total=242745344
[junit4:junit4] 2> NOTE: All tests run in this JVM: [DistributedTermsComponentTest, AlternateDirectoryTest, SolrCoreTest, ZkControllerTest, SyncSliceTest, TestSolrDeletionPolicy2, HardAutoCommitTest, TestHashPartitioner, TestOmitPositions, DateFieldTest, TestBadConfig, TestPropInjectDefaults, TestStressRecovery, UUIDFieldTest, TestFuzzyAnalyzedSuggestions, SolrRequestParserTest, TestIBSimilarityFactory, LukeRequestHandlerTest, DocumentAnalysisRequestHandlerTest, RequiredFieldsTest, SOLR749Test, ZkCLITest, BinaryUpdateRequestHandlerTest, ResourceLoaderTest, ConvertedLegacyTest, JSONWriterTest, DirectSolrConnectionTest, TestFieldCollectionResource, TestCharFilters, SpellCheckCollatorTest, StatsComponentTest, BadComponentTest, SynonymTokenizerTest, WordBreakSolrSpellCheckerTest, ExternalFileFieldSortTest, AliasIntegrationTest, StatelessScriptUpdateProcessorFactoryTest, FieldMutatingUpdateProcessorTest, SystemInfoHandlerTest, TestQuerySenderListener, TestLazyCores, PolyFieldTest, LegacyHTMLStripCharFilterTest, RecoveryZkTest, TestSolrIndexConfig, BasicZkTest, TestJoin, ShardRoutingCustomTest, TestSearchPerf, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 138.52s, 1 test, 1 failure <<< FAILURES!
[...truncated 463 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 268 suites, 1130 tests, 1 error, 1 failure, 9 ignored (3 assumptions)
Total time: 42 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b79) - Build #
4593 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4593/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([DD66E7F1FADBC6A2:5C8069E98D84A69E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9251 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4] 2> 0 T1062 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 3 T1062 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922
[junit4:junit4] 2> 4 T1062 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 4 T1063 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 5 T1063 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 5 T1063 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 5 T1063 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 5 T1063 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 6 T1063 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-1362751849922/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 104 T1062 oasc.ZkTestServer.run start zk server on port:45341
[junit4:junit4] 2> 105 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4229383f
[junit4:junit4] 2> 105 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 105 T1068 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 106 T1068 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 106 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32783
[junit4:junit4] 2> 106 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32783
[junit4:junit4] 2> 107 T1066 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 519 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c50000 with negotiated timeout 10000 for client /127.0.0.1:32783
[junit4:junit4] 2> 519 T1068 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c50000, negotiated timeout = 10000
[junit4:junit4] 2> 519 T1069 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4229383f name:ZooKeeperConnection Watcher:127.0.0.1:45341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 520 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 520 T1062 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 523 T1067 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a5705c50000
[junit4:junit4] 2> 523 T1069 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 523 T1064 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:32783 which had sessionid 0x13d4a5705c50000
[junit4:junit4] 2> 523 T1062 oaz.ZooKeeper.close Session: 0x13d4a5705c50000 closed
[junit4:junit4] 2> 524 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4ceece0a
[junit4:junit4] 2> 524 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 525 T1070 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 525 T1070 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 525 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32784
[junit4:junit4] 2> 525 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32784
[junit4:junit4] 2> 526 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c50001 with negotiated timeout 10000 for client /127.0.0.1:32784
[junit4:junit4] 2> 526 T1070 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c50001, negotiated timeout = 10000
[junit4:junit4] 2> 526 T1071 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ceece0a name:ZooKeeperConnection Watcher:127.0.0.1:45341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 526 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 527 T1062 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 529 T1062 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 531 T1062 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 532 T1062 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 534 T1062 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 534 T1062 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 545 T1062 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 546 T1062 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 548 T1062 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 549 T1062 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 551 T1062 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 551 T1062 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 553 T1062 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 553 T1062 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 555 T1062 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 556 T1062 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 558 T1062 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 558 T1062 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 560 T1062 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 561 T1062 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 563 T1062 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 563 T1062 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 565 T1067 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a5705c50001
[junit4:junit4] 2> 566 T1071 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 566 T1064 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:32784 which had sessionid 0x13d4a5705c50001
[junit4:junit4] 2> 566 T1062 oaz.ZooKeeper.close Session: 0x13d4a5705c50001 closed
[junit4:junit4] 2> 621 T1062 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 624 T1062 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45458
[junit4:junit4] 2> 625 T1062 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 625 T1062 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 625 T1062 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362751850485
[junit4:junit4] 2> 625 T1062 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362751850485/solr.xml
[junit4:junit4] 2> 626 T1062 oasc.CoreContainer.<init> New CoreContainer 1814474984
[junit4:junit4] 2> 626 T1062 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362751850485/'
[junit4:junit4] 2> 626 T1062 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1362751850485/'
[junit4:junit4] 2> 642 T1062 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 642 T1062 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 643 T1062 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 643 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 643 T1062 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 644 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 644 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 644 T1062 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 645 T1062 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 645 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 650 T1062 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 662 T1062 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45341/solr
[junit4:junit4] 2> 662 T1062 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 663 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1049f14b
[junit4:junit4] 2> 664 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 664 T1081 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 665 T1081 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 665 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32785
[junit4:junit4] 2> 665 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32785
[junit4:junit4] 2> 666 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c50002 with negotiated timeout 20000 for client /127.0.0.1:32785
[junit4:junit4] 2> 666 T1081 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c50002, negotiated timeout = 20000
[junit4:junit4] 2> 666 T1082 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1049f14b name:ZooKeeperConnection Watcher:127.0.0.1:45341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 666 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 667 T1067 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a5705c50002
[junit4:junit4] 2> 668 T1064 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:32785 which had sessionid 0x13d4a5705c50002
[junit4:junit4] 2> 668 T1082 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 668 T1062 oaz.ZooKeeper.close Session: 0x13d4a5705c50002 closed
[junit4:junit4] 2> 668 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 671 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@43e71fab
[junit4:junit4] 2> 672 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 672 T1083 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 673 T1083 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 673 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32786
[junit4:junit4] 2> 673 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32786
[junit4:junit4] 2> 674 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c50003 with negotiated timeout 20000 for client /127.0.0.1:32786
[junit4:junit4] 2> 674 T1083 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c50003, negotiated timeout = 20000
[junit4:junit4] 2> 674 T1084 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43e71fab name:ZooKeeperConnection Watcher:127.0.0.1:45341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 674 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 675 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 676 T1062 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 677 T1062 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45458_
[junit4:junit4] 2> 678 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45458_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45458_
[junit4:junit4] 2> 678 T1062 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45458_
[junit4:junit4] 2> 680 T1062 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 684 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 684 T1062 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 686 T1062 oasc.Overseer.start Overseer (id=89309305236684803-127.0.0.1:45458_-n_0000000000) starting
[junit4:junit4] 2> 687 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 687 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 688 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 688 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 689 T1086 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 689 T1062 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 691 T1062 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 693 T1062 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 694 T1085 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 696 T1062 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 696 T1062 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 697 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 699 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 699 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@48596dd6
[junit4:junit4] 2> 700 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 700 T1087 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 701 T1087 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 701 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32787
[junit4:junit4] 2> 701 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32787
[junit4:junit4] 2> 702 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c50004 with negotiated timeout 10000 for client /127.0.0.1:32787
[junit4:junit4] 2> 702 T1087 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c50004, negotiated timeout = 10000
[junit4:junit4] 2> 702 T1088 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48596dd6 name:ZooKeeperConnection Watcher:127.0.0.1:45341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 702 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 703 T1062 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 705 T1062 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 777 T1062 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 779 T1062 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58255
[junit4:junit4] 2> 779 T1062 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 780 T1062 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 780 T1062 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362751850624
[junit4:junit4] 2> 780 T1062 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362751850624/solr.xml
[junit4:junit4] 2> 781 T1062 oasc.CoreContainer.<init> New CoreContainer 1574237564
[junit4:junit4] 2> 781 T1062 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362751850624/'
[junit4:junit4] 2> 781 T1062 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362751850624/'
[junit4:junit4] 2> 799 T1062 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 799 T1062 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 799 T1062 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 800 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 800 T1062 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 800 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 801 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 801 T1062 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 801 T1062 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 802 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 807 T1062 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 815 T1062 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45341/solr
[junit4:junit4] 2> 816 T1062 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 816 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@338a23d8
[junit4:junit4] 2> 817 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 817 T1098 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 817 T1098 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 818 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32788
[junit4:junit4] 2> 818 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32788
[junit4:junit4] 2> 819 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c50005 with negotiated timeout 20000 for client /127.0.0.1:32788
[junit4:junit4] 2> 819 T1098 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c50005, negotiated timeout = 20000
[junit4:junit4] 2> 819 T1099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@338a23d8 name:ZooKeeperConnection Watcher:127.0.0.1:45341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 819 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 820 T1067 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a5705c50005
[junit4:junit4] 2> 820 T1099 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 820 T1064 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:32788 which had sessionid 0x13d4a5705c50005
[junit4:junit4] 2> 820 T1062 oaz.ZooKeeper.close Session: 0x13d4a5705c50005 closed
[junit4:junit4] 2> 821 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 823 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2bce3181
[junit4:junit4] 2> 824 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 824 T1100 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 824 T1100 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 824 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32789
[junit4:junit4] 2> 825 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32789
[junit4:junit4] 2> 825 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c50006 with negotiated timeout 20000 for client /127.0.0.1:32789
[junit4:junit4] 2> 825 T1100 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c50006, negotiated timeout = 20000
[junit4:junit4] 2> 826 T1101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bce3181 name:ZooKeeperConnection Watcher:127.0.0.1:45341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 826 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 826 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50006 type:create cxid:0x1 zxid:0x2e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 827 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50006 type:create cxid:0x2 zxid:0x2f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 828 T1062 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1830 T1062 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58255_
[junit4:junit4] 2> 1831 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50006 type:delete cxid:0xb zxid:0x30 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58255_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58255_
[junit4:junit4] 2> 1832 T1062 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58255_
[junit4:junit4] 2> 1837 T1084 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1837 T1088 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1838 T1101 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1843 T1062 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1843 T1062 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1844 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1927 T1062 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 1930 T1062 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60810
[junit4:junit4] 2> 1930 T1062 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1931 T1062 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1931 T1062 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362751851766
[junit4:junit4] 2> 1931 T1062 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362751851766/solr.xml
[junit4:junit4] 2> 1931 T1062 oasc.CoreContainer.<init> New CoreContainer 1566896883
[junit4:junit4] 2> 1932 T1062 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362751851766/'
[junit4:junit4] 2> 1932 T1062 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362751851766/'
[junit4:junit4] 2> 1947 T1062 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1948 T1062 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1948 T1062 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1948 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1949 T1062 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1949 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1949 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1950 T1062 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1950 T1062 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1950 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1955 T1062 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 1974 T1062 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45341/solr
[junit4:junit4] 2> 1974 T1062 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1974 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@53359990
[junit4:junit4] 2> 1975 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1975 T1111 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1976 T1111 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 1976 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32790
[junit4:junit4] 2> 1977 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32790
[junit4:junit4] 2> 1978 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c50007 with negotiated timeout 20000 for client /127.0.0.1:32790
[junit4:junit4] 2> 1978 T1111 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c50007, negotiated timeout = 20000
[junit4:junit4] 2> 1978 T1112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53359990 name:ZooKeeperConnection Watcher:127.0.0.1:45341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1978 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1979 T1067 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a5705c50007
[junit4:junit4] 2> 1980 T1112 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1980 T1064 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:32790 which had sessionid 0x13d4a5705c50007
[junit4:junit4] 2> 1980 T1062 oaz.ZooKeeper.close Session: 0x13d4a5705c50007 closed
[junit4:junit4] 2> 1980 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1983 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4148e26b
[junit4:junit4] 2> 1983 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1984 T1113 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1984 T1113 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 1984 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32791
[junit4:junit4] 2> 1985 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32791
[junit4:junit4] 2> 1986 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c50008 with negotiated timeout 20000 for client /127.0.0.1:32791
[junit4:junit4] 2> 1986 T1113 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c50008, negotiated timeout = 20000
[junit4:junit4] 2> 1986 T1114 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4148e26b name:ZooKeeperConnection Watcher:127.0.0.1:45341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1986 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1987 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50008 type:create cxid:0x1 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1987 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50008 type:create cxid:0x2 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1989 T1062 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2991 T1062 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60810_
[junit4:junit4] 2> 2992 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50008 type:delete cxid:0xb zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60810_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60810_
[junit4:junit4] 2> 2993 T1062 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60810_
[junit4:junit4] 2> 2996 T1088 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2997 T1084 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2997 T1101 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2997 T1114 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3003 T1062 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3003 T1062 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3004 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3064 T1062 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3066 T1062 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:32996
[junit4:junit4] 2> 3067 T1062 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3067 T1062 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3067 T1062 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362751852927
[junit4:junit4] 2> 3068 T1062 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362751852927/solr.xml
[junit4:junit4] 2> 3068 T1062 oasc.CoreContainer.<init> New CoreContainer 55616541
[junit4:junit4] 2> 3068 T1062 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362751852927/'
[junit4:junit4] 2> 3069 T1062 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362751852927/'
[junit4:junit4] 2> 3084 T1062 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3085 T1062 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3085 T1062 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3085 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3086 T1062 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3086 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3086 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3087 T1062 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3087 T1062 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3087 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3092 T1062 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3101 T1062 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45341/solr
[junit4:junit4] 2> 3101 T1062 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3101 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2d8188f4
[junit4:junit4] 2> 3102 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3102 T1124 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3103 T1124 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 3103 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32792
[junit4:junit4] 2> 3104 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32792
[junit4:junit4] 2> 3104 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c50009 with negotiated timeout 20000 for client /127.0.0.1:32792
[junit4:junit4] 2> 3104 T1124 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c50009, negotiated timeout = 20000
[junit4:junit4] 2> 3105 T1125 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d8188f4 name:ZooKeeperConnection Watcher:127.0.0.1:45341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3105 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3112 T1067 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a5705c50009
[junit4:junit4] 2> 3113 T1125 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3113 T1064 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:32792 which had sessionid 0x13d4a5705c50009
[junit4:junit4] 2> 3113 T1062 oaz.ZooKeeper.close Session: 0x13d4a5705c50009 closed
[junit4:junit4] 2> 3113 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3117 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@547b1059
[junit4:junit4] 2> 3118 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3118 T1126 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3119 T1126 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 3119 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32793
[junit4:junit4] 2> 3119 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32793
[junit4:junit4] 2> 3120 T1126 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c5000a, negotiated timeout = 20000
[junit4:junit4] 2> 3120 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c5000a with negotiated timeout 20000 for client /127.0.0.1:32793
[junit4:junit4] 2> 3121 T1127 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@547b1059 name:ZooKeeperConnection Watcher:127.0.0.1:45341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3121 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3122 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c5000a type:create cxid:0x1 zxid:0x3e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3122 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c5000a type:create cxid:0x2 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3124 T1062 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4127 T1062 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32996_
[junit4:junit4] 2> 4128 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c5000a type:delete cxid:0xb zxid:0x40 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:32996_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:32996_
[junit4:junit4] 2> 4128 T1062 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32996_
[junit4:junit4] 2> 4132 T1084 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4132 T1088 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4132 T1114 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4132 T1127 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4132 T1101 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4136 T1062 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 4136 T1062 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4137 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4196 T1062 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4198 T1062 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35856
[junit4:junit4] 2> 4199 T1062 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4199 T1062 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4199 T1062 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362751854058
[junit4:junit4] 2> 4200 T1062 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362751854058/solr.xml
[junit4:junit4] 2> 4200 T1062 oasc.CoreContainer.<init> New CoreContainer 833612939
[junit4:junit4] 2> 4200 T1062 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362751854058/'
[junit4:junit4] 2> 4201 T1062 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1362751854058/'
[junit4:junit4] 2> 4217 T1062 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4217 T1062 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4217 T1062 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4218 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4218 T1062 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4218 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4219 T1062 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4219 T1062 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4219 T1062 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4220 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4225 T1062 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4234 T1062 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:45341/solr
[junit4:junit4] 2> 4235 T1062 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4235 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@67a6a5de
[junit4:junit4] 2> 4236 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4236 T1137 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4237 T1137 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 4237 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32794
[junit4:junit4] 2> 4237 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32794
[junit4:junit4] 2> 4238 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c5000b with negotiated timeout 20000 for client /127.0.0.1:32794
[junit4:junit4] 2> 4238 T1137 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c5000b, negotiated timeout = 20000
[junit4:junit4] 2> 4238 T1138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67a6a5de name:ZooKeeperConnection Watcher:127.0.0.1:45341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4238 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4239 T1067 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4a5705c5000b
[junit4:junit4] 2> 4240 T1064 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:32794 which had sessionid 0x13d4a5705c5000b
[junit4:junit4] 2> 4240 T1062 oaz.ZooKeeper.close Session: 0x13d4a5705c5000b closed
[junit4:junit4] 2> 4240 T1138 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4240 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4243 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@41ba55ee
[junit4:junit4] 2> 4244 T1139 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4244 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4245 T1139 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 4245 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32795
[junit4:junit4] 2> 4245 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32795
[junit4:junit4] 2> 4246 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c5000c with negotiated timeout 20000 for client /127.0.0.1:32795
[junit4:junit4] 2> 4246 T1139 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c5000c, negotiated timeout = 20000
[junit4:junit4] 2> 4247 T1140 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41ba55ee name:ZooKeeperConnection Watcher:127.0.0.1:45341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4247 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4248 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c5000c type:create cxid:0x1 zxid:0x46 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4249 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c5000c type:create cxid:0x2 zxid:0x47 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4250 T1062 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5253 T1062 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35856_
[junit4:junit4] 2> 5254 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c5000c type:delete cxid:0xb zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35856_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35856_
[junit4:junit4] 2> 5255 T1062 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35856_
[junit4:junit4] 2> 5257 T1101 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5257 T1114 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5258 T1127 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5258 T1088 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5258 T1084 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5258 T1140 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5263 T1062 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 5264 T1062 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 5264 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5267 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5270 T1094 oasc.CoreContainer.create Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362751850624/unloadcollection1
[junit4:junit4] 2> 5270 T1094 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 5271 T1094 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:unloadcollection
[junit4:junit4] 2> 5271 T1094 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 5272 T1094 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 5272 T1094 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection
[junit4:junit4] 2> 5274 T1094 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 5275 T1094 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362751850624/unloadcollection1/'
[junit4:junit4] 2> 5307 T1094 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 5333 T1094 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5334 T1094 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5338 T1094 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5643 T1094 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5648 T1094 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5650 T1094 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5660 T1094 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5662 T1094 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5665 T1094 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5666 T1094 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5667 T1094 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5667 T1094 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5667 T1094 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5668 T1094 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5668 T1094 oasc.SolrCore.<init> [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362751850624/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751855188unloadcollection1_1n/
[junit4:junit4] 2> 5668 T1094 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36bbb1c7
[junit4:junit4] 2> 5669 T1094 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5669 T1094 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751855188unloadcollection1_1n forceNew: false
[junit4:junit4] 2> 5670 T1094 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751855188unloadcollection1_1n/index/
[junit4:junit4] 2> 5670 T1094 oasc.SolrCore.initIndex WARNING [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751855188unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5676 T1094 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751855188unloadcollection1_1n/index forceNew: false
[junit4:junit4] 2> 5678 T1094 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d7ea1a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ae23f40)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5678 T1094 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5679 T1094 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5680 T1094 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5680 T1094 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5681 T1094 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5681 T1094 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5681 T1094 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5682 T1094 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5682 T1094 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5682 T1094 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5684 T1094 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5686 T1094 oass.SolrIndexSearcher.<init> Opening Searcher@72c89a1 main
[junit4:junit4] 2> 5687 T1094 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751855188unloadcollection1_1n/tlog
[junit4:junit4] 2> 5687 T1094 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5688 T1094 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5690 T1141 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@72c89a1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5691 T1094 oasc.ZkController.publish publishing core=unloadcollection1 state=down
[junit4:junit4] 2> 5691 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50006 type:create cxid:0x40 zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 6702 T1085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6702 T1085 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58255",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"unloadcollection1",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58255_"}
[junit4:junit4] 2> 6703 T1085 oasc.Overseer$ClusterStateUpdater.createCollection Create collection unloadcollection with numShards 1
[junit4:junit4] 2> 6703 T1085 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6703 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50003 type:create cxid:0x46 zxid:0x4f txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 6708 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6708 T1114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6708 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6708 T1140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6708 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6708 T1127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6750 T1094 oasc.CoreContainer.registerCore registering core: unloadcollection1
[junit4:junit4] 2> 6751 T1094 oasc.ZkController.register Register replica - core:unloadcollection1 address:http://127.0.0.1:58255 collection:unloadcollection shard:shard1
[junit4:junit4] 2> 6752 T1094 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4] 2> 6756 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50006 type:delete cxid:0x51 zxid:0x59 txntype:-1 reqpath:n/a Error Path:/solr/collections/unloadcollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/unloadcollection/leaders
[junit4:junit4] 2> 6757 T1094 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 6757 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50006 type:create cxid:0x52 zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6759 T1094 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 6759 T1094 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 6759 T1094 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58255/unloadcollection1/
[junit4:junit4] 2> 6760 T1094 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 6760 T1094 oasc.SyncStrategy.syncToMe http://127.0.0.1:58255/unloadcollection1/ has no replicas
[junit4:junit4] 2> 6760 T1094 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58255/unloadcollection1/
[junit4:junit4] 2> 6761 T1094 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4] 2> 6764 T1067 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4a5705c50006 type:create cxid:0x5c zxid:0x5e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8212 T1085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8217 T1127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8217 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8217 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8217 T1114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8217 T1140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8217 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8269 T1094 oasc.ZkController.register We are http://127.0.0.1:58255/unloadcollection1/ and leader is http://127.0.0.1:58255/unloadcollection1/
[junit4:junit4] 2> 8270 T1094 oasc.ZkController.register No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:58255
[junit4:junit4] 2> 8270 T1094 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8270 T1094 oasc.ZkController.publish publishing core=unloadcollection1 state=active
[junit4:junit4] 2> 8279 T1094 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8280 T1094 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362751850624/solr.xml
[junit4:junit4] 2> 8288 T1094 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1362751850624/solr.xml
[junit4:junit4] 2> 8289 T1094 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {name=unloadcollection1&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751855188unloadcollection1_1n&numShards=1&wt=javabin&collection=unloadcollection&action=CREATE&version=2} status=0 QTime=3019
[junit4:junit4] 2> 8289 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 8291 T1062 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:45341/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@52e36272
[junit4:junit4] 2> 8292 T1062 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8292 T1142 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:45341. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8292 T1142 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:45341, initiating session
[junit4:junit4] 2> 8292 T1064 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:32808
[junit4:junit4] 2> 8293 T1064 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:32808
[junit4:junit4] 2> 8294 T1066 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4a5705c5000d with negotiated timeout 10000 for client /127.0.0.1:32808
[junit4:junit4] 2> 8294 T1142 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:45341, sessionid = 0x13d4a5705c5000d, negotiated timeout = 10000
[junit4:junit4] 2> 8294 T1143 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52e36272 name:ZooKeeperConnection Watcher:127.0.0.1:45341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8295 T1062 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8296 T1062 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 8298 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8298 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8302 T1107 oasc.CoreContainer.create Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362751851766/unloadcollection2
[junit4:junit4] 2> 8302 T1107 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 8303 T1107 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 8303 T1107 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 8304 T1107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362751851766/unloadcollection2/'
[junit4:junit4] 2> 8329 T1107 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 8364 T1107 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 8365 T1107 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 8368 T1107 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 8697 T1107 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 8703 T1107 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 8705 T1107 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 8714 T1107 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8718 T1107 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8721 T1107 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8722 T1107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8723 T1107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8723 T1107 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8724 T1107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8724 T1107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8724 T1107 oasc.SolrCore.<init> [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362751851766/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751858220unloadcollection1_2n/
[junit4:junit4] 2> 8724 T1107 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36bbb1c7
[junit4:junit4] 2> 8725 T1107 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 8726 T1107 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751858220unloadcollection1_2n forceNew: false
[junit4:junit4] 2> 8726 T1107 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751858220unloadcollection1_2n/index/
[junit4:junit4] 2> 8726 T1107 oasc.SolrCore.initIndex WARNING [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751858220unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 8727 T1107 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751858220unloadcollection1_2n/index forceNew: false
[junit4:junit4] 2> 8728 T1107 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1805c7cd lockFactory=org.apache.lucene.store.NativeFSLockFactory@765f8172)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 8728 T1107 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 8730 T1107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 8730 T1107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 8731 T1107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 8731 T1107 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 8732 T1107 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 8732 T1107 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 8732 T1107 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 8733 T1107 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 8733 T1107 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 8735 T1107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 8737 T1107 oass.SolrIndexSearcher.<init> Opening Searcher@2b8d3e79 main
[junit4:junit4] 2> 8738 T1107 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751858220unloadcollection1_2n/tlog
[junit4:junit4] 2> 8738 T1107 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 8739 T1107 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 8742 T1144 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@2b8d3e79 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 8742 T1107 oasc.ZkController.publish publishing core=unloadcollection2 state=down
[junit4:junit4] 2> 8743 T1107 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9723 T1085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9724 T1085 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58255",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"unloadcollection1",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58255_"}
[junit4:junit4] 2> 9727 T1085 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60810",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60810_"}
[junit4:junit4] 2> 9727 T1085 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 9727 T1085 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 9730 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9730 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9730 T1127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9730 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9730 T1143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9730 T1114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9730 T1140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9744 T1107 oasc.CoreContainer.registerCore registering core: unloadcollection2
[junit4:junit4] 2> 9744 T1107 oasc.ZkController.register Register replica - core:unloadcollection2 address:http://127.0.0.1:60810 collection:unloadcollection shard:shard1
[junit4:junit4] 2> 9747 T1107 oasc.ZkController.register We are http://127.0.0.1:60810/unloadcollection2/ and leader is http://127.0.0.1:58255/unloadcollection1/
[junit4:junit4] 2> 9747 T1107 oasc.ZkController.register No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:60810
[junit4:junit4] 2> 9747 T1107 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection2
[junit4:junit4] 2> 9747 T1107 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C81 name=unloadcollection2 org.apache.solr.core.SolrCore@68ffabf8 url=http://127.0.0.1:60810/unloadcollection2 node=127.0.0.1:60810_ C81_STATE=coll:unloadcollection core:unloadcollection2 props:{base_url=http://127.0.0.1:60810, state=down, core=unloadcollection2, collection=unloadcollection, node_name=127.0.0.1:60810_}
[junit4:junit4] 2> 9748 T1145 C81 P60810 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4] 2> 9748 T1145 C81 P60810 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 9748 T1107 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9748 T1145 C81 P60810 oasc.ZkController.publish publishing core=unloadcollection2 state=recovering
[junit4:junit4] 2> 9749 T1145 C81 P60810 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9749 T1107 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362751851766/solr.xml
[junit4:junit4] 2> 9749 T1145 C81 P60810 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 9755 T1107 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1362751851766/solr.xml
[junit4:junit4] 2> 9756 T1107 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {name=unloadcollection2&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751858220unloadcollection1_2n&wt=javabin&collection=unloadcollection&action=CREATE&version=2} status=0 QTime=1454
[junit4:junit4] 2> 9758 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9759 T1062 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 9760 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10761 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11235 T1085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11236 T1085 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60810",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60810_"}
[junit4:junit4] 2> 11239 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11239 T1140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11239 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11239 T1143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11239 T1127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11239 T1114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11239 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11754 T1094 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {state=recovering&nodeName=127.0.0.1:60810_&wt=javabin&checkLive=true&core=unloadcollection1&onlyIfLeader=true&action=PREPRECOVERY&version=2&coreNodeName=127.0.0.1:60810__unloadcollection2} status=0 QTime=2001
[junit4:junit4] 2> 11763 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12764 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C81_STATE=coll:unloadcollection core:unloadcollection2 props:{base_url=http://127.0.0.1:60810, state=recovering, shard=shard1, core=unloadcollection2, collection=unloadcollection, node_name=127.0.0.1:60810_}
[junit4:junit4] 2> 13754 T1145 C81 P60810 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:58255/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4] 2> 13755 T1145 C81 P60810 oasu.PeerSync.sync PeerSync: core=unloadcollection2 url=http://127.0.0.1:60810 START replicas=[http://127.0.0.1:58255/unloadcollection1/] nUpdates=100
[junit4:junit4] 2> 13755 T1145 C81 P60810 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 13756 T1145 C81 P60810 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4] 2> 13756 T1145 C81 P60810 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection2
[junit4:junit4] 2> 13756 T1145 C81 P60810 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection2
[junit4:junit4] 2> 13756 T1145 C81 P60810 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 13756 T1145 C81 P60810 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:58255/unloadcollection1/. core=unloadcollection2
[junit4:junit4] 2> 13757 T1145 C81 P60810 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C82 name=unloadcollection1 org.apache.solr.core.SolrCore@3e8e06d6 url=http://127.0.0.1:58255/unloadcollection1 node=127.0.0.1:58255_ C82_STATE=coll:unloadcollection core:unloadcollection1 props:{base_url=http://127.0.0.1:58255, state=active, shard=shard1, core=unloadcollection1, collection=unloadcollection, node_name=127.0.0.1:58255_, leader=true}
[junit4:junit4] 2> 13759 T1094 C82 P58255 REQ /get {getVersions=100&wt=javabin&qt=/get&distrib=false&version=2} status=0 QTime=0
[junit4:junit4] 2> 13762 T1095 C82 P58255 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 13764 T1095 C82 P58255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d7ea1a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ae23f40)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13765 T1095 C82 P58255 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13766 T1095 C82 P58255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d7ea1a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ae23f40)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d7ea1a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ae23f40)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 13766 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13766 T1095 C82 P58255 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 13767 T1095 C82 P58255 oass.SolrIndexSearcher.<init> Opening Searcher@34a3e092 realtime
[junit4:junit4] 2> 13767 T1095 C82 P58255 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 13767 T1095 C82 P58255 /update {wt=javabin&softCommit=false&openSearcher=false&commit_end_point=true&commit=true&waitSearcher=true&version=2} {commit=} 0 5
[junit4:junit4] 2> 13768 T1145 C81 P60810 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 13769 T1145 C81 P60810 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 13785 T1097 C82 P58255 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 13785 T1097 C82 P58255 REQ /replication {qt=/replication&wt=javabin&command=indexversion&version=2} status=0 QTime=15
[junit4:junit4] 2> 13786 T1145 C81 P60810 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 13786 T1145 C81 P60810 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 13786 T1145 C81 P60810 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 13789 T1094 C82 P58255 REQ /replication {qt=/replication&wt=javabin&command=filelist&version=2&generation=2} status=0 QTime=0
[junit4:junit4] 2> 13789 T1145 C81 P60810 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 13790 T1145 C81 P60810 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751858220unloadcollection1_2n/index.20130308161103708 forceNew: false
[junit4:junit4] 2> 13790 T1145 C81 P60810 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ad0a491 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2c801210) fullCopy=false
[junit4:junit4] 2> 13793 T1095 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=segments_2&generation=2} status=0 QTime=1
[junit4:junit4] 2> 13794 T1145 C81 P60810 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 13794 T1145 C81 P60810 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 13795 T1145 C81 P60810 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4] 2> 13796 T1145 C81 P60810 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1805c7cd lockFactory=org.apache.lucene.store.NativeFSLockFactory@765f8172)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1805c7cd lockFactory=org.apache.lucene.store.NativeFSLockFactory@765f8172)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 13797 T1145 C81 P60810 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 13797 T1145 C81 P60810 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 13797 T1145 C81 P60810 oass.SolrIndexSearcher.<init> Opening Searcher@3c052ff8 main
[junit4:junit4] 2> 13798 T1144 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@3c052ff8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 13798 T1145 C81 P60810 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ad0a491 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2c801210)
[junit4:junit4] 2> 13798 T1145 C81 P60810 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection2
[junit4:junit4] 2> 13799 T1145 C81 P60810 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4] 2> 13799 T1145 C81 P60810 oasc.ZkController.publish publishing core=unloadcollection2 state=active
[junit4:junit4] 2> 13799 T1145 C81 P60810 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13800 T1145 C81 P60810 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection2
[junit4:junit4] 2> 14245 T1085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14246 T1085 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60810",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60810_"}
[junit4:junit4] 2> 14249 T1127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14249 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14249 T1143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14250 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14250 T1114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14249 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14249 T1140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14767 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14769 T1062 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4] 2> 14769 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> C81_STATE=coll:unloadcollection core:unloadcollection2 props:{base_url=http://127.0.0.1:60810, state=active, shard=shard1, core=unloadcollection2, collection=unloadcollection, node_name=127.0.0.1:60810_}
[junit4:junit4] 2> 14784 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[6 (1428948899272327168)]} 0 2
[junit4:junit4] 2> 14785 T1095 C82 P58255 /update {wt=javabin&version=2} {add=[6 (1428948899272327168)]} 0 11
[junit4:junit4] 2> 14791 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[7 (1428948899285958656)]} 0 0
[junit4:junit4] 2> 14792 T1096 C82 P58255 /update {wt=javabin&version=2} {add=[7 (1428948899285958656)]} 0 5
[junit4:junit4] 2> 14798 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[8 (1428948899293298688)]} 0 1
[junit4:junit4] 2> 14798 T1097 C82 P58255 /update {wt=javabin&version=2} {add=[8 (1428948899293298688)]} 0 4
[junit4:junit4] 2> 14801 T1094 C82 P58255 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14807 T1094 C82 P58255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d7ea1a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ae23f40)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d7ea1a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ae23f40)),segFN=segments_3,generation=3,filenames=[_0_MockRandom_0.tib, _0.fnm, _0.nvm, _0.nvd, _0.fdt, _0.fdx, _0_MockRandom_0.pos, _0_NestedPulsing_0.doc, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_NestedPulsing_0.pos, _0_NestedPulsing_0.tim, _0_MockRandom_0.skp, _0_Memory_0.ram, _0_MockRandom_0.pyl, _0_NestedPulsing_0.tip, _0_MockRandom_0.doc, _0_SimpleText_0.pst, segments_3, _0.si, _0_MockRandom_0.tiv]
[junit4:junit4] 2> 14807 T1094 C82 P58255 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_MockRandom_0.tib, _0.fnm, _0.nvm, _0.nvd, _0.fdt, _0.fdx, _0_MockRandom_0.pos, _0_NestedPulsing_0.doc, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_NestedPulsing_0.pos, _0_NestedPulsing_0.tim, _0_MockRandom_0.skp, _0_Memory_0.ram, _0_MockRandom_0.pyl, _0_NestedPulsing_0.tip, _0_MockRandom_0.doc, _0_SimpleText_0.pst, segments_3, _0.si, _0_MockRandom_0.tiv]
[junit4:junit4] 2> 14808 T1094 C82 P58255 oass.SolrIndexSearcher.<init> Opening Searcher@7d85f2f2 main
[junit4:junit4] 2> 14809 T1094 C82 P58255 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14809 T1141 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@7d85f2f2 main{StandardDirectoryReader(segments_3:3:nrt _0(4.2):C3)}
[junit4:junit4] 2> 14810 T1094 C82 P58255 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:60810/unloadcollection2/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 14812 T1109 C81 P60810 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14816 T1109 C81 P60810 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1805c7cd lockFactory=org.apache.lucene.store.NativeFSLockFactory@765f8172)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1805c7cd lockFactory=org.apache.lucene.store.NativeFSLockFactory@765f8172)),segFN=segments_3,generation=3,filenames=[_0_MockRandom_0.tib, _0.fnm, _0.nvm, _0.nvd, _0.fdt, _0.fdx, _0_MockRandom_0.pos, _0_NestedPulsing_0.doc, _0_MockRandom_0.sd, _0_NestedPulsing_0.pos, _0_NestedPulsing_0.tim, _0_Memory_0.ram, _0_NestedPulsing_0.tip, _0_MockRandom_0.doc, _0_SimpleText_0.pst, segments_3, _0.si, _0_MockRandom_0.tiv]
[junit4:junit4] 2> 14816 T1109 C81 P60810 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_MockRandom_0.tib, _0.fnm, _0.nvm, _0.nvd, _0.fdt, _0.fdx, _0_MockRandom_0.pos, _0_NestedPulsing_0.doc, _0_MockRandom_0.sd, _0_NestedPulsing_0.pos, _0_NestedPulsing_0.tim, _0_Memory_0.ram, _0_NestedPulsing_0.tip, _0_MockRandom_0.doc, _0_SimpleText_0.pst, segments_3, _0.si, _0_MockRandom_0.tiv]
[junit4:junit4] 2> 14818 T1109 C81 P60810 oass.SolrIndexSearcher.<init> Opening Searcher@72ebcf7a main
[junit4:junit4] 2> 14818 T1109 C81 P60810 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14819 T1144 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@72ebcf7a main{StandardDirectoryReader(segments_3:3:nrt _0(4.2):C3)}
[junit4:junit4] 2> 14819 T1109 C81 P60810 /update {wt=javabin&softCommit=false&expungeDeletes=false&commit_end_point=true&commit=true&waitSearcher=true&version=2} {commit=} 0 7
[junit4:junit4] 2> 14820 T1094 C82 P58255 /update {wt=javabin&softCommit=false&commit=true&waitSearcher=true&version=2} {commit=} 0 19
[junit4:junit4] 2> 14820 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14825 T1120 oasc.CoreContainer.create Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362751852927/unloadcollection3
[junit4:junit4] 2> 14826 T1120 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 14827 T1120 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14827 T1120 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 14828 T1120 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362751852927/unloadcollection3/'
[junit4:junit4] 2> 14871 T1120 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_42
[junit4:junit4] 2> 14913 T1120 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14914 T1120 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14919 T1120 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15283 T1120 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15287 T1120 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15290 T1120 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15300 T1120 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15303 T1120 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15305 T1120 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15306 T1120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15306 T1120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15307 T1120 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15308 T1120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15308 T1120 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15308 T1120 oasc.SolrCore.<init> [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362751852927/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751864743unloadcollection_3n/
[junit4:junit4] 2> 15308 T1120 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@36bbb1c7
[junit4:junit4] 2> 15309 T1120 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15309 T1120 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751864743unloadcollection_3n forceNew: false
[junit4:junit4] 2> 15310 T1120 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751864743unloadcollection_3n/index/
[junit4:junit4] 2> 15310 T1120 oasc.SolrCore.initIndex WARNING [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751864743unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15310 T1120 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751864743unloadcollection_3n/index forceNew: false
[junit4:junit4] 2> 15312 T1120 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@29cbbb0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@5610757e)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15312 T1120 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15314 T1120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15314 T1120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15314 T1120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15315 T1120 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15315 T1120 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15315 T1120 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15316 T1120 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15316 T1120 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15316 T1120 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15319 T1120 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15321 T1120 oass.SolrIndexSearcher.<init> Opening Searcher@441742f1 main
[junit4:junit4] 2> 15321 T1120 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751864743unloadcollection_3n/tlog
[junit4:junit4] 2> 15322 T1120 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15322 T1120 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15331 T1149 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@441742f1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15331 T1120 oasc.ZkController.publish publishing core=unloadcollection3 state=down
[junit4:junit4] 2> 15332 T1120 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15754 T1085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15754 T1085 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32996",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:32996_"}
[junit4:junit4] 2> 15755 T1085 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 15755 T1085 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 15879 T1140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15879 T1127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15879 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15879 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15879 T1114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15879 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15879 T1143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16333 T1120 oasc.CoreContainer.registerCore registering core: unloadcollection3
[junit4:junit4] 2> 16333 T1120 oasc.ZkController.register Register replica - core:unloadcollection3 address:http://127.0.0.1:32996 collection:unloadcollection shard:shard1
[junit4:junit4] 2> 16336 T1120 oasc.ZkController.register We are http://127.0.0.1:32996/unloadcollection3/ and leader is http://127.0.0.1:58255/unloadcollection1/
[junit4:junit4] 2> 16336 T1120 oasc.ZkController.register No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:32996
[junit4:junit4] 2> 16337 T1120 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection3
[junit4:junit4] 2> 16337 T1120 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C83 name=unloadcollection3 org.apache.solr.core.SolrCore@24119b24 url=http://127.0.0.1:32996/unloadcollection3 node=127.0.0.1:32996_ C83_STATE=coll:unloadcollection core:unloadcollection3 props:{base_url=http://127.0.0.1:32996, state=down, core=unloadcollection3, collection=unloadcollection, node_name=127.0.0.1:32996_}
[junit4:junit4] 2> 16338 T1150 C83 P32996 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4] 2> 16338 T1150 C83 P32996 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16339 T1150 C83 P32996 oasc.ZkController.publish publishing core=unloadcollection3 state=recovering
[junit4:junit4] 2> 16339 T1150 C83 P32996 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16339 T1120 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16340 T1150 C83 P32996 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16340 T1120 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362751852927/solr.xml
[junit4:junit4] 2> 16345 T1120 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1362751852927/solr.xml
[junit4:junit4] 2> 16346 T1120 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {name=unloadcollection3&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751864743unloadcollection_3n&wt=javabin&collection=unloadcollection&action=CREATE&version=2} status=0 QTime=1521
[junit4:junit4] 2> 16346 T1062 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 16347 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17348 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17384 T1085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17384 T1085 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32996",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:32996_"}
[junit4:junit4] 2> 17387 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17387 T1143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17387 T1127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17388 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17387 T1114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17387 T1140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17388 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18344 T1097 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {state=recovering&nodeName=127.0.0.1:32996_&wt=javabin&checkLive=true&core=unloadcollection1&onlyIfLeader=true&action=PREPRECOVERY&version=2&coreNodeName=127.0.0.1:32996__unloadcollection3} status=0 QTime=2001
[junit4:junit4] 2> 18350 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19352 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C83_STATE=coll:unloadcollection core:unloadcollection3 props:{base_url=http://127.0.0.1:32996, state=recovering, shard=shard1, core=unloadcollection3, collection=unloadcollection, node_name=127.0.0.1:32996_}
[junit4:junit4] 2> 20345 T1150 C83 P32996 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:58255/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4] 2> 20345 T1150 C83 P32996 oasu.PeerSync.sync PeerSync: core=unloadcollection3 url=http://127.0.0.1:32996 START replicas=[http://127.0.0.1:58255/unloadcollection1/] nUpdates=100
[junit4:junit4] 2> 20346 T1150 C83 P32996 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20346 T1150 C83 P32996 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4] 2> 20346 T1150 C83 P32996 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection3
[junit4:junit4] 2> 20346 T1150 C83 P32996 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection3
[junit4:junit4] 2> 20346 T1150 C83 P32996 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20346 T1150 C83 P32996 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:58255/unloadcollection1/. core=unloadcollection3
[junit4:junit4] 2> 20346 T1150 C83 P32996 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20348 T1097 C82 P58255 REQ /get {getVersions=100&wt=javabin&qt=/get&distrib=false&version=2} status=0 QTime=1
[junit4:junit4] 2> 20351 T1095 C82 P58255 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 20351 T1095 C82 P58255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d7ea1a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ae23f40)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d7ea1a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ae23f40)),segFN=segments_3,generation=3,filenames=[_0_MockRandom_0.tib, _0.fnm, _0.nvm, _0.nvd, _0.fdt, _0.fdx, _0_MockRandom_0.pos, _0_NestedPulsing_0.doc, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_NestedPulsing_0.pos, _0_NestedPulsing_0.tim, _0_MockRandom_0.skp, _0_Memory_0.ram, _0_MockRandom_0.pyl, _0_NestedPulsing_0.tip, _0_MockRandom_0.doc, _0_SimpleText_0.pst, segments_3, _0.si, _0_MockRandom_0.tiv]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d7ea1a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ae23f40)),segFN=segments_4,generation=4,filenames=[_0_MockRandom_0.tib, _0.fnm, _0.nvm, _0.nvd, _0.fdt, _0.fdx, _0_MockRandom_0.pos, _0_NestedPulsing_0.doc, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_NestedPulsing_0.pos, _0_NestedPulsing_0.tim, _0_MockRandom_0.skp, _0_Memory_0.ram, segments_4, _0_MockRandom_0.pyl, _0_NestedPulsing_0.tip, _0_MockRandom_0.doc, _0_SimpleText_0.pst, _0.si, _0_MockRandom_0.tiv]
[junit4:junit4] 2> 20352 T1095 C82 P58255 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0_MockRandom_0.tib, _0.fnm, _0.nvm, _0.nvd, _0.fdt, _0.fdx, _0_MockRandom_0.pos, _0_NestedPulsing_0.doc, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_NestedPulsing_0.pos, _0_NestedPulsing_0.tim, _0_MockRandom_0.skp, _0_Memory_0.ram, segments_4, _0_MockRandom_0.pyl, _0_NestedPulsing_0.tip, _0_MockRandom_0.doc, _0_SimpleText_0.pst, _0.si, _0_MockRandom_0.tiv]
[junit4:junit4] 2> 20352 T1095 C82 P58255 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20352 T1095 C82 P58255 /update {wt=javabin&softCommit=false&openSearcher=false&commit_end_point=true&commit=true&waitSearcher=true&version=2} {commit=} 0 2
[junit4:junit4] 2> 20353 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20353 T1150 C83 P32996 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20354 T1150 C83 P32996 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20357 T1096 C82 P58255 REQ /replication {qt=/replication&wt=javabin&command=indexversion&version=2} status=0 QTime=0
[junit4:junit4] 2> 20357 T1150 C83 P32996 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 20358 T1150 C83 P32996 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20358 T1150 C83 P32996 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20360 T1094 C82 P58255 REQ /replication {qt=/replication&wt=javabin&command=filelist&version=2&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20361 T1150 C83 P32996 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 21
[junit4:junit4] 2> 20366 T1150 C83 P32996 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1362751849922/1362751864743unloadcollection_3n/index.20130308161110282 forceNew: false
[junit4:junit4] 2> 20367 T1150 C83 P32996 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2ebd8e34 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b9ac785) fullCopy=false
[junit4:junit4] 2> 20370 T1095 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_MockRandom_0.tib&generation=4} status=0 QTime=1
[junit4:junit4] 2> 20374 T1097 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0.fdt&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20377 T1096 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0.nvd&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20381 T1094 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0.nvm&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20388 T1095 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0.fnm&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20397 T1097 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_MockRandom_0.pos&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20402 T1096 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0.fdx&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20419 T1094 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_NestedPulsing_0.doc&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20423 T1095 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_MockRandom_0.sd&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20427 T1097 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_MockRandom_0.frq&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20432 T1096 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_NestedPulsing_0.pos&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20440 T1094 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_MockRandom_0.skp&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20442 T1150 C83 P32996 oash.SnapPuller$DirectoryFileFetcher.fetchPackets WARNING No content recieved for file: {name=_0_MockRandom_0.skp, size=0}
[junit4:junit4] 2> 20445 T1095 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_NestedPulsing_0.tim&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20448 T1097 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_Memory_0.ram&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20453 T1096 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=segments_4&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20457 T1094 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_NestedPulsing_0.tip&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20462 T1095 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_MockRandom_0.pyl&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20463 T1150 C83 P32996 oash.SnapPuller$DirectoryFileFetcher.fetchPackets WARNING No content recieved for file: {name=_0_MockRandom_0.pyl, size=0}
[junit4:junit4] 2> 20469 T1097 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_MockRandom_0.doc&generation=4} status=0 QTime=1
[junit4:junit4] 2> 20473 T1096 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_SimpleText_0.pst&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20479 T1094 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0_MockRandom_0.tiv&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20482 T1095 C82 P58255 REQ /replication {checksum=true&wt=filestream&qt=/replication&command=filecontent&file=_0.si&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20484 T1150 C83 P32996 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20486 T1150 C83 P32996 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20487 T1150 C83 P32996 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4] 2> 20491 T1150 C83 P32996 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@29cbbb0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@5610757e)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@29cbbb0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@5610757e)),segFN=segments_4,generation=4,filenames=[_0_MockRandom_0.tib, _0.fnm, _0.nvm, _0.nvd, _0.fdt, _0.fdx, _0_MockRandom_0.pos, _0_NestedPulsing_0.doc, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_NestedPulsing_0.pos, _0_MockRandom_0.skp, _0_NestedPulsing_0.tim, _0_Memory_0.ram, segments_4, _0_NestedPulsing_0.tip, _0_MockRandom_0.pyl, _0_MockRandom_0.doc, _0_SimpleText_0.pst, _0_MockRandom_0.tiv, _0.si]
[junit4:junit4] 2> 20491 T1150 C83 P32996 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0_MockRandom_0.tib, _0.fnm, _0.nvm, _0.nvd, _0.fdt, _0.fdx, _0_MockRandom_0.pos, _0_NestedPulsing_0.doc, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_NestedPulsing_0.pos, _0_MockRandom_0.skp, _0_NestedPulsing_0.tim, _0_Memory_0.ram, segments_4, _0_NestedPulsing_0.tip, _0_MockRandom_0.pyl, _0_MockRandom_0.doc, _0_SimpleText_0.pst, _0_MockRandom_0.tiv, _0.si]
[junit4:junit4] 2> 20492 T1150 C83 P32996 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20510 T1150 C83 P32996 oass.SolrIndexSearcher.<init> Opening Searcher@8f3f7f0 main
[junit4:junit4] 2> 20511 T1149 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@8f3f7f0 main{StandardDirectoryReader(segments_4:3:nrt _0(4.2):C3)}
[junit4:junit4] 2> 20512 T1150 C83 P32996 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@2ebd8e34 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b9ac785)
[junit4:junit4] 2> 20512 T1150 C83 P32996 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection3
[junit4:junit4] 2> 20512 T1150 C83 P32996 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4] 2> 20512 T1150 C83 P32996 oasc.ZkController.publish publishing core=unloadcollection3 state=active
[junit4:junit4] 2> 20512 T1150 C83 P32996 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20513 T1150 C83 P32996 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection3
[junit4:junit4] 2> 21355 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21895 T1085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21896 T1085 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32996",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:32996_"}
[junit4:junit4] 2> 21901 T1088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21901 T1140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21901 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21901 T1143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21901 T1114 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21901 T1127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21901 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22357 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22359 T1062 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4] 2> 22359 T1062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> C83_STATE=coll:unloadcollection core:unloadcollection3 props:{base_url=http://127.0.0.1:32996, state=active, shard=shard1, core=unloadcollection3, collection=unloadcollection, node_name=127.0.0.1:32996_}
[junit4:junit4] 2> 22379 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[20 (1428948907238359040)]} 0 2
[junit4:junit4] 2> 22380 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[20 (1428948907238359040)]} 0 2
[junit4:junit4] 2> 22380 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[20 (1428948907238359040)]} 0 10
[junit4:junit4] 2> 22381 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[20]} 0 13
[junit4:junit4] 2> 22391 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[21 (1428948907255136256)]} 0 1
[junit4:junit4] 2> 22391 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[21 (1428948907255136256)]} 0 1
[junit4:junit4] 2> 22394 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[21 (1428948907255136256)]} 0 7
[junit4:junit4] 2> 22394 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[21]} 0 9
[junit4:junit4] 2> 22403 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[22 (1428948907267719168)]} 0 1
[junit4:junit4] 2> 22406 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[22 (1428948907267719168)]} 0 2
[junit4:junit4] 2> 22407 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[22 (1428948907267719168)]} 0 8
[junit4:junit4] 2> 22407 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[22]} 0 10
[junit4:junit4] 2> 22416 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[23 (1428948907282399232)]} 0 1
[junit4:junit4] 2> 22418 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[23 (1428948907282399232)]} 0 2
[junit4:junit4] 2> 22418 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[23 (1428948907282399232)]} 0 6
[junit4:junit4] 2> 22419 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[23]} 0 9
[junit4:junit4] 2> 22429 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[24 (1428948907293933568)]} 0 1
[junit4:junit4] 2> 22429 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[24 (1428948907293933568)]} 0 0
[junit4:junit4] 2> 22430 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[24 (1428948907293933568)]} 0 6
[junit4:junit4] 2> 22430 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[24]} 0 8
[junit4:junit4] 2> 22439 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[25 (1428948907306516480)]} 0 1
[junit4:junit4] 2> 22439 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[25 (1428948907306516480)]} 0 1
[junit4:junit4] 2> 22440 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[25 (1428948907306516480)]} 0 5
[junit4:junit4] 2> 22441 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[25]} 0 8
[junit4:junit4] 2> 22450 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[26 (1428948907318050816)]} 0 0
[junit4:junit4] 2> 22450 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[26 (1428948907318050816)]} 0 0
[junit4:junit4] 2> 22451 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[26 (1428948907318050816)]} 0 4
[junit4:junit4] 2> 22452 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[26]} 0 8
[junit4:junit4] 2> 22461 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[27 (1428948907328536576)]} 0 1
[junit4:junit4] 2> 22461 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[27 (1428948907328536576)]} 0 1
[junit4:junit4] 2> 22462 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[27 (1428948907328536576)]} 0 5
[junit4:junit4] 2> 22463 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[27]} 0 8
[junit4:junit4] 2> 22477 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[28 (1428948907341119488)]} 0 1
[junit4:junit4] 2> 22477 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[28 (1428948907341119488)]} 0 1
[junit4:junit4] 2> 22480 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[28 (1428948907341119488)]} 0 11
[junit4:junit4] 2> 22481 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[28]} 0 15
[junit4:junit4] 2> 22498 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[29 (1428948907366285312)]} 0 1
[junit4:junit4] 2> 22498 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[29 (1428948907366285312)]} 0 0
[junit4:junit4] 2> 22499 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[29 (1428948907366285312)]} 0 6
[junit4:junit4] 2> 22499 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[29]} 0 12
[junit4:junit4] 2> 22515 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[30 (1428948907384111104)]} 0 1
[junit4:junit4] 2> 22518 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[30 (1428948907384111104)]} 0 1
[junit4:junit4] 2> 22520 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[30 (1428948907384111104)]} 0 10
[junit4:junit4] 2> 22521 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[30]} 0 13
[junit4:junit4] 2> 22530 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[31 (1428948907400888320)]} 0 2
[junit4:junit4] 2> 22530 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[31 (1428948907400888320)]} 0 1
[junit4:junit4] 2> 22531 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[31 (1428948907400888320)]} 0 6
[junit4:junit4] 2> 22531 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[31]} 0 8
[junit4:junit4] 2> 22546 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[32 (1428948907417665536)]} 0 1
[junit4:junit4] 2> 22549 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[32 (1428948907417665536)]} 0 1
[junit4:junit4] 2> 22550 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[32 (1428948907417665536)]} 0 9
[junit4:junit4] 2> 22551 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[32]} 0 16
[junit4:junit4] 2> 22561 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[33 (1428948907433394176)]} 0 1
[junit4:junit4] 2> 22561 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[33 (1428948907433394176)]} 0 1
[junit4:junit4] 2> 22562 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[33 (1428948907433394176)]} 0 5
[junit4:junit4] 2> 22564 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[33]} 0 9
[junit4:junit4] 2> 22577 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[34 (1428948907449122816)]} 0 2
[junit4:junit4] 2> 22577 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[34 (1428948907449122816)]} 0 2
[junit4:junit4] 2> 22578 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[34 (1428948907449122816)]} 0 6
[junit4:junit4] 2> 22579 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[34]} 0 12
[junit4:junit4] 2> 22589 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[35 (1428948907463802880)]} 0 1
[junit4:junit4] 2> 22589 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[35 (1428948907463802880)]} 0 1
[junit4:junit4] 2> 22590 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[35 (1428948907463802880)]} 0 5
[junit4:junit4] 2> 22591 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[35]} 0 10
[junit4:junit4] 2> 22602 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[36 (1428948907475337216)]} 0 1
[junit4:junit4] 2> 22603 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[36 (1428948907475337216)]} 0 1
[junit4:junit4] 2> 22604 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[36 (1428948907475337216)]} 0 7
[junit4:junit4] 2> 22605 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[36]} 0 12
[junit4:junit4] 2> 22613 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[37 (1428948907488968704)]} 0 1
[junit4:junit4] 2> 22615 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[37 (1428948907488968704)]} 0 1
[junit4:junit4] 2> 22616 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[37 (1428948907488968704)]} 0 6
[junit4:junit4] 2> 22616 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[37]} 0 9
[junit4:junit4] 2> 22626 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[38 (1428948907500503040)]} 0 2
[junit4:junit4] 2> 22626 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[38 (1428948907500503040)]} 0 1
[junit4:junit4] 2> 22628 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[38 (1428948907500503040)]} 0 7
[junit4:junit4] 2> 22629 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[38]} 0 11
[junit4:junit4] 2> 22638 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[39 (1428948907515183104)]} 0 1
[junit4:junit4] 2> 22639 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[39 (1428948907515183104)]} 0 1
[junit4:junit4] 2> 22640 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[39 (1428948907515183104)]} 0 5
[junit4:junit4] 2> 22641 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[39]} 0 9
[junit4:junit4] 2> 22649 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[40 (1428948907525668864)]} 0 1
[junit4:junit4] 2> 22650 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[40 (1428948907525668864)]} 0 1
[junit4:junit4] 2> 22651 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[40 (1428948907525668864)]} 0 6
[junit4:junit4] 2> 22651 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[40]} 0 8
[junit4:junit4] 2> 22660 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[41 (1428948907538251776)]} 0 1
[junit4:junit4] 2> 22660 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[41 (1428948907538251776)]} 0 1
[junit4:junit4] 2> 22661 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[41 (1428948907538251776)]} 0 5
[junit4:junit4] 2> 22661 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[41]} 0 7
[junit4:junit4] 2> 22670 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[42 (1428948907547688960)]} 0 1
[junit4:junit4] 2> 22670 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[42 (1428948907547688960)]} 0 1
[junit4:junit4] 2> 22671 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[42 (1428948907547688960)]} 0 5
[junit4:junit4] 2> 22671 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[42]} 0 7
[junit4:junit4] 2> 22679 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[43 (1428948907558174720)]} 0 0
[junit4:junit4] 2> 22679 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[43 (1428948907558174720)]} 0 0
[junit4:junit4] 2> 22680 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[43 (1428948907558174720)]} 0 4
[junit4:junit4] 2> 22681 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[43]} 0 7
[junit4:junit4] 2> 22689 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[44 (1428948907568660480)]} 0 1
[junit4:junit4] 2> 22689 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[44 (1428948907568660480)]} 0 1
[junit4:junit4] 2> 22690 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[44 (1428948907568660480)]} 0 5
[junit4:junit4] 2> 22691 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[44]} 0 8
[junit4:junit4] 2> 22699 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[45 (1428948907578097664)]} 0 1
[junit4:junit4] 2> 22699 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[45 (1428948907578097664)]} 0 1
[junit4:junit4] 2> 22700 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[45 (1428948907578097664)]} 0 5
[junit4:junit4] 2> 22700 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[45]} 0 7
[junit4:junit4] 2> 22709 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[46 (1428948907588583424)]} 0 1
[junit4:junit4] 2> 22709 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[46 (1428948907588583424)]} 0 0
[junit4:junit4] 2> 22710 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[46 (1428948907588583424)]} 0 5
[junit4:junit4] 2> 22711 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[46]} 0 8
[junit4:junit4] 2> 22719 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[47 (1428948907600117760)]} 0 1
[junit4:junit4] 2> 22719 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[47 (1428948907600117760)]} 0 1
[junit4:junit4] 2> 22719 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[47 (1428948907600117760)]} 0 4
[junit4:junit4] 2> 22720 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[47]} 0 7
[junit4:junit4] 2> 22729 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[48 (1428948907610603520)]} 0 1
[junit4:junit4] 2> 22729 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[48 (1428948907610603520)]} 0 1
[junit4:junit4] 2> 22730 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[48 (1428948907610603520)]} 0 4
[junit4:junit4] 2> 22730 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[48]} 0 8
[junit4:junit4] 2> 22739 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[49 (1428948907620040704)]} 0 1
[junit4:junit4] 2> 22739 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[49 (1428948907620040704)]} 0 1
[junit4:junit4] 2> 22740 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[49 (1428948907620040704)]} 0 5
[junit4:junit4] 2> 22741 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[49]} 0 8
[junit4:junit4] 2> 22751 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[50 (1428948907632623616)]} 0 1
[junit4:junit4] 2> 22752 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[50 (1428948907632623616)]} 0 1
[junit4:junit4] 2> 22752 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[50 (1428948907632623616)]} 0 5
[junit4:junit4] 2> 22753 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[50]} 0 8
[junit4:junit4] 2> 22762 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[51 (1428948907644157952)]} 0 1
[junit4:junit4] 2> 22763 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[51 (1428948907644157952)]} 0 0
[junit4:junit4] 2> 22764 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[51 (1428948907644157952)]} 0 6
[junit4:junit4] 2> 22765 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[51]} 0 10
[junit4:junit4] 2> 22775 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[52 (1428948907657789440)]} 0 0
[junit4:junit4] 2> 22776 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[52 (1428948907657789440)]} 0 1
[junit4:junit4] 2> 22779 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[52 (1428948907657789440)]} 0 8
[junit4:junit4] 2> 22780 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[52]} 0 12
[junit4:junit4] 2> 22789 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[53 (1428948907673518080)]} 0 1
[junit4:junit4] 2> 22793 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[53 (1428948907673518080)]} 0 1
[junit4:junit4] 2> 22794 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[53 (1428948907673518080)]} 0 9
[junit4:junit4] 2> 22795 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[53]} 0 13
[junit4:junit4] 2> 22807 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[54 (1428948907690295296)]} 0 1
[junit4:junit4] 2> 22808 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[54 (1428948907690295296)]} 0 0
[junit4:junit4] 2> 22809 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[54 (1428948907690295296)]} 0 8
[junit4:junit4] 2> 22810 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[54]} 0 11
[junit4:junit4] 2> 22823 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[55 (1428948907708121088)]} 0 1
[junit4:junit4] 2> 22823 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[55 (1428948907708121088)]} 0 1
[junit4:junit4] 2> 22824 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[55 (1428948907708121088)]} 0 5
[junit4:junit4] 2> 22824 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[55]} 0 8
[junit4:junit4] 2> 22834 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[56 (1428948907719655424)]} 0 1
[junit4:junit4] 2> 22835 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[56 (1428948907719655424)]} 0 1
[junit4:junit4] 2> 22836 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[56 (1428948907719655424)]} 0 7
[junit4:junit4] 2> 22836 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[56]} 0 9
[junit4:junit4] 2> 22845 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[57 (1428948907731189760)]} 0 1
[junit4:junit4] 2> 22847 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[57 (1428948907731189760)]} 0 3
[junit4:junit4] 2> 22851 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[57 (1428948907731189760)]} 0 10
[junit4:junit4] 2> 22852 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[57]} 0 14
[junit4:junit4] 2> 22862 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[58 (1428948907747966976)]} 0 1
[junit4:junit4] 2> 22862 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[58 (1428948907747966976)]} 0 1
[junit4:junit4] 2> 22863 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[58 (1428948907747966976)]} 0 6
[junit4:junit4] 2> 22863 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[58]} 0 9
[junit4:junit4] 2> 22874 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[59 (1428948907762647040)]} 0 1
[junit4:junit4] 2> 22874 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[59 (1428948907762647040)]} 0 1
[junit4:junit4] 2> 22875 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[59 (1428948907762647040)]} 0 5
[junit4:junit4] 2> 22876 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[59]} 0 8
[junit4:junit4] 2> 22883 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[60 (1428948907772084224)]} 0 0
[junit4:junit4] 2> 22884 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[60 (1428948907772084224)]} 0 1
[junit4:junit4] 2> 22884 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[60 (1428948907772084224)]} 0 4
[junit4:junit4] 2> 22885 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[60]} 0 7
[junit4:junit4] 2> 22893 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[61 (1428948907782569984)]} 0 1
[junit4:junit4] 2> 22893 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[61 (1428948907782569984)]} 0 1
[junit4:junit4] 2> 22894 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[61 (1428948907782569984)]} 0 4
[junit4:junit4] 2> 22895 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[61]} 0 8
[junit4:junit4] 2> 22904 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[62 (1428948907794104320)]} 0 1
[junit4:junit4] 2> 22904 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[62 (1428948907794104320)]} 0 1
[junit4:junit4] 2> 22905 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[62 (1428948907794104320)]} 0 5
[junit4:junit4] 2> 22906 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[62]} 0 8
[junit4:junit4] 2> 22914 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[63 (1428948907804590080)]} 0 1
[junit4:junit4] 2> 22914 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[63 (1428948907804590080)]} 0 1
[junit4:junit4] 2> 22915 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[63 (1428948907804590080)]} 0 5
[junit4:junit4] 2> 22915 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[63]} 0 7
[junit4:junit4] 2> 22924 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[64 (1428948907814027264)]} 0 1
[junit4:junit4] 2> 22924 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[64 (1428948907814027264)]} 0 1
[junit4:junit4] 2> 22925 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[64 (1428948907814027264)]} 0 5
[junit4:junit4] 2> 22925 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[64]} 0 7
[junit4:junit4] 2> 22933 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[65 (1428948907824513024)]} 0 1
[junit4:junit4] 2> 22933 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[65 (1428948907824513024)]} 0 1
[junit4:junit4] 2> 22934 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[65 (1428948907824513024)]} 0 4
[junit4:junit4] 2> 22935 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[65]} 0 8
[junit4:junit4] 2> 22943 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[66 (1428948907833950208)]} 0 1
[junit4:junit4] 2> 22944 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[66 (1428948907833950208)]} 0 1
[junit4:junit4] 2> 22945 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[66 (1428948907833950208)]} 0 6
[junit4:junit4] 2> 22945 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[66]} 0 8
[junit4:junit4] 2> 22953 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[67 (1428948907845484544)]} 0 1
[junit4:junit4] 2> 22953 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[67 (1428948907845484544)]} 0 1
[junit4:junit4] 2> 22954 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[67 (1428948907845484544)]} 0 4
[junit4:junit4] 2> 22955 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[67]} 0 7
[junit4:junit4] 2> 22964 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[68 (1428948907855970304)]} 0 1
[junit4:junit4] 2> 22964 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[68 (1428948907855970304)]} 0 1
[junit4:junit4] 2> 22965 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[68 (1428948907855970304)]} 0 5
[junit4:junit4] 2> 22965 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[68]} 0 7
[junit4:junit4] 2> 22974 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[69 (1428948907867504640)]} 0 0
[junit4:junit4] 2> 22974 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[69 (1428948907867504640)]} 0 0
[junit4:junit4] 2> 22975 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[69 (1428948907867504640)]} 0 4
[junit4:junit4] 2> 22976 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[69]} 0 9
[junit4:junit4] 2> 22984 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[70 (1428948907877990400)]} 0 1
[junit4:junit4] 2> 22984 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[70 (1428948907877990400)]} 0 1
[junit4:junit4] 2> 22985 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[70 (1428948907877990400)]} 0 5
[junit4:junit4] 2> 22985 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[70]} 0 7
[junit4:junit4] 2> 22995 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[71 (1428948907888476160)]} 0 1
[junit4:junit4] 2> 22996 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[71 (1428948907888476160)]} 0 1
[junit4:junit4] 2> 22996 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[71 (1428948907888476160)]} 0 5
[junit4:junit4] 2> 22997 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[71]} 0 9
[junit4:junit4] 2> 23008 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[72 (1428948907902107648)]} 0 1
[junit4:junit4] 2> 23008 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[72 (1428948907902107648)]} 0 1
[junit4:junit4] 2> 23009 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[72 (1428948907902107648)]} 0 6
[junit4:junit4] 2> 23009 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[72]} 0 9
[junit4:junit4] 2> 23018 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[73 (1428948907912593408)]} 0 1
[junit4:junit4] 2> 23018 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[73 (1428948907912593408)]} 0 1
[junit4:junit4] 2> 23019 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[73 (1428948907912593408)]} 0 5
[junit4:junit4] 2> 23019 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[73]} 0 7
[junit4:junit4] 2> 23027 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[74 (1428948907923079168)]} 0 1
[junit4:junit4] 2> 23028 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[74 (1428948907923079168)]} 0 1
[junit4:junit4] 2> 23029 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[74 (1428948907923079168)]} 0 5
[junit4:junit4] 2> 23029 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[74]} 0 8
[junit4:junit4] 2> 23037 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[75 (1428948907933564928)]} 0 1
[junit4:junit4] 2> 23039 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[75 (1428948907933564928)]} 0 1
[junit4:junit4] 2> 23039 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[75 (1428948907933564928)]} 0 5
[junit4:junit4] 2> 23040 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[75]} 0 9
[junit4:junit4] 2> 23048 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[76 (1428948907945099264)]} 0 1
[junit4:junit4] 2> 23049 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[76 (1428948907945099264)]} 0 1
[junit4:junit4] 2> 23049 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[76 (1428948907945099264)]} 0 5
[junit4:junit4] 2> 23050 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[76]} 0 8
[junit4:junit4] 2> 23062 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[77 (1428948907958730752)]} 0 1
[junit4:junit4] 2> 23062 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[77 (1428948907958730752)]} 0 1
[junit4:junit4] 2> 23062 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[77 (1428948907958730752)]} 0 4
[junit4:junit4] 2> 23063 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[77]} 0 7
[junit4:junit4] 2> 23074 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[78 (1428948907971313664)]} 0 2
[junit4:junit4] 2> 23075 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[78 (1428948907971313664)]} 0 1
[junit4:junit4] 2> 23075 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[78 (1428948907971313664)]} 0 6
[junit4:junit4] 2> 23076 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[78]} 0 10
[junit4:junit4] 2> 23084 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[79 (1428948907982848000)]} 0 1
[junit4:junit4] 2> 23084 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[79 (1428948907982848000)]} 0 1
[junit4:junit4] 2> 23085 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[79 (1428948907982848000)]} 0 5
[junit4:junit4] 2> 23085 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[79]} 0 6
[junit4:junit4] 2> 23094 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[80 (1428948907993333760)]} 0 1
[junit4:junit4] 2> 23094 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[80 (1428948907993333760)]} 0 1
[junit4:junit4] 2> 23095 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[80 (1428948907993333760)]} 0 5
[junit4:junit4] 2> 23095 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[80]} 0 7
[junit4:junit4] 2> 23104 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[81 (1428948908003819520)]} 0 1
[junit4:junit4] 2> 23104 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[81 (1428948908003819520)]} 0 1
[junit4:junit4] 2> 23105 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[81 (1428948908003819520)]} 0 5
[junit4:junit4] 2> 23105 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[81]} 0 7
[junit4:junit4] 2> 23115 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[82 (1428948908014305280)]} 0 1
[junit4:junit4] 2> 23115 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[82 (1428948908014305280)]} 0 1
[junit4:junit4] 2> 23115 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[82 (1428948908014305280)]} 0 4
[junit4:junit4] 2> 23116 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[82]} 0 8
[junit4:junit4] 2> 23126 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[83 (1428948908025839616)]} 0 1
[junit4:junit4] 2> 23126 T1121 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[83 (1428948908025839616)]} 0 1
[junit4:junit4] 2> 23129 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[83 (1428948908025839616)]} 0 7
[junit4:junit4] 2> 23130 T1120 C83 P32996 /update {wt=javabin&version=2} {add=[83]} 0 11
[junit4:junit4] 2> 23139 T1122 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[84 (1428948908039471104)]} 0 1
[junit4:junit4] 2> 23139 T1109 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[84 (1428948908039471104)]} 0 1
[junit4:junit4] 2> 23141 T1096 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[84 (1428948908039471104)]} 0 6
[junit4:junit4] 2> 23142 T1123 C83 P32996 /update {wt=javabin&version=2} {add=[84]} 0 9
[junit4:junit4] 2> 23155 T1120 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[85 (1428948908056248320)]} 0 1
[junit4:junit4] 2> 23155 T1107 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[85 (1428948908056248320)]} 0 1
[junit4:junit4] 2> 23156 T1097 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[85 (1428948908056248320)]} 0 5
[junit4:junit4] 2> 23157 T1121 C83 P32996 /update {wt=javabin&version=2} {add=[85]} 0 13
[junit4:junit4] 2> 23174 T1110 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[86 (1428948908076171264)]} 0 1
[junit4:junit4] 2> 23174 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[86 (1428948908076171264)]} 0 1
[junit4:junit4] 2> 23176 T1094 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[86 (1428948908076171264)]} 0 6
[junit4:junit4] 2> 23177 T1122 C83 P32996 /update {wt=javabin&version=2} {add=[86]} 0 18
[junit4:junit4] 2> 23185 T1108 C81 P60810 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[87 (1428948908087705600)]} 0 1
[junit4:junit4] 2> 23185 T1123 C83 P32996 /update {wt=javabin&distrib.from=http://127.0.0.1:58255/unloadcollection1/&update.distrib=FROMLEADER&version=2} {add=[87 (1428948908087705600)]} 0 1
[junit4:junit4] 2> 23185 T1095 C82 P58255 /update {wt=javabin&distrib.from=http://127.0.0.1:32996/unloadcollection3/&update.distrib=TOLEADER&version=2} {add=[87 (14
[...truncated too long message...]
ow=true -Dtests.locale=vi -Dtests.timezone=Asia/Gaza -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 141s J0 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([DD66E7F1FADBC6A2:5C8069E98D84A69E]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 141212 T1062 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 141221 T1061 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 142291 T1140 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 142292 T1140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 142292 T1140 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 142292 T1140 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {intDefault=PostingsFormat(name=NestedPulsing), a_si=PostingsFormat(name=SimpleText), timestamp=PostingsFormat(name=NestedPulsing), range_facet_l=PostingsFormat(name=NestedPulsing), other_tl1=PostingsFormat(name=NestedPulsing), _version_=PostingsFormat(name=SimpleText), a_t=PostingsFormat(name=NestedPulsing), range_facet_sl=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=NestedPulsing), id=PostingsFormat(name=MockRandom), range_facet_si=PostingsFormat(name=NestedPulsing), text=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=vi, timezone=Asia/Gaza
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=82639376,total=212410368
[junit4:junit4] 2> NOTE: All tests run in this JVM: [PrimUtilsTest, AlternateDirectoryTest, JsonLoaderTest, TestFieldCollectionResource, TestPerFieldSimilarity, ShowFileRequestHandlerTest, TestPluginEnable, TestFiltering, TestCoreContainer, SpatialFilterTest, IndexSchemaRuntimeFieldTest, PathHierarchyTokenizerFactoryTest, TestOmitPositions, XmlUpdateRequestHandlerTest, SyncSliceTest, FieldAnalysisRequestHandlerTest, SolrCoreTest, RequestHandlersTest, LegacyHTMLStripCharFilterTest, CSVRequestHandlerTest, TestFieldTypeResource, TestLMDirichletSimilarityFactory, TestLRUCache, TestFoldingMultitermQuery, SOLR749Test, DirectSolrConnectionTest, TestFuzzyAnalyzedSuggestions, CurrencyFieldOpenExchangeTest, TestFunctionQuery, PolyFieldTest, TestDocumentBuilder, TestQuerySenderListener, SynonymTokenizerTest, TestConfig, SolrRequestParserTest, TestTrie, TestRemoteStreaming, SuggesterTSTTest, TestLazyCores, DateFieldTest, TestJmxIntegration, TestIndexSearcher, TestJoin, TestWriterPerf, TestPseudoReturnFields, BinaryUpdateRequestHandlerTest, SliceStateTest, TestFieldResource, CircularListTest, WordBreakSolrSpellCheckerTest, TestCSVResponseWriter, ZkCLITest, StatelessScriptUpdateProcessorFactoryTest, CacheHeaderTest, UUIDFieldTest, MinimalSchemaTest, TestIndexingPerformance, TestQueryTypes, SpellingQueryConverterTest, DirectUpdateHandlerOptimizeTest, TestDynamicFieldCollectionResource, DocumentAnalysisRequestHandlerTest, SystemInfoHandlerTest, TestPropInjectDefaults, TestSurroundQueryParser, BasicDistributedZkTest, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 142.50s, 1 test, 1 failure <<< FAILURES!
[...truncated 410 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 268 suites, 1130 tests, 1 failure, 9 ignored (3 assumptions)
Total time: 37 minutes 39 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure