You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/24 12:39:14 UTC
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b82) - Build #
4805 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4805/
Java: 32bit/jdk1.8.0-ea-b82 -server -XX:+UseG1GC -XX:MarkStackSize=256K
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:52380/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:52380/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([995C80BF3A3661E9:18BA0EA74D6901D5]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9326 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T2185 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 3 T2185 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444
[junit4:junit4] 2> 4 T2185 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 4 T2186 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 5 T2186 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 5 T2186 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 5 T2186 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 5 T2186 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 6 T2186 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 104 T2185 oasc.ZkTestServer.run start zk server on port:54134
[junit4:junit4] 2> 105 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@9bef6b
[junit4:junit4] 2> 106 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 107 T2191 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 107 T2191 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 107 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41172
[junit4:junit4] 2> 108 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41172
[junit4:junit4] 2> 108 T2189 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 162 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f0000 with negotiated timeout 10000 for client /127.0.0.1:41172
[junit4:junit4] 2> 163 T2191 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f0000, negotiated timeout = 10000
[junit4:junit4] 2> 163 T2192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9bef6b name:ZooKeeperConnection Watcher:127.0.0.1:54134 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 164 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 164 T2185 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 170 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f0000
[junit4:junit4] 2> 171 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41172 which had sessionid 0x13d9c2bd26f0000
[junit4:junit4] 2> 171 T2192 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 171 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f0000 closed
[junit4:junit4] 2> 172 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5c1988
[junit4:junit4] 2> 174 T2193 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 174 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 174 T2193 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 175 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41173
[junit4:junit4] 2> 175 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41173
[junit4:junit4] 2> 176 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f0001 with negotiated timeout 10000 for client /127.0.0.1:41173
[junit4:junit4] 2> 176 T2193 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f0001, negotiated timeout = 10000
[junit4:junit4] 2> 177 T2194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c1988 name:ZooKeeperConnection Watcher:127.0.0.1:54134/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 177 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 178 T2185 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 184 T2185 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 188 T2185 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 192 T2185 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 197 T2185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 198 T2185 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 205 T2185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 206 T2185 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 212 T2185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 213 T2185 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 218 T2185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 218 T2185 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 223 T2185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 224 T2185 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 228 T2185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 229 T2185 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 234 T2185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 235 T2185 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 240 T2185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 241 T2185 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 245 T2185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 246 T2185 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 251 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f0001
[junit4:junit4] 2> 252 T2194 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 252 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41173 which had sessionid 0x13d9c2bd26f0001
[junit4:junit4] 2> 252 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f0001 closed
[junit4:junit4] 2> 325 T2185 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 332 T2185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50017
[junit4:junit4] 2> 333 T2185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 333 T2185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 333 T2185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364124750693
[junit4:junit4] 2> 334 T2185 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364124750693/solr.xml
[junit4:junit4] 2> 334 T2185 oasc.CoreContainer.<init> New CoreContainer 20301957
[junit4:junit4] 2> 334 T2185 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364124750693/'
[junit4:junit4] 2> 335 T2185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364124750693/'
[junit4:junit4] 2> 352 T2185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 352 T2185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 353 T2185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 353 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 353 T2185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 354 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 354 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 354 T2185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 355 T2185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 355 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 360 T2185 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 369 T2185 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54134/solr
[junit4:junit4] 2> 370 T2185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 370 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1871d3e
[junit4:junit4] 2> 371 T2204 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 371 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 372 T2204 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 372 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41174
[junit4:junit4] 2> 372 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41174
[junit4:junit4] 2> 373 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f0002 with negotiated timeout 20000 for client /127.0.0.1:41174
[junit4:junit4] 2> 373 T2204 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f0002, negotiated timeout = 20000
[junit4:junit4] 2> 374 T2205 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1871d3e name:ZooKeeperConnection Watcher:127.0.0.1:54134 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 374 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 375 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f0002
[junit4:junit4] 2> 376 T2205 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 376 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41174 which had sessionid 0x13d9c2bd26f0002
[junit4:junit4] 2> 376 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f0002 closed
[junit4:junit4] 2> 377 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 379 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c9e6a6
[junit4:junit4] 2> 380 T2206 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 380 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 380 T2206 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 380 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41175
[junit4:junit4] 2> 381 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41175
[junit4:junit4] 2> 381 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f0003 with negotiated timeout 20000 for client /127.0.0.1:41175
[junit4:junit4] 2> 381 T2206 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f0003, negotiated timeout = 20000
[junit4:junit4] 2> 382 T2207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c9e6a6 name:ZooKeeperConnection Watcher:127.0.0.1:54134/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 382 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 384 T2185 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 387 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 388 T2185 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 393 T2185 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 396 T2185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50017_
[junit4:junit4] 2> 397 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50017_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50017_
[junit4:junit4] 2> 398 T2185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50017_
[junit4:junit4] 2> 403 T2185 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 410 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 411 T2185 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 415 T2185 oasc.Overseer.start Overseer (id=89399279645294595-127.0.0.1:50017_-n_0000000000) starting
[junit4:junit4] 2> 416 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 418 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 419 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 421 T2185 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 425 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 427 T2209 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 428 T2185 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 432 T2185 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 435 T2185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 440 T2208 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 443 T2210 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364124750693/collection1
[junit4:junit4] 2> 443 T2210 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 444 T2210 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 445 T2210 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 447 T2210 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364124750693/collection1/'
[junit4:junit4] 2> 448 T2210 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364124750693/collection1/lib/README' to classloader
[junit4:junit4] 2> 448 T2210 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364124750693/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 485 T2210 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 512 T2210 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 513 T2210 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 517 T2210 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 812 T2210 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 817 T2210 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 819 T2210 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 837 T2210 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 841 T2210 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 844 T2210 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 846 T2210 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 846 T2210 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 846 T2210 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 848 T2210 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 848 T2210 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 849 T2210 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 849 T2210 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364124750693/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/control/data/
[junit4:junit4] 2> 849 T2210 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11b579d
[junit4:junit4] 2> 850 T2210 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 851 T2210 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/control/data
[junit4:junit4] 2> 851 T2210 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/control/data/index/
[junit4:junit4] 2> 851 T2210 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 852 T2210 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/control/data/index
[junit4:junit4] 2> 854 T2210 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b26544 lockFactory=org.apache.lucene.store.NativeFSLockFactory@29cc3b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 854 T2210 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 856 T2210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 857 T2210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 857 T2210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 858 T2210 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 858 T2210 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 859 T2210 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 859 T2210 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 860 T2210 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 860 T2210 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 864 T2210 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 867 T2210 oass.SolrIndexSearcher.<init> Opening Searcher@1ed2e99 main
[junit4:junit4] 2> 868 T2210 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/control/data/tlog
[junit4:junit4] 2> 868 T2210 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 869 T2210 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 873 T2211 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ed2e99 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 874 T2210 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 874 T2210 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1946 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1947 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:50017_",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50017",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 1948 T2208 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1948 T2208 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1955 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2876 T2210 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2877 T2210 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50017 collection:control_collection shard:shard1
[junit4:junit4] 2> 2878 T2210 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2890 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2891 T2210 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2892 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2896 T2210 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2897 T2210 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2897 T2210 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50017/collection1/
[junit4:junit4] 2> 2897 T2210 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2898 T2210 oasc.SyncStrategy.syncToMe http://127.0.0.1:50017/collection1/ has no replicas
[junit4:junit4] 2> 2898 T2210 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50017/collection1/
[junit4:junit4] 2> 2898 T2210 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2904 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3463 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3473 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3510 T2210 oasc.ZkController.register We are http://127.0.0.1:50017/collection1/ and leader is http://127.0.0.1:50017/collection1/
[junit4:junit4] 2> 3510 T2210 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50017
[junit4:junit4] 2> 3510 T2210 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3511 T2210 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3511 T2210 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3513 T2210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3515 T2185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3516 T2185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3516 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3522 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3523 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e25de4
[junit4:junit4] 2> 3525 T2213 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3525 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3525 T2213 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 3526 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41176
[junit4:junit4] 2> 3526 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41176
[junit4:junit4] 2> 3527 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f0004 with negotiated timeout 10000 for client /127.0.0.1:41176
[junit4:junit4] 2> 3528 T2213 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f0004, negotiated timeout = 10000
[junit4:junit4] 2> 3528 T2214 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e25de4 name:ZooKeeperConnection Watcher:127.0.0.1:54134/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3528 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3531 T2185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3534 T2185 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3603 T2185 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3606 T2185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41035
[junit4:junit4] 2> 3607 T2185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3608 T2185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3609 T2185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975
[junit4:junit4] 2> 3609 T2185 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/solr.xml
[junit4:junit4] 2> 3610 T2185 oasc.CoreContainer.<init> New CoreContainer 31263381
[junit4:junit4] 2> 3611 T2185 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/'
[junit4:junit4] 2> 3612 T2185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/'
[junit4:junit4] 2> 3637 T2185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3638 T2185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3638 T2185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3638 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3639 T2185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3639 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3639 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3640 T2185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3640 T2185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3640 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3646 T2185 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3655 T2185 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54134/solr
[junit4:junit4] 2> 3655 T2185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3655 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a3310
[junit4:junit4] 2> 3657 T2224 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3656 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3657 T2224 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 3658 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41177
[junit4:junit4] 2> 3658 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41177
[junit4:junit4] 2> 3659 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f0005 with negotiated timeout 20000 for client /127.0.0.1:41177
[junit4:junit4] 2> 3659 T2224 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f0005, negotiated timeout = 20000
[junit4:junit4] 2> 3659 T2225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a3310 name:ZooKeeperConnection Watcher:127.0.0.1:54134 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3660 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3661 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f0005
[junit4:junit4] 2> 3662 T2225 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3662 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41177 which had sessionid 0x13d9c2bd26f0005
[junit4:junit4] 2> 3662 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f0005 closed
[junit4:junit4] 2> 3663 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3665 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@343421
[junit4:junit4] 2> 3666 T2226 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3666 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3666 T2226 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 3666 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41178
[junit4:junit4] 2> 3667 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41178
[junit4:junit4] 2> 3668 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f0006 with negotiated timeout 20000 for client /127.0.0.1:41178
[junit4:junit4] 2> 3668 T2226 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f0006, negotiated timeout = 20000
[junit4:junit4] 2> 3668 T2227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@343421 name:ZooKeeperConnection Watcher:127.0.0.1:54134/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3669 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3670 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3671 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3674 T2185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4678 T2185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41035_
[junit4:junit4] 2> 4680 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41035_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41035_
[junit4:junit4] 2> 4681 T2185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41035_
[junit4:junit4] 2> 4686 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4687 T2227 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4687 T2214 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4689 T2207 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4696 T2228 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/collection1
[junit4:junit4] 2> 4696 T2228 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4698 T2228 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4698 T2228 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4700 T2228 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/collection1/'
[junit4:junit4] 2> 4701 T2228 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/collection1/lib/README' to classloader
[junit4:junit4] 2> 4701 T2228 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4738 T2228 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 4794 T2228 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4796 T2228 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4799 T2228 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4981 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4982 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:50017_",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50017",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 4997 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4997 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4997 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5099 T2228 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5104 T2228 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5106 T2228 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5124 T2228 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5127 T2228 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5133 T2228 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5134 T2228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5135 T2228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5135 T2228 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5137 T2228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5138 T2228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5138 T2228 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5138 T2228 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty1/
[junit4:junit4] 2> 5139 T2228 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11b579d
[junit4:junit4] 2> 5139 T2228 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5140 T2228 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty1
[junit4:junit4] 2> 5141 T2228 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty1/index/
[junit4:junit4] 2> 5141 T2228 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5141 T2228 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty1/index
[junit4:junit4] 2> 5144 T2228 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1fb3191 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ba4243),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5144 T2228 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5147 T2228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5148 T2228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5148 T2228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5149 T2228 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5150 T2228 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5150 T2228 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5151 T2228 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5152 T2228 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5152 T2228 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5157 T2228 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5161 T2228 oass.SolrIndexSearcher.<init> Opening Searcher@14de489 main
[junit4:junit4] 2> 5161 T2228 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty1/tlog
[junit4:junit4] 2> 5162 T2228 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5162 T2228 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5169 T2229 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14de489 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5171 T2228 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5172 T2228 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6503 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6505 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:41035_",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41035",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 6505 T2208 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6505 T2208 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6513 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6513 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6513 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7174 T2228 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7174 T2228 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41035 collection:collection1 shard:shard1
[junit4:junit4] 2> 7176 T2228 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7186 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:delete cxid:0x4a zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7187 T2228 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7188 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:create cxid:0x4b zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7191 T2228 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7191 T2228 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7192 T2228 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41035/collection1/
[junit4:junit4] 2> 7192 T2228 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7192 T2228 oasc.SyncStrategy.syncToMe http://127.0.0.1:41035/collection1/ has no replicas
[junit4:junit4] 2> 7193 T2228 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41035/collection1/
[junit4:junit4] 2> 7193 T2228 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7200 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:create cxid:0x56 zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8021 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8035 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8036 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8035 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8056 T2228 oasc.ZkController.register We are http://127.0.0.1:41035/collection1/ and leader is http://127.0.0.1:41035/collection1/
[junit4:junit4] 2> 8057 T2228 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41035
[junit4:junit4] 2> 8057 T2228 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8057 T2228 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8058 T2228 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8060 T2228 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8062 T2185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8063 T2185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8064 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8130 T2185 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8133 T2185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52380
[junit4:junit4] 2> 8134 T2185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8134 T2185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8135 T2185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364124758509
[junit4:junit4] 2> 8135 T2185 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364124758509/solr.xml
[junit4:junit4] 2> 8136 T2185 oasc.CoreContainer.<init> New CoreContainer 2286710
[junit4:junit4] 2> 8137 T2185 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364124758509/'
[junit4:junit4] 2> 8138 T2185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364124758509/'
[junit4:junit4] 2> 8162 T2185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8162 T2185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8163 T2185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8163 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8163 T2185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8164 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8164 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8164 T2185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8165 T2185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8165 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8170 T2185 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8179 T2185 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54134/solr
[junit4:junit4] 2> 8179 T2185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8180 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6292cb
[junit4:junit4] 2> 8181 T2240 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8181 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8181 T2240 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 8182 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41180
[junit4:junit4] 2> 8182 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41180
[junit4:junit4] 2> 8183 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f0007 with negotiated timeout 20000 for client /127.0.0.1:41180
[junit4:junit4] 2> 8183 T2240 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f0007, negotiated timeout = 20000
[junit4:junit4] 2> 8183 T2241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6292cb name:ZooKeeperConnection Watcher:127.0.0.1:54134 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8183 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8185 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f0007
[junit4:junit4] 2> 8186 T2241 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8186 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41180 which had sessionid 0x13d9c2bd26f0007
[junit4:junit4] 2> 8186 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f0007 closed
[junit4:junit4] 2> 8187 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8189 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1eaa2e2
[junit4:junit4] 2> 8190 T2242 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8190 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8190 T2242 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 8190 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41181
[junit4:junit4] 2> 8191 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41181
[junit4:junit4] 2> 8192 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f0008 with negotiated timeout 20000 for client /127.0.0.1:41181
[junit4:junit4] 2> 8192 T2242 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f0008, negotiated timeout = 20000
[junit4:junit4] 2> 8192 T2243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eaa2e2 name:ZooKeeperConnection Watcher:127.0.0.1:54134/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8193 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8194 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8195 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0008 type:create cxid:0x3 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8199 T2185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9203 T2185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52380_
[junit4:junit4] 2> 9205 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0008 type:delete cxid:0xd zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52380_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52380_
[junit4:junit4] 2> 9206 T2185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52380_
[junit4:junit4] 2> 9209 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9209 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9210 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9213 T2243 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9215 T2227 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9215 T2214 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9216 T2207 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9222 T2244 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364124758509/collection1
[junit4:junit4] 2> 9222 T2244 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9223 T2244 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9224 T2244 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9226 T2244 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364124758509/collection1/'
[junit4:junit4] 2> 9226 T2244 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364124758509/collection1/lib/README' to classloader
[junit4:junit4] 2> 9227 T2244 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364124758509/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9260 T2244 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 9287 T2244 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9288 T2244 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9292 T2244 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9553 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9554 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:41035_",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41035",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 9557 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9557 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9558 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9557 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9602 T2244 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9607 T2244 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9609 T2244 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9628 T2244 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9631 T2244 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9637 T2244 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9639 T2244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9640 T2244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9640 T2244 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9642 T2244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9642 T2244 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9643 T2244 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9643 T2244 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364124758509/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty2/
[junit4:junit4] 2> 9644 T2244 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11b579d
[junit4:junit4] 2> 9644 T2244 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9645 T2244 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty2
[junit4:junit4] 2> 9646 T2244 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty2/index/
[junit4:junit4] 2> 9646 T2244 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9646 T2244 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty2/index
[junit4:junit4] 2> 9649 T2244 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a65a4a lockFactory=org.apache.lucene.store.NativeFSLockFactory@17d94e0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9649 T2244 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9652 T2244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9652 T2244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9653 T2244 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9654 T2244 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9655 T2244 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9655 T2244 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9656 T2244 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9657 T2244 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9657 T2244 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9662 T2244 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9666 T2244 oass.SolrIndexSearcher.<init> Opening Searcher@2770d1 main
[junit4:junit4] 2> 9666 T2244 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty2/tlog
[junit4:junit4] 2> 9667 T2244 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9667 T2244 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9670 T2245 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2770d1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9671 T2244 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9672 T2244 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11064 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11065 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:52380_",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52380",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 11066 T2208 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11066 T2208 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 11073 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11073 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11073 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11073 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11674 T2244 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11674 T2244 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52380 collection:collection1 shard:shard2
[junit4:junit4] 2> 11675 T2244 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 11681 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0008 type:delete cxid:0x49 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 11682 T2244 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11683 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0008 type:create cxid:0x4a zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11685 T2244 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11685 T2244 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11685 T2244 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52380/collection1/
[junit4:junit4] 2> 11686 T2244 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11686 T2244 oasc.SyncStrategy.syncToMe http://127.0.0.1:52380/collection1/ has no replicas
[junit4:junit4] 2> 11686 T2244 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52380/collection1/
[junit4:junit4] 2> 11686 T2244 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 11689 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0008 type:create cxid:0x54 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12579 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12590 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12590 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12590 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12590 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12594 T2244 oasc.ZkController.register We are http://127.0.0.1:52380/collection1/ and leader is http://127.0.0.1:52380/collection1/
[junit4:junit4] 2> 12595 T2244 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52380
[junit4:junit4] 2> 12595 T2244 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 12595 T2244 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 12596 T2244 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12598 T2244 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12600 T2185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 12600 T2185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12601 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12673 T2185 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12675 T2185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38174
[junit4:junit4] 2> 12676 T2185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12677 T2185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12677 T2185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364124763047
[junit4:junit4] 2> 12678 T2185 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364124763047/solr.xml
[junit4:junit4] 2> 12678 T2185 oasc.CoreContainer.<init> New CoreContainer 8656520
[junit4:junit4] 2> 12678 T2185 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364124763047/'
[junit4:junit4] 2> 12679 T2185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364124763047/'
[junit4:junit4] 2> 12699 T2185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12700 T2185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12700 T2185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12701 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12701 T2185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12701 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12702 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12702 T2185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12702 T2185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12703 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12708 T2185 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12718 T2185 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54134/solr
[junit4:junit4] 2> 12718 T2185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12719 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@cb7683
[junit4:junit4] 2> 12720 T2256 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12720 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12721 T2256 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 12721 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41188
[junit4:junit4] 2> 12721 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41188
[junit4:junit4] 2> 12722 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f0009 with negotiated timeout 20000 for client /127.0.0.1:41188
[junit4:junit4] 2> 12722 T2256 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f0009, negotiated timeout = 20000
[junit4:junit4] 2> 12722 T2257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cb7683 name:ZooKeeperConnection Watcher:127.0.0.1:54134 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12723 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12724 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f0009
[junit4:junit4] 2> 12725 T2257 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12725 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41188 which had sessionid 0x13d9c2bd26f0009
[junit4:junit4] 2> 12725 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f0009 closed
[junit4:junit4] 2> 12726 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12728 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@13e6d98
[junit4:junit4] 2> 12729 T2258 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12729 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12729 T2258 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 12729 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41189
[junit4:junit4] 2> 12730 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41189
[junit4:junit4] 2> 12731 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f000a with negotiated timeout 20000 for client /127.0.0.1:41189
[junit4:junit4] 2> 12731 T2258 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f000a, negotiated timeout = 20000
[junit4:junit4] 2> 12731 T2259 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13e6d98 name:ZooKeeperConnection Watcher:127.0.0.1:54134/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12731 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12732 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12734 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f000a type:create cxid:0x3 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12735 T2185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13738 T2185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38174_
[junit4:junit4] 2> 13739 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f000a type:delete cxid:0xd zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38174_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38174_
[junit4:junit4] 2> 13739 T2185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38174_
[junit4:junit4] 2> 13741 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13742 T2214 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13743 T2227 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13743 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13743 T2259 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13743 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13743 T2207 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13743 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13745 T2243 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13751 T2260 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364124763047/collection1
[junit4:junit4] 2> 13751 T2260 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13752 T2260 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13752 T2260 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13753 T2260 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364124763047/collection1/'
[junit4:junit4] 2> 13753 T2260 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364124763047/collection1/lib/README' to classloader
[junit4:junit4] 2> 13754 T2260 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364124763047/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13779 T2260 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 13809 T2260 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13809 T2260 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13813 T2260 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 14098 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14098 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:52380_",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52380",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 14102 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14102 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14102 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14102 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14102 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14163 T2260 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14169 T2260 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14171 T2260 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14183 T2260 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14187 T2260 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14191 T2260 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14193 T2260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14193 T2260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14193 T2260 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14195 T2260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14195 T2260 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14195 T2260 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14195 T2260 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364124763047/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty3/
[junit4:junit4] 2> 14196 T2260 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11b579d
[junit4:junit4] 2> 14196 T2260 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14197 T2260 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty3
[junit4:junit4] 2> 14197 T2260 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty3/index/
[junit4:junit4] 2> 14197 T2260 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14197 T2260 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty3/index
[junit4:junit4] 2> 14198 T2260 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@182ecfa lockFactory=org.apache.lucene.store.NativeFSLockFactory@7795a9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14199 T2260 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14200 T2260 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14200 T2260 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14201 T2260 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14201 T2260 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14202 T2260 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14202 T2260 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14202 T2260 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14203 T2260 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14203 T2260 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14205 T2260 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14207 T2260 oass.SolrIndexSearcher.<init> Opening Searcher@98de9d main
[junit4:junit4] 2> 14208 T2260 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty3/tlog
[junit4:junit4] 2> 14208 T2260 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14208 T2260 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14212 T2261 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@98de9d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14213 T2260 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14213 T2260 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15607 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15608 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:38174_",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38174",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 15608 T2208 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15608 T2208 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 15612 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15612 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15613 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15613 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15613 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16215 T2260 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16215 T2260 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38174 collection:collection1 shard:shard1
[junit4:junit4] 2> 16218 T2260 oasc.ZkController.register We are http://127.0.0.1:38174/collection1/ and leader is http://127.0.0.1:41035/collection1/
[junit4:junit4] 2> 16218 T2260 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38174
[junit4:junit4] 2> 16219 T2260 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16219 T2260 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C365 name=collection1 org.apache.solr.core.SolrCore@e317da url=http://127.0.0.1:38174/collection1 node=127.0.0.1:38174_ C365_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:38174_, state=down, core=collection1, base_url=http://127.0.0.1:38174}
[junit4:junit4] 2> 16219 T2262 C365 P38174 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16220 T2262 C365 P38174 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16220 T2260 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16220 T2262 C365 P38174 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16221 T2262 C365 P38174 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16222 T2262 C365 P38174 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16222 T2185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 16222 T2185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16223 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16284 T2185 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16287 T2185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34006
[junit4:junit4] 2> 16287 T2185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16288 T2185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16288 T2185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364124766665
[junit4:junit4] 2> 16288 T2185 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364124766665/solr.xml
[junit4:junit4] 2> 16289 T2185 oasc.CoreContainer.<init> New CoreContainer 20216423
[junit4:junit4] 2> 16289 T2185 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364124766665/'
[junit4:junit4] 2> 16290 T2185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364124766665/'
[junit4:junit4] 2> 16309 T2185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 16309 T2185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 16310 T2185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 16310 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 16311 T2185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 16311 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 16311 T2185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 16312 T2185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 16312 T2185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 16312 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 16318 T2185 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16328 T2185 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54134/solr
[junit4:junit4] 2> 16329 T2185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16329 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ab9891
[junit4:junit4] 2> 16331 T2273 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16330 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16331 T2273 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 16331 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41191
[junit4:junit4] 2> 16332 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41191
[junit4:junit4] 2> 16332 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f000b with negotiated timeout 20000 for client /127.0.0.1:41191
[junit4:junit4] 2> 16332 T2273 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f000b, negotiated timeout = 20000
[junit4:junit4] 2> 16333 T2274 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ab9891 name:ZooKeeperConnection Watcher:127.0.0.1:54134 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16333 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16334 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f000b
[junit4:junit4] 2> 16334 T2274 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16334 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41191 which had sessionid 0x13d9c2bd26f000b
[junit4:junit4] 2> 16334 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f000b closed
[junit4:junit4] 2> 16335 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 16337 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1098467
[junit4:junit4] 2> 16338 T2275 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16338 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16339 T2275 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 16339 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41192
[junit4:junit4] 2> 16339 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41192
[junit4:junit4] 2> 16340 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f000c with negotiated timeout 20000 for client /127.0.0.1:41192
[junit4:junit4] 2> 16340 T2275 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f000c, negotiated timeout = 20000
[junit4:junit4] 2> 16340 T2276 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1098467 name:ZooKeeperConnection Watcher:127.0.0.1:54134/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16341 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16341 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f000c type:create cxid:0x1 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16343 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f000c type:create cxid:0x3 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16345 T2185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17117 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17118 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:38174_",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38174",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 17129 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17129 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17129 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17129 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17129 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17129 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17226 T2220 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {onlyIfLeader=true&state=recovering&coreNodeName=4&action=PREPRECOVERY&version=2&core=collection1&wt=javabin&checkLive=true&nodeName=127.0.0.1:38174_} status=0 QTime=1000
[junit4:junit4] 2> 17347 T2185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34006_
[junit4:junit4] 2> 17348 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f000c type:delete cxid:0xf zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34006_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34006_
[junit4:junit4] 2> 17349 T2185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34006_
[junit4:junit4] 2> 17350 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17351 T2214 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17351 T2207 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17351 T2276 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17351 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17351 T2227 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17351 T2243 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17352 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17352 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17351 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17352 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17352 T2259 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17357 T2277 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364124766665/collection1
[junit4:junit4] 2> 17357 T2277 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17358 T2277 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17358 T2277 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17359 T2277 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364124766665/collection1/'
[junit4:junit4] 2> 17359 T2277 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364124766665/collection1/lib/README' to classloader
[junit4:junit4] 2> 17360 T2277 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364124766665/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17384 T2277 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 17420 T2277 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17422 T2277 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17427 T2277 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17758 T2277 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17764 T2277 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17766 T2277 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17780 T2277 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17784 T2277 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17788 T2277 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17789 T2277 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17790 T2277 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17791 T2277 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17792 T2277 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17792 T2277 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17792 T2277 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17793 T2277 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364124766665/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty4/
[junit4:junit4] 2> 17793 T2277 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11b579d
[junit4:junit4] 2> 17794 T2277 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17794 T2277 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty4
[junit4:junit4] 2> 17795 T2277 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty4/index/
[junit4:junit4] 2> 17795 T2277 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17795 T2277 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty4/index
[junit4:junit4] 2> 17797 T2277 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@113eb22 lockFactory=org.apache.lucene.store.NativeFSLockFactory@357112),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17798 T2277 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17800 T2277 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17800 T2277 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17801 T2277 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17802 T2277 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17802 T2277 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17803 T2277 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17803 T2277 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17804 T2277 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17804 T2277 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17808 T2277 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17812 T2277 oass.SolrIndexSearcher.<init> Opening Searcher@a06d9b main
[junit4:junit4] 2> 17812 T2277 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty4/tlog
[junit4:junit4] 2> 17813 T2277 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17813 T2277 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17818 T2278 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a06d9b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17820 T2277 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 17820 T2277 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18634 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18635 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:34006_",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34006",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 18635 T2208 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 18635 T2208 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 18640 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18640 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18640 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18640 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18640 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18640 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18822 T2277 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 18822 T2277 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34006 collection:collection1 shard:shard2
[junit4:junit4] 2> 18826 T2277 oasc.ZkController.register We are http://127.0.0.1:34006/collection1/ and leader is http://127.0.0.1:52380/collection1/
[junit4:junit4] 2> 18826 T2277 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34006
[junit4:junit4] 2> 18826 T2277 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 18826 T2277 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C366 name=collection1 org.apache.solr.core.SolrCore@f48866 url=http://127.0.0.1:34006/collection1 node=127.0.0.1:34006_ C366_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:34006_, state=down, core=collection1, base_url=http://127.0.0.1:34006}
[junit4:junit4] 2> 18826 T2279 C366 P34006 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 18828 T2279 C366 P34006 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 18828 T2277 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18828 T2279 C366 P34006 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 18828 T2279 C366 P34006 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18829 T2279 C366 P34006 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18829 T2185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 18830 T2185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 18830 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18834 T2185 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18836 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18840 T2220 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/onenodecollectioncore
[junit4:junit4] 2> 18841 T2220 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 18842 T2220 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 18842 T2220 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 18843 T2220 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 18844 T2220 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 18846 T2220 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 18848 T2220 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/onenodecollectioncore/'
[junit4:junit4] 2> 18900 T2220 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 18930 T2220 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18931 T2220 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18934 T2220 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> C365_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:38174_, state=recovering, shard=shard1, core=collection1, base_url=http://127.0.0.1:38174}
[junit4:junit4] 2> 19227 T2262 C365 P38174 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:41035/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19227 T2262 C365 P38174 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38174 START replicas=[http://127.0.0.1:41035/collection1/] nUpdates=100
[junit4:junit4] 2> 19228 T2262 C365 P38174 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19228 T2262 C365 P38174 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19228 T2262 C365 P38174 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19228 T2262 C365 P38174 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19229 T2262 C365 P38174 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19229 T2262 C365 P38174 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:41035/collection1/. core=collection1
[junit4:junit4] 2> 19229 T2262 C365 P38174 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C367 name=collection1 org.apache.solr.core.SolrCore@7e023d url=http://127.0.0.1:41035/collection1 node=127.0.0.1:41035_ C367_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:41035_, state=active, shard=shard1, core=collection1, base_url=http://127.0.0.1:41035, leader=true}
[junit4:junit4] 2> 19233 T2223 C367 P41035 REQ /get {version=2&wt=javabin&qt=/get&distrib=false&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 19235 T2222 C367 P41035 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19236 T2222 C367 P41035 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1fb3191 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ba4243),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19236 T2222 C367 P41035 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19237 T2222 C367 P41035 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1fb3191 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ba4243),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1fb3191 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ba4243),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19237 T2222 C367 P41035 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19238 T2222 C367 P41035 oass.SolrIndexSearcher.<init> Opening Searcher@ca1923 realtime
[junit4:junit4] 2> 19238 T2222 C367 P41035 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19238 T2222 C367 P41035 /update {waitSearcher=true&version=2&softCommit=false&wt=javabin&commit_end_point=true&commit=true&openSearcher=false} {commit=} 0 3
[junit4:junit4] 2> 19239 T2262 C365 P38174 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19240 T2262 C365 P38174 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19243 T2223 C367 P41035 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19244 T2223 C367 P41035 REQ /replication {command=indexversion&version=2&wt=javabin&qt=/replication} status=0 QTime=4
[junit4:junit4] 2> 19244 T2262 C365 P38174 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19244 T2262 C365 P38174 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19245 T2262 C365 P38174 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19246 T2222 C367 P41035 REQ /replication {generation=2&command=filelist&version=2&wt=javabin&qt=/replication} status=0 QTime=0
[junit4:junit4] 2> 19247 T2262 C365 P38174 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19248 T2262 C365 P38174 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty3/index.20130324073249687
[junit4:junit4] 2> 19248 T2262 C365 P38174 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@14bc680 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e84bdb) fullCopy=false
[junit4:junit4] 2> 19251 T2221 C367 P41035 REQ /replication {file=segments_2&generation=2&command=filecontent&checksum=true&wt=filestream&qt=/replication} status=0 QTime=1
[junit4:junit4] 2> 19253 T2262 C365 P38174 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19253 T2262 C365 P38174 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19253 T2262 C365 P38174 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19254 T2262 C365 P38174 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@182ecfa lockFactory=org.apache.lucene.store.NativeFSLockFactory@7795a9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@182ecfa lockFactory=org.apache.lucene.store.NativeFSLockFactory@7795a9),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19254 T2262 C365 P38174 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19255 T2262 C365 P38174 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19255 T2262 C365 P38174 oass.SolrIndexSearcher.<init> Opening Searcher@f4770e main
[junit4:junit4] 2> 19256 T2261 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f4770e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19256 T2262 C365 P38174 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19256 T2262 C365 P38174 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19256 T2262 C365 P38174 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19256 T2262 C365 P38174 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19258 T2262 C365 P38174 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19273 T2220 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19279 T2220 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19281 T2220 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19294 T2220 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19297 T2220 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19300 T2220 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19302 T2220 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19302 T2220 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19302 T2220 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19303 T2220 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19304 T2220 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19304 T2220 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19304 T2220 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364124753975/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection/
[junit4:junit4] 2> 19305 T2220 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11b579d
[junit4:junit4] 2> 19305 T2220 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19306 T2220 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection
[junit4:junit4] 2> 19306 T2220 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection/index/
[junit4:junit4] 2> 19306 T2220 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19307 T2220 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection/index
[junit4:junit4] 2> 19308 T2220 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@8d5ef6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1076677),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19308 T2220 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19310 T2220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19310 T2220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19311 T2220 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19311 T2220 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19312 T2220 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19312 T2220 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19312 T2220 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19313 T2220 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19313 T2220 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19315 T2220 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19317 T2220 oass.SolrIndexSearcher.<init> Opening Searcher@1bb2a74 main
[junit4:junit4] 2> 19318 T2220 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection/tlog
[junit4:junit4] 2> 19318 T2220 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19319 T2220 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19322 T2283 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@1bb2a74 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19323 T2220 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 20146 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20147 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:34006_",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34006",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 20150 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:38174_",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38174",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 20153 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:41035_",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41035",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":"none"}
[junit4:junit4] 2> 20153 T2208 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 20154 T2208 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 20157 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20157 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20157 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20157 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20157 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20157 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20324 T2220 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 20325 T2220 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:41035 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 20326 T2220 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 20332 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:delete cxid:0xac zxid:0xc2 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 20332 T2220 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 20333 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:create cxid:0xad zxid:0xc3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20335 T2220 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 20335 T2220 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 20335 T2220 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41035/onenodecollectioncore/
[junit4:junit4] 2> 20336 T2220 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 20336 T2220 oasc.SyncStrategy.syncToMe http://127.0.0.1:41035/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 20337 T2220 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41035/onenodecollectioncore/
[junit4:junit4] 2> 20337 T2220 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 20340 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:create cxid:0xb8 zxid:0xc7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20833 T2239 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {onlyIfLeader=true&state=recovering&coreNodeName=5&action=PREPRECOVERY&version=2&core=collection1&wt=javabin&checkLive=true&nodeName=127.0.0.1:34006_} status=0 QTime=2000
[junit4:junit4] 2> 21664 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21672 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21672 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21672 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21672 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21672 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21672 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21695 T2220 oasc.ZkController.register We are http://127.0.0.1:41035/onenodecollectioncore/ and leader is http://127.0.0.1:41035/onenodecollectioncore/
[junit4:junit4] 2> 21695 T2220 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:41035
[junit4:junit4] 2> 21695 T2220 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 21696 T2220 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 21697 T2220 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21698 T2220 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {collection=onenodecollection&action=CREATE&version=2&numShards=1&name=onenodecollectioncore&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection&wt=javabin&roles=none} status=0 QTime=2858
[junit4:junit4] 2> 21699 T2185 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21700 T2185 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22701 T2185 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C366_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:34006_, state=recovering, shard=shard2, core=collection1, base_url=http://127.0.0.1:34006}
[junit4:junit4] 2> 22834 T2279 C366 P34006 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52380/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 22834 T2279 C366 P34006 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34006 START replicas=[http://127.0.0.1:52380/collection1/] nUpdates=100
[junit4:junit4] 2> 22835 T2279 C366 P34006 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 22835 T2279 C366 P34006 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 22835 T2279 C366 P34006 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 22835 T2279 C366 P34006 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 22835 T2279 C366 P34006 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 22836 T2279 C366 P34006 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52380/collection1/. core=collection1
[junit4:junit4] 2> 22836 T2279 C366 P34006 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C368 name=collection1 org.apache.solr.core.SolrCore@392959 url=http://127.0.0.1:52380/collection1 node=127.0.0.1:52380_ C368_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:52380_, state=active, shard=shard2, core=collection1, base_url=http://127.0.0.1:52380, leader=true}
[junit4:junit4] 2> 22840 T2236 C368 P52380 REQ /get {version=2&wt=javabin&qt=/get&distrib=false&getVersions=100} status=0 QTime=1
[junit4:junit4] 2> 22840 T2238 C368 P52380 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22841 T2238 C368 P52380 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a65a4a lockFactory=org.apache.lucene.store.NativeFSLockFactory@17d94e0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22842 T2238 C368 P52380 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22842 T2238 C368 P52380 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a65a4a lockFactory=org.apache.lucene.store.NativeFSLockFactory@17d94e0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a65a4a lockFactory=org.apache.lucene.store.NativeFSLockFactory@17d94e0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22842 T2238 C368 P52380 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22843 T2238 C368 P52380 oass.SolrIndexSearcher.<init> Opening Searcher@1370f0a realtime
[junit4:junit4] 2> 22843 T2238 C368 P52380 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22843 T2238 C368 P52380 /update {waitSearcher=true&version=2&softCommit=false&wt=javabin&commit_end_point=true&commit=true&openSearcher=false} {commit=} 0 3
[junit4:junit4] 2> 22844 T2279 C366 P34006 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22844 T2279 C366 P34006 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 22846 T2237 C368 P52380 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22846 T2237 C368 P52380 REQ /replication {command=indexversion&version=2&wt=javabin&qt=/replication} status=0 QTime=1
[junit4:junit4] 2> 22847 T2279 C366 P34006 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 22847 T2279 C366 P34006 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 22847 T2279 C366 P34006 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 22848 T2236 C368 P52380 REQ /replication {generation=2&command=filelist&version=2&wt=javabin&qt=/replication} status=0 QTime=0
[junit4:junit4] 2> 22849 T2279 C366 P34006 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 22850 T2279 C366 P34006 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty4/index.20130324073253289
[junit4:junit4] 2> 22850 T2279 C366 P34006 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@b67628 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f1a722) fullCopy=false
[junit4:junit4] 2> 22852 T2238 C368 P52380 REQ /replication {file=segments_2&generation=2&command=filecontent&checksum=true&wt=filestream&qt=/replication} status=0 QTime=0
[junit4:junit4] 2> 22854 T2279 C366 P34006 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 22854 T2279 C366 P34006 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22854 T2279 C366 P34006 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22855 T2279 C366 P34006 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@113eb22 lockFactory=org.apache.lucene.store.NativeFSLockFactory@357112),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@113eb22 lockFactory=org.apache.lucene.store.NativeFSLockFactory@357112),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22856 T2279 C366 P34006 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22856 T2279 C366 P34006 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 22856 T2279 C366 P34006 oass.SolrIndexSearcher.<init> Opening Searcher@9ea1a1 main
[junit4:junit4] 2> 22857 T2278 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9ea1a1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22857 T2279 C366 P34006 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 22857 T2279 C366 P34006 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 22858 T2279 C366 P34006 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 22858 T2279 C366 P34006 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22859 T2279 C366 P34006 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23180 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23181 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:41035__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:41035_",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41035",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":"none"}
[junit4:junit4] 2> 23184 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:34006_",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34006",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 23187 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23187 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23187 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23187 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23187 T2214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23187 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23703 T2185 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23704 T2185 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 23705 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23713 T2185 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54134 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@10bbb81
[junit4:junit4] 2> 23714 T2185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 23715 T2286 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:54134. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 23715 T2286 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:54134, initiating session
[junit4:junit4] 2> 23715 T2187 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:41203
[junit4:junit4] 2> 23715 T2187 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:41203
[junit4:junit4] 2> 23716 T2189 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c2bd26f000d with negotiated timeout 10000 for client /127.0.0.1:41203
[junit4:junit4] 2> 23716 T2286 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:54134, sessionid = 0x13d9c2bd26f000d, negotiated timeout = 10000
[junit4:junit4] 2> 23717 T2287 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10bbb81 name:ZooKeeperConnection Watcher:127.0.0.1:54134 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 23717 T2185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 23763 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f000d
[junit4:junit4] 2> 23764 T2287 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 23764 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41203 which had sessionid 0x13d9c2bd26f000d
[junit4:junit4] 2> 23764 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f000d closed
[junit4:junit4] 2> 23765 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f0004
[junit4:junit4] 2> 23765 T2214 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 23765 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41176 which had sessionid 0x13d9c2bd26f0004
[junit4:junit4] 2> 23765 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f0004 closed
[junit4:junit4] 2> 23767 T2185 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 50017
[junit4:junit4] 2> 23768 T2185 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=20301957
[junit4:junit4] 2> 24692 T2208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24693 T2208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:50017_",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50017",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 24698 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24698 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24698 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24698 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24698 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25769 T2185 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 25770 T2185 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 25772 T2185 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@15d681
[junit4:junit4] 2> 25775 T2185 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 25775 T2185 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 25776 T2185 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 25776 T2185 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 25777 T2185 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 25778 T2185 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/control/data
[junit4:junit4] 2> 25778 T2185 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/control/data
[junit4:junit4] 2> 25778 T2185 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/control/data/index
[junit4:junit4] 2> 25778 T2185 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/control/data/index
[junit4:junit4] 2> 25779 T2208 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89399279645294595-127.0.0.1:50017_-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 25780 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f0003
[junit4:junit4] 2> 25781 T2207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25781 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25781 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25781 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41175 which had sessionid 0x13d9c2bd26f0003
[junit4:junit4] 2> 25781 T2243 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25781 T2259 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25781 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25781 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f0003 closed
[junit4:junit4] 2> 25782 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25783 T2276 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25783 T2227 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25785 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:delete cxid:0xc9 zxid:0xe3 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 25785 T2227 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 25787 T2227 oasc.Overseer.start Overseer (id=89399279645294598-127.0.0.1:41035_-n_0000000001) starting
[junit4:junit4] 2> 25787 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:create cxid:0xce zxid:0xe5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25788 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:create cxid:0xcf zxid:0xe6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25789 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:create cxid:0xd1 zxid:0xe7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25790 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0006 type:create cxid:0xd3 zxid:0xe8 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25791 T2289 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 25792 T2288 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 25793 T2288 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25794 T2288 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:50017_",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50017",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 25797 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25797 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25797 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25797 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25804 T2185 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 25857 T2185 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 41035
[junit4:junit4] 2> 25857 T2185 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=31263381
[junit4:junit4] 2> 27081 T2207 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27081 T2207 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 27081 T2207 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 27301 T2288 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27302 T2288 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:41035_",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41035",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 27307 T2288 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:41035__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:41035_",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41035",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":"none"}
[junit4:junit4] 2> 27313 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 27313 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 27313 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 27313 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 28860 T2185 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 28861 T2185 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 28862 T2185 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 28864 T2185 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7e023d
[junit4:junit4] 2> 28869 T2185 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 28869 T2185 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 28870 T2185 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 28870 T2185 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 28871 T2185 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 28872 T2185 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty1
[junit4:junit4] 2> 28872 T2185 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty1
[junit4:junit4] 2> 28872 T2185 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty1/index
[junit4:junit4] 2> 28873 T2185 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1364124750443/jetty1/index
[junit4:junit4] 2> 28873 T2185 oasc.SolrCore.close [onenodecollectioncore] CLOSING SolrCore org.apache.solr.core.SolrCore@166127c
[junit4:junit4] 2> 28877 T2185 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 28877 T2185 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 28877 T2185 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 28878 T2185 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 28878 T2185 oasc.SolrCore.closeSearcher [onenodecollectioncore] Closing main searcher on request.
[junit4:junit4] 2> 28879 T2185 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection
[junit4:junit4] 2> 28879 T2185 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection
[junit4:junit4] 2> 28879 T2185 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection/index
[junit4:junit4] 2> 28880 T2185 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364124750444/onenodecollection/index
[junit4:junit4] 2> 28880 T2288 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89399279645294598-127.0.0.1:41035_-n_0000000001) am no longer a leader.
[junit4:junit4] 2> 28881 T2190 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c2bd26f0006
[junit4:junit4] 2> 28882 T2276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 28882 T2243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 28882 T2227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 28882 T2187 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:41178 which had sessionid 0x13d9c2bd26f0006
[junit4:junit4] 2> 28882 T2227 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 28883 T2227 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 28883 T2227 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 28883 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f000a type:delete cxid:0x5e zxid:0xf9 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4] 2> 28882 T2185 oaz.ZooKeeper.close Session: 0x13d9c2bd26f0006 closed
[junit4:junit4] 2> 28883 T2259 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 28884 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f000a type:create cxid:0x5f zxid:0xfa txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 28885 T2276 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 28885 T2243 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 28886 T2259 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 28886 T2259 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 28886 T2259 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 28886 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0008 type:delete cxid:0x7f zxid:0xfc txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 28886 T2259 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38174/collection1/
[junit4:junit4] 2> 28886 T2259 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38174 START replicas=[http://127.0.0.1:41035/collection1/] nUpdates=100
[junit4:junit4] 2> 28886 T2243 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 28886 T2259 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38174 DONE. We have no versions. sync failed.
[junit4:junit4] 2> 28887 T2259 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 28887 T2259 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 28887 T2259 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38174/collection1/
[junit4:junit4] 2> 28887 T2259 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 28888 T2243 oasc.Overseer.start Overseer (id=89399279645294600-127.0.0.1:52380_-n_0000000002) starting
[junit4:junit4] 2> 28888 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0008 type:create cxid:0x84 zxid:0xfe txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 28889 T2190 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c2bd26f0008 type:create cxid:0x85 zxid:0xff txntype:
[...truncated too long message...]
DistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:52380/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([995C80BF3A3661E9:18BA0EA74D6901D5]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 32242 T2185 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 32246 T2184 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 32358 T2259 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 32358 T2259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 32358 T2259 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 32359 T2259 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 32560 T2188 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> NOTE: test params are: codec=SimpleText, sim=DefaultSimilarity, locale=tr_TR, timezone=America/Indiana/Indianapolis
[junit4:junit4] 2> NOTE: Linux 3.2.0-39-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=3,free=56204528,total=316669952
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TermVectorComponentDistributedTest, TestQueryTypes, TestCSVLoader, CurrencyFieldXmlFileTest, CollectionsAPIDistributedZkTest, SpellCheckCollatorTest, XsltUpdateRequestHandlerTest, TestFieldTypeCollectionResource, HighlighterTest, SignatureUpdateProcessorFactoryTest, TestLazyCores, SortByFunctionTest, TestSolr4Spatial, OpenCloseCoreStressTest, TestBinaryField, CachingDirectoryFactoryTest, ChaosMonkeySafeLeaderTest, SolrCmdDistributorTest, CoreContainerCoreInitFailuresTest, NoCacheHeaderTest, IndexSchemaRuntimeFieldTest, ConvertedLegacyTest, TimeZoneUtilsTest, TestJmxIntegration, UniqFieldsUpdateProcessorFactoryTest, OpenExchangeRatesOrgProviderTest, SpellCheckComponentTest, StatsComponentTest, DistanceFunctionTest, TestSolrXMLSerializer, TestFastOutputStream, TestZkChroot, TestLuceneMatchVersion, TestFoldingMultitermQuery, TestCollationField, TestNumberUtils, TestSuggestSpellingConverter, TestArbitraryIndexDir, TestMultiCoreConfBootstrap, SuggesterTSTTest, MultiTermTest, DOMUtilTest, TestAnalyzedSuggestions, FullSolrCloudDistribCmdsTest, RequestHandlersTest, TestStressReorder, PathHierarchyTokenizerFactoryTest, TestSolrJ, HighlighterConfigTest, TestRTGBase, ZkSolrClientTest, JSONWriterTest, TestPartialUpdateDeduplication, ZkNodePropsTest, TestUpdate, TestMergePolicyConfig, SimplePostToolTest, SolrCoreCheckLockOnStartupTest, XmlUpdateRequestHandlerTest, TestHashPartitioner, TestAtomicUpdateErrorCases, NotRequiredUniqueKeyTest, TestCSVResponseWriter, IndexBasedSpellCheckerTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 32.78s, 1 test, 1 error <<< FAILURES!
[...truncated 445 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1212: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:876: There were test failures: 273 suites, 1149 tests, 1 error, 13 ignored (7 assumptions)
Total time: 40 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b82 -server -XX:+UseG1GC -XX:MarkStackSize=256K
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b82) - Build #
4806 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4806/
Java: 32bit/jdk1.8.0-ea-b82 -server -XX:+UseConcMarkSweepGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard2 in collection test_unload_shard_and_collection
Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
at __randomizedtesting.SeedInfo.seed([12AF573644669E6B:9349D92E3339FE57]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:127)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:34480/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:34480/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([12AF573644669E6B:9349D92E3339FE57]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9003 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4:junit4] 2> 0 T31 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 9 T31 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471
[junit4:junit4] 2> 13 T31 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 16 T32 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 42 T32 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 42 T32 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4] 2> 43 T32 oaz.Environment.logEnv Server environment:java.version=1.8.0-ea
[junit4:junit4] 2> 43 T32 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4] 2> 43 T32 oaz.Environment.logEnv Server environment:java.home=/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b82/jre
[junit4:junit4] 2> 43 T32 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/noggit-0.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b82/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 44 T32 oaz.Environment.logEnv Server environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4] 2> 44 T32 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4] 2> 45 T32 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4] 2> 45 T32 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4] 2> 45 T32 oaz.Environment.logEnv Server environment:os.arch=i386
[junit4:junit4] 2> 45 T32 oaz.Environment.logEnv Server environment:os.version=3.2.0-39-generic
[junit4:junit4] 2> 46 T32 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4] 2> 46 T32 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4] 2> 46 T32 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 60 T32 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 60 T32 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 60 T32 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 62 T32 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 88 T32 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-1364129512470/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 115 T31 oasc.ZkTestServer.run start zk server on port:38828
[junit4:junit4] 2> 139 T31 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 140 T31 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4] 2> 141 T31 oaz.Environment.logEnv Client environment:java.version=1.8.0-ea
[junit4:junit4] 2> 141 T31 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4] 2> 142 T31 oaz.Environment.logEnv Client environment:java.home=/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b82/jre
[junit4:junit4] 2> 142 T31 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/noggit-0.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b82/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 144 T31 oaz.Environment.logEnv Client environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4] 2> 145 T31 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4] 2> 145 T31 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4] 2> 146 T31 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4] 2> 147 T31 oaz.Environment.logEnv Client environment:os.arch=i386
[junit4:junit4] 2> 147 T31 oaz.Environment.logEnv Client environment:os.version=3.2.0-39-generic
[junit4:junit4] 2> 148 T31 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4] 2> 148 T31 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4] 2> 149 T31 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 152 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d0efc6
[junit4:junit4] 2> 178 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 182 T37 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 183 T37 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 183 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40090
[junit4:junit4] 2> 192 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40090
[junit4:junit4] 2> 197 T35 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 208 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f0000 with negotiated timeout 10000 for client /127.0.0.1:40090
[junit4:junit4] 2> 208 T37 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f0000, negotiated timeout = 10000
[junit4:junit4] 2> 211 T38 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d0efc6 name:ZooKeeperConnection Watcher:127.0.0.1:38828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 211 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 213 T31 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 236 T36 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c747c6f0000
[junit4:junit4] 2> 237 T38 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 237 T31 oaz.ZooKeeper.close Session: 0x13d9c747c6f0000 closed
[junit4:junit4] 2> 238 T33 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40090 which had sessionid 0x13d9c747c6f0000
[junit4:junit4] 2> 238 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7c0acf
[junit4:junit4] 2> 239 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 239 T39 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 240 T39 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 240 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40091
[junit4:junit4] 2> 241 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40091
[junit4:junit4] 2> 242 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f0001 with negotiated timeout 10000 for client /127.0.0.1:40091
[junit4:junit4] 2> 242 T39 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f0001, negotiated timeout = 10000
[junit4:junit4] 2> 242 T40 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c0acf name:ZooKeeperConnection Watcher:127.0.0.1:38828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 243 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 248 T31 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 253 T31 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 259 T31 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 263 T31 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 268 T31 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 276 T31 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 284 T31 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 284 T31 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 290 T31 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 290 T31 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 297 T31 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 298 T31 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 304 T31 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 305 T31 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 310 T31 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 311 T31 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 315 T31 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 316 T31 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 321 T31 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 322 T31 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 327 T31 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 327 T31 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 332 T36 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c747c6f0001
[junit4:junit4] 2> 333 T40 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 333 T31 oaz.ZooKeeper.close Session: 0x13d9c747c6f0001 closed
[junit4:junit4] 2> 333 T33 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40091 which had sessionid 0x13d9c747c6f0001
[junit4:junit4] 2> 412 T31 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 418 T31 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48031
[junit4:junit4] 2> 419 T31 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 419 T31 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 420 T31 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1364129512795
[junit4:junit4] 2> 420 T31 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1364129512795/solr.xml
[junit4:junit4] 2> 421 T31 oasc.CoreContainer.<init> New CoreContainer 6066463
[junit4:junit4] 2> 421 T31 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1364129512795/'
[junit4:junit4] 2> 422 T31 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1364129512795/'
[junit4:junit4] 2> 443 T31 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 443 T31 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 444 T31 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 444 T31 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 445 T31 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 445 T31 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 445 T31 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 446 T31 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 446 T31 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 447 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 537 T31 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 555 T31 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:38828/solr
[junit4:junit4] 2> 563 T31 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 564 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@67b42d
[junit4:junit4] 2> 565 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 565 T50 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 566 T50 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 566 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40092
[junit4:junit4] 2> 567 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40092
[junit4:junit4] 2> 569 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f0002 with negotiated timeout 20000 for client /127.0.0.1:40092
[junit4:junit4] 2> 569 T50 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f0002, negotiated timeout = 20000
[junit4:junit4] 2> 570 T51 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67b42d name:ZooKeeperConnection Watcher:127.0.0.1:38828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 570 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 572 T36 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c747c6f0002
[junit4:junit4] 2> 573 T51 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 573 T31 oaz.ZooKeeper.close Session: 0x13d9c747c6f0002 closed
[junit4:junit4] 2> 573 T33 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40092 which had sessionid 0x13d9c747c6f0002
[junit4:junit4] 2> 575 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 580 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@f8f755
[junit4:junit4] 2> 581 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 581 T52 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 582 T52 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 582 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40093
[junit4:junit4] 2> 582 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40093
[junit4:junit4] 2> 583 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f0003 with negotiated timeout 20000 for client /127.0.0.1:40093
[junit4:junit4] 2> 584 T52 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f0003, negotiated timeout = 20000
[junit4:junit4] 2> 584 T53 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f8f755 name:ZooKeeperConnection Watcher:127.0.0.1:38828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 584 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 590 T31 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 596 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 598 T31 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 605 T31 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 608 T31 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48031_
[junit4:junit4] 2> 612 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48031_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48031_
[junit4:junit4] 2> 618 T31 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48031_
[junit4:junit4] 2> 624 T31 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 637 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 638 T31 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 643 T31 oasc.Overseer.start Overseer (id=89399591735066627-127.0.0.1:48031_-n_0000000000) starting
[junit4:junit4] 2> 644 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 651 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 653 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 655 T31 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 663 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 665 T55 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 665 T31 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 670 T31 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 673 T31 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 681 T54 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 683 T31 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 684 T31 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 699 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 709 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 711 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1469ad5
[junit4:junit4] 2> 712 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 712 T57 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 713 T57 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 713 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40094
[junit4:junit4] 2> 713 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40094
[junit4:junit4] 2> 714 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f0004 with negotiated timeout 10000 for client /127.0.0.1:40094
[junit4:junit4] 2> 714 T57 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f0004, negotiated timeout = 10000
[junit4:junit4] 2> 715 T58 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1469ad5 name:ZooKeeperConnection Watcher:127.0.0.1:38828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 715 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 717 T31 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 722 T31 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 794 T31 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 796 T31 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43934
[junit4:junit4] 2> 797 T31 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 798 T31 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 798 T31 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1364129513183
[junit4:junit4] 2> 798 T31 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1364129513183/solr.xml
[junit4:junit4] 2> 799 T31 oasc.CoreContainer.<init> New CoreContainer 15549231
[junit4:junit4] 2> 799 T31 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1364129513183/'
[junit4:junit4] 2> 800 T31 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1364129513183/'
[junit4:junit4] 2> 821 T31 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 822 T31 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 823 T31 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 823 T31 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 824 T31 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 825 T31 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 825 T31 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 826 T31 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 826 T31 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 827 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 834 T31 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 847 T31 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:38828/solr
[junit4:junit4] 2> 847 T31 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 848 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@8db5ca
[junit4:junit4] 2> 849 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 849 T68 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 850 T68 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 851 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40095
[junit4:junit4] 2> 851 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40095
[junit4:junit4] 2> 852 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f0005 with negotiated timeout 20000 for client /127.0.0.1:40095
[junit4:junit4] 2> 853 T68 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f0005, negotiated timeout = 20000
[junit4:junit4] 2> 853 T69 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8db5ca name:ZooKeeperConnection Watcher:127.0.0.1:38828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 853 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 855 T36 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c747c6f0005
[junit4:junit4] 2> 856 T33 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40095 which had sessionid 0x13d9c747c6f0005
[junit4:junit4] 2> 856 T31 oaz.ZooKeeper.close Session: 0x13d9c747c6f0005 closed
[junit4:junit4] 2> 856 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 860 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@188e830
[junit4:junit4] 2> 861 T69 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 861 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 864 T70 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 865 T70 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 865 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40096
[junit4:junit4] 2> 866 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40096
[junit4:junit4] 2> 867 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f0006 with negotiated timeout 20000 for client /127.0.0.1:40096
[junit4:junit4] 2> 867 T70 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f0006, negotiated timeout = 20000
[junit4:junit4] 2> 868 T71 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@188e830 name:ZooKeeperConnection Watcher:127.0.0.1:38828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 868 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 869 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0006 type:create cxid:0x1 zxid:0x30 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 871 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0006 type:create cxid:0x3 zxid:0x31 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 875 T31 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1879 T31 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43934_
[junit4:junit4] 2> 1881 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0006 type:delete cxid:0xd zxid:0x32 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:43934_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:43934_
[junit4:junit4] 2> 1883 T31 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43934_
[junit4:junit4] 2> 1894 T53 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1894 T58 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1894 T71 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1908 T31 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1909 T31 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1910 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1976 T31 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 1978 T31 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45516
[junit4:junit4] 2> 1979 T31 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1980 T31 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1980 T31 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1364129514377
[junit4:junit4] 2> 1981 T31 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1364129514377/solr.xml
[junit4:junit4] 2> 1981 T31 oasc.CoreContainer.<init> New CoreContainer 32428294
[junit4:junit4] 2> 1981 T31 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1364129514377/'
[junit4:junit4] 2> 1982 T31 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1364129514377/'
[junit4:junit4] 2> 2002 T31 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2002 T31 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2003 T31 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2003 T31 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2004 T31 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2004 T31 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2004 T31 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2005 T31 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2005 T31 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2006 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2012 T31 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 2027 T31 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:38828/solr
[junit4:junit4] 2> 2027 T31 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2028 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@91a0ba
[junit4:junit4] 2> 2029 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2029 T82 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2030 T82 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 2031 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40099
[junit4:junit4] 2> 2032 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40099
[junit4:junit4] 2> 2033 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f0007 with negotiated timeout 20000 for client /127.0.0.1:40099
[junit4:junit4] 2> 2033 T82 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f0007, negotiated timeout = 20000
[junit4:junit4] 2> 2034 T83 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@91a0ba name:ZooKeeperConnection Watcher:127.0.0.1:38828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2034 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2037 T36 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c747c6f0007
[junit4:junit4] 2> 2038 T83 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2039 T33 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40099 which had sessionid 0x13d9c747c6f0007
[junit4:junit4] 2> 2038 T31 oaz.ZooKeeper.close Session: 0x13d9c747c6f0007 closed
[junit4:junit4] 2> 2039 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2043 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f49823
[junit4:junit4] 2> 2044 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2044 T84 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2044 T84 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 2045 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40100
[junit4:junit4] 2> 2046 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40100
[junit4:junit4] 2> 2047 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f0008 with negotiated timeout 20000 for client /127.0.0.1:40100
[junit4:junit4] 2> 2047 T84 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f0008, negotiated timeout = 20000
[junit4:junit4] 2> 2048 T85 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f49823 name:ZooKeeperConnection Watcher:127.0.0.1:38828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2048 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2050 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0008 type:create cxid:0x1 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2053 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0008 type:create cxid:0x3 zxid:0x39 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2058 T31 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3066 T31 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45516_
[junit4:junit4] 2> 3068 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0008 type:delete cxid:0xd zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45516_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45516_
[junit4:junit4] 2> 3069 T31 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45516_
[junit4:junit4] 2> 3077 T71 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3077 T58 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3077 T53 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3078 T85 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3087 T31 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3088 T31 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3089 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3156 T31 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3159 T31 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44754
[junit4:junit4] 2> 3160 T31 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3160 T31 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3161 T31 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1364129515557
[junit4:junit4] 2> 3161 T31 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1364129515557/solr.xml
[junit4:junit4] 2> 3162 T31 oasc.CoreContainer.<init> New CoreContainer 10694544
[junit4:junit4] 2> 3162 T31 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1364129515557/'
[junit4:junit4] 2> 3163 T31 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1364129515557/'
[junit4:junit4] 2> 3183 T31 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3184 T31 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3184 T31 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3184 T31 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3185 T31 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3185 T31 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3185 T31 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3186 T31 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3186 T31 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3187 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3194 T31 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3208 T31 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:38828/solr
[junit4:junit4] 2> 3209 T31 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3209 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@25afb5
[junit4:junit4] 2> 3210 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3211 T96 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3212 T96 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 3212 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40101
[junit4:junit4] 2> 3213 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40101
[junit4:junit4] 2> 3215 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f0009 with negotiated timeout 20000 for client /127.0.0.1:40101
[junit4:junit4] 2> 3215 T96 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f0009, negotiated timeout = 20000
[junit4:junit4] 2> 3216 T97 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@25afb5 name:ZooKeeperConnection Watcher:127.0.0.1:38828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3216 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3219 T36 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c747c6f0009
[junit4:junit4] 2> 3220 T97 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3220 T31 oaz.ZooKeeper.close Session: 0x13d9c747c6f0009 closed
[junit4:junit4] 2> 3220 T33 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40101 which had sessionid 0x13d9c747c6f0009
[junit4:junit4] 2> 3221 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3224 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1019e13
[junit4:junit4] 2> 3225 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3225 T98 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3226 T98 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 3226 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40102
[junit4:junit4] 2> 3227 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40102
[junit4:junit4] 2> 3229 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f000a with negotiated timeout 20000 for client /127.0.0.1:40102
[junit4:junit4] 2> 3229 T98 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f000a, negotiated timeout = 20000
[junit4:junit4] 2> 3230 T99 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1019e13 name:ZooKeeperConnection Watcher:127.0.0.1:38828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3231 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3232 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f000a type:create cxid:0x1 zxid:0x40 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3236 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f000a type:create cxid:0x3 zxid:0x41 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3241 T31 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4247 T31 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44754_
[junit4:junit4] 2> 4248 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f000a type:delete cxid:0xd zxid:0x42 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:44754_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:44754_
[junit4:junit4] 2> 4250 T31 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44754_
[junit4:junit4] 2> 4254 T53 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4254 T85 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4255 T71 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4255 T58 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4255 T99 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 4261 T31 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 4262 T31 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4262 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4326 T31 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4328 T31 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35158
[junit4:junit4] 2> 4329 T31 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4329 T31 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4330 T31 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1364129516726
[junit4:junit4] 2> 4330 T31 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1364129516726/solr.xml
[junit4:junit4] 2> 4331 T31 oasc.CoreContainer.<init> New CoreContainer 23052275
[junit4:junit4] 2> 4331 T31 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1364129516726/'
[junit4:junit4] 2> 4332 T31 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1364129516726/'
[junit4:junit4] 2> 4350 T31 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4351 T31 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4351 T31 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4351 T31 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4352 T31 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4352 T31 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4353 T31 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4353 T31 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4353 T31 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4354 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4362 T31 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4377 T31 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:38828/solr
[junit4:junit4] 2> 4377 T31 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4378 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5b268
[junit4:junit4] 2> 4379 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4379 T110 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4380 T110 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 4380 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40105
[junit4:junit4] 2> 4381 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40105
[junit4:junit4] 2> 4382 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f000b with negotiated timeout 20000 for client /127.0.0.1:40105
[junit4:junit4] 2> 4382 T110 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f000b, negotiated timeout = 20000
[junit4:junit4] 2> 4383 T111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b268 name:ZooKeeperConnection Watcher:127.0.0.1:38828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4384 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4386 T36 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9c747c6f000b
[junit4:junit4] 2> 4387 T111 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4387 T33 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40105 which had sessionid 0x13d9c747c6f000b
[junit4:junit4] 2> 4387 T31 oaz.ZooKeeper.close Session: 0x13d9c747c6f000b closed
[junit4:junit4] 2> 4389 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4393 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@339c34
[junit4:junit4] 2> 4394 T112 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4394 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4395 T112 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 4395 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40106
[junit4:junit4] 2> 4395 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40106
[junit4:junit4] 2> 4396 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f000c with negotiated timeout 20000 for client /127.0.0.1:40106
[junit4:junit4] 2> 4396 T112 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f000c, negotiated timeout = 20000
[junit4:junit4] 2> 4397 T113 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@339c34 name:ZooKeeperConnection Watcher:127.0.0.1:38828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4397 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4398 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f000c type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4400 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f000c type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4403 T31 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5408 T31 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35158_
[junit4:junit4] 2> 5410 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f000c type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35158_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35158_
[junit4:junit4] 2> 5412 T31 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35158_
[junit4:junit4] 2> 5419 T53 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5419 T99 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5420 T71 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5420 T58 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5420 T113 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5420 T85 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 5433 T31 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 5434 T31 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 5435 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5442 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5642 T65 oasc.CoreContainer.create Creating SolrCore 'unloadcollection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1364129513183/unloadcollection1
[junit4:junit4] 2> 5644 T65 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 5646 T65 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:unloadcollection
[junit4:junit4] 2> 5648 T65 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 5650 T65 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 5652 T65 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection
[junit4:junit4] 2> 5656 T65 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 5659 T65 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1364129513183/unloadcollection1/'
[junit4:junit4] 2> 5719 T65 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 5765 T65 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5767 T65 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5808 T65 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6259 T65 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6270 T65 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6273 T65 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6305 T65 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6311 T65 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6316 T65 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6319 T65 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6319 T65 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6320 T65 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6322 T65 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6322 T65 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6323 T65 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6323 T65 oasc.SolrCore.<init> [unloadcollection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1364129513183/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129517911unloadcollection1_1n/
[junit4:junit4] 2> 6325 T65 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e2550a
[junit4:junit4] 2> 6328 T65 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6328 T65 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129517911unloadcollection1_1n
[junit4:junit4] 2> 6329 T65 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129517911unloadcollection1_1n/index/
[junit4:junit4] 2> 6329 T65 oasc.SolrCore.initIndex WARNING [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129517911unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6330 T65 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129517911unloadcollection1_1n/index
[junit4:junit4] 2> 6332 T65 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@27b834 lockFactory=org.apache.lucene.store.NativeFSLockFactory@55ef6f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6332 T65 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6345 T65 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6346 T65 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6347 T65 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6348 T65 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6349 T65 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6349 T65 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6349 T65 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6350 T65 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6351 T65 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6353 T65 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6356 T65 oass.SolrIndexSearcher.<init> Opening Searcher@244168 main
[junit4:junit4] 2> 6358 T65 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129517911unloadcollection1_1n/tlog
[junit4:junit4] 2> 6364 T65 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6364 T65 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6371 T115 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@244168 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6376 T65 oasc.ZkController.publish publishing core=unloadcollection1 state=down
[junit4:junit4] 2> 6703 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6705 T54 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "core":"unloadcollection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:43934_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43934",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "shard":null}
[junit4:junit4] 2> 6706 T54 oasc.Overseer$ClusterStateUpdater.createCollection Create collection unloadcollection with numShards 1
[junit4:junit4] 2> 6721 T54 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6739 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6739 T113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6739 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6739 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6739 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 6739 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 7379 T65 oasc.CoreContainer.registerCore registering core: unloadcollection1
[junit4:junit4] 2> 7380 T65 oasc.ZkController.register Register replica - core:unloadcollection1 address:http://127.0.0.1:43934 collection:unloadcollection shard:shard1
[junit4:junit4] 2> 7387 T65 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 7394 T65 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4:junit4] 2> 7413 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0006 type:delete cxid:0x51 zxid:0x57 txntype:-1 reqpath:n/a Error Path:/solr/collections/unloadcollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/unloadcollection/leaders
[junit4:junit4] 2> 7414 T65 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7416 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0006 type:create cxid:0x52 zxid:0x58 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7423 T65 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7423 T65 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7424 T65 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43934/unloadcollection1/
[junit4:junit4] 2> 7425 T65 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7426 T65 oasc.SyncStrategy.syncToMe http://127.0.0.1:43934/unloadcollection1/ has no replicas
[junit4:junit4] 2> 7427 T65 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43934/unloadcollection1/
[junit4:junit4] 2> 7427 T65 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leaders/shard1
[junit4:junit4] 2> 7439 T36 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9c747c6f0006 type:create cxid:0x5d zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8250 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8269 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8269 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8269 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8269 T113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8269 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8270 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 8298 T65 oasc.ZkController.register We are http://127.0.0.1:43934/unloadcollection1/ and leader is http://127.0.0.1:43934/unloadcollection1/
[junit4:junit4] 2> 8301 T65 oasc.ZkController.register No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:43934
[junit4:junit4] 2> 8301 T65 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8302 T65 oasc.ZkController.publish publishing core=unloadcollection1 state=active
[junit4:junit4] 2> 8306 T65 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8309 T65 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1364129513183/solr.xml
[junit4:junit4] 2> 8323 T65 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1364129513183/solr.xml
[junit4:junit4] 2> 8326 T65 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=1&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129517911unloadcollection1_1n&action=CREATE&name=unloadcollection1&version=2&wt=javabin&collection=unloadcollection} status=0 QTime=2687
[junit4:junit4] 2> 8357 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 8359 T31 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:38828/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@d3d1d5
[junit4:junit4] 2> 8360 T31 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8360 T116 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:38828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8361 T116 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:38828, initiating session
[junit4:junit4] 2> 8361 T33 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40111
[junit4:junit4] 2> 8362 T33 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40111
[junit4:junit4] 2> 8370 T35 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9c747c6f000d with negotiated timeout 10000 for client /127.0.0.1:40111
[junit4:junit4] 2> 8370 T116 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:38828, sessionid = 0x13d9c747c6f000d, negotiated timeout = 10000
[junit4:junit4] 2> 8371 T117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d3d1d5 name:ZooKeeperConnection Watcher:127.0.0.1:38828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8372 T31 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8375 T31 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 8379 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8381 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8392 T79 oasc.CoreContainer.create Creating SolrCore 'unloadcollection2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1364129514377/unloadcollection2
[junit4:junit4] 2> 8393 T79 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 8394 T79 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 8395 T79 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 8398 T79 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1364129514377/unloadcollection2/'
[junit4:junit4] 2> 8451 T79 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 8489 T79 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 8491 T79 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 8518 T79 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 8913 T79 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 8926 T79 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 8929 T79 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 8971 T79 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8980 T79 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8988 T79 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8991 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8993 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8993 T79 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8996 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8997 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8998 T79 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 8999 T79 oasc.SolrCore.<init> [unloadcollection2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1364129514377/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129520849unloadcollection1_2n/
[junit4:junit4] 2> 8999 T79 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e2550a
[junit4:junit4] 2> 9001 T79 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9003 T79 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129520849unloadcollection1_2n
[junit4:junit4] 2> 9003 T79 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129520849unloadcollection1_2n/index/
[junit4:junit4] 2> 9004 T79 oasc.SolrCore.initIndex WARNING [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129520849unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9005 T79 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129520849unloadcollection1_2n/index
[junit4:junit4] 2> 9009 T79 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c3d04 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1555268),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9009 T79 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9014 T79 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9015 T79 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9017 T79 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9018 T79 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9020 T79 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9020 T79 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9021 T79 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9023 T79 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9024 T79 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9027 T79 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9030 T79 oass.SolrIndexSearcher.<init> Opening Searcher@8d47a0 main
[junit4:junit4] 2> 9030 T79 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129520849unloadcollection1_2n/tlog
[junit4:junit4] 2> 9031 T79 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9031 T79 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9040 T118 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@8d47a0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9047 T79 oasc.ZkController.publish publishing core=unloadcollection2 state=down
[junit4:junit4] 2> 9048 T79 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9788 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9790 T54 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:43934__unloadcollection1",
[junit4:junit4] 2> "core":"unloadcollection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:43934_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43934",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "shard":"shard1"}
[junit4:junit4] 2> 9800 T54 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:45516_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45516",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "shard":null}
[junit4:junit4] 2> 9801 T54 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 9801 T54 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 9811 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9811 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9812 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9811 T113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9811 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9811 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 9813 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 10050 T79 oasc.CoreContainer.registerCore registering core: unloadcollection2
[junit4:junit4] 2> 10051 T79 oasc.ZkController.register Register replica - core:unloadcollection2 address:http://127.0.0.1:45516 collection:unloadcollection shard:shard1
[junit4:junit4] 2> 10061 T79 oasc.ZkController.register We are http://127.0.0.1:45516/unloadcollection2/ and leader is http://127.0.0.1:43934/unloadcollection1/
[junit4:junit4] 2> 10062 T79 oasc.ZkController.register No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:45516
[junit4:junit4] 2> 10062 T79 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection2
[junit4:junit4] 2> 10063 T79 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1 name=unloadcollection2 org.apache.solr.core.SolrCore@b0cace url=http://127.0.0.1:45516/unloadcollection2 node=127.0.0.1:45516_ C1_STATE=coll:unloadcollection core:unloadcollection2 props:{state=down, core=unloadcollection2, node_name=127.0.0.1:45516_, base_url=http://127.0.0.1:45516, collection=unloadcollection}
[junit4:junit4] 2> 10068 T119 C1 P45516 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection2 recoveringAfterStartup=true
[junit4:junit4] 2> 10069 T119 C1 P45516 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 10069 T79 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10070 T119 C1 P45516 oasc.ZkController.publish publishing core=unloadcollection2 state=recovering
[junit4:junit4] 2> 10071 T119 C1 P45516 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10072 T79 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1364129514377/solr.xml
[junit4:junit4] 2> 10073 T119 C1 P45516 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 10079 T79 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1364129514377/solr.xml
[junit4:junit4] 2> 10080 T79 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129520849unloadcollection1_2n&action=CREATE&name=unloadcollection2&version=2&wt=javabin&collection=unloadcollection} status=0 QTime=1688
[junit4:junit4] 2> 10082 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10084 T31 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 10085 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11089 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11330 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11332 T54 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:45516__unloadcollection2",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:45516_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45516",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "shard":"shard1"}
[junit4:junit4] 2> 11440 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11440 T113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11441 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11441 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11440 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11440 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 11440 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 12081 T65 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {state=recovering&core=unloadcollection1&onlyIfLeader=true&action=PREPRECOVERY&version=2&coreNodeName=127.0.0.1:45516__unloadcollection2&checkLive=true&wt=javabin&nodeName=127.0.0.1:45516_} status=0 QTime=2002
[junit4:junit4] 2> 12093 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13096 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C1_STATE=coll:unloadcollection core:unloadcollection2 props:{state=recovering, core=unloadcollection2, node_name=127.0.0.1:45516_, base_url=http://127.0.0.1:45516, collection=unloadcollection, shard=shard1}
[junit4:junit4] 2> 14083 T119 C1 P45516 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43934/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4:junit4] 2> 14088 T119 C1 P45516 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 14100 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14101 T119 C1 P45516 oasu.PeerSync.sync PeerSync: core=unloadcollection2 url=http://127.0.0.1:45516 START replicas=[http://127.0.0.1:43934/unloadcollection1/] nUpdates=100
[junit4:junit4] 2> 14106 T119 C1 P45516 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 14106 T119 C1 P45516 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4:junit4] 2> 14107 T119 C1 P45516 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection2
[junit4:junit4] 2> 14107 T119 C1 P45516 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection2
[junit4:junit4] 2> 14107 T119 C1 P45516 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 14107 T119 C1 P45516 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43934/unloadcollection1/. core=unloadcollection2
[junit4:junit4] 2> 14107 T119 C1 P45516 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2 name=unloadcollection1 org.apache.solr.core.SolrCore@946ce8 url=http://127.0.0.1:43934/unloadcollection1 node=127.0.0.1:43934_ C2_STATE=coll:unloadcollection core:unloadcollection1 props:{state=active, core=unloadcollection1, node_name=127.0.0.1:43934_, base_url=http://127.0.0.1:43934, collection=unloadcollection, shard=shard1, leader=true}
[junit4:junit4] 2> 14125 T66 C2 P43934 REQ /get {version=2&wt=javabin&getVersions=100&distrib=false&qt=/get} status=0 QTime=3
[junit4:junit4] 2> 14133 T67 C2 P43934 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14136 T67 C2 P43934 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@27b834 lockFactory=org.apache.lucene.store.NativeFSLockFactory@55ef6f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14137 T67 C2 P43934 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14138 T67 C2 P43934 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@27b834 lockFactory=org.apache.lucene.store.NativeFSLockFactory@55ef6f),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@27b834 lockFactory=org.apache.lucene.store.NativeFSLockFactory@55ef6f),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 14138 T67 C2 P43934 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 14139 T67 C2 P43934 oass.SolrIndexSearcher.<init> Opening Searcher@9877df realtime
[junit4:junit4] 2> 14139 T67 C2 P43934 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14139 T67 C2 P43934 /update {commit=true&softCommit=false&version=2&waitSearcher=true&commit_end_point=true&wt=javabin&openSearcher=false} {commit=} 0 18
[junit4:junit4] 2> 14170 T119 C1 P45516 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 14170 T119 C1 P45516 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 14175 T119 C1 P45516 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 14210 T65 C2 P43934 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 14211 T65 C2 P43934 REQ /replication {version=2&command=indexversion&wt=javabin&qt=/replication} status=0 QTime=33
[junit4:junit4] 2> 14212 T119 C1 P45516 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 14212 T119 C1 P45516 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 14213 T119 C1 P45516 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 14216 T66 C2 P43934 REQ /replication {generation=2&version=2&command=filelist&wt=javabin&qt=/replication} status=0 QTime=1
[junit4:junit4] 2> 14217 T119 C1 P45516 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 14218 T119 C1 P45516 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129520849unloadcollection1_2n/index.20130324085206678
[junit4:junit4] 2> 14218 T119 C1 P45516 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@da78d5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f65578) fullCopy=false
[junit4:junit4] 2> 14224 T67 C2 P43934 REQ /replication {generation=2&checksum=true&file=segments_2&command=filecontent&wt=filestream&qt=/replication} status=0 QTime=1
[junit4:junit4] 2> 14228 T119 C1 P45516 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 14230 T119 C1 P45516 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 14231 T119 C1 P45516 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection2
[junit4:junit4] 2> 14233 T119 C1 P45516 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c3d04 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1555268),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c3d04 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1555268),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 14234 T119 C1 P45516 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 14234 T119 C1 P45516 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 14235 T119 C1 P45516 oass.SolrIndexSearcher.<init> Opening Searcher@1c79e main
[junit4:junit4] 2> 14239 T118 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@1c79e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 14240 T119 C1 P45516 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection2
[junit4:junit4] 2> 14240 T119 C1 P45516 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4:junit4] 2> 14240 T119 C1 P45516 oasc.ZkController.publish publishing core=unloadcollection2 state=active
[junit4:junit4] 2> 14241 T119 C1 P45516 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14243 T119 C1 P45516 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection2
[junit4:junit4] 2> 14456 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14459 T54 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:45516__unloadcollection2",
[junit4:junit4] 2> "core":"unloadcollection2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:45516_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45516",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "shard":"shard1"}
[junit4:junit4] 2> 14470 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14471 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14471 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14470 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14471 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14471 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 14470 T113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15103 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15105 T31 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4] 2> 15105 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15122 T94 oasc.CoreContainer.create Creating SolrCore 'unloadcollection3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1364129515557/unloadcollection3
[junit4:junit4] 2> 15122 T94 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4:junit4] 2> 15124 T94 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15125 T94 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4:junit4] 2> 15128 T94 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1364129515557/unloadcollection3/'
[junit4:junit4] 2> 15170 T94 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 15208 T94 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15209 T94 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15231 T94 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15665 T94 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15675 T94 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15678 T94 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15708 T94 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15713 T94 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15717 T94 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15719 T94 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15719 T94 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15720 T94 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15722 T94 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15722 T94 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15722 T94 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15723 T94 oasc.SolrCore.<init> [unloadcollection3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1364129515557/unloadcollection3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129527575unloadcollection_3n/
[junit4:junit4] 2> 15723 T94 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e2550a
[junit4:junit4] 2> 15724 T94 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15725 T94 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129527575unloadcollection_3n
[junit4:junit4] 2> 15725 T94 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129527575unloadcollection_3n/index/
[junit4:junit4] 2> 15725 T94 oasc.SolrCore.initIndex WARNING [unloadcollection3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129527575unloadcollection_3n/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15726 T94 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129527575unloadcollection_3n/index
[junit4:junit4] 2> 15727 T94 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@fefd95 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54575e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15728 T94 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15730 T94 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15731 T94 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15731 T94 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15732 T94 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15733 T94 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15733 T94 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15733 T94 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15734 T94 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15735 T94 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15740 T94 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15746 T94 oass.SolrIndexSearcher.<init> Opening Searcher@1680587 main
[junit4:junit4] 2> 15746 T94 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129527575unloadcollection_3n/tlog
[junit4:junit4] 2> 15747 T94 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15747 T94 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15752 T122 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@1680587 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15755 T94 oasc.ZkController.publish publishing core=unloadcollection3 state=down
[junit4:junit4] 2> 15755 T94 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15980 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15981 T54 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:44754_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44754",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "shard":null}
[junit4:junit4] 2> 15981 T54 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 15982 T54 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16081 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16082 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16082 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16082 T113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16082 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16082 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16082 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16758 T94 oasc.CoreContainer.registerCore registering core: unloadcollection3
[junit4:junit4] 2> 16759 T94 oasc.ZkController.register Register replica - core:unloadcollection3 address:http://127.0.0.1:44754 collection:unloadcollection shard:shard1
[junit4:junit4] 2> 16765 T94 oasc.ZkController.register We are http://127.0.0.1:44754/unloadcollection3/ and leader is http://127.0.0.1:43934/unloadcollection1/
[junit4:junit4] 2> 16766 T94 oasc.ZkController.register No LogReplay needed for core=unloadcollection3 baseURL=http://127.0.0.1:44754
[junit4:junit4] 2> 16766 T94 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection3
[junit4:junit4] 2> 16766 T94 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C3 name=unloadcollection3 org.apache.solr.core.SolrCore@88dbd9 url=http://127.0.0.1:44754/unloadcollection3 node=127.0.0.1:44754_ C3_STATE=coll:unloadcollection core:unloadcollection3 props:{state=down, core=unloadcollection3, node_name=127.0.0.1:44754_, base_url=http://127.0.0.1:44754, collection=unloadcollection}
[junit4:junit4] 2> 16767 T123 C3 P44754 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection3 recoveringAfterStartup=true
[junit4:junit4] 2> 16768 T123 C3 P44754 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16769 T94 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16769 T123 C3 P44754 oasc.ZkController.publish publishing core=unloadcollection3 state=recovering
[junit4:junit4] 2> 16770 T123 C3 P44754 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16771 T94 oasc.CoreContainer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1364129515557/solr.xml
[junit4:junit4] 2> 16785 T94 oasc.SolrXMLSerializer.persistFile Persisting cores config to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1364129515557/solr.xml
[junit4:junit4] 2> 16786 T94 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129527575unloadcollection_3n&action=CREATE&name=unloadcollection3&version=2&wt=javabin&collection=unloadcollection} status=0 QTime=1665
[junit4:junit4] 2> 16787 T31 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 16791 T123 C3 P44754 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16791 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17594 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17595 T54 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:44754__unloadcollection3",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:44754_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44754",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "shard":"shard1"}
[junit4:junit4] 2> 17602 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17602 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17603 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17603 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17603 T113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17603 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17603 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17798 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17803 T64 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {state=recovering&core=unloadcollection1&onlyIfLeader=true&action=PREPRECOVERY&version=2&coreNodeName=127.0.0.1:44754__unloadcollection3&checkLive=true&wt=javabin&nodeName=127.0.0.1:44754_} status=0 QTime=1000
[junit4:junit4] 2> 18804 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C3_STATE=coll:unloadcollection core:unloadcollection3 props:{state=recovering, core=unloadcollection3, node_name=127.0.0.1:44754_, base_url=http://127.0.0.1:44754, collection=unloadcollection, shard=shard1}
[junit4:junit4] 2> 19804 T123 C3 P44754 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43934/unloadcollection1/ core=unloadcollection3 - recoveringAfterStartup=true
[junit4:junit4] 2> 19805 T123 C3 P44754 oasu.PeerSync.sync PeerSync: core=unloadcollection3 url=http://127.0.0.1:44754 START replicas=[http://127.0.0.1:43934/unloadcollection1/] nUpdates=100
[junit4:junit4] 2> 19805 T123 C3 P44754 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19806 T123 C3 P44754 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection3
[junit4:junit4] 2> 19807 T123 C3 P44754 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection3
[junit4:junit4] 2> 19807 T123 C3 P44754 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection3
[junit4:junit4] 2> 19807 T123 C3 P44754 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19807 T123 C3 P44754 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43934/unloadcollection1/. core=unloadcollection3
[junit4:junit4] 2> 19807 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19807 T123 C3 P44754 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19809 T64 C2 P43934 REQ /get {version=2&wt=javabin&getVersions=100&distrib=false&qt=/get} status=0 QTime=0
[junit4:junit4] 2> 19815 T65 C2 P43934 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19817 T65 C2 P43934 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@27b834 lockFactory=org.apache.lucene.store.NativeFSLockFactory@55ef6f),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@27b834 lockFactory=org.apache.lucene.store.NativeFSLockFactory@55ef6f),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 19817 T65 C2 P43934 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 19818 T65 C2 P43934 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19819 T65 C2 P43934 /update {commit=true&softCommit=false&version=2&waitSearcher=true&commit_end_point=true&wt=javabin&openSearcher=false} {commit=} 0 5
[junit4:junit4] 2> 19820 T123 C3 P44754 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19821 T123 C3 P44754 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19826 T67 C2 P43934 REQ /replication {version=2&command=indexversion&wt=javabin&qt=/replication} status=0 QTime=1
[junit4:junit4] 2> 19827 T123 C3 P44754 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 19827 T123 C3 P44754 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19827 T123 C3 P44754 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19830 T64 C2 P43934 REQ /replication {generation=3&version=2&command=filelist&wt=javabin&qt=/replication} status=0 QTime=0
[junit4:junit4] 2> 19831 T123 C3 P44754 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19832 T123 C3 P44754 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1364129512471/1364129527575unloadcollection_3n/index.20130324085212292
[junit4:junit4] 2> 19832 T123 C3 P44754 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1801ff4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@12da36a) fullCopy=false
[junit4:junit4] 2> 19836 T65 C2 P43934 REQ /replication {generation=3&checksum=true&file=segments_3&command=filecontent&wt=filestream&qt=/replication} status=0 QTime=0
[junit4:junit4] 2> 19838 T123 C3 P44754 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19840 T123 C3 P44754 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19841 T123 C3 P44754 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=unloadcollection3
[junit4:junit4] 2> 19844 T123 C3 P44754 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@fefd95 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54575e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@fefd95 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54575e),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 19845 T123 C3 P44754 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 19846 T123 C3 P44754 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19847 T123 C3 P44754 oass.SolrIndexSearcher.<init> Opening Searcher@18eb64d main
[junit4:junit4] 2> 19849 T122 oasc.SolrCore.registerSearcher [unloadcollection3] Registered new searcher Searcher@18eb64d main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 19851 T123 C3 P44754 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection3
[junit4:junit4] 2> 19852 T123 C3 P44754 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection3
[junit4:junit4] 2> 19852 T123 C3 P44754 oasc.ZkController.publish publishing core=unloadcollection3 state=active
[junit4:junit4] 2> 19853 T123 C3 P44754 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19856 T123 C3 P44754 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection3
[junit4:junit4] 2> 20615 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20616 T54 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:44754__unloadcollection3",
[junit4:junit4] 2> "core":"unloadcollection3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:44754_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44754",
[junit4:junit4] 2> "collection":"unloadcollection",
[junit4:junit4] 2> "shard":"shard1"}
[junit4:junit4] 2> 20740 T113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20740 T53 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20740 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20740 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20740 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20740 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20740 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20810 T31 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20811 T31 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4:junit4] 2> 20812 T31 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> C3_STATE=coll:unloadcollection core:unloadcollection3 props:{state=active, core=unloadcollection3, node_name=127.0.0.1:44754_, base_url=http://127.0.0.1:44754, collection=unloadcollection, shard=shard1}
[junit4:junit4] 2> 20998 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[20 (1430393489600806912)]} 0 5
[junit4:junit4] 2> C1_STATE=coll:unloadcollection core:unloadcollection2 props:{state=active, core=unloadcollection2, node_name=127.0.0.1:45516_, base_url=http://127.0.0.1:45516, collection=unloadcollection, shard=shard1}
[junit4:junit4] 2> 21002 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[20 (1430393489600806912)]} 0 4
[junit4:junit4] 2> 21003 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[20 (1430393489600806912)]} 0 78
[junit4:junit4] 2> 21004 T92 C3 P44754 /update {version=2&wt=javabin} {add=[20]} 0 170
[junit4:junit4] 2> 21020 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[21 (1430393489688887296)]} 0 4
[junit4:junit4] 2> 21020 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[21 (1430393489688887296)]} 0 4
[junit4:junit4] 2> 21021 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[21 (1430393489688887296)]} 0 11
[junit4:junit4] 2> 21022 T93 C3 P44754 /update {version=2&wt=javabin} {add=[21]} 0 15
[junit4:junit4] 2> 21035 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[22 (1430393489706713088)]} 0 3
[junit4:junit4] 2> 21035 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[22 (1430393489706713088)]} 0 3
[junit4:junit4] 2> 21036 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[22 (1430393489706713088)]} 0 9
[junit4:junit4] 2> 21037 T94 C3 P44754 /update {version=2&wt=javabin} {add=[22]} 0 11
[junit4:junit4] 2> 21049 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[23 (1430393489722441728)]} 0 3
[junit4:junit4] 2> 21049 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[23 (1430393489722441728)]} 0 3
[junit4:junit4] 2> 21050 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[23 (1430393489722441728)]} 0 8
[junit4:junit4] 2> 21051 T95 C3 P44754 /update {version=2&wt=javabin} {add=[23]} 0 12
[junit4:junit4] 2> 21062 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[24 (1430393489737121792)]} 0 2
[junit4:junit4] 2> 21062 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[24 (1430393489737121792)]} 0 2
[junit4:junit4] 2> 21063 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[24 (1430393489737121792)]} 0 7
[junit4:junit4] 2> 21064 T92 C3 P44754 /update {version=2&wt=javabin} {add=[24]} 0 11
[junit4:junit4] 2> 21077 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[25 (1430393489750753280)]} 0 3
[junit4:junit4] 2> 21077 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[25 (1430393489750753280)]} 0 3
[junit4:junit4] 2> 21078 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[25 (1430393489750753280)]} 0 9
[junit4:junit4] 2> 21079 T93 C3 P44754 /update {version=2&wt=javabin} {add=[25]} 0 13
[junit4:junit4] 2> 21090 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[26 (1430393489766481920)]} 0 2
[junit4:junit4] 2> 21090 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[26 (1430393489766481920)]} 0 2
[junit4:junit4] 2> 21091 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[26 (1430393489766481920)]} 0 7
[junit4:junit4] 2> 21092 T94 C3 P44754 /update {version=2&wt=javabin} {add=[26]} 0 11
[junit4:junit4] 2> 21103 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[27 (1430393489780113408)]} 0 2
[junit4:junit4] 2> 21103 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[27 (1430393489780113408)]} 0 2
[junit4:junit4] 2> 21104 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[27 (1430393489780113408)]} 0 7
[junit4:junit4] 2> 21105 T95 C3 P44754 /update {version=2&wt=javabin} {add=[27]} 0 11
[junit4:junit4] 2> 21118 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[28 (1430393489794793472)]} 0 2
[junit4:junit4] 2> 21119 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[28 (1430393489794793472)]} 0 3
[junit4:junit4] 2> 21120 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[28 (1430393489794793472)]} 0 9
[junit4:junit4] 2> 21121 T92 C3 P44754 /update {version=2&wt=javabin} {add=[28]} 0 13
[junit4:junit4] 2> 21134 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[29 (1430393489811570688)]} 0 3
[junit4:junit4] 2> 21134 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[29 (1430393489811570688)]} 0 3
[junit4:junit4] 2> 21135 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[29 (1430393489811570688)]} 0 8
[junit4:junit4] 2> 21136 T93 C3 P44754 /update {version=2&wt=javabin} {add=[29]} 0 12
[junit4:junit4] 2> 21150 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[30 (1430393489827299328)]} 0 3
[junit4:junit4] 2> 21150 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[30 (1430393489827299328)]} 0 3
[junit4:junit4] 2> 21151 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[30 (1430393489827299328)]} 0 10
[junit4:junit4] 2> 21152 T94 C3 P44754 /update {version=2&wt=javabin} {add=[30]} 0 14
[junit4:junit4] 2> 21164 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[31 (1430393489844076544)]} 0 2
[junit4:junit4] 2> 21165 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[31 (1430393489844076544)]} 0 2
[junit4:junit4] 2> 21166 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[31 (1430393489844076544)]} 0 9
[junit4:junit4] 2> 21167 T95 C3 P44754 /update {version=2&wt=javabin} {add=[31]} 0 13
[junit4:junit4] 2> 21179 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[32 (1430393489859805184)]} 0 2
[junit4:junit4] 2> 21179 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[32 (1430393489859805184)]} 0 2
[junit4:junit4] 2> 21180 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[32 (1430393489859805184)]} 0 7
[junit4:junit4] 2> 21181 T92 C3 P44754 /update {version=2&wt=javabin} {add=[32]} 0 11
[junit4:junit4] 2> 21195 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[33 (1430393489874485248)]} 0 3
[junit4:junit4] 2> 21195 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[33 (1430393489874485248)]} 0 2
[junit4:junit4] 2> 21196 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[33 (1430393489874485248)]} 0 9
[junit4:junit4] 2> 21197 T93 C3 P44754 /update {version=2&wt=javabin} {add=[33]} 0 13
[junit4:junit4] 2> 21211 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[34 (1430393489891262464)]} 0 2
[junit4:junit4] 2> 21213 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[34 (1430393489891262464)]} 0 2
[junit4:junit4] 2> 21214 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[34 (1430393489891262464)]} 0 11
[junit4:junit4] 2> 21215 T92 C3 P44754 /update {version=2&wt=javabin} {add=[34]} 0 15
[junit4:junit4] 2> 21229 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[35 (1430393489911185408)]} 0 3
[junit4:junit4] 2> 21229 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[35 (1430393489911185408)]} 0 3
[junit4:junit4] 2> 21231 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[35 (1430393489911185408)]} 0 10
[junit4:junit4] 2> 21232 T93 C3 P44754 /update {version=2&wt=javabin} {add=[35]} 0 14
[junit4:junit4] 2> 21246 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[36 (1430393489929011200)]} 0 3
[junit4:junit4] 2> 21246 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[36 (1430393489929011200)]} 0 3
[junit4:junit4] 2> 21247 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[36 (1430393489929011200)]} 0 8
[junit4:junit4] 2> 21248 T95 C3 P44754 /update {version=2&wt=javabin} {add=[36]} 0 12
[junit4:junit4] 2> 21260 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[37 (1430393489945788416)]} 0 2
[junit4:junit4] 2> 21261 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[37 (1430393489945788416)]} 0 2
[junit4:junit4] 2> 21262 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[37 (1430393489945788416)]} 0 8
[junit4:junit4] 2> 21263 T94 C3 P44754 /update {version=2&wt=javabin} {add=[37]} 0 12
[junit4:junit4] 2> 21275 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[38 (1430393489960468480)]} 0 3
[junit4:junit4] 2> 21275 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[38 (1430393489960468480)]} 0 3
[junit4:junit4] 2> 21276 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[38 (1430393489960468480)]} 0 8
[junit4:junit4] 2> 21277 T92 C3 P44754 /update {version=2&wt=javabin} {add=[38]} 0 11
[junit4:junit4] 2> 21292 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[39 (1430393489975148544)]} 0 2
[junit4:junit4] 2> 21294 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[39 (1430393489975148544)]} 0 3
[junit4:junit4] 2> 21295 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[39 (1430393489975148544)]} 0 12
[junit4:junit4] 2> 21296 T93 C3 P44754 /update {version=2&wt=javabin} {add=[39]} 0 16
[junit4:junit4] 2> 21308 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[40 (1430393489994022912)]} 0 3
[junit4:junit4] 2> 21308 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[40 (1430393489994022912)]} 0 1
[junit4:junit4] 2> 21309 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[40 (1430393489994022912)]} 0 8
[junit4:junit4] 2> 21310 T95 C3 P44754 /update {version=2&wt=javabin} {add=[40]} 0 12
[junit4:junit4] 2> 21321 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[41 (1430393490008702976)]} 0 2
[junit4:junit4] 2> 21322 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[41 (1430393490008702976)]} 0 3
[junit4:junit4] 2> 21323 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[41 (1430393490008702976)]} 0 8
[junit4:junit4] 2> 21323 T94 C3 P44754 /update {version=2&wt=javabin} {add=[41]} 0 11
[junit4:junit4] 2> 21334 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[42 (1430393490023383040)]} 0 1
[junit4:junit4] 2> 21335 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[42 (1430393490023383040)]} 0 2
[junit4:junit4] 2> 21336 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[42 (1430393490023383040)]} 0 7
[junit4:junit4] 2> 21337 T92 C3 P44754 /update {version=2&wt=javabin} {add=[42]} 0 11
[junit4:junit4] 2> 21348 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[43 (1430393490037014528)]} 0 2
[junit4:junit4] 2> 21349 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[43 (1430393490037014528)]} 0 2
[junit4:junit4] 2> 21349 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[43 (1430393490037014528)]} 0 7
[junit4:junit4] 2> 21350 T93 C3 P44754 /update {version=2&wt=javabin} {add=[43]} 0 11
[junit4:junit4] 2> 21361 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[44 (1430393490051694592)]} 0 2
[junit4:junit4] 2> 21362 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[44 (1430393490051694592)]} 0 3
[junit4:junit4] 2> 21363 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[44 (1430393490051694592)]} 0 8
[junit4:junit4] 2> 21364 T95 C3 P44754 /update {version=2&wt=javabin} {add=[44]} 0 11
[junit4:junit4] 2> 21375 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[45 (1430393490065326080)]} 0 1
[junit4:junit4] 2> 21375 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[45 (1430393490065326080)]} 0 1
[junit4:junit4] 2> 21377 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[45 (1430393490065326080)]} 0 8
[junit4:junit4] 2> 21377 T94 C3 P44754 /update {version=2&wt=javabin} {add=[45]} 0 11
[junit4:junit4] 2> 21389 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[46 (1430393490080006144)]} 0 2
[junit4:junit4] 2> 21389 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[46 (1430393490080006144)]} 0 2
[junit4:junit4] 2> 21391 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[46 (1430393490080006144)]} 0 8
[junit4:junit4] 2> 21392 T92 C3 P44754 /update {version=2&wt=javabin} {add=[46]} 0 12
[junit4:junit4] 2> 21403 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[47 (1430393490094686208)]} 0 2
[junit4:junit4] 2> 21403 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[47 (1430393490094686208)]} 0 1
[junit4:junit4] 2> 21404 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[47 (1430393490094686208)]} 0 7
[junit4:junit4] 2> 21405 T93 C3 P44754 /update {version=2&wt=javabin} {add=[47]} 0 11
[junit4:junit4] 2> 21418 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[48 (1430393490110414848)]} 0 2
[junit4:junit4] 2> 21418 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[48 (1430393490110414848)]} 0 2
[junit4:junit4] 2> 21419 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[48 (1430393490110414848)]} 0 7
[junit4:junit4] 2> 21420 T92 C3 P44754 /update {version=2&wt=javabin} {add=[48]} 0 11
[junit4:junit4] 2> 21431 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[49 (1430393490124046336)]} 0 1
[junit4:junit4] 2> 21432 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[49 (1430393490124046336)]} 0 2
[junit4:junit4] 2> 21433 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[49 (1430393490124046336)]} 0 8
[junit4:junit4] 2> 21434 T94 C3 P44754 /update {version=2&wt=javabin} {add=[49]} 0 11
[junit4:junit4] 2> 21447 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[50 (1430393490139774976)]} 0 2
[junit4:junit4] 2> 21447 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[50 (1430393490139774976)]} 0 2
[junit4:junit4] 2> 21448 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[50 (1430393490139774976)]} 0 8
[junit4:junit4] 2> 21449 T95 C3 P44754 /update {version=2&wt=javabin} {add=[50]} 0 12
[junit4:junit4] 2> 21461 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[51 (1430393490154455040)]} 0 2
[junit4:junit4] 2> 21461 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[51 (1430393490154455040)]} 0 2
[junit4:junit4] 2> 21462 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[51 (1430393490154455040)]} 0 8
[junit4:junit4] 2> 21462 T93 C3 P44754 /update {version=2&wt=javabin} {add=[51]} 0 11
[junit4:junit4] 2> 21473 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[52 (1430393490169135104)]} 0 2
[junit4:junit4] 2> 21473 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[52 (1430393490169135104)]} 0 2
[junit4:junit4] 2> 21475 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[52 (1430393490169135104)]} 0 7
[junit4:junit4] 2> 21476 T92 C3 P44754 /update {version=2&wt=javabin} {add=[52]} 0 11
[junit4:junit4] 2> 21488 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[53 (1430393490183815168)]} 0 3
[junit4:junit4] 2> 21488 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[53 (1430393490183815168)]} 0 2
[junit4:junit4] 2> 21489 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[53 (1430393490183815168)]} 0 7
[junit4:junit4] 2> 21490 T94 C3 P44754 /update {version=2&wt=javabin} {add=[53]} 0 11
[junit4:junit4] 2> 21501 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[54 (1430393490197446656)]} 0 2
[junit4:junit4] 2> 21501 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[54 (1430393490197446656)]} 0 2
[junit4:junit4] 2> 21502 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[54 (1430393490197446656)]} 0 7
[junit4:junit4] 2> 21503 T95 C3 P44754 /update {version=2&wt=javabin} {add=[54]} 0 11
[junit4:junit4] 2> 21522 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[55 (1430393490219466752)]} 0 2
[junit4:junit4] 2> 21522 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[55 (1430393490219466752)]} 0 2
[junit4:junit4] 2> 21523 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[55 (1430393490219466752)]} 0 15
[junit4:junit4] 2> 21524 T93 C3 P44754 /update {version=2&wt=javabin} {add=[55]} 0 18
[junit4:junit4] 2> 21535 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[56 (1430393490233098240)]} 0 2
[junit4:junit4] 2> 21536 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[56 (1430393490233098240)]} 0 3
[junit4:junit4] 2> 21537 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[56 (1430393490233098240)]} 0 8
[junit4:junit4] 2> 21538 T92 C3 P44754 /update {version=2&wt=javabin} {add=[56]} 0 11
[junit4:junit4] 2> 21553 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[57 (1430393490251972608)]} 0 2
[junit4:junit4] 2> 21553 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[57 (1430393490251972608)]} 0 2
[junit4:junit4] 2> 21554 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[57 (1430393490251972608)]} 0 8
[junit4:junit4] 2> 21555 T94 C3 P44754 /update {version=2&wt=javabin} {add=[57]} 0 13
[junit4:junit4] 2> 21568 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[58 (1430393490267701248)]} 0 2
[junit4:junit4] 2> 21568 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[58 (1430393490267701248)]} 0 2
[junit4:junit4] 2> 21569 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[58 (1430393490267701248)]} 0 8
[junit4:junit4] 2> 21570 T95 C3 P44754 /update {version=2&wt=javabin} {add=[58]} 0 12
[junit4:junit4] 2> 21581 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[59 (1430393490281332736)]} 0 2
[junit4:junit4] 2> 21582 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[59 (1430393490281332736)]} 0 3
[junit4:junit4] 2> 21583 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[59 (1430393490281332736)]} 0 8
[junit4:junit4] 2> 21583 T93 C3 P44754 /update {version=2&wt=javabin} {add=[59]} 0 10
[junit4:junit4] 2> 21594 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[60 (1430393490296012800)]} 0 2
[junit4:junit4] 2> 21595 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[60 (1430393490296012800)]} 0 2
[junit4:junit4] 2> 21596 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[60 (1430393490296012800)]} 0 8
[junit4:junit4] 2> 21597 T92 C3 P44754 /update {version=2&wt=javabin} {add=[60]} 0 11
[junit4:junit4] 2> 21607 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[61 (1430393490309644288)]} 0 1
[junit4:junit4] 2> 21607 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[61 (1430393490309644288)]} 0 1
[junit4:junit4] 2> 21608 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[61 (1430393490309644288)]} 0 6
[junit4:junit4] 2> 21609 T94 C3 P44754 /update {version=2&wt=javabin} {add=[61]} 0 10
[junit4:junit4] 2> 21620 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[62 (1430393490323275776)]} 0 2
[junit4:junit4] 2> 21620 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[62 (1430393490323275776)]} 0 2
[junit4:junit4] 2> 21621 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[62 (1430393490323275776)]} 0 7
[junit4:junit4] 2> 21622 T92 C3 P44754 /update {version=2&wt=javabin} {add=[62]} 0 10
[junit4:junit4] 2> 21632 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[63 (1430393490335858688)]} 0 1
[junit4:junit4] 2> 21632 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[63 (1430393490335858688)]} 0 1
[junit4:junit4] 2> 21634 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[63 (1430393490335858688)]} 0 7
[junit4:junit4] 2> 21634 T95 C3 P44754 /update {version=2&wt=javabin} {add=[63]} 0 9
[junit4:junit4] 2> 21645 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[64 (1430393490349490176)]} 0 2
[junit4:junit4] 2> 21645 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[64 (1430393490349490176)]} 0 2
[junit4:junit4] 2> 21646 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[64 (1430393490349490176)]} 0 7
[junit4:junit4] 2> 21647 T93 C3 P44754 /update {version=2&wt=javabin} {add=[64]} 0 10
[junit4:junit4] 2> 21657 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[65 (1430393490362073088)]} 0 2
[junit4:junit4] 2> 21657 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[65 (1430393490362073088)]} 0 2
[junit4:junit4] 2> 21659 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[65 (1430393490362073088)]} 0 7
[junit4:junit4] 2> 21660 T94 C3 P44754 /update {version=2&wt=javabin} {add=[65]} 0 11
[junit4:junit4] 2> 21671 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[66 (1430393490376753152)]} 0 1
[junit4:junit4] 2> 21671 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[66 (1430393490376753152)]} 0 1
[junit4:junit4] 2> 21672 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[66 (1430393490376753152)]} 0 7
[junit4:junit4] 2> 21673 T92 C3 P44754 /update {version=2&wt=javabin} {add=[66]} 0 10
[junit4:junit4] 2> 21684 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[67 (1430393490390384640)]} 0 1
[junit4:junit4] 2> 21684 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[67 (1430393490390384640)]} 0 1
[junit4:junit4] 2> 21685 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[67 (1430393490390384640)]} 0 6
[junit4:junit4] 2> 21686 T95 C3 P44754 /update {version=2&wt=javabin} {add=[67]} 0 10
[junit4:junit4] 2> 21697 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[68 (1430393490404016128)]} 0 2
[junit4:junit4] 2> 21697 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[68 (1430393490404016128)]} 0 2
[junit4:junit4] 2> 21698 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[68 (1430393490404016128)]} 0 7
[junit4:junit4] 2> 21699 T93 C3 P44754 /update {version=2&wt=javabin} {add=[68]} 0 10
[junit4:junit4] 2> 21711 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[69 (1430393490417647616)]} 0 2
[junit4:junit4] 2> 21711 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[69 (1430393490417647616)]} 0 2
[junit4:junit4] 2> 21712 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[69 (1430393490417647616)]} 0 8
[junit4:junit4] 2> 21713 T94 C3 P44754 /update {version=2&wt=javabin} {add=[69]} 0 11
[junit4:junit4] 2> 21723 T93 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[70 (1430393490431279104)]} 0 1
[junit4:junit4] 2> 21724 T80 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[70 (1430393490431279104)]} 0 2
[junit4:junit4] 2> 21725 T67 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[70 (1430393490431279104)]} 0 7
[junit4:junit4] 2> 21725 T92 C3 P44754 /update {version=2&wt=javabin} {add=[70]} 0 10
[junit4:junit4] 2> 21736 T94 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[71 (1430393490444910592)]} 0 2
[junit4:junit4] 2> 21736 T78 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[71 (1430393490444910592)]} 0 2
[junit4:junit4] 2> 21737 T66 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[71 (1430393490444910592)]} 0 7
[junit4:junit4] 2> 21738 T95 C3 P44754 /update {version=2&wt=javabin} {add=[71]} 0 10
[junit4:junit4] 2> 21748 T92 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[72 (1430393490457493504)]} 0 2
[junit4:junit4] 2> 21748 T81 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[72 (1430393490457493504)]} 0 1
[junit4:junit4] 2> 21749 T65 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[72 (1430393490457493504)]} 0 6
[junit4:junit4] 2> 21750 T93 C3 P44754 /update {version=2&wt=javabin} {add=[72]} 0 9
[junit4:junit4] 2> 21761 T95 C3 P44754 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[73 (1430393490470076416)]} 0 2
[junit4:junit4] 2> 21761 T79 C1 P45516 /update {update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:43934/unloadcollection1/&wt=javabin} {add=[73 (1430393490470076416)]} 0 2
[junit4:junit4] 2> 21762 T64 C2 P43934 /update {update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:44754/unloadcollection3/&wt=javabin} {add=[73
[...truncated too long message...]
junit4] 1> "core":"collection1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:42989"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=12AF573644669E6B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_SG -Dtests.timezone=Asia/Istanbul -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 32.7s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:34480/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([12AF573644669E6B:9349D92E3339FE57]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 32737 T234 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 32740 T233 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 33461 T237 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 33896 T325 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 33897 T325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 33897 T325 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 33897 T325 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=en_SG, timezone=Asia/Istanbul
[junit4:junit4] 2> NOTE: Linux 3.2.0-39-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=2,free=24255272,total=94502912
[junit4:junit4] 2> NOTE: All tests run in this JVM: [HighlighterTest, OpenExchangeRatesOrgProviderTest, EchoParamsTest, ShardRoutingCustomTest, TestCollationField, DirectUpdateHandlerTest, FileUtilsTest, TestStressLucene, TimeZoneUtilsTest, DisMaxRequestHandlerTest, TestHashPartitioner, XmlUpdateRequestHandlerTest, SpellCheckComponentTest, TestSuggestSpellingConverter, DefaultValueUpdateProcessorTest, TestWordDelimiterFilterFactory, ZkNodePropsTest, HardAutoCommitTest, TestFiltering, NumericFieldsTest, RequestHandlersTest, NoCacheHeaderTest, TestStressReorder, DOMUtilTest, TestElisionMultitermQuery, SpellPossibilityIteratorTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 34.03s, 1 test, 1 error <<< FAILURES!
[...truncated 758 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1212: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:876: There were test failures: 273 suites, 1149 tests, 1 error, 1 failure, 13 ignored (7 assumptions)
Total time: 39 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b82 -server -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure