You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/13 16:13:50 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b79) - Build #
4694 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/4694/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:34611/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:34611/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([40FDC9BBF29DF852:C11B47A385C2986E]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 8998 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T258 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 5 T258 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378
[junit4:junit4] 2> 6 T258 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 6 T259 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 7 T259 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 7 T259 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 7 T259 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 7 T259 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 8 T259 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 106 T258 oasc.ZkTestServer.run start zk server on port:53901
[junit4:junit4] 2> 107 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6ec91cc0
[junit4:junit4] 2> 108 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 108 T264 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 108 T264 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 108 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45518
[junit4:junit4] 2> 109 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45518
[junit4:junit4] 2> 109 T262 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 168 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd0000 with negotiated timeout 10000 for client /127.0.0.1:45518
[junit4:junit4] 2> 168 T264 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd0000, negotiated timeout = 10000
[junit4:junit4] 2> 169 T265 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ec91cc0 name:ZooKeeperConnection Watcher:127.0.0.1:53901 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 169 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 169 T258 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 173 T263 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d64452ebd0000
[junit4:junit4] 2> 173 T265 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 173 T258 oaz.ZooKeeper.close Session: 0x13d64452ebd0000 closed
[junit4:junit4] 2> 174 T260 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45518 which had sessionid 0x13d64452ebd0000
[junit4:junit4] 2> 174 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6af695c1
[junit4:junit4] 2> 175 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 175 T266 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 175 T266 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 175 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45519
[junit4:junit4] 2> 176 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45519
[junit4:junit4] 2> 176 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd0001 with negotiated timeout 10000 for client /127.0.0.1:45519
[junit4:junit4] 2> 176 T266 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd0001, negotiated timeout = 10000
[junit4:junit4] 2> 177 T267 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6af695c1 name:ZooKeeperConnection Watcher:127.0.0.1:53901/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 177 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 177 T258 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 180 T258 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 182 T258 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 184 T258 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 186 T258 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 186 T258 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 190 T258 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 191 T258 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 195 T258 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 196 T258 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 198 T258 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 199 T258 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 202 T258 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 202 T258 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 205 T258 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 205 T258 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 208 T258 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 208 T258 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 211 T258 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 211 T258 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 214 T258 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 214 T258 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 217 T263 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d64452ebd0001
[junit4:junit4] 2> 218 T267 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 217 T258 oaz.ZooKeeper.close Session: 0x13d64452ebd0001 closed
[junit4:junit4] 2> 218 T260 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45519 which had sessionid 0x13d64452ebd0001
[junit4:junit4] 2> 281 T258 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 287 T258 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52883
[junit4:junit4] 2> 288 T258 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 288 T258 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 289 T258 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363186888590
[junit4:junit4] 2> 289 T258 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363186888590/solr.xml
[junit4:junit4] 2> 290 T258 oasc.CoreContainer.<init> New CoreContainer 547067301
[junit4:junit4] 2> 290 T258 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363186888590/'
[junit4:junit4] 2> 291 T258 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363186888590/'
[junit4:junit4] 2> 318 T258 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 319 T258 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 319 T258 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 320 T258 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 320 T258 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 320 T258 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 320 T258 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 321 T258 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 321 T258 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 321 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 331 T258 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 340 T258 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53901/solr
[junit4:junit4] 2> 341 T258 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 341 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c779bc0
[junit4:junit4] 2> 342 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 342 T277 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 343 T277 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 343 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45522
[junit4:junit4] 2> 343 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45522
[junit4:junit4] 2> 344 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd0002 with negotiated timeout 20000 for client /127.0.0.1:45522
[junit4:junit4] 2> 344 T277 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd0002, negotiated timeout = 20000
[junit4:junit4] 2> 345 T278 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c779bc0 name:ZooKeeperConnection Watcher:127.0.0.1:53901 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 345 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 346 T263 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d64452ebd0002
[junit4:junit4] 2> 347 T278 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 347 T260 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45522 which had sessionid 0x13d64452ebd0002
[junit4:junit4] 2> 347 T258 oaz.ZooKeeper.close Session: 0x13d64452ebd0002 closed
[junit4:junit4] 2> 347 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 361 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@643fa028
[junit4:junit4] 2> 362 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 362 T279 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 363 T279 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 363 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45523
[junit4:junit4] 2> 364 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45523
[junit4:junit4] 2> 364 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd0003 with negotiated timeout 20000 for client /127.0.0.1:45523
[junit4:junit4] 2> 364 T279 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd0003, negotiated timeout = 20000
[junit4:junit4] 2> 365 T280 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@643fa028 name:ZooKeeperConnection Watcher:127.0.0.1:53901/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 365 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 367 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 368 T258 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 372 T258 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52883_
[junit4:junit4] 2> 373 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52883_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52883_
[junit4:junit4] 2> 373 T258 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52883_
[junit4:junit4] 2> 376 T258 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 380 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 381 T258 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 388 T258 oasc.Overseer.start Overseer (id=89337815916937219-127.0.0.1:52883_-n_0000000000) starting
[junit4:junit4] 2> 389 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 391 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 392 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 393 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 394 T282 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 394 T258 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 397 T258 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 398 T258 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 403 T281 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 404 T283 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363186888590/collection1
[junit4:junit4] 2> 404 T283 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 405 T283 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 405 T283 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 407 T283 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363186888590/collection1/'
[junit4:junit4] 2> 407 T283 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363186888590/collection1/lib/README' to classloader
[junit4:junit4] 2> 408 T283 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363186888590/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 446 T283 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 496 T283 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 497 T283 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 502 T283 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 846 T283 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 852 T283 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 854 T283 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 875 T283 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 878 T283 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 881 T283 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 882 T283 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 883 T283 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 883 T283 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 884 T283 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 884 T283 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 884 T283 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 884 T283 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363186888590/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/control/data/
[junit4:junit4] 2> 885 T283 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c41d47e
[junit4:junit4] 2> 885 T283 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 885 T283 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/control/data forceNew: false
[junit4:junit4] 2> 886 T283 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/control/data/index/
[junit4:junit4] 2> 886 T283 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 886 T283 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/control/data/index forceNew: false
[junit4:junit4] 2> 888 T283 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@28338bac lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ddd9754)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 888 T283 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 898 T283 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 899 T283 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 899 T283 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 900 T283 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 900 T283 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 900 T283 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 900 T283 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 901 T283 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 901 T283 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 903 T283 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 955 T283 oass.SolrIndexSearcher.<init> Opening Searcher@54f69763 main
[junit4:junit4] 2> 958 T283 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/control/data/tlog
[junit4:junit4] 2> 963 T283 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 963 T283 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 966 T284 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54f69763 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 966 T283 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 967 T283 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 967 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 1907 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1908 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52883",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52883_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 1908 T281 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1911 T281 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1911 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1916 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1970 T283 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1970 T283 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52883 collection:control_collection shard:shard1
[junit4:junit4] 2> 1971 T283 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1977 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 1977 T283 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1978 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1979 T283 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1980 T283 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1980 T283 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52883/collection1/
[junit4:junit4] 2> 1980 T283 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1980 T283 oasc.SyncStrategy.syncToMe http://127.0.0.1:52883/collection1/ has no replicas
[junit4:junit4] 2> 1980 T283 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52883/collection1/
[junit4:junit4] 2> 1981 T283 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1984 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3421 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3429 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3439 T283 oasc.ZkController.register We are http://127.0.0.1:52883/collection1/ and leader is http://127.0.0.1:52883/collection1/
[junit4:junit4] 2> 3440 T283 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52883
[junit4:junit4] 2> 3440 T283 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3440 T283 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3440 T283 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3442 T283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3443 T258 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3443 T258 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3455 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3461 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3462 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@212eb5e1
[junit4:junit4] 2> 3463 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3463 T286 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3464 T286 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 3464 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45525
[junit4:junit4] 2> 3464 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45525
[junit4:junit4] 2> 3465 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd0004 with negotiated timeout 10000 for client /127.0.0.1:45525
[junit4:junit4] 2> 3465 T286 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd0004, negotiated timeout = 10000
[junit4:junit4] 2> 3465 T287 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@212eb5e1 name:ZooKeeperConnection Watcher:127.0.0.1:53901/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3465 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3467 T258 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3470 T258 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3527 T258 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3529 T258 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47842
[junit4:junit4] 2> 3529 T258 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3530 T258 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3530 T258 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842
[junit4:junit4] 2> 3530 T258 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/solr.xml
[junit4:junit4] 2> 3531 T258 oasc.CoreContainer.<init> New CoreContainer 607147595
[junit4:junit4] 2> 3531 T258 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/'
[junit4:junit4] 2> 3531 T258 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/'
[junit4:junit4] 2> 3549 T258 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3549 T258 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3550 T258 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3550 T258 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3550 T258 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3551 T258 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3551 T258 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3551 T258 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3551 T258 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3552 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3558 T258 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3567 T258 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53901/solr
[junit4:junit4] 2> 3567 T258 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3568 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@50e8ea13
[junit4:junit4] 2> 3568 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3569 T297 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3569 T297 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 3569 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45526
[junit4:junit4] 2> 3570 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45526
[junit4:junit4] 2> 3570 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd0005 with negotiated timeout 20000 for client /127.0.0.1:45526
[junit4:junit4] 2> 3570 T297 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd0005, negotiated timeout = 20000
[junit4:junit4] 2> 3571 T298 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50e8ea13 name:ZooKeeperConnection Watcher:127.0.0.1:53901 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3571 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3572 T263 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d64452ebd0005
[junit4:junit4] 2> 3573 T298 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3573 T260 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45526 which had sessionid 0x13d64452ebd0005
[junit4:junit4] 2> 3573 T258 oaz.ZooKeeper.close Session: 0x13d64452ebd0005 closed
[junit4:junit4] 2> 3573 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3577 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1fb468
[junit4:junit4] 2> 3578 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3578 T299 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3579 T299 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 3579 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45527
[junit4:junit4] 2> 3579 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45527
[junit4:junit4] 2> 3580 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd0006 with negotiated timeout 20000 for client /127.0.0.1:45527
[junit4:junit4] 2> 3580 T299 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd0006, negotiated timeout = 20000
[junit4:junit4] 2> 3580 T300 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fb468 name:ZooKeeperConnection Watcher:127.0.0.1:53901/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3580 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3581 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3582 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3584 T258 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4586 T258 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47842_
[junit4:junit4] 2> 4587 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:47842_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:47842_
[junit4:junit4] 2> 4588 T258 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47842_
[junit4:junit4] 2> 4591 T300 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4591 T280 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4591 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4591 T287 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4596 T301 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/collection1
[junit4:junit4] 2> 4596 T301 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4596 T301 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4597 T301 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4598 T301 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/collection1/'
[junit4:junit4] 2> 4598 T301 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/collection1/lib/README' to classloader
[junit4:junit4] 2> 4598 T301 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4626 T301 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 4653 T301 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4654 T301 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4658 T301 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4937 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4938 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52883",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52883_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 4941 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4941 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4941 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4976 T301 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 4982 T301 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 4984 T301 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5000 T301 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5004 T301 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5008 T301 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5009 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5010 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5010 T301 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5011 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5011 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5011 T301 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5012 T301 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty1/
[junit4:junit4] 2> 5012 T301 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c41d47e
[junit4:junit4] 2> 5012 T301 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5013 T301 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty1 forceNew: false
[junit4:junit4] 2> 5013 T301 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty1/index/
[junit4:junit4] 2> 5013 T301 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5014 T301 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty1/index forceNew: false
[junit4:junit4] 2> 5015 T301 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@abab463 lockFactory=org.apache.lucene.store.NativeFSLockFactory@42e75b42)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5015 T301 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5017 T301 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5017 T301 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5018 T301 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5018 T301 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5018 T301 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5019 T301 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5019 T301 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5019 T301 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5020 T301 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5022 T301 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5074 T301 oass.SolrIndexSearcher.<init> Opening Searcher@182dce4e main
[junit4:junit4] 2> 5075 T301 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty1/tlog
[junit4:junit4] 2> 5075 T301 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5075 T301 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5084 T302 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@182dce4e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5086 T301 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5086 T301 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6445 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6446 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47842",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:47842_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 6446 T281 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6447 T281 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6468 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6468 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6468 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7087 T301 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7088 T301 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47842 collection:collection1 shard:shard1
[junit4:junit4] 2> 7088 T301 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7096 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7096 T301 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7097 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7099 T301 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7099 T301 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7099 T301 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47842/collection1/
[junit4:junit4] 2> 7099 T301 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7100 T301 oasc.SyncStrategy.syncToMe http://127.0.0.1:47842/collection1/ has no replicas
[junit4:junit4] 2> 7100 T301 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47842/collection1/
[junit4:junit4] 2> 7100 T301 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7104 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7973 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7982 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7983 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7983 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8008 T301 oasc.ZkController.register We are http://127.0.0.1:47842/collection1/ and leader is http://127.0.0.1:47842/collection1/
[junit4:junit4] 2> 8009 T301 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47842
[junit4:junit4] 2> 8009 T301 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8009 T301 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8009 T301 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8011 T301 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8012 T258 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8013 T258 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8013 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8073 T258 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8078 T258 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34611
[junit4:junit4] 2> 8079 T258 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8079 T258 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8079 T258 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363186896389
[junit4:junit4] 2> 8080 T258 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363186896389/solr.xml
[junit4:junit4] 2> 8080 T258 oasc.CoreContainer.<init> New CoreContainer 1087650918
[junit4:junit4] 2> 8080 T258 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363186896389/'
[junit4:junit4] 2> 8080 T258 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363186896389/'
[junit4:junit4] 2> 8099 T258 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8099 T258 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8100 T258 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8100 T258 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8100 T258 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8101 T258 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8101 T258 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8101 T258 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8101 T258 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8102 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8108 T258 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8116 T258 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53901/solr
[junit4:junit4] 2> 8117 T258 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8117 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@474e000c
[junit4:junit4] 2> 8118 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8118 T313 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8119 T313 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 8119 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45543
[junit4:junit4] 2> 8119 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45543
[junit4:junit4] 2> 8120 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd0007 with negotiated timeout 20000 for client /127.0.0.1:45543
[junit4:junit4] 2> 8120 T313 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd0007, negotiated timeout = 20000
[junit4:junit4] 2> 8120 T314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@474e000c name:ZooKeeperConnection Watcher:127.0.0.1:53901 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8121 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8122 T263 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d64452ebd0007
[junit4:junit4] 2> 8122 T314 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8122 T260 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45543 which had sessionid 0x13d64452ebd0007
[junit4:junit4] 2> 8122 T258 oaz.ZooKeeper.close Session: 0x13d64452ebd0007 closed
[junit4:junit4] 2> 8123 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8126 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@74314067
[junit4:junit4] 2> 8127 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8127 T315 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8128 T315 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 8128 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45544
[junit4:junit4] 2> 8128 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45544
[junit4:junit4] 2> 8129 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd0008 with negotiated timeout 20000 for client /127.0.0.1:45544
[junit4:junit4] 2> 8129 T315 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd0008, negotiated timeout = 20000
[junit4:junit4] 2> 8129 T316 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74314067 name:ZooKeeperConnection Watcher:127.0.0.1:53901/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8129 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8130 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8131 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8132 T258 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9135 T258 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34611_
[junit4:junit4] 2> 9136 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34611_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34611_
[junit4:junit4] 2> 9137 T258 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34611_
[junit4:junit4] 2> 9139 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9140 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9141 T300 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9141 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9141 T316 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9142 T280 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9143 T287 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9146 T317 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363186896389/collection1
[junit4:junit4] 2> 9146 T317 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9147 T317 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9147 T317 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9148 T317 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363186896389/collection1/'
[junit4:junit4] 2> 9149 T317 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363186896389/collection1/lib/README' to classloader
[junit4:junit4] 2> 9149 T317 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363186896389/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9178 T317 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 9204 T317 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9205 T317 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9209 T317 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9489 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9489 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47842",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:47842_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 9493 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9493 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9493 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9493 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9550 T317 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9556 T317 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9558 T317 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9573 T317 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9576 T317 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9579 T317 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9580 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9580 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9581 T317 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9581 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9582 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9582 T317 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9582 T317 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363186896389/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty2/
[junit4:junit4] 2> 9582 T317 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c41d47e
[junit4:junit4] 2> 9583 T317 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9583 T317 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty2 forceNew: false
[junit4:junit4] 2> 9583 T317 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty2/index/
[junit4:junit4] 2> 9583 T317 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9584 T317 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty2/index forceNew: false
[junit4:junit4] 2> 9585 T317 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@130e7ed1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a10ad2)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9585 T317 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9587 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9588 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9588 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9589 T317 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9590 T317 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9590 T317 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9590 T317 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9590 T317 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9591 T317 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9593 T317 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9645 T317 oass.SolrIndexSearcher.<init> Opening Searcher@48b3eb12 main
[junit4:junit4] 2> 9646 T317 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty2/tlog
[junit4:junit4] 2> 9646 T317 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9647 T317 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9650 T318 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48b3eb12 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9652 T317 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9652 T317 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10998 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10999 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34611",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:34611_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 10999 T281 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 10999 T281 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 11008 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11008 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11008 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11008 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11654 T317 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11654 T317 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34611 collection:collection1 shard:shard2
[junit4:junit4] 2> 11655 T317 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 11660 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 11660 T317 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11661 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11662 T317 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11662 T317 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11662 T317 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34611/collection1/
[junit4:junit4] 2> 11663 T317 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11663 T317 oasc.SyncStrategy.syncToMe http://127.0.0.1:34611/collection1/ has no replicas
[junit4:junit4] 2> 11663 T317 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34611/collection1/
[junit4:junit4] 2> 11663 T317 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 11666 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12513 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12520 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12520 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12520 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12520 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12569 T317 oasc.ZkController.register We are http://127.0.0.1:34611/collection1/ and leader is http://127.0.0.1:34611/collection1/
[junit4:junit4] 2> 12569 T317 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34611
[junit4:junit4] 2> 12569 T317 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 12569 T317 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 12570 T317 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12571 T317 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12572 T258 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 12573 T258 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12573 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12639 T258 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12641 T258 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33902
[junit4:junit4] 2> 12642 T258 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12643 T258 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12643 T258 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363186900949
[junit4:junit4] 2> 12643 T258 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363186900949/solr.xml
[junit4:junit4] 2> 12644 T258 oasc.CoreContainer.<init> New CoreContainer 1958256921
[junit4:junit4] 2> 12648 T258 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363186900949/'
[junit4:junit4] 2> 12649 T258 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363186900949/'
[junit4:junit4] 2> 12668 T258 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12669 T258 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12669 T258 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12669 T258 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12670 T258 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12670 T258 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12670 T258 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12671 T258 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12671 T258 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12671 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12678 T258 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12688 T258 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53901/solr
[junit4:junit4] 2> 12688 T258 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12688 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@680aa742
[junit4:junit4] 2> 12689 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12689 T329 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12690 T329 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 12690 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45553
[junit4:junit4] 2> 12691 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45553
[junit4:junit4] 2> 12691 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd0009 with negotiated timeout 20000 for client /127.0.0.1:45553
[junit4:junit4] 2> 12691 T329 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd0009, negotiated timeout = 20000
[junit4:junit4] 2> 12692 T330 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@680aa742 name:ZooKeeperConnection Watcher:127.0.0.1:53901 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12692 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12693 T263 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d64452ebd0009
[junit4:junit4] 2> 12694 T330 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12694 T260 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45553 which had sessionid 0x13d64452ebd0009
[junit4:junit4] 2> 12694 T258 oaz.ZooKeeper.close Session: 0x13d64452ebd0009 closed
[junit4:junit4] 2> 12695 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12698 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@519e16bd
[junit4:junit4] 2> 12699 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12699 T331 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12700 T331 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 12700 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45554
[junit4:junit4] 2> 12700 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45554
[junit4:junit4] 2> 12701 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd000a with negotiated timeout 20000 for client /127.0.0.1:45554
[junit4:junit4] 2> 12701 T331 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd000a, negotiated timeout = 20000
[junit4:junit4] 2> 12701 T332 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@519e16bd name:ZooKeeperConnection Watcher:127.0.0.1:53901/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12702 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12703 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12704 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12706 T258 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13709 T258 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33902_
[junit4:junit4] 2> 13710 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33902_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33902_
[junit4:junit4] 2> 13711 T258 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33902_
[junit4:junit4] 2> 13714 T280 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13714 T332 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13714 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13714 T287 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13714 T300 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13714 T316 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13714 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13714 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13715 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13720 T333 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363186900949/collection1
[junit4:junit4] 2> 13720 T333 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13721 T333 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13721 T333 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13722 T333 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363186900949/collection1/'
[junit4:junit4] 2> 13723 T333 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363186900949/collection1/lib/README' to classloader
[junit4:junit4] 2> 13723 T333 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363186900949/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13746 T333 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 13776 T333 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13777 T333 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13781 T333 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 14026 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14027 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34611",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:34611_",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 14034 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14034 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14034 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14034 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14034 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14111 T333 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14120 T333 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14122 T333 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14145 T333 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14150 T333 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14154 T333 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14156 T333 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14156 T333 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14156 T333 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14157 T333 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14158 T333 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14158 T333 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14158 T333 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363186900949/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty3/
[junit4:junit4] 2> 14159 T333 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c41d47e
[junit4:junit4] 2> 14159 T333 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14160 T333 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty3 forceNew: false
[junit4:junit4] 2> 14160 T333 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty3/index/
[junit4:junit4] 2> 14160 T333 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14161 T333 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty3/index forceNew: false
[junit4:junit4] 2> 14163 T333 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5b95624 lockFactory=org.apache.lucene.store.NativeFSLockFactory@8bb4340)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14163 T333 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14166 T333 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14166 T333 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14167 T333 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14168 T333 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14168 T333 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14168 T333 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14168 T333 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14169 T333 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14169 T333 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14173 T333 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14225 T333 oass.SolrIndexSearcher.<init> Opening Searcher@56edcd83 main
[junit4:junit4] 2> 14226 T333 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty3/tlog
[junit4:junit4] 2> 14226 T333 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14227 T333 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14232 T334 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56edcd83 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14234 T333 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14235 T333 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15539 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15540 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33902",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:33902_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 15540 T281 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15541 T281 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 15544 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15544 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15544 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15544 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15544 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16236 T333 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16236 T333 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33902 collection:collection1 shard:shard1
[junit4:junit4] 2> 16240 T333 oasc.ZkController.register We are http://127.0.0.1:33902/collection1/ and leader is http://127.0.0.1:47842/collection1/
[junit4:junit4] 2> 16240 T333 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33902
[junit4:junit4] 2> 16240 T333 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16240 T333 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C12 name=collection1 org.apache.solr.core.SolrCore@5f4ed863 url=http://127.0.0.1:33902/collection1 node=127.0.0.1:33902_ C12_STATE=coll:collection1 core:collection1 props:{collection=collection1, state=down, base_url=http://127.0.0.1:33902, node_name=127.0.0.1:33902_, core=collection1}
[junit4:junit4] 2> 16245 T335 C12 P33902 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16246 T335 C12 P33902 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16245 T333 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16246 T335 C12 P33902 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16246 T335 C12 P33902 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16247 T258 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 16247 T335 C12 P33902 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16247 T258 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16248 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16310 T258 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16312 T258 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39406
[junit4:junit4] 2> 16312 T258 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16313 T258 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16313 T258 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363186904623
[junit4:junit4] 2> 16313 T258 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363186904623/solr.xml
[junit4:junit4] 2> 16314 T258 oasc.CoreContainer.<init> New CoreContainer 222151898
[junit4:junit4] 2> 16314 T258 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363186904623/'
[junit4:junit4] 2> 16314 T258 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363186904623/'
[junit4:junit4] 2> 16339 T258 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 16340 T258 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 16340 T258 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 16340 T258 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 16341 T258 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 16341 T258 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 16341 T258 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 16342 T258 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 16342 T258 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 16342 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 16349 T258 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16358 T258 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53901/solr
[junit4:junit4] 2> 16359 T258 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16359 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@d398580
[junit4:junit4] 2> 16360 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16360 T346 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16361 T346 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 16361 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45566
[junit4:junit4] 2> 16361 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45566
[junit4:junit4] 2> 16362 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd000b with negotiated timeout 20000 for client /127.0.0.1:45566
[junit4:junit4] 2> 16362 T346 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd000b, negotiated timeout = 20000
[junit4:junit4] 2> 16362 T347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d398580 name:ZooKeeperConnection Watcher:127.0.0.1:53901 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16362 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16364 T263 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d64452ebd000b
[junit4:junit4] 2> 16364 T260 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45566 which had sessionid 0x13d64452ebd000b
[junit4:junit4] 2> 16364 T258 oaz.ZooKeeper.close Session: 0x13d64452ebd000b closed
[junit4:junit4] 2> 16364 T347 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16365 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 16368 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1dcd2f3a
[junit4:junit4] 2> 16369 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16369 T348 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16369 T348 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 16370 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45567
[junit4:junit4] 2> 16370 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45567
[junit4:junit4] 2> 16371 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd000c with negotiated timeout 20000 for client /127.0.0.1:45567
[junit4:junit4] 2> 16371 T348 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd000c, negotiated timeout = 20000
[junit4:junit4] 2> 16371 T349 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dcd2f3a name:ZooKeeperConnection Watcher:127.0.0.1:53901/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16371 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16372 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd000c type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16373 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd000c type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16374 T258 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17049 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17050 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33902",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:33902_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 17055 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17055 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17055 T349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17055 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17055 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17055 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17377 T258 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39406_
[junit4:junit4] 2> 17378 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd000c type:delete cxid:0xd zxid:0xa9 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39406_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39406_
[junit4:junit4] 2> 17379 T258 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39406_
[junit4:junit4] 2> 17382 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17382 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17382 T349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17382 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17383 T280 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17382 T332 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17384 T300 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17384 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17385 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17386 T316 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17387 T287 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17387 T349 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17393 T350 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363186904623/collection1
[junit4:junit4] 2> 17394 T350 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17395 T350 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17395 T350 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17396 T350 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363186904623/collection1/'
[junit4:junit4] 2> 17397 T350 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363186904623/collection1/lib/README' to classloader
[junit4:junit4] 2> 17398 T350 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363186904623/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17435 T350 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 17440 T296 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {nodeName=127.0.0.1:33902_&wt=javabin&onlyIfLeader=true&state=recovering&action=PREPRECOVERY&checkLive=true&version=2&coreNodeName=4&core=collection1} status=0 QTime=1006
[junit4:junit4] 2> 17479 T350 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17480 T350 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17485 T350 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17896 T350 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17902 T350 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17905 T350 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17923 T350 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17928 T350 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17932 T350 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17934 T350 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17934 T350 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17934 T350 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17935 T350 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17936 T350 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17936 T350 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17936 T350 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363186904623/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty4/
[junit4:junit4] 2> 17936 T350 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c41d47e
[junit4:junit4] 2> 17937 T350 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17937 T350 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty4 forceNew: false
[junit4:junit4] 2> 17938 T350 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty4/index/
[junit4:junit4] 2> 17938 T350 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17939 T350 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty4/index forceNew: false
[junit4:junit4] 2> 17940 T350 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f357d39 lockFactory=org.apache.lucene.store.NativeFSLockFactory@60a0a88d)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17940 T350 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17942 T350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17942 T350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17943 T350 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17944 T350 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17944 T350 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17944 T350 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17944 T350 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17945 T350 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17945 T350 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17949 T350 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 18003 T350 oass.SolrIndexSearcher.<init> Opening Searcher@5ff432a main
[junit4:junit4] 2> 18004 T350 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty4/tlog
[junit4:junit4] 2> 18005 T350 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 18005 T350 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 18009 T351 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ff432a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 18010 T350 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 18011 T350 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18561 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18562 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39406",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:39406_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 18562 T281 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 18562 T281 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 18566 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18566 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18566 T349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18566 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18566 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18566 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19012 T350 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 19012 T350 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39406 collection:collection1 shard:shard2
[junit4:junit4] 2> 19016 T350 oasc.ZkController.register We are http://127.0.0.1:39406/collection1/ and leader is http://127.0.0.1:34611/collection1/
[junit4:junit4] 2> 19016 T350 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39406
[junit4:junit4] 2> 19016 T350 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 19016 T350 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C13 name=collection1 org.apache.solr.core.SolrCore@75f31d20 url=http://127.0.0.1:39406/collection1 node=127.0.0.1:39406_ C13_STATE=coll:collection1 core:collection1 props:{collection=collection1, state=down, base_url=http://127.0.0.1:39406, node_name=127.0.0.1:39406_, core=collection1}
[junit4:junit4] 2> 19017 T352 C13 P39406 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 19018 T352 C13 P39406 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 19018 T352 C13 P39406 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 19018 T350 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19018 T352 C13 P39406 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19019 T352 C13 P39406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19019 T258 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 19019 T258 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 19020 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19024 T258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19026 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19031 T296 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/onenodecollectioncore
[junit4:junit4] 2> 19032 T296 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 19033 T296 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 19033 T296 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 19034 T296 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 19035 T296 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 19037 T296 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 19039 T296 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/onenodecollectioncore/'
[junit4:junit4] 2> 19072 T296 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 19101 T296 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 19103 T296 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 19107 T296 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 19465 T296 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19470 T296 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> C12_STATE=coll:collection1 core:collection1 props:{collection=collection1, state=recovering, base_url=http://127.0.0.1:33902, node_name=127.0.0.1:33902_, shard=shard1, core=collection1}
[junit4:junit4] 2> 19471 T335 C12 P33902 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:47842/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19473 T296 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19476 T335 C12 P33902 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 19483 T335 C12 P33902 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:33902 START replicas=[http://127.0.0.1:47842/collection1/] nUpdates=100
[junit4:junit4] 2> 19486 T335 C12 P33902 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19487 T335 C12 P33902 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19487 T335 C12 P33902 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19487 T335 C12 P33902 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19487 T335 C12 P33902 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19488 T335 C12 P33902 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:47842/collection1/. core=collection1
[junit4:junit4] 2> 19488 T335 C12 P33902 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19488 T296 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19491 T296 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19495 T296 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19500 T296 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19500 T296 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19501 T296 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> ASYNC NEW_CORE C14 name=collection1 org.apache.solr.core.SolrCore@37ccfdf1 url=http://127.0.0.1:47842/collection1 node=127.0.0.1:47842_ C14_STATE=coll:collection1 core:collection1 props:{collection=collection1, state=active, base_url=http://127.0.0.1:47842, node_name=127.0.0.1:47842_, shard=shard1, core=collection1, leader=true}
[junit4:junit4] 2> 19506 T293 C14 P47842 REQ /get {wt=javabin&qt=/get&getVersions=100&distrib=false&version=2} status=0 QTime=6
[junit4:junit4] 2> 19507 T296 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19507 T296 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19508 T296 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19508 T296 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363186891842/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection/
[junit4:junit4] 2> 19509 T296 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c41d47e
[junit4:junit4] 2> 19510 T296 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19510 T296 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection forceNew: false
[junit4:junit4] 2> 19510 T296 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection/index/
[junit4:junit4] 2> 19511 T296 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19511 T296 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection/index forceNew: false
[junit4:junit4] 2> 19511 T294 C14 P47842 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19513 T294 C14 P47842 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@abab463 lockFactory=org.apache.lucene.store.NativeFSLockFactory@42e75b42)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19513 T296 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1364bbe6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@310b908a)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19513 T294 C14 P47842 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19513 T296 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19514 T294 C14 P47842 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@abab463 lockFactory=org.apache.lucene.store.NativeFSLockFactory@42e75b42)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@abab463 lockFactory=org.apache.lucene.store.NativeFSLockFactory@42e75b42)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19514 T294 C14 P47842 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19514 T294 C14 P47842 oass.SolrIndexSearcher.<init> Opening Searcher@1eea4ab1 realtime
[junit4:junit4] 2> 19515 T294 C14 P47842 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19515 T294 C14 P47842 /update {wt=javabin&openSearcher=false&commit_end_point=true&softCommit=false&commit=true&version=2&waitSearcher=true} {commit=} 0 15
[junit4:junit4] 2> 19515 T296 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19515 T296 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19516 T296 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19517 T296 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19517 T296 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19517 T296 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19518 T296 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19518 T296 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19519 T296 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19521 T296 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19543 T335 C12 P33902 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19544 T335 C12 P33902 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 19551 T335 C12 P33902 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19566 T293 C14 P47842 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19566 T293 C14 P47842 REQ /replication {wt=javabin&command=indexversion&qt=/replication&version=2} status=0 QTime=12
[junit4:junit4] 2> 19568 T335 C12 P33902 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19568 T335 C12 P33902 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19568 T335 C12 P33902 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19572 T294 C14 P47842 REQ /replication {wt=javabin&command=filelist&qt=/replication&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 19572 T335 C12 P33902 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19573 T296 oass.SolrIndexSearcher.<init> Opening Searcher@10dc1da6 main
[junit4:junit4] 2> 19573 T335 C12 P33902 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty3/index.20130313100147945 forceNew: false
[junit4:junit4] 2> 19574 T335 C12 P33902 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3c47bf7e lockFactory=org.apache.lucene.store.NativeFSLockFactory@72da1431) fullCopy=false
[junit4:junit4] 2> 19574 T296 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection/tlog
[junit4:junit4] 2> 19575 T296 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19575 T296 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19579 T355 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@10dc1da6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19580 T296 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 19581 T295 C14 P47842 REQ /replication {wt=filestream&command=filecontent&qt=/replication&generation=2&file=segments_2&checksum=true} status=0 QTime=2
[junit4:junit4] 2> 19586 T335 C12 P33902 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19588 T335 C12 P33902 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19588 T335 C12 P33902 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19590 T335 C12 P33902 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5b95624 lockFactory=org.apache.lucene.store.NativeFSLockFactory@8bb4340)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5b95624 lockFactory=org.apache.lucene.store.NativeFSLockFactory@8bb4340)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19590 T335 C12 P33902 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19590 T335 C12 P33902 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19591 T335 C12 P33902 oass.SolrIndexSearcher.<init> Opening Searcher@41847f3b main
[junit4:junit4] 2> 19592 T334 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@41847f3b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19592 T335 C12 P33902 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@3c47bf7e lockFactory=org.apache.lucene.store.NativeFSLockFactory@72da1431)
[junit4:junit4] 2> 19592 T335 C12 P33902 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19593 T335 C12 P33902 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19593 T335 C12 P33902 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19593 T335 C12 P33902 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19599 T335 C12 P33902 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20071 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20072 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39406",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:39406_",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 20076 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47842",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47842_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 20076 T281 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 20076 T281 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 20079 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33902",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:33902_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 20084 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20084 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20084 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20085 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20085 T349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20086 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20599 T296 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 20600 T296 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:47842 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 20601 T296 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 20613 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:delete cxid:0xa8 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 20614 T296 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 20615 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:create cxid:0xa9 zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20619 T296 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 20619 T296 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 20619 T296 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47842/onenodecollectioncore/
[junit4:junit4] 2> 20620 T296 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 20620 T296 oasc.SyncStrategy.syncToMe http://127.0.0.1:47842/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 20620 T296 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47842/onenodecollectioncore/
[junit4:junit4] 2> 20621 T296 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 20626 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:create cxid:0xb3 zxid:0xc9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 21026 T312 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {nodeName=127.0.0.1:39406_&wt=javabin&onlyIfLeader=true&state=recovering&action=PREPRECOVERY&checkLive=true&version=2&coreNodeName=5&core=collection1} status=0 QTime=2000
[junit4:junit4] 2> 21593 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21600 T349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21601 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21601 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21601 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21601 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21603 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21631 T296 oasc.ZkController.register We are http://127.0.0.1:47842/onenodecollectioncore/ and leader is http://127.0.0.1:47842/onenodecollectioncore/
[junit4:junit4] 2> 21632 T296 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:47842
[junit4:junit4] 2> 21632 T296 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 21632 T296 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 21634 T296 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21635 T296 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {collection=onenodecollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection&wt=javabin&action=CREATE&roles=none&name=onenodecollectioncore&version=2&numShards=1} status=0 QTime=2604
[junit4:junit4] 2> 21635 T258 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21636 T258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22638 T258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C13_STATE=coll:collection1 core:collection1 props:{collection=collection1, state=recovering, base_url=http://127.0.0.1:39406, node_name=127.0.0.1:39406_, shard=shard2, core=collection1}
[junit4:junit4] 2> 23027 T352 C13 P39406 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:34611/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 23027 T352 C13 P39406 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:39406 START replicas=[http://127.0.0.1:34611/collection1/] nUpdates=100
[junit4:junit4] 2> 23028 T352 C13 P39406 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 23028 T352 C13 P39406 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 23028 T352 C13 P39406 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 23028 T352 C13 P39406 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 23028 T352 C13 P39406 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 23028 T352 C13 P39406 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:34611/collection1/. core=collection1
[junit4:junit4] 2> 23029 T352 C13 P39406 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C15 name=collection1 org.apache.solr.core.SolrCore@69999900 url=http://127.0.0.1:34611/collection1 node=127.0.0.1:34611_ C15_STATE=coll:collection1 core:collection1 props:{collection=collection1, state=active, base_url=http://127.0.0.1:34611, node_name=127.0.0.1:34611_, shard=shard2, core=collection1, leader=true}
[junit4:junit4] 2> 23036 T312 C15 P34611 REQ /get {wt=javabin&qt=/get&getVersions=100&distrib=false&version=2} status=0 QTime=1
[junit4:junit4] 2> 23037 T311 C15 P34611 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23038 T311 C15 P34611 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@130e7ed1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a10ad2)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 23039 T311 C15 P34611 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 23039 T311 C15 P34611 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@130e7ed1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a10ad2)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@130e7ed1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a10ad2)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 23040 T311 C15 P34611 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 23040 T311 C15 P34611 oass.SolrIndexSearcher.<init> Opening Searcher@512bb6e realtime
[junit4:junit4] 2> 23040 T311 C15 P34611 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23040 T311 C15 P34611 /update {wt=javabin&openSearcher=false&commit_end_point=true&softCommit=false&commit=true&version=2&waitSearcher=true} {commit=} 0 3
[junit4:junit4] 2> 23041 T352 C13 P39406 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 23042 T352 C13 P39406 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 23045 T312 C15 P34611 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 23046 T312 C15 P34611 REQ /replication {wt=javabin&command=indexversion&qt=/replication&version=2} status=0 QTime=1
[junit4:junit4] 2> 23046 T352 C13 P39406 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 23046 T352 C13 P39406 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 23047 T352 C13 P39406 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 23049 T311 C15 P34611 REQ /replication {wt=javabin&command=filelist&qt=/replication&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 23050 T352 C13 P39406 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 23050 T352 C13 P39406 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty4/index.20130313100151422 forceNew: false
[junit4:junit4] 2> 23051 T352 C13 P39406 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@7eb7c70e lockFactory=org.apache.lucene.store.NativeFSLockFactory@37da21a3) fullCopy=false
[junit4:junit4] 2> 23053 T309 C15 P34611 REQ /replication {wt=filestream&command=filecontent&qt=/replication&generation=2&file=segments_2&checksum=true} status=0 QTime=0
[junit4:junit4] 2> 23054 T352 C13 P39406 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 23055 T352 C13 P39406 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 23055 T352 C13 P39406 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 23056 T352 C13 P39406 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f357d39 lockFactory=org.apache.lucene.store.NativeFSLockFactory@60a0a88d)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f357d39 lockFactory=org.apache.lucene.store.NativeFSLockFactory@60a0a88d)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 23057 T352 C13 P39406 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 23057 T352 C13 P39406 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 23057 T352 C13 P39406 oass.SolrIndexSearcher.<init> Opening Searcher@64df62a8 main
[junit4:junit4] 2> 23058 T351 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@64df62a8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 23059 T352 C13 P39406 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@7eb7c70e lockFactory=org.apache.lucene.store.NativeFSLockFactory@37da21a3)
[junit4:junit4] 2> 23059 T352 C13 P39406 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 23059 T352 C13 P39406 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 23059 T352 C13 P39406 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 23059 T352 C13 P39406 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 23060 T352 C13 P39406 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23111 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23112 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47842",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47842_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 23116 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39406",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:39406_",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 23120 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23121 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23121 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23121 T349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23121 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23121 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23640 T258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23641 T258 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 23642 T258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23655 T309 oejs.Response.sendError WARNING Committed before 404 Can not find: /onenodecollectioncore/update
[junit4:junit4] 2> 23656 T309 oejs.ServletHandler.doHandle WARNING /onenodecollectioncore/update java.lang.IllegalStateException: Committed
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.resetBuffer(Response.java:1136)
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.sendError(Response.java:314)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$Servlet404.service(JettySolrRunner.java:465)
[junit4:junit4] 2> at javax.servlet.http.HttpServlet.service(HttpServlet.java:770)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1336)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:379)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 23656 T258 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53901 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@27ae4934
[junit4:junit4] 2> 23657 T258 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 23657 T359 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:53901. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 23657 T359 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:53901, initiating session
[junit4:junit4] 2> 23658 T260 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:45590
[junit4:junit4] 2> 23658 T260 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:45590
[junit4:junit4] 2> 23659 T262 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d64452ebd000d with negotiated timeout 10000 for client /127.0.0.1:45590
[junit4:junit4] 2> 23659 T359 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:53901, sessionid = 0x13d64452ebd000d, negotiated timeout = 10000
[junit4:junit4] 2> 23659 T360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27ae4934 name:ZooKeeperConnection Watcher:127.0.0.1:53901 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 23659 T258 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 23702 T263 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d64452ebd000d
[junit4:junit4] 2> 23702 T260 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45590 which had sessionid 0x13d64452ebd000d
[junit4:junit4] 2> 23702 T258 oaz.ZooKeeper.close Session: 0x13d64452ebd000d closed
[junit4:junit4] 2> 23703 T360 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 23703 T263 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d64452ebd0004
[junit4:junit4] 2> 23704 T287 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 23704 T260 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45525 which had sessionid 0x13d64452ebd0004
[junit4:junit4] 2> 23704 T258 oaz.ZooKeeper.close Session: 0x13d64452ebd0004 closed
[junit4:junit4] 2> 23707 T258 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 52883
[junit4:junit4] 2> 23707 T258 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=547067301
[junit4:junit4] 2> 24627 T281 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24628 T281 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52883",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52883_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 24632 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24633 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24633 T349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24633 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24633 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25709 T258 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 25709 T258 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 25712 T258 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@31108917
[junit4:junit4] 2> 25717 T258 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 25718 T258 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 25718 T258 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 25719 T258 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 25719 T258 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 25720 T258 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/control/data/index
[junit4:junit4] 2> 25720 T258 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/control/data/index
[junit4:junit4] 2> 25720 T258 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/control/data
[junit4:junit4] 2> 25721 T258 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/control/data
[junit4:junit4] 2> 25721 T281 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89337815916937219-127.0.0.1:52883_-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 25722 T263 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d64452ebd0003
[junit4:junit4] 2> 25723 T349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25723 T280 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25723 T260 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:45523 which had sessionid 0x13d64452ebd0003
[junit4:junit4] 2> 25723 T280 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 25723 T258 oaz.ZooKeeper.close Session: 0x13d64452ebd0003 closed
[junit4:junit4] 2> 25724 T332 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25724 T280 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 25724 T300 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25724 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25724 T316 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25725 T349 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25725 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25724 T280 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 25725 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25732 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:delete cxid:0xc3 zxid:0xe5 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 25732 T300 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 25734 T300 oasc.Overseer.start Overseer (id=89337815916937222-127.0.0.1:47842_-n_0000000001) starting
[junit4:junit4] 2> 25735 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:create cxid:0xc8 zxid:0xe7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25735 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:create cxid:0xc9 zxid:0xe8 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25736 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:create cxid:0xca zxid:0xe9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25737 T263 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d64452ebd0006 type:create cxid:0xcb zxid:0xea txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25737 T362 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 25738 T361 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 25739 T361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25740 T361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52883",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52883_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 25743 T349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25743 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25743 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25743 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25745 T258 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 25798 T258 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 47842
[junit4:junit4] 2> 25798 T258 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=607147595
[junit4:junit4] 2> 27248 T361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27249 T361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47842",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:47842_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 27252 T361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47842",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47842__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:47842_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 27256 T349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 27256 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 27256 T300 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 27256 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 28801 T258 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 28802 T258 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 28809 T258 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 28812 T258 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@37ccfdf1
[junit4:junit4] 2> 28815 T258 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 28815 T258 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 28815 T258 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 28816 T258 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 28818 T258 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 28818 T258 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty1
[junit4:junit4] 2> 28818 T258 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty1
[junit4:junit4] 2> 28818 T258 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty1/index
[junit4:junit4] 2> 28819 T258 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363186888377/jetty1/index
[junit4:junit4] 2> 28819 T258 oasc.SolrCore.close [onenodecollectioncore] CLOSING SolrCore org.apache.solr.core.SolrCore@6274f7a3
[junit4:junit4] 2> 28823 T258 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 28824 T258 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 28824 T258 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 28824 T258 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 28825 T258 oasc.SolrCore.closeSearcher [onenodecollectioncore] Closing main searcher on request.
[junit4:junit4] 2> 28825 T258 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection/index
[junit4:junit4] 2> 28825 T258 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection/index
[junit4:junit4] 2> 28826 T258 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection
[junit4:junit4] 2> 28826 T258 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363186888378/onenodecollection
[junit4:junit4] 2> 28826 T361 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89337815916937222-127.0.0.1:47842_-n_
[...truncated too long message...]
t4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:52883",
[junit4:junit4] 1> "node_name":"127.0.0.1:52883_",
[junit4:junit4] 1> "core":"collection1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=40FDC9BBF29DF852 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_CA -Dtests.timezone=America/Matamoros -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 32.2s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:34611/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([40FDC9BBF29DF852:C11B47A385C2986E]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 32218 T258 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 32223 T257 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4:junit4] 2> 32320 T332 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 32321 T332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 32321 T332 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 32321 T332 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 32628 T261 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 33424 T349 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 33424 T349 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 33424 T349 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=en_CA, timezone=America/Matamoros
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=43581056,total=133758976
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestUtils, TestJmxMonitoredMap, RequiredFieldsTest, TestRTGBase, TestSolr4Spatial, TestNumberUtils, DirectUpdateHandlerTest, URLClassifyProcessorTest, TestSuggestSpellingConverter, TestComponentsName, TestFiltering, DOMUtilTest, TestHashPartitioner, SampleTest, TestSolrDiscoveryProperties, TestLuceneMatchVersion, SignatureUpdateProcessorFactoryTest, HighlighterTest, LeaderElectionIntegrationTest, PathHierarchyTokenizerFactoryTest, TestFieldTypeResource, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 33.52s, 1 test, 1 error <<< FAILURES!
[...truncated 711 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:877: There were test failures: 271 suites, 1141 tests, 1 error, 13 ignored (7 assumptions)
Total time: 38 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure