You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/14 23:29:59 UTC
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_15) - Build # 4680
- Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4680/
Java: 32bit/jdk1.7.0_15 -client -XX:+UseSerialGC
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZk2Test
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=2179, name=coreLoadExecutor-1457-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZk2Test], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=2179, name=coreLoadExecutor-1457-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZk2Test], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1567)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:520)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:980)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:878)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:870)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:34)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:272)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:224)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:244)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:458)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:744)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:619)
at org.apache.solr.core.CoreContainer.createFromZk(CoreContainer.java:872)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:955)
at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:579)
at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:574)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.AssertionError: Directory not closed: BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6197d3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@12d799c)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZk2Test
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=2179, name=coreLoadExecutor-1457-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZk2Test], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=2179, name=coreLoadExecutor-1457-thread-1, state=RUNNABLE, group=TGRP-BasicDistributedZk2Test], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1567)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:520)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:986)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:878)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:870)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:34)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:272)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:62)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:500)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:744)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:619)
at org.apache.solr.core.CoreContainer.createFromZk(CoreContainer.java:872)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:955)
at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:579)
at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:574)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.AssertionError: Directory not closed: MockDirWrapper(org.apache.lucene.store.RAMDirectory@114a6ae lockFactory=org.apache.lucene.store.NativeFSLockFactory@17b65)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZk2Test
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=2181, name=RecoveryThread, state=RUNNABLE, group=TGRP-BasicDistributedZk2Test], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=2181, name=RecoveryThread, state=RUNNABLE, group=TGRP-BasicDistributedZk2Test], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1567)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:520)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:980)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:878)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:870)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:34)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:272)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:224)
at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:383)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:281)
at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:153)
at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:409)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
Caused by: java.lang.AssertionError: Directory not closed: BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@123ae5a lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d804fc)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([BCA665D6C2CF3CB7:3D40EBCEB5905C8B]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9365 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T2011 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /n_/n
[junit4:junit4] 2> 3 T2011 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363299449939
[junit4:junit4] 2> 4 T2011 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 4 T2012 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 5 T2012 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 5 T2012 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 5 T2012 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 6 T2012 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 6 T2012 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 104 T2011 oasc.ZkTestServer.run start zk server on port:46002
[junit4:junit4] 2> 105 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1538300
[junit4:junit4] 2> 106 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 106 T2017 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 106 T2017 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 107 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53879
[junit4:junit4] 2> 107 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53879
[junit4:junit4] 2> 107 T2015 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 195 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc560000 with negotiated timeout 10000 for client /127.0.0.1:53879
[junit4:junit4] 2> 195 T2017 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc560000, negotiated timeout = 10000
[junit4:junit4] 2> 196 T2018 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1538300 name:ZooKeeperConnection Watcher:127.0.0.1:46002 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 196 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 197 T2011 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 200 T2016 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6afabc560000
[junit4:junit4] 2> 201 T2018 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 201 T2011 oaz.ZooKeeper.close Session: 0x13d6afabc560000 closed
[junit4:junit4] 2> 201 T2013 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53879 which had sessionid 0x13d6afabc560000
[junit4:junit4] 2> 202 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@15bb6d0
[junit4:junit4] 2> 202 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 203 T2019 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 203 T2019 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 203 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53880
[junit4:junit4] 2> 203 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53880
[junit4:junit4] 2> 204 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc560001 with negotiated timeout 10000 for client /127.0.0.1:53880
[junit4:junit4] 2> 204 T2019 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc560001, negotiated timeout = 10000
[junit4:junit4] 2> 204 T2020 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15bb6d0 name:ZooKeeperConnection Watcher:127.0.0.1:46002/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 205 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 205 T2011 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 208 T2011 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 210 T2011 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 211 T2011 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 213 T2011 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 213 T2011 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 216 T2011 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 216 T2011 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 219 T2011 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 219 T2011 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 221 T2011 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 221 T2011 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 223 T2011 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 223 T2011 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 225 T2011 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 226 T2011 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 227 T2011 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 228 T2011 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 230 T2011 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 230 T2011 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 232 T2011 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 232 T2011 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 234 T2016 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6afabc560001
[junit4:junit4] 2> 234 T2020 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 234 T2013 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53880 which had sessionid 0x13d6afabc560001
[junit4:junit4] 2> 234 T2011 oaz.ZooKeeper.close Session: 0x13d6afabc560001 closed
[junit4:junit4] 2> 289 T2011 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 292 T2011 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35929
[junit4:junit4] 2> 292 T2011 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 293 T2011 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 293 T2011 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363299450170
[junit4:junit4] 2> 293 T2011 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363299450170/solr.xml
[junit4:junit4] 2> 294 T2011 oasc.CoreContainer.<init> New CoreContainer 12741327
[junit4:junit4] 2> 294 T2011 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363299450170/'
[junit4:junit4] 2> 294 T2011 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363299450170/'
[junit4:junit4] 2> 313 T2011 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 313 T2011 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 314 T2011 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 314 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 314 T2011 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 315 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 315 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 315 T2011 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 316 T2011 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 316 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 322 T2011 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 334 T2011 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:46002/solr
[junit4:junit4] 2> 335 T2011 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 336 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@bd03dd
[junit4:junit4] 2> 336 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 337 T2030 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 337 T2030 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 337 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53881
[junit4:junit4] 2> 338 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53881
[junit4:junit4] 2> 338 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc560002 with negotiated timeout 20000 for client /127.0.0.1:53881
[junit4:junit4] 2> 338 T2030 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc560002, negotiated timeout = 20000
[junit4:junit4] 2> 339 T2031 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bd03dd name:ZooKeeperConnection Watcher:127.0.0.1:46002 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 339 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 340 T2016 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6afabc560002
[junit4:junit4] 2> 340 T2013 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53881 which had sessionid 0x13d6afabc560002
[junit4:junit4] 2> 340 T2031 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 340 T2011 oaz.ZooKeeper.close Session: 0x13d6afabc560002 closed
[junit4:junit4] 2> 341 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 344 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@18108f3
[junit4:junit4] 2> 345 T2032 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 344 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 345 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53882
[junit4:junit4] 2> 345 T2032 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 345 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53882
[junit4:junit4] 2> 346 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc560003 with negotiated timeout 20000 for client /127.0.0.1:53882
[junit4:junit4] 2> 346 T2032 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc560003, negotiated timeout = 20000
[junit4:junit4] 2> 346 T2033 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18108f3 name:ZooKeeperConnection Watcher:127.0.0.1:46002/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 347 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 348 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 349 T2011 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 351 T2011 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35929_n_%2Fn
[junit4:junit4] 2> 351 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35929_n_%2Fn Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35929_n_%2Fn
[junit4:junit4] 2> 352 T2011 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35929_n_%2Fn
[junit4:junit4] 2> 354 T2011 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 357 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 357 T2011 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 359 T2011 oasc.Overseer.start Overseer (id=89345192751398915-127.0.0.1:35929_n_%2Fn-n_0000000000) starting
[junit4:junit4] 2> 359 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 360 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 360 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 361 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 361 T2035 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 362 T2011 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 363 T2011 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 364 T2011 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 366 T2034 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 368 T2036 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363299450170/collection1
[junit4:junit4] 2> 368 T2036 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 368 T2036 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 368 T2036 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 369 T2036 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363299450170/collection1/'
[junit4:junit4] 2> 370 T2036 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363299450170/collection1/lib/README' to classloader
[junit4:junit4] 2> 370 T2036 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363299450170/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 402 T2036 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 436 T2036 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 437 T2036 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 441 T2036 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 840 T2036 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 845 T2036 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 848 T2036 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 856 T2036 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 859 T2036 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 862 T2036 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 862 T2036 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 863 T2036 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 863 T2036 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 864 T2036 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 864 T2036 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 864 T2036 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 864 T2036 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363299450170/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/control/data/
[junit4:junit4] 2> 865 T2036 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@17300f9
[junit4:junit4] 2> 865 T2036 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 865 T2036 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/control/data forceNew: false
[junit4:junit4] 2> 865 T2036 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/control/data/index/
[junit4:junit4] 2> 866 T2036 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 866 T2036 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/control/data/index forceNew: false
[junit4:junit4] 2> 867 T2036 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@bc5786 lockFactory=org.apache.lucene.store.NativeFSLockFactory@168f41),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 867 T2036 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 868 T2036 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 869 T2036 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 869 T2036 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 869 T2036 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 870 T2036 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 870 T2036 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 870 T2036 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 870 T2036 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 871 T2036 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 873 T2036 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 875 T2036 oass.SolrIndexSearcher.<init> Opening Searcher@1a9479b main
[junit4:junit4] 2> 876 T2036 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/control/data/tlog
[junit4:junit4] 2> 876 T2036 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 876 T2036 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 879 T2037 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a9479b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 880 T2036 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 880 T2036 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 880 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 1868 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1869 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:35929_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35929/n_/n"}
[junit4:junit4] 2> 1869 T2034 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1869 T2034 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1870 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1873 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1882 T2036 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1882 T2036 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35929/n_/n collection:control_collection shard:shard1
[junit4:junit4] 2> 1883 T2036 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1887 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 1888 T2036 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1888 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1890 T2036 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1890 T2036 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1890 T2036 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35929/n_/n/collection1/
[junit4:junit4] 2> 1890 T2036 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1890 T2036 oasc.SyncStrategy.syncToMe http://127.0.0.1:35929/n_/n/collection1/ has no replicas
[junit4:junit4] 2> 1891 T2036 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35929/n_/n/collection1/
[junit4:junit4] 2> 1891 T2036 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1893 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3378 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3387 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3398 T2036 oasc.ZkController.register We are http://127.0.0.1:35929/n_/n/collection1/ and leader is http://127.0.0.1:35929/n_/n/collection1/
[junit4:junit4] 2> 3399 T2036 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35929/n_/n
[junit4:junit4] 2> 3399 T2036 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3400 T2036 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3400 T2036 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3402 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3403 T2011 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3404 T2011 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3405 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3411 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3412 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@100118e
[junit4:junit4] 2> 3414 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3414 T2039 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3415 T2039 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 3415 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53887
[junit4:junit4] 2> 3416 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53887
[junit4:junit4] 2> 3417 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc560004 with negotiated timeout 10000 for client /127.0.0.1:53887
[junit4:junit4] 2> 3417 T2039 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc560004, negotiated timeout = 10000
[junit4:junit4] 2> 3417 T2040 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@100118e name:ZooKeeperConnection Watcher:127.0.0.1:46002/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3418 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3420 T2011 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3423 T2011 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3497 T2011 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3499 T2011 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49255
[junit4:junit4] 2> 3500 T2011 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3500 T2011 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3501 T2011 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359
[junit4:junit4] 2> 3501 T2011 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/solr.xml
[junit4:junit4] 2> 3501 T2011 oasc.CoreContainer.<init> New CoreContainer 23283335
[junit4:junit4] 2> 3502 T2011 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/'
[junit4:junit4] 2> 3502 T2011 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/'
[junit4:junit4] 2> 3520 T2011 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3520 T2011 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3520 T2011 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3521 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3521 T2011 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3521 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3522 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3522 T2011 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3522 T2011 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3523 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3529 T2011 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3540 T2011 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:46002/solr
[junit4:junit4] 2> 3540 T2011 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3541 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1401924
[junit4:junit4] 2> 3542 T2050 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3541 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3542 T2050 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 3543 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53888
[junit4:junit4] 2> 3543 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53888
[junit4:junit4] 2> 3543 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc560005 with negotiated timeout 20000 for client /127.0.0.1:53888
[junit4:junit4] 2> 3543 T2050 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc560005, negotiated timeout = 20000
[junit4:junit4] 2> 3544 T2051 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1401924 name:ZooKeeperConnection Watcher:127.0.0.1:46002 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3544 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3546 T2016 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6afabc560005
[junit4:junit4] 2> 3547 T2051 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3547 T2013 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53888 which had sessionid 0x13d6afabc560005
[junit4:junit4] 2> 3547 T2011 oaz.ZooKeeper.close Session: 0x13d6afabc560005 closed
[junit4:junit4] 2> 3548 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3550 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ed5b34
[junit4:junit4] 2> 3551 T2052 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3551 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3552 T2052 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 3552 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53889
[junit4:junit4] 2> 3552 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53889
[junit4:junit4] 2> 3553 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc560006 with negotiated timeout 20000 for client /127.0.0.1:53889
[junit4:junit4] 2> 3553 T2052 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc560006, negotiated timeout = 20000
[junit4:junit4] 2> 3553 T2053 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ed5b34 name:ZooKeeperConnection Watcher:127.0.0.1:46002/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3553 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3555 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3556 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3558 T2011 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4561 T2011 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49255_n_%2Fn
[junit4:junit4] 2> 4562 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49255_n_%2Fn Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49255_n_%2Fn
[junit4:junit4] 2> 4563 T2011 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49255_n_%2Fn
[junit4:junit4] 2> 4568 T2033 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4569 T2040 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4569 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4569 T2053 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4577 T2054 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/collection1
[junit4:junit4] 2> 4578 T2054 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4579 T2054 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4579 T2054 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4581 T2054 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/collection1/'
[junit4:junit4] 2> 4582 T2054 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/collection1/lib/README' to classloader
[junit4:junit4] 2> 4582 T2054 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4623 T2054 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 4658 T2054 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4659 T2054 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4663 T2054 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4892 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4893 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:35929_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35929/n_/n"}
[junit4:junit4] 2> 4896 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4896 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4896 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5086 T2054 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5092 T2054 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5094 T2054 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5104 T2054 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5108 T2054 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5112 T2054 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5113 T2054 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5113 T2054 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5114 T2054 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5115 T2054 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5115 T2054 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5115 T2054 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5116 T2054 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty1/
[junit4:junit4] 2> 5116 T2054 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@17300f9
[junit4:junit4] 2> 5117 T2054 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5117 T2054 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty1 forceNew: false
[junit4:junit4] 2> 5118 T2054 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty1/index/
[junit4:junit4] 2> 5118 T2054 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5119 T2054 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty1/index forceNew: false
[junit4:junit4] 2> 5120 T2054 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@48dee3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1422ace),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5121 T2054 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5123 T2054 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5123 T2054 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5124 T2054 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5125 T2054 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5125 T2054 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5126 T2054 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5126 T2054 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5127 T2054 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5127 T2054 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5130 T2054 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5132 T2054 oass.SolrIndexSearcher.<init> Opening Searcher@10ab3ff main
[junit4:junit4] 2> 5132 T2054 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty1/tlog
[junit4:junit4] 2> 5133 T2054 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5133 T2054 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5137 T2055 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10ab3ff main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5138 T2054 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5139 T2054 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6401 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6402 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:49255_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49255/n_/n"}
[junit4:junit4] 2> 6402 T2034 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6403 T2034 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6409 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6409 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6409 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6585 T2054 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 6585 T2054 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49255/n_/n collection:collection1 shard:shard1
[junit4:junit4] 2> 6586 T2054 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 6590 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 6591 T2054 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 6591 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6592 T2054 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 6593 T2054 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 6593 T2054 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49255/n_/n/collection1/
[junit4:junit4] 2> 6593 T2054 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 6593 T2054 oasc.SyncStrategy.syncToMe http://127.0.0.1:49255/n_/n/collection1/ has no replicas
[junit4:junit4] 2> 6593 T2054 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49255/n_/n/collection1/
[junit4:junit4] 2> 6593 T2054 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 6596 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7914 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7919 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7919 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7919 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7950 T2054 oasc.ZkController.register We are http://127.0.0.1:49255/n_/n/collection1/ and leader is http://127.0.0.1:49255/n_/n/collection1/
[junit4:junit4] 2> 7950 T2054 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49255/n_/n
[junit4:junit4] 2> 7950 T2054 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 7951 T2054 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 7951 T2054 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7953 T2054 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7954 T2011 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 7954 T2011 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 7955 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8018 T2011 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8020 T2011 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46733
[junit4:junit4] 2> 8021 T2011 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8022 T2011 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8023 T2011 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363299457893
[junit4:junit4] 2> 8023 T2011 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363299457893/solr.xml
[junit4:junit4] 2> 8024 T2011 oasc.CoreContainer.<init> New CoreContainer 13298263
[junit4:junit4] 2> 8024 T2011 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363299457893/'
[junit4:junit4] 2> 8025 T2011 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363299457893/'
[junit4:junit4] 2> 8046 T2011 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8047 T2011 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8047 T2011 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8048 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8048 T2011 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8048 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8049 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8049 T2011 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8049 T2011 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8049 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8056 T2011 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8067 T2011 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:46002/solr
[junit4:junit4] 2> 8067 T2011 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8068 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@786425
[junit4:junit4] 2> 8069 T2066 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8068 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8069 T2066 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 8069 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53890
[junit4:junit4] 2> 8070 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53890
[junit4:junit4] 2> 8071 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc560007 with negotiated timeout 20000 for client /127.0.0.1:53890
[junit4:junit4] 2> 8071 T2066 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc560007, negotiated timeout = 20000
[junit4:junit4] 2> 8071 T2067 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@786425 name:ZooKeeperConnection Watcher:127.0.0.1:46002 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8072 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8073 T2016 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6afabc560007
[junit4:junit4] 2> 8073 T2013 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53890 which had sessionid 0x13d6afabc560007
[junit4:junit4] 2> 8073 T2067 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8073 T2011 oaz.ZooKeeper.close Session: 0x13d6afabc560007 closed
[junit4:junit4] 2> 8074 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8077 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@bbd04b
[junit4:junit4] 2> 8078 T2068 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8078 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8078 T2068 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 8078 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53891
[junit4:junit4] 2> 8079 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53891
[junit4:junit4] 2> 8080 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc560008 with negotiated timeout 20000 for client /127.0.0.1:53891
[junit4:junit4] 2> 8080 T2068 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc560008, negotiated timeout = 20000
[junit4:junit4] 2> 8080 T2069 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bbd04b name:ZooKeeperConnection Watcher:127.0.0.1:46002/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8080 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8081 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8081 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8083 T2011 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9085 T2011 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46733_n_%2Fn
[junit4:junit4] 2> 9086 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:46733_n_%2Fn Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:46733_n_%2Fn
[junit4:junit4] 2> 9087 T2011 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46733_n_%2Fn
[junit4:junit4] 2> 9090 T2053 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9090 T2040 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9090 T2069 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9090 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9090 T2033 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9090 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9091 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9095 T2070 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363299457893/collection1
[junit4:junit4] 2> 9095 T2070 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9096 T2070 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9096 T2070 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9097 T2070 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363299457893/collection1/'
[junit4:junit4] 2> 9098 T2070 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363299457893/collection1/lib/README' to classloader
[junit4:junit4] 2> 9098 T2070 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363299457893/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9139 T2070 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 9174 T2070 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9174 T2070 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9178 T2070 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9422 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9423 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:49255_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49255/n_/n"}
[junit4:junit4] 2> 9425 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9425 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9425 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9425 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9600 T2070 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9606 T2070 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9608 T2070 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9617 T2070 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9620 T2070 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9624 T2070 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9625 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9625 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9625 T2070 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9626 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9627 T2070 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9627 T2070 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9627 T2070 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363299457893/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty2/
[junit4:junit4] 2> 9627 T2070 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@17300f9
[junit4:junit4] 2> 9628 T2070 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9628 T2070 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty2 forceNew: false
[junit4:junit4] 2> 9628 T2070 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty2/index/
[junit4:junit4] 2> 9628 T2070 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9629 T2070 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty2/index forceNew: false
[junit4:junit4] 2> 9630 T2070 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e32146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1478035),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9630 T2070 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9631 T2070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9631 T2070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9632 T2070 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9632 T2070 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9633 T2070 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9633 T2070 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9633 T2070 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9634 T2070 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9634 T2070 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9636 T2070 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9638 T2070 oass.SolrIndexSearcher.<init> Opening Searcher@1e4e3a3 main
[junit4:junit4] 2> 9639 T2070 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty2/tlog
[junit4:junit4] 2> 9639 T2070 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9639 T2070 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9643 T2071 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e4e3a3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9644 T2070 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9644 T2070 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10930 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10930 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:46733_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46733/n_/n"}
[junit4:junit4] 2> 10931 T2034 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 10931 T2034 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 10934 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10934 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10934 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10935 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11646 T2070 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11647 T2070 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46733/n_/n collection:collection1 shard:shard2
[junit4:junit4] 2> 11648 T2070 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 11653 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 11653 T2070 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11654 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11655 T2070 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11655 T2070 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11655 T2070 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46733/n_/n/collection1/
[junit4:junit4] 2> 11656 T2070 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11656 T2070 oasc.SyncStrategy.syncToMe http://127.0.0.1:46733/n_/n/collection1/ has no replicas
[junit4:junit4] 2> 11656 T2070 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46733/n_/n/collection1/
[junit4:junit4] 2> 11657 T2070 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 11659 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12439 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12447 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12447 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12447 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12447 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12463 T2070 oasc.ZkController.register We are http://127.0.0.1:46733/n_/n/collection1/ and leader is http://127.0.0.1:46733/n_/n/collection1/
[junit4:junit4] 2> 12463 T2070 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46733/n_/n
[junit4:junit4] 2> 12464 T2070 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 12464 T2070 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 12464 T2070 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12465 T2070 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12466 T2011 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 12466 T2011 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12467 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12528 T2011 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12530 T2011 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:42545
[junit4:junit4] 2> 12531 T2011 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12531 T2011 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12531 T2011 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363299462406
[junit4:junit4] 2> 12532 T2011 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363299462406/solr.xml
[junit4:junit4] 2> 12532 T2011 oasc.CoreContainer.<init> New CoreContainer 5930555
[junit4:junit4] 2> 12532 T2011 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363299462406/'
[junit4:junit4] 2> 12533 T2011 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363299462406/'
[junit4:junit4] 2> 12550 T2011 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12551 T2011 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12551 T2011 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12551 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12552 T2011 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12552 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12552 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12553 T2011 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12553 T2011 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12553 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12560 T2011 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12571 T2011 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:46002/solr
[junit4:junit4] 2> 12571 T2011 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12571 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c1ee3
[junit4:junit4] 2> 12572 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12572 T2082 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12573 T2082 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 12573 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53892
[junit4:junit4] 2> 12574 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53892
[junit4:junit4] 2> 12574 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc560009 with negotiated timeout 20000 for client /127.0.0.1:53892
[junit4:junit4] 2> 12574 T2082 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc560009, negotiated timeout = 20000
[junit4:junit4] 2> 12575 T2083 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c1ee3 name:ZooKeeperConnection Watcher:127.0.0.1:46002 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12575 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12576 T2016 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6afabc560009
[junit4:junit4] 2> 12577 T2013 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53892 which had sessionid 0x13d6afabc560009
[junit4:junit4] 2> 12577 T2083 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12577 T2011 oaz.ZooKeeper.close Session: 0x13d6afabc560009 closed
[junit4:junit4] 2> 12577 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12580 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c8c47e
[junit4:junit4] 2> 12581 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12581 T2084 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12581 T2084 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 12581 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53893
[junit4:junit4] 2> 12582 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53893
[junit4:junit4] 2> 12582 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc56000a with negotiated timeout 20000 for client /127.0.0.1:53893
[junit4:junit4] 2> 12582 T2084 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc56000a, negotiated timeout = 20000
[junit4:junit4] 2> 12583 T2085 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c8c47e name:ZooKeeperConnection Watcher:127.0.0.1:46002/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12583 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12584 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc56000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12584 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc56000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12586 T2011 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13588 T2011 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42545_n_%2Fn
[junit4:junit4] 2> 13589 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc56000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42545_n_%2Fn Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42545_n_%2Fn
[junit4:junit4] 2> 13590 T2011 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42545_n_%2Fn
[junit4:junit4] 2> 13593 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13594 T2033 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13595 T2040 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13595 T2053 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13595 T2085 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13595 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13595 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13596 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13596 T2069 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13604 T2086 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363299462406/collection1
[junit4:junit4] 2> 13604 T2086 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13605 T2086 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13606 T2086 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13608 T2086 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363299462406/collection1/'
[junit4:junit4] 2> 13609 T2086 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363299462406/collection1/lib/README' to classloader
[junit4:junit4] 2> 13609 T2086 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363299462406/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13667 T2086 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 13701 T2086 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13702 T2086 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13706 T2086 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13952 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13952 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:46733_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46733/n_/n"}
[junit4:junit4] 2> 13956 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13957 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13956 T2085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13956 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13957 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14103 T2086 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14116 T2086 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14119 T2086 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14130 T2086 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14133 T2086 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14135 T2086 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14137 T2086 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14137 T2086 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14137 T2086 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14138 T2086 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14138 T2086 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14139 T2086 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14139 T2086 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363299462406/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty3/
[junit4:junit4] 2> 14139 T2086 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@17300f9
[junit4:junit4] 2> 14139 T2086 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14140 T2086 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty3 forceNew: false
[junit4:junit4] 2> 14140 T2086 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty3/index/
[junit4:junit4] 2> 14140 T2086 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14140 T2086 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty3/index forceNew: false
[junit4:junit4] 2> 14142 T2086 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@179cdd2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14cfb29),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14142 T2086 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14143 T2086 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14144 T2086 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14144 T2086 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14145 T2086 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14145 T2086 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14145 T2086 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14146 T2086 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14146 T2086 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14146 T2086 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14149 T2086 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14151 T2086 oass.SolrIndexSearcher.<init> Opening Searcher@9632ef main
[junit4:junit4] 2> 14152 T2086 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty3/tlog
[junit4:junit4] 2> 14152 T2086 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14153 T2086 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14157 T2087 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9632ef main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14159 T2086 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14159 T2086 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15460 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15460 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:42545_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42545/n_/n"}
[junit4:junit4] 2> 15460 T2034 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15461 T2034 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 15463 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15463 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15463 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15463 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15463 T2085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16160 T2086 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16160 T2086 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:42545/n_/n collection:collection1 shard:shard1
[junit4:junit4] 2> 16162 T2086 oasc.ZkController.register We are http://127.0.0.1:42545/n_/n/collection1/ and leader is http://127.0.0.1:49255/n_/n/collection1/
[junit4:junit4] 2> 16163 T2086 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42545/n_/n
[junit4:junit4] 2> 16163 T2086 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16163 T2086 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C153 name=collection1 org.apache.solr.core.SolrCore@1d7c113 url=http://127.0.0.1:42545/n_/n/collection1 node=127.0.0.1:42545_n_%2Fn C153_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:42545_n_%2Fn, base_url=http://127.0.0.1:42545/n_/n}
[junit4:junit4] 2> 16164 T2088 C153 P42545 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16164 T2088 C153 P42545 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16164 T2086 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16164 T2088 C153 P42545 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16164 T2088 C153 P42545 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16165 T2088 C153 P42545 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16165 T2011 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 16165 T2011 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16166 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16226 T2011 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16228 T2011 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47819
[junit4:junit4] 2> 16229 T2011 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16229 T2011 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16229 T2011 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363299466103
[junit4:junit4] 2> 16230 T2011 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363299466103/solr.xml
[junit4:junit4] 2> 16230 T2011 oasc.CoreContainer.<init> New CoreContainer 18795703
[junit4:junit4] 2> 16230 T2011 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363299466103/'
[junit4:junit4] 2> 16231 T2011 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363299466103/'
[junit4:junit4] 2> 16250 T2011 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 16251 T2011 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 16251 T2011 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 16252 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 16252 T2011 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 16252 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 16253 T2011 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 16253 T2011 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 16253 T2011 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 16254 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 16260 T2011 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16271 T2011 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:46002/solr
[junit4:junit4] 2> 16272 T2011 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16272 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b177a3
[junit4:junit4] 2> 16273 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16273 T2099 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16274 T2099 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 16274 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53896
[junit4:junit4] 2> 16274 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53896
[junit4:junit4] 2> 16275 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc56000b with negotiated timeout 20000 for client /127.0.0.1:53896
[junit4:junit4] 2> 16275 T2099 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc56000b, negotiated timeout = 20000
[junit4:junit4] 2> 16275 T2100 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b177a3 name:ZooKeeperConnection Watcher:127.0.0.1:46002 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16275 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16277 T2016 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6afabc56000b
[junit4:junit4] 2> 16277 T2100 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16277 T2013 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53896 which had sessionid 0x13d6afabc56000b
[junit4:junit4] 2> 16277 T2011 oaz.ZooKeeper.close Session: 0x13d6afabc56000b closed
[junit4:junit4] 2> 16278 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 16281 T2011 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:46002/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1449
[junit4:junit4] 2> 16282 T2101 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:46002. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16281 T2011 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16282 T2101 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:46002, initiating session
[junit4:junit4] 2> 16282 T2013 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53897
[junit4:junit4] 2> 16282 T2013 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53897
[junit4:junit4] 2> 16283 T2015 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6afabc56000c with negotiated timeout 20000 for client /127.0.0.1:53897
[junit4:junit4] 2> 16283 T2101 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:46002, sessionid = 0x13d6afabc56000c, negotiated timeout = 20000
[junit4:junit4] 2> 16283 T2102 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1449 name:ZooKeeperConnection Watcher:127.0.0.1:46002/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16283 T2011 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16284 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc56000c type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16285 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc56000c type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16286 T2011 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 16967 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16968 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:42545_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42545/n_/n"}
[junit4:junit4] 2> 17040 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17040 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17040 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17040 T2102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17040 T2085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17040 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17169 T2048 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:42545_n_%252Fn_collection1&state=recovering&nodeName=127.0.0.1:42545_n_%252Fn&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1000
[junit4:junit4] 2> 17288 T2011 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47819_n_%2Fn
[junit4:junit4] 2> 17289 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc56000c type:delete cxid:0xd zxid:0xa9 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:47819_n_%2Fn Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:47819_n_%2Fn
[junit4:junit4] 2> 17290 T2011 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47819_n_%2Fn
[junit4:junit4] 2> 17291 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17292 T2033 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17292 T2085 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17292 T2053 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17292 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17292 T2085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17293 T2102 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17293 T2102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17292 T2040 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17292 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17294 T2069 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17293 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17298 T2103 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363299466103/collection1
[junit4:junit4] 2> 17298 T2103 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17299 T2103 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17299 T2103 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17300 T2103 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363299466103/collection1/'
[junit4:junit4] 2> 17300 T2103 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363299466103/collection1/lib/README' to classloader
[junit4:junit4] 2> 17300 T2103 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363299466103/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17335 T2103 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 17369 T2103 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17370 T2103 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17374 T2103 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17790 T2103 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17796 T2103 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17799 T2103 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17808 T2103 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17817 T2103 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17820 T2103 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17821 T2103 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17822 T2103 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17822 T2103 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17823 T2103 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17823 T2103 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17824 T2103 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17824 T2103 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363299466103/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty4/
[junit4:junit4] 2> 17824 T2103 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@17300f9
[junit4:junit4] 2> 17824 T2103 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17825 T2103 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty4 forceNew: false
[junit4:junit4] 2> 17825 T2103 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty4/index/
[junit4:junit4] 2> 17825 T2103 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17825 T2103 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty4/index forceNew: false
[junit4:junit4] 2> 17826 T2103 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9f0a5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a1661b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17827 T2103 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17828 T2103 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17828 T2103 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17829 T2103 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17829 T2103 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17829 T2103 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17830 T2103 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17830 T2103 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17830 T2103 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17831 T2103 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17833 T2103 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17835 T2103 oass.SolrIndexSearcher.<init> Opening Searcher@b2a9af main
[junit4:junit4] 2> 17836 T2103 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty4/tlog
[junit4:junit4] 2> 17836 T2103 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17836 T2103 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17840 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b2a9af main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17841 T2103 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 17842 T2103 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18544 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18545 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:47819_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47819/n_/n"}
[junit4:junit4] 2> 18545 T2034 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 18545 T2034 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 18555 T2102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18555 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18555 T2085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18555 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18555 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18555 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18856 T2103 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 18856 T2103 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47819/n_/n collection:collection1 shard:shard2
[junit4:junit4] 2> 18859 T2103 oasc.ZkController.register We are http://127.0.0.1:47819/n_/n/collection1/ and leader is http://127.0.0.1:46733/n_/n/collection1/
[junit4:junit4] 2> 18859 T2103 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47819/n_/n
[junit4:junit4] 2> 18859 T2103 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 18860 T2103 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C154 name=collection1 org.apache.solr.core.SolrCore@44e4a2 url=http://127.0.0.1:47819/n_/n/collection1 node=127.0.0.1:47819_n_%2Fn C154_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:47819_n_%2Fn, base_url=http://127.0.0.1:47819/n_/n}
[junit4:junit4] 2> 18860 T2105 C154 P47819 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 18860 T2105 C154 P47819 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 18860 T2103 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18860 T2105 C154 P47819 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 18861 T2105 C154 P47819 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18861 T2011 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 18862 T2105 C154 P47819 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18862 T2011 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 18862 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18866 T2011 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18867 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18871 T2048 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/onenodecollectioncore
[junit4:junit4] 2> 18871 T2048 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 18872 T2048 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 18872 T2048 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 18873 T2048 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 18874 T2048 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 18876 T2048 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 18877 T2048 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/onenodecollectioncore/'
[junit4:junit4] 2> 18924 T2048 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 18980 T2048 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18981 T2048 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18986 T2048 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> C153_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:42545_n_%2Fn, base_url=http://127.0.0.1:42545/n_/n}
[junit4:junit4] 2> 19170 T2088 C153 P42545 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49255/n_/n/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19170 T2088 C153 P42545 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:42545/n_/n START replicas=[http://127.0.0.1:49255/n_/n/collection1/] nUpdates=100
[junit4:junit4] 2> 19170 T2088 C153 P42545 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19171 T2088 C153 P42545 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19171 T2088 C153 P42545 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19171 T2088 C153 P42545 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19172 T2088 C153 P42545 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19172 T2088 C153 P42545 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49255/n_/n/collection1/. core=collection1
[junit4:junit4] 2> 19172 T2088 C153 P42545 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C155 name=collection1 org.apache.solr.core.SolrCore@1b72604 url=http://127.0.0.1:49255/n_/n/collection1 node=127.0.0.1:49255_n_%2Fn C155_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49255_n_%2Fn, base_url=http://127.0.0.1:49255/n_/n, leader=true}
[junit4:junit4] 2> 19176 T2049 C155 P49255 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 19180 T2046 C155 P49255 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19181 T2046 C155 P49255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@48dee3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1422ace),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19181 T2046 C155 P49255 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19182 T2046 C155 P49255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@48dee3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1422ace),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@48dee3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1422ace),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19182 T2046 C155 P49255 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19183 T2046 C155 P49255 oass.SolrIndexSearcher.<init> Opening Searcher@1fc8f84 realtime
[junit4:junit4] 2> 19183 T2046 C155 P49255 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19194 T2046 C155 P49255 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 14
[junit4:junit4] 2> 19195 T2088 C153 P42545 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19195 T2088 C153 P42545 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19197 T2047 C155 P49255 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19197 T2047 C155 P49255 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 19198 T2088 C153 P42545 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19198 T2088 C153 P42545 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19198 T2088 C153 P42545 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19200 T2046 C155 P49255 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 19200 T2088 C153 P42545 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19201 T2088 C153 P42545 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty3/index.20130314121749136 forceNew: false
[junit4:junit4] 2> 19202 T2088 C153 P42545 oash.SnapPuller.fetchLatestIndex Starting download to BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d70386 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c8f803) fullCopy=false
[junit4:junit4] 2> 19204 T2049 C155 P49255 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 19205 T2088 C153 P42545 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19205 T2088 C153 P42545 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19206 T2088 C153 P42545 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19207 T2088 C153 P42545 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@179cdd2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14cfb29),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@179cdd2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14cfb29),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19207 T2088 C153 P42545 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19208 T2088 C153 P42545 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19208 T2088 C153 P42545 oass.SolrIndexSearcher.<init> Opening Searcher@768cd6 main
[junit4:junit4] 2> 19209 T2087 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@768cd6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19210 T2088 C153 P42545 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d70386 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c8f803)
[junit4:junit4] 2> 19210 T2088 C153 P42545 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19211 T2088 C153 P42545 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19211 T2088 C153 P42545 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19211 T2088 C153 P42545 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19226 T2088 C153 P42545 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19457 T2048 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19463 T2048 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19467 T2048 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19477 T2048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19481 T2048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19485 T2048 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19486 T2048 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19486 T2048 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19486 T2048 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19487 T2048 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19487 T2048 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19487 T2048 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19488 T2048 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363299453359/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363299449939/onenodecollection/
[junit4:junit4] 2> 19488 T2048 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@17300f9
[junit4:junit4] 2> 19488 T2048 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19489 T2048 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363299449939/onenodecollection forceNew: false
[junit4:junit4] 2> 19489 T2048 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363299449939/onenodecollection/index/
[junit4:junit4] 2> 19490 T2048 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363299449939/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19490 T2048 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363299449939/onenodecollection/index forceNew: false
[junit4:junit4] 2> 19491 T2048 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c4757 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1cdaac),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19492 T2048 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19493 T2048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19493 T2048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19494 T2048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19494 T2048 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19495 T2048 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19495 T2048 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19495 T2048 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19496 T2048 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19496 T2048 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19499 T2048 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19502 T2048 oass.SolrIndexSearcher.<init> Opening Searcher@61b80 main
[junit4:junit4] 2> 19503 T2048 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363299449939/onenodecollection/tlog
[junit4:junit4] 2> 19503 T2048 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19504 T2048 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19507 T2109 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@61b80 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19508 T2048 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 20060 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20060 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:47819_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47819/n_/n"}
[junit4:junit4] 2> 20063 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:42545_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42545/n_/n"}
[junit4:junit4] 2> 20065 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:49255_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49255/n_/n"}
[junit4:junit4] 2> 20065 T2034 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 20065 T2034 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 20068 T2102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20068 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20068 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20068 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20068 T2085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20068 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20510 T2048 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 20511 T2048 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:49255/n_/n collection:onenodecollection shard:shard1
[junit4:junit4] 2> 20512 T2048 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 20516 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560006 type:delete cxid:0xa8 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 20517 T2048 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 20517 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560006 type:create cxid:0xa9 zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20519 T2048 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 20519 T2048 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 20520 T2048 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49255/n_/n/onenodecollectioncore/
[junit4:junit4] 2> 20520 T2048 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 20520 T2048 oasc.SyncStrategy.syncToMe http://127.0.0.1:49255/n_/n/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 20521 T2048 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49255/n_/n/onenodecollectioncore/
[junit4:junit4] 2> 20521 T2048 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 20524 T2016 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6afabc560006 type:create cxid:0xb3 zxid:0xc9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20867 T2064 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:47819_n_%252Fn_collection1&state=recovering&nodeName=127.0.0.1:47819_n_%252Fn&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2000
[junit4:junit4] 2> 21576 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21582 T2085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21582 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21582 T2102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21582 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21582 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21582 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21628 T2048 oasc.ZkController.register We are http://127.0.0.1:49255/n_/n/onenodecollectioncore/ and leader is http://127.0.0.1:49255/n_/n/onenodecollectioncore/
[junit4:junit4] 2> 21628 T2048 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:49255/n_/n
[junit4:junit4] 2> 21628 T2048 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 21629 T2048 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 21631 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21632 T2048 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=1&roles=none&name=onenodecollectioncore&action=CREATE&collection=onenodecollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363299449939/onenodecollection&wt=javabin&version=2} status=0 QTime=2762
[junit4:junit4] 2> 21632 T2011 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21633 T2011 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22635 T2011 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C154_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:47819_n_%2Fn, base_url=http://127.0.0.1:47819/n_/n}
[junit4:junit4] 2> 22868 T2105 C154 P47819 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46733/n_/n/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 22868 T2105 C154 P47819 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:47819/n_/n START replicas=[http://127.0.0.1:46733/n_/n/collection1/] nUpdates=100
[junit4:junit4] 2> 22869 T2105 C154 P47819 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 22869 T2105 C154 P47819 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 22869 T2105 C154 P47819 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 22869 T2105 C154 P47819 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 22869 T2105 C154 P47819 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 22869 T2105 C154 P47819 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46733/n_/n/collection1/. core=collection1
[junit4:junit4] 2> 22870 T2105 C154 P47819 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C156 name=collection1 org.apache.solr.core.SolrCore@5d904f url=http://127.0.0.1:46733/n_/n/collection1 node=127.0.0.1:46733_n_%2Fn C156_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46733_n_%2Fn, base_url=http://127.0.0.1:46733/n_/n, leader=true}
[junit4:junit4] 2> 22875 T2063 C156 P46733 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 22876 T2062 C156 P46733 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22877 T2062 C156 P46733 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e32146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1478035),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22878 T2062 C156 P46733 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22878 T2062 C156 P46733 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e32146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1478035),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e32146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1478035),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22879 T2062 C156 P46733 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22879 T2062 C156 P46733 oass.SolrIndexSearcher.<init> Opening Searcher@1bde880 realtime
[junit4:junit4] 2> 22879 T2062 C156 P46733 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22880 T2062 C156 P46733 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 22880 T2105 C154 P47819 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22881 T2105 C154 P47819 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 22882 T2065 C156 P46733 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22882 T2065 C156 P46733 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 22882 T2105 C154 P47819 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 22883 T2105 C154 P47819 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 22883 T2105 C154 P47819 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 22884 T2063 C156 P46733 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 22885 T2105 C154 P47819 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 22885 T2105 C154 P47819 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363299449938/jetty4/index.20130314121752820 forceNew: false
[junit4:junit4] 2> 22886 T2105 C154 P47819 oash.SnapPuller.fetchLatestIndex Starting download to BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1f08552 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dae9d8) fullCopy=false
[junit4:junit4] 2> 22887 T2062 C156 P46733 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 22888 T2105 C154 P47819 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 22889 T2105 C154 P47819 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22889 T2105 C154 P47819 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22890 T2105 C154 P47819 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9f0a5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a1661b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9f0a5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a1661b),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22890 T2105 C154 P47819 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22890 T2105 C154 P47819 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 22890 T2105 C154 P47819 oass.SolrIndexSearcher.<init> Opening Searcher@1f21f7d main
[junit4:junit4] 2> 22891 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f21f7d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22892 T2105 C154 P47819 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1f08552 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dae9d8)
[junit4:junit4] 2> 22892 T2105 C154 P47819 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 22892 T2105 C154 P47819 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 22892 T2105 C154 P47819 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 22892 T2105 C154 P47819 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22893 T2105 C154 P47819 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23087 T2034 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23088 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:49255_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49255/n_/n"}
[junit4:junit4] 2> 23099 T2034 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:47819_n_%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47819/n_/n"}
[junit4:junit4] 2> 23101 T2053 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23101 T2033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23101 T2102 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23101 T2085 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23101 T2069 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23101 T2040 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23637 T2011 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23638 T2011 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 23638 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C157 name=onenodecollectioncore org.apache.solr.core.SolrCore@1672afc url=http://127.0.0.1:49255/n_/n/onenodecollectioncore node=127.0.0.1:49255_n_%2Fn C157_STATE=coll:onenodecollection core:onenodecollectioncore props:{shard=shard1, roles=none, state=active, core=onenodecollectioncore, collection=onenodecollection, node_name=127.0.0.1:49255_n_%2Fn, base_url=http://127.0.0.1:49255/n_/n, leader=true}
[junit4:junit4] 2> 23650 T2047 C157 P49255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c4757 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1cdaac),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 23650 T2047 C157 P49255 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 23651 T2047 C157 P49255 /update {wt=javabin&version=2} {add=[1 (1429523108812816384)]} 0 2
[junit4:junit4] 2> 23658 T2046 C157 P49255 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23659 T2046 C157 P49255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c4757 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1cdaac),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c4757 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1cdaac),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4] 2> 23660 T2046 C157 P49255 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4] 2> 23661 T2046 C157 P49255 oass.SolrIndexSearcher.<init> Opening Searcher@1d51145 main
[junit4:junit4] 2> 23661 T2046 C157 P49255 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23662 T2109 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@1d51145 main{StandardDirectoryReader(segments_2:3 _0(4.3):C1)}
[junit4:junit4] 2> 23662 T2046 C157 P49255 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 23665 T2048 C157 P49255 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 23666 T2011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23669 T2049 C157 P49255 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C158 name=collection1 org.apache.solr.core.SolrCore@9a87e5 url=http://127.0.0.1:35929/n_/n/collection1 node=127.0.0.1:35929_n_%2Fn C158_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:35929_n_%2Fn, base_url=http://127.0.0.1:35929/n_/n, leader=true}
[junit4:junit4] 2> 23677 T2027 C158 P35929 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@bc5786 lockFactory=org.apache.lucene.store.NativeFSLockFactory@168f41),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 23678 T2027 C158 P35929 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 23680 T2027 C158 P35929 /update {wt=javabin&version=2} {add=[1 (1429523108841127936)]} 0 4
[junit4:junit4] 2> C153_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:42545_n_%2Fn, base_url=http://127.0.0.1:42545/n_/n}
[junit4:junit4] 2> 23691 T2080 C153 P42545 /update {distrib.from=http://127.0.0.1:49255/n_/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429523108848467968)]} 0 2
[junit4:junit4] 2> 23691 T2046 C155 P49255 /update {wt=javabin&version=2} {add=[1 (1429523108848467968)]} 0 8
[junit4:junit4] 2> 23693 T2029 C158 P35929 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23696 T2029 C158 P35929 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@bc5786 lockFactory=org.apache.lucene.store.NativeFSLockFactory@168f41),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@bc5786 lockFactory=org.apache.lucene.store.NativeFSLockFactory@168f41),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4] 2> 23696 T2029 C158 P35929 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4] 2> 23697 T2029 C158 P35929 oass.SolrIndexSearcher.<init> Opening Searcher@15d32e4 main
[junit4:junit4] 2> 23698 T2029 C158 P35929 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23698 T2037 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15d32e4 main{StandardDirectoryReader(segments_2:3 _0(4.3):C1)}
[junit4:junit4] 2> 23699 T2029 C158 P35929 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 23701 T2048 C155 P49255 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23703 T2048 C155 P49255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@48dee3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1422ace),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@48dee3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1422ace),segFN=segments_3,generation=3,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip, segments_3]
[junit4:junit4] 2> 23704 T2048 C155 P49255 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip, segments_3]
[junit4:junit4] 2> 23705 T2048 C155 P49255 oass.SolrIndexSearcher.<init> Opening Searcher@1f1e0c4 main
[junit4:junit4] 2> 23705 T2048 C155 P49255 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23706 T2055 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f1e0c4 main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C1)}
[junit4:junit4] 2> 23707 T2048 C155 P49255 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:42545/n_/n/collection1/, StdNode: http://127.0.0.1:46733/n_/n/collection1/, StdNode: http://127.0.0.1:47819/n_/n/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 23708 T2062 C156 P46733 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23708 T2081 C153 P42545 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23709 T2062 C156 P46733 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e32146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1478035),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e32146 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1478035),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 23709 T2062 C156 P46733 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 23710 T2062 C156 P46733 oass.SolrIndexSearcher.<init> Opening Searcher@1add4cd main
[junit4:junit4] 2> 23710 T2062 C156 P46733 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23711 T2081 C153 P42545 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@179cdd2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14cfb29),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@179cdd2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14cfb29),segFN=segments_3,generation=3,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip, segments_3]
[junit4:junit4] 2> 23711 T2081 C153 P42545 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip, segments_3]
[junit4:junit4] 2> 23712 T2071 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1add4cd main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 23712 T2081 C153 P42545 oass.SolrIndexSearcher.<init> Opening Searcher@1f8043b main
[junit4:junit4] 2> 23712 T2062 C156 P46733 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 23713 T2081 C153 P42545 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> C154_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:47819_n_%2Fn, base_url=http://127.0.0.1:47819/n_/n}
[junit4:junit4] 2> 23713 T2096 C154 P47819 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23714 T2087 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f8043b main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C1)}
[junit4:junit4] 2> 23714 T2096 C154 P47819 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9f0a5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a1661b),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9f0a5c lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a1661b),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 23715 T2081 C153 P42545 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 23715 T2096 C154 P47819 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 23715 T2096 C154 P47819 oass.SolrIndexSearcher.<init> Opening Searcher@df4c73 main
[junit4:junit4] 2> 23716 T2096 C154 P47819 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23716 T2104 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@df4c73 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 23717 T2096 C154 P47819 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 23717 T2048 C155 P49255 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4] 2> 23718 T2011 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 23719 T2011 oascc.ZkS
[...truncated too long message...]
s.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 48773 T2240 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 48773 T2240 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=BCA665D6C2CF3CB7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_EC -Dtests.timezone=GB-Eire -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 48.8s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([BCA665D6C2CF3CB7:3D40EBCEB5905C8B]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:92)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:54)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 48781 T2240 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 48784 T2239 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 48847 T2315 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 48848 T2315 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 48848 T2315 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 48848 T2315 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 49645 T2243 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=es_EC, timezone=GB-Eire
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic i386/Oracle Corporation 1.7.0_15 (32-bit)/cpus=8,threads=6,free=54517528,total=175480832
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestSuggestSpellingConverter, TestOmitPositions, TermVectorComponentDistributedTest, TestBinaryField, CopyFieldTest, EchoParamsTest, DisMaxRequestHandlerTest, TestSolrXMLSerializer, TestIndexingPerformance, TestRandomFaceting, PathHierarchyTokenizerFactoryTest, SuggesterTSTTest, ClusterStateTest, TestDFRSimilarityFactory, TestBinaryResponseWriter, DefaultValueUpdateProcessorTest, TestDistributedSearch, TestDynamicFieldResource, CoreContainerCoreInitFailuresTest, FullSolrCloudDistribCmdsTest, TestAnalyzedSuggestions, SignatureUpdateProcessorFactoryTest, UpdateParamsTest, BadIndexSchemaTest, TestPostingsSolrHighlighter, TestPropInject, SolrRequestParserTest, SolrCmdDistributorTest, SpellCheckCollatorTest, TestJmxMonitoredMap, SpellPossibilityIteratorTest, TestCollationField, CollectionsAPIDistributedZkTest, XmlUpdateRequestHandlerTest, XsltUpdateRequestHandlerTest, MultiTermTest, TestLazyCores, ConvertedLegacyTest, TestPartialUpdateDeduplication, TestWordDelimiterFilterFactory, RequiredFieldsTest, TestCSVResponseWriter, ChaosMonkeySafeLeaderTest, TestShardHandlerFactory, SortByFunctionTest, DocumentAnalysisRequestHandlerTest, TestCSVLoader, PingRequestHandlerTest, StatsComponentTest, HighlighterConfigTest, TestMergePolicyConfig, TestFoldingMultitermQuery, TestCodecSupport, UniqFieldsUpdateProcessorFactoryTest, TestElisionMultitermQuery, TestLuceneMatchVersion, TestSolrDiscoveryProperties, TestFiltering, TestNumberUtils, OutputWriterTest, TestStressLucene, NumericFieldsTest, BasicZkTest, TestArbitraryIndexDir, BasicDistributedZk2Test, SyncSliceTest]
[junit4:junit4] Completed on J1 in 49.82s, 1 test, 1 failure <<< FAILURES!
[...truncated 479 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 3 suite-level errors, 1 failure, 13 ignored (7 assumptions)
Total time: 49 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_15 -client -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_15) - Build # 4687
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4687/
Java: 32bit/jdk1.7.0_15 -server -XX:+UseParallelGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.RecoveryZkTest
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=623, name=coreLoadExecutor-274-thread-1, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=623, name=coreLoadExecutor-274-thread-1, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1567)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:520)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:986)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:878)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:870)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:34)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:272)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:224)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:244)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:458)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:744)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:619)
at org.apache.solr.core.CoreContainer.createFromZk(CoreContainer.java:872)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:955)
at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:579)
at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:574)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.AssertionError: Directory not closed: MockDirWrapper(org.apache.lucene.store.RAMDirectory@194e6e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@69dc90)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.RecoveryZkTest
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=625, name=RecoveryThread, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=625, name=RecoveryThread, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1567)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:520)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:986)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:878)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:870)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:34)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:272)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:224)
at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:383)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:281)
at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:153)
at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:409)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
Caused by: java.lang.AssertionError: Directory not closed: MockDirWrapper(org.apache.lucene.store.RAMDirectory@aab251 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1778e41)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([953AC8948B467D9E:14DC468CFC191DA2]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9019 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4:junit4] 2> 0 T564 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 3 T564 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-RecoveryZkTest-1363347118760
[junit4:junit4] 2> 3 T564 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 4 T565 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 5 T565 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 5 T565 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 5 T565 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 6 T565 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 7 T565 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-1363347118760/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 104 T564 oasc.ZkTestServer.run start zk server on port:33773
[junit4:junit4] 2> 106 T564 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33773 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@141df20
[junit4:junit4] 2> 108 T570 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33773. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 108 T564 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 109 T570 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33773, initiating session
[junit4:junit4] 2> 109 T566 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47520
[junit4:junit4] 2> 110 T566 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47520
[junit4:junit4] 2> 110 T568 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 133 T568 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6dd21aad0000 with negotiated timeout 10000 for client /127.0.0.1:47520
[junit4:junit4] 2> 133 T570 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33773, sessionid = 0x13d6dd21aad0000, negotiated timeout = 10000
[junit4:junit4] 2> 134 T571 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@141df20 name:ZooKeeperConnection Watcher:127.0.0.1:33773 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 134 T564 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 134 T564 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 140 T569 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6dd21aad0000
[junit4:junit4] 2> 141 T571 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 141 T566 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47520 which had sessionid 0x13d6dd21aad0000
[junit4:junit4] 2> 141 T564 oaz.ZooKeeper.close Session: 0x13d6dd21aad0000 closed
[junit4:junit4] 2> 142 T564 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33773/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@16e066a
[junit4:junit4] 2> 143 T564 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 144 T572 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33773. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 144 T572 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33773, initiating session
[junit4:junit4] 2> 145 T566 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47521
[junit4:junit4] 2> 145 T566 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47521
[junit4:junit4] 2> 146 T568 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6dd21aad0001 with negotiated timeout 10000 for client /127.0.0.1:47521
[junit4:junit4] 2> 146 T572 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33773, sessionid = 0x13d6dd21aad0001, negotiated timeout = 10000
[junit4:junit4] 2> 147 T573 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16e066a name:ZooKeeperConnection Watcher:127.0.0.1:33773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 147 T564 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 148 T564 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 153 T564 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 155 T564 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 157 T564 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 160 T564 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 161 T564 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 167 T564 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 168 T564 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 174 T564 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 175 T564 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 177 T564 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 177 T564 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 180 T564 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 180 T564 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 183 T564 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 184 T564 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 188 T564 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 188 T564 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 191 T564 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 191 T564 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 193 T564 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 193 T564 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 196 T569 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6dd21aad0001
[junit4:junit4] 2> 196 T573 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 196 T566 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47521 which had sessionid 0x13d6dd21aad0001
[junit4:junit4] 2> 196 T564 oaz.ZooKeeper.close Session: 0x13d6dd21aad0001 closed
[junit4:junit4] 2> 259 T564 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 261 T564 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55456
[junit4:junit4] 2> 261 T564 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 262 T564 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 262 T564 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363347118954
[junit4:junit4] 2> 262 T564 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363347118954/solr.xml
[junit4:junit4] 2> 263 T564 oasc.CoreContainer.<init> New CoreContainer 3970031
[junit4:junit4] 2> 263 T564 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363347118954/'
[junit4:junit4] 2> 263 T564 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363347118954/'
[junit4:junit4] 2> 279 T564 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 280 T564 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 280 T564 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 280 T564 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 280 T564 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 281 T564 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 281 T564 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 281 T564 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 282 T564 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 282 T564 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 288 T564 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 296 T564 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33773/solr
[junit4:junit4] 2> 296 T564 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 297 T564 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33773 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d49ec
[junit4:junit4] 2> 297 T564 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 297 T583 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33773. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 298 T583 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33773, initiating session
[junit4:junit4] 2> 298 T566 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47522
[junit4:junit4] 2> 298 T566 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47522
[junit4:junit4] 2> 300 T568 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6dd21aad0002 with negotiated timeout 20000 for client /127.0.0.1:47522
[junit4:junit4] 2> 300 T583 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33773, sessionid = 0x13d6dd21aad0002, negotiated timeout = 20000
[junit4:junit4] 2> 300 T584 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d49ec name:ZooKeeperConnection Watcher:127.0.0.1:33773 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 300 T564 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 302 T569 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6dd21aad0002
[junit4:junit4] 2> 302 T584 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 302 T566 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47522 which had sessionid 0x13d6dd21aad0002
[junit4:junit4] 2> 302 T564 oaz.ZooKeeper.close Session: 0x13d6dd21aad0002 closed
[junit4:junit4] 2> 304 T564 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 308 T564 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33773/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@82fb20
[junit4:junit4] 2> 309 T564 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 309 T585 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33773. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 309 T585 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33773, initiating session
[junit4:junit4] 2> 310 T566 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47523
[junit4:junit4] 2> 310 T566 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47523
[junit4:junit4] 2> 312 T568 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6dd21aad0003 with negotiated timeout 20000 for client /127.0.0.1:47523
[junit4:junit4] 2> 312 T585 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33773, sessionid = 0x13d6dd21aad0003, negotiated timeout = 20000
[junit4:junit4] 2> 312 T586 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@82fb20 name:ZooKeeperConnection Watcher:127.0.0.1:33773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 312 T564 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 317 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 320 T564 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 322 T564 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55456_
[junit4:junit4] 2> 322 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55456_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55456_
[junit4:junit4] 2> 323 T564 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55456_
[junit4:junit4] 2> 326 T564 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 330 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 331 T564 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 334 T564 oasc.Overseer.start Overseer (id=89348316775383043-127.0.0.1:55456_-n_0000000000) starting
[junit4:junit4] 2> 335 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 344 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 345 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 347 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 348 T588 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 349 T564 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 354 T564 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 356 T564 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 365 T587 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 368 T589 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363347118954/collection1
[junit4:junit4] 2> 368 T589 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 369 T589 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 369 T589 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 371 T589 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363347118954/collection1/'
[junit4:junit4] 2> 372 T589 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1363347118954/collection1/lib/README' to classloader
[junit4:junit4] 2> 372 T589 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1363347118954/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 410 T589 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 437 T589 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 438 T589 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 442 T589 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 725 T589 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 734 T589 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 737 T589 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 751 T589 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 753 T589 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 757 T589 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 758 T589 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 758 T589 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 758 T589 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 760 T589 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 760 T589 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 760 T589 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 760 T589 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363347118954/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/control/data/
[junit4:junit4] 2> 761 T589 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28dfb2
[junit4:junit4] 2> 761 T589 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 762 T589 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363347118760/control/data forceNew: false
[junit4:junit4] 2> 762 T589 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/control/data/index/
[junit4:junit4] 2> 762 T589 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1363347118760/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 763 T589 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363347118760/control/data/index forceNew: false
[junit4:junit4] 2> 765 T589 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1325022 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10ad780),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 765 T589 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 767 T589 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 767 T589 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 768 T589 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 768 T589 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 769 T589 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 769 T589 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 769 T589 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 770 T589 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 770 T589 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 773 T589 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 776 T589 oass.SolrIndexSearcher.<init> Opening Searcher@894a23 main
[junit4:junit4] 2> 777 T589 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/control/data/tlog
[junit4:junit4] 2> 777 T589 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 778 T589 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 781 T590 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@894a23 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 782 T589 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 782 T589 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 783 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 1869 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1869 T587 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:55456_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55456"}
[junit4:junit4] 2> 1870 T587 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1875 T587 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1876 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1884 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2786 T589 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2787 T589 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55456 collection:control_collection shard:shard1
[junit4:junit4] 2> 2792 T589 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 2798 T589 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2804 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2805 T589 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2806 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2807 T589 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2808 T589 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2809 T589 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55456/collection1/
[junit4:junit4] 2> 2810 T589 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2810 T589 oasc.SyncStrategy.syncToMe http://127.0.0.1:55456/collection1/ has no replicas
[junit4:junit4] 2> 2810 T589 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55456/collection1/
[junit4:junit4] 2> 2811 T589 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2815 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3389 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3499 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3518 T589 oasc.ZkController.register We are http://127.0.0.1:55456/collection1/ and leader is http://127.0.0.1:55456/collection1/
[junit4:junit4] 2> 3519 T589 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55456
[junit4:junit4] 2> 3519 T589 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3519 T589 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3519 T589 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3521 T589 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3522 T564 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3522 T564 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3522 T564 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3526 T564 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3527 T564 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33773/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@baf7ac
[junit4:junit4] 2> 3528 T564 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3528 T592 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33773. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3528 T592 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33773, initiating session
[junit4:junit4] 2> 3529 T566 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47524
[junit4:junit4] 2> 3529 T566 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47524
[junit4:junit4] 2> 3530 T568 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6dd21aad0004 with negotiated timeout 10000 for client /127.0.0.1:47524
[junit4:junit4] 2> 3530 T592 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33773, sessionid = 0x13d6dd21aad0004, negotiated timeout = 10000
[junit4:junit4] 2> 3530 T593 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@baf7ac name:ZooKeeperConnection Watcher:127.0.0.1:33773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3530 T564 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3532 T564 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3535 T564 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3588 T564 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3590 T564 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52685
[junit4:junit4] 2> 3591 T564 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3591 T564 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3591 T564 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363347122292
[junit4:junit4] 2> 3592 T564 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363347122292/solr.xml
[junit4:junit4] 2> 3592 T564 oasc.CoreContainer.<init> New CoreContainer 29490862
[junit4:junit4] 2> 3592 T564 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363347122292/'
[junit4:junit4] 2> 3593 T564 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363347122292/'
[junit4:junit4] 2> 3608 T564 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3609 T564 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3609 T564 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3609 T564 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3610 T564 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3610 T564 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3610 T564 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3611 T564 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3611 T564 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3611 T564 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3618 T564 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3626 T564 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33773/solr
[junit4:junit4] 2> 3626 T564 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3627 T564 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33773 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2d3fb0
[junit4:junit4] 2> 3627 T564 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3628 T603 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33773. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3628 T603 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33773, initiating session
[junit4:junit4] 2> 3628 T566 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47525
[junit4:junit4] 2> 3630 T566 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47525
[junit4:junit4] 2> 3630 T568 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6dd21aad0005 with negotiated timeout 20000 for client /127.0.0.1:47525
[junit4:junit4] 2> 3630 T603 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33773, sessionid = 0x13d6dd21aad0005, negotiated timeout = 20000
[junit4:junit4] 2> 3631 T604 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d3fb0 name:ZooKeeperConnection Watcher:127.0.0.1:33773 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3631 T564 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3632 T569 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6dd21aad0005
[junit4:junit4] 2> 3633 T604 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3633 T566 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47525 which had sessionid 0x13d6dd21aad0005
[junit4:junit4] 2> 3633 T564 oaz.ZooKeeper.close Session: 0x13d6dd21aad0005 closed
[junit4:junit4] 2> 3633 T564 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3636 T564 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33773/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@605c34
[junit4:junit4] 2> 3637 T564 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3637 T605 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33773. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3638 T605 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33773, initiating session
[junit4:junit4] 2> 3638 T566 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47526
[junit4:junit4] 2> 3638 T566 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47526
[junit4:junit4] 2> 3639 T568 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6dd21aad0006 with negotiated timeout 20000 for client /127.0.0.1:47526
[junit4:junit4] 2> 3639 T605 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33773, sessionid = 0x13d6dd21aad0006, negotiated timeout = 20000
[junit4:junit4] 2> 3639 T606 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@605c34 name:ZooKeeperConnection Watcher:127.0.0.1:33773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3639 T564 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3640 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3641 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3643 T564 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4645 T564 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52685_
[junit4:junit4] 2> 4646 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52685_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52685_
[junit4:junit4] 2> 4647 T564 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52685_
[junit4:junit4] 2> 4651 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4653 T606 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4653 T593 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4654 T586 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4659 T607 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363347122292/collection1
[junit4:junit4] 2> 4659 T607 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4660 T607 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4660 T607 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4661 T607 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363347122292/collection1/'
[junit4:junit4] 2> 4661 T607 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1363347122292/collection1/lib/README' to classloader
[junit4:junit4] 2> 4662 T607 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1363347122292/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4695 T607 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 4734 T607 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4735 T607 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4740 T607 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5006 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5007 T587 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:55456_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55456"}
[junit4:junit4] 2> 5028 T607 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5033 T607 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5036 T607 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5062 T606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5062 T593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5062 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5095 T607 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5101 T607 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5106 T607 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5107 T607 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5108 T607 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5108 T607 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5110 T607 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5110 T607 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5110 T607 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5111 T607 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363347122292/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty1/
[junit4:junit4] 2> 5111 T607 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28dfb2
[junit4:junit4] 2> 5112 T607 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5112 T607 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty1 forceNew: false
[junit4:junit4] 2> 5113 T607 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty1/index/
[junit4:junit4] 2> 5113 T607 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5114 T607 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty1/index forceNew: false
[junit4:junit4] 2> 5116 T607 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7785a1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@55d171),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5116 T607 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5119 T607 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5119 T607 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5120 T607 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5121 T607 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5122 T607 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5122 T607 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5122 T607 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5123 T607 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5124 T607 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5128 T607 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5132 T607 oass.SolrIndexSearcher.<init> Opening Searcher@5133d2 main
[junit4:junit4] 2> 5132 T607 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty1/tlog
[junit4:junit4] 2> 5133 T607 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5133 T607 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5137 T608 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5133d2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5140 T607 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5140 T607 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6585 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6586 T587 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52685_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52685"}
[junit4:junit4] 2> 6586 T587 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 6586 T587 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6671 T593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6671 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6671 T606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7162 T607 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7162 T607 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52685 collection:collection1 shard:shard1
[junit4:junit4] 2> 7163 T607 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7169 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7169 T607 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7170 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7171 T607 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7171 T607 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7171 T607 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52685/collection1/
[junit4:junit4] 2> 7172 T607 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7172 T607 oasc.SyncStrategy.syncToMe http://127.0.0.1:52685/collection1/ has no replicas
[junit4:junit4] 2> 7172 T607 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52685/collection1/
[junit4:junit4] 2> 7172 T607 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7175 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8177 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8186 T593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8186 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8186 T606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8229 T607 oasc.ZkController.register We are http://127.0.0.1:52685/collection1/ and leader is http://127.0.0.1:52685/collection1/
[junit4:junit4] 2> 8229 T607 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52685
[junit4:junit4] 2> 8229 T607 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8230 T607 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8230 T607 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8231 T607 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8232 T564 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 8233 T564 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8233 T564 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8300 T564 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8302 T564 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60464
[junit4:junit4] 2> 8303 T564 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8303 T564 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8304 T564 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363347126994
[junit4:junit4] 2> 8304 T564 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363347126994/solr.xml
[junit4:junit4] 2> 8304 T564 oasc.CoreContainer.<init> New CoreContainer 4394265
[junit4:junit4] 2> 8304 T564 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363347126994/'
[junit4:junit4] 2> 8305 T564 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363347126994/'
[junit4:junit4] 2> 8320 T564 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8320 T564 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8321 T564 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8321 T564 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8321 T564 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8322 T564 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8322 T564 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8322 T564 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8322 T564 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8323 T564 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8328 T564 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8336 T564 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:33773/solr
[junit4:junit4] 2> 8336 T564 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8337 T564 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33773 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@b21adc
[junit4:junit4] 2> 8337 T564 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8338 T619 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33773. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8338 T619 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33773, initiating session
[junit4:junit4] 2> 8338 T566 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47527
[junit4:junit4] 2> 8338 T566 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47527
[junit4:junit4] 2> 8339 T568 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6dd21aad0007 with negotiated timeout 20000 for client /127.0.0.1:47527
[junit4:junit4] 2> 8339 T619 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33773, sessionid = 0x13d6dd21aad0007, negotiated timeout = 20000
[junit4:junit4] 2> 8339 T620 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b21adc name:ZooKeeperConnection Watcher:127.0.0.1:33773 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8340 T564 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8341 T569 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6dd21aad0007
[junit4:junit4] 2> 8341 T566 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47527 which had sessionid 0x13d6dd21aad0007
[junit4:junit4] 2> 8341 T564 oaz.ZooKeeper.close Session: 0x13d6dd21aad0007 closed
[junit4:junit4] 2> 8341 T620 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8342 T564 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8345 T564 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33773/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@c6986b
[junit4:junit4] 2> 8346 T621 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33773. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8346 T564 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8346 T621 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33773, initiating session
[junit4:junit4] 2> 8346 T566 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:47528
[junit4:junit4] 2> 8346 T566 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:47528
[junit4:junit4] 2> 8347 T568 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6dd21aad0008 with negotiated timeout 20000 for client /127.0.0.1:47528
[junit4:junit4] 2> 8347 T621 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33773, sessionid = 0x13d6dd21aad0008, negotiated timeout = 20000
[junit4:junit4] 2> 8347 T622 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c6986b name:ZooKeeperConnection Watcher:127.0.0.1:33773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8348 T564 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8349 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8349 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8351 T564 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9353 T564 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60464_
[junit4:junit4] 2> 9354 T569 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6dd21aad0008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60464_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60464_
[junit4:junit4] 2> 9355 T564 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60464_
[junit4:junit4] 2> 9356 T606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9357 T593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9357 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9358 T622 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9359 T606 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9359 T593 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9359 T586 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9376 T623 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363347126994/collection1
[junit4:junit4] 2> 9376 T623 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9377 T623 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9377 T623 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9378 T623 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363347126994/collection1/'
[junit4:junit4] 2> 9378 T623 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1363347126994/collection1/lib/README' to classloader
[junit4:junit4] 2> 9378 T623 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1363347126994/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9399 T623 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 9429 T623 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9430 T623 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9433 T623 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9692 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9693 T587 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52685_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52685"}
[junit4:junit4] 2> 9696 T606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9696 T622 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9696 T593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9697 T623 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9697 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9702 T623 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9704 T623 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9717 T623 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9720 T623 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9722 T623 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9723 T623 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9723 T623 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9723 T623 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9724 T623 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9724 T623 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9725 T623 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9725 T623 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363347126994/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/
[junit4:junit4] 2> 9725 T623 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28dfb2
[junit4:junit4] 2> 9725 T623 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9726 T623 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2 forceNew: false
[junit4:junit4] 2> 9726 T623 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/index/
[junit4:junit4] 2> 9726 T623 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9726 T623 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/index forceNew: false
[junit4:junit4] 2> 9727 T623 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@15fecea lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ba240),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9728 T623 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9729 T623 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9729 T623 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9729 T623 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9730 T623 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9730 T623 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9730 T623 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9731 T623 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9731 T623 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9731 T623 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9733 T623 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9735 T623 oass.SolrIndexSearcher.<init> Opening Searcher@baacda main
[junit4:junit4] 2> 9735 T623 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/tlog
[junit4:junit4] 2> 9736 T623 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9736 T623 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9739 T624 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@baacda main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9740 T623 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9740 T623 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11201 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11201 T587 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60464_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60464"}
[junit4:junit4] 2> 11202 T587 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 11202 T587 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11211 T593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11211 T606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11211 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11211 T622 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11742 T623 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11742 T623 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60464 collection:collection1 shard:shard1
[junit4:junit4] 2> 11746 T623 oasc.ZkController.register We are http://127.0.0.1:60464/collection1/ and leader is http://127.0.0.1:52685/collection1/
[junit4:junit4] 2> 11746 T623 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60464
[junit4:junit4] 2> 11746 T623 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 11747 T623 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C38 name=collection1 org.apache.solr.core.SolrCore@10c4920 url=http://127.0.0.1:60464/collection1 node=127.0.0.1:60464_ C38_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:60464_, base_url=http://127.0.0.1:60464}
[junit4:junit4] 2> 11750 T625 C38 P60464 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 11751 T625 C38 P60464 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 11751 T623 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11751 T625 C38 P60464 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 11751 T625 C38 P60464 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11752 T564 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 11753 T625 C38 P60464 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11753 T564 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 11753 T564 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11758 T564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C39 name=collection1 org.apache.solr.core.SolrCore@19c293d url=http://127.0.0.1:55456/collection1 node=127.0.0.1:55456_ C39_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:55456_, base_url=http://127.0.0.1:55456, leader=true}
[junit4:junit4] 2> 11770 T580 C39 P55456 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1325022 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10ad780),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 11771 T580 C39 P55456 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 11774 T581 C39 P55456 /update {wt=javabin&version=2} {add=[1 (1429573080738430977)]} 0 9
[junit4:junit4] 2> 11774 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10001 (1429573080738430976)]} 0 9
[junit4:junit4] 2> ASYNC NEW_CORE C40 name=collection1 org.apache.solr.core.SolrCore@10774fe url=http://127.0.0.1:52685/collection1 node=127.0.0.1:52685_ C40_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52685_, base_url=http://127.0.0.1:52685, leader=true}
[junit4:junit4] 2> 11784 T599 C40 P52685 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7785a1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@55d171),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 11784 T599 C40 P52685 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 11787 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10001 (1429573080753111040)]} 0 4
[junit4:junit4] 2> 11787 T600 C40 P52685 /update {wt=javabin&version=2} {add=[1 (1429573080753111041)]} 0 4
[junit4:junit4] 2> 11877 T582 C39 P55456 /update {wt=javabin&version=2} {add=[2 (1429573080850628609)]} 0 2
[junit4:junit4] 2> 11877 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10002 (1429573080850628608)]} 0 2
[junit4:junit4] 2> 11881 T601 C40 P52685 /update {wt=javabin&version=2} {add=[2 (1429573080854822912)]} 0 2
[junit4:junit4] 2> 11881 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10002 (1429573080854822913)]} 0 1
[junit4:junit4] 2> 11956 T580 C39 P55456 /update {wt=javabin&version=2} {add=[3 (1429573080934514688)]} 0 1
[junit4:junit4] 2> 11957 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10003 (1429573080934514689)]} 0 2
[junit4:junit4] 2> 11960 T600 C40 P52685 /update {wt=javabin&version=2} {add=[3 (1429573080937660416)]} 0 1
[junit4:junit4] 2> 11960 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10003 (1429573080937660417)]} 0 1
[junit4:junit4] 2> 12013 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10004 (1429573080993234945)]} 0 1
[junit4:junit4] 2> 12014 T582 C39 P55456 /update {wt=javabin&version=2} {add=[4 (1429573080993234944)]} 0 2
[junit4:junit4] 2> 12017 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10004 (1429573080997429248)]} 0 1
[junit4:junit4] 2> 12017 T601 C40 P52685 /update {wt=javabin&version=2} {add=[4 (1429573080997429249)]} 0 1
[junit4:junit4] 2> 12063 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10005 (1429573081045663744)]} 0 1
[junit4:junit4] 2> 12064 T581 C39 P55456 /update {wt=javabin&version=2} {add=[5 (1429573081045663745)]} 0 2
[junit4:junit4] 2> 12067 T600 C40 P52685 /update {wt=javabin&version=2} {add=[10005 (1429573081049858048)]} 0 1
[junit4:junit4] 2> 12067 T599 C40 P52685 /update {wt=javabin&version=2} {add=[5 (1429573081049858049)]} 0 1
[junit4:junit4] 2> 12165 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[3 (-1429573081153667073)]} 0 0
[junit4:junit4] 2> 12165 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[10003 (-1429573081153667072)]} 0 0
[junit4:junit4] 2> 12168 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[3 (-1429573081156812800)]} 0 0
[junit4:junit4] 2> 12168 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[10003 (-1429573081156812801)]} 0 0
[junit4:junit4] 2> 12172 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10006 (1429573081159958529)]} 0 2
[junit4:junit4] 2> 12172 T580 C39 P55456 /update {wt=javabin&version=2} {add=[6 (1429573081159958528)]} 0 2
[junit4:junit4] 2> 12175 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10006 (1429573081163104256)]} 0 1
[junit4:junit4] 2> 12175 T600 C40 P52685 /update {wt=javabin&version=2} {add=[6 (1429573081163104257)]} 0 1
[junit4:junit4] 2> 12251 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[4 (-1429573081242796032)]} 0 1
[junit4:junit4] 2> 12251 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[10004 (-1429573081242796033)]} 0 1
[junit4:junit4] 2> 12253 T599 C40 P52685 /update {wt=javabin&version=2} {delete=[10004 (-1429573081245941761)]} 0 0
[junit4:junit4] 2> 12253 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[4 (-1429573081245941760)]} 0 0
[junit4:junit4] 2> 12256 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10007 (1429573081249087488)]} 0 1
[junit4:junit4] 2> 12257 T580 C39 P55456 /update {wt=javabin&version=2} {add=[7 (1429573081249087489)]} 0 2
[junit4:junit4] 2> 12260 T600 C40 P52685 /update {wt=javabin&version=2} {add=[10007 (1429573081252233216)]} 0 1
[junit4:junit4] 2> 12260 T599 C40 P52685 /update {wt=javabin&version=2} {add=[7 (1429573081252233217)]} 0 1
[junit4:junit4] 2> 12329 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[5 (-1429573081324584960)]} 0 1
[junit4:junit4] 2> 12329 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[10005 (-1429573081325633536)]} 0 1
[junit4:junit4] 2> 12332 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[10005 (-1429573081328779264)]} 0 0
[junit4:junit4] 2> 12332 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[5 (-1429573081328779265)]} 0 0
[junit4:junit4] 2> 12335 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10008 (1429573081330876416)]} 0 1
[junit4:junit4] 2> 12336 T580 C39 P55456 /update {wt=javabin&version=2} {add=[8 (1429573081330876417)]} 0 2
[junit4:junit4] 2> 12338 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10008 (1429573081335070720)]} 0 0
[junit4:junit4] 2> 12339 T600 C40 P52685 /update {wt=javabin&version=2} {add=[8 (1429573081335070721)]} 0 1
[junit4:junit4] 2> 12360 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10009 (1429573081357090816)]} 0 1
[junit4:junit4] 2> 12361 T582 C39 P55456 /update {wt=javabin&version=2} {add=[9 (1429573081357090817)]} 0 2
[junit4:junit4] 2> 12363 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10009 (1429573081361285120)]} 0 1
[junit4:junit4] 2> 12364 T599 C40 P52685 /update {wt=javabin&version=2} {add=[9 (1429573081361285121)]} 0 1
[junit4:junit4] 2> 12465 T581 C39 P55456 /update {wt=javabin&version=2} {delete=[10006 (-1429573081468239872)]} 0 0
[junit4:junit4] 2> 12465 T580 C39 P55456 /update {wt=javabin&version=2} {delete=[6 (-1429573081468239873)]} 0 0
[junit4:junit4] 2> 12468 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[10006 (-1429573081471385600)]} 0 0
[junit4:junit4] 2> 12468 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[6 (-1429573081471385601)]} 0 0
[junit4:junit4] 2> 12472 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10010 (1429573081474531328)]} 0 2
[junit4:junit4] 2> 12472 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10 (1429573081474531329)]} 0 2
[junit4:junit4] 2> 12475 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10010 (1429573081477677056)]} 0 1
[junit4:junit4] 2> 12475 T600 C40 P52685 /update {wt=javabin&version=2} {add=[10 (1429573081477677057)]} 0 1
[junit4:junit4] 2> 12510 T581 C39 P55456 /update {wt=javabin&version=2} {add=[11 (1429573081515425792)]} 0 1
[junit4:junit4] 2> 12511 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10011 (1429573081515425793)]} 0 2
[junit4:junit4] 2> 12514 T601 C40 P52685 /update {wt=javabin&version=2} {add=[11 (1429573081518571520)]} 0 1
[junit4:junit4] 2> 12514 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10011 (1429573081518571521)]} 0 1
[junit4:junit4] 2> 12602 T581 C39 P55456 /update {wt=javabin&version=2} {delete=[10007 (-1429573081611894784)]} 0 0
[junit4:junit4] 2> 12602 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[7 (-1429573081611894785)]} 0 0
[junit4:junit4] 2> 12605 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[7 (-1429573081615040512)]} 0 1
[junit4:junit4] 2> 12605 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[10007 (-1429573081615040513)]} 0 1
[junit4:junit4] 2> 12608 T582 C39 P55456 /update {wt=javabin&version=2} {add=[12 (1429573081617137664)]} 0 1
[junit4:junit4] 2> 12608 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10012 (1429573081617137665)]} 0 1
[junit4:junit4] 2> 12611 T599 C40 P52685 /update {wt=javabin&version=2} {add=[12 (1429573081621331968)]} 0 1
[junit4:junit4] 2> 12612 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10012 (1429573081621331969)]} 0 2
[junit4:junit4] 2> 12691 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10013 (1429573081705218048)]} 0 1
[junit4:junit4] 2> 12692 T579 C39 P55456 /update {wt=javabin&version=2} {add=[13 (1429573081705218049)]} 0 2
[junit4:junit4] 2> 12695 T600 C40 P52685 /update {wt=javabin&version=2} {add=[10013 (1429573081708363776)]} 0 1
[junit4:junit4] 2> 12695 T599 C40 P52685 /update {wt=javabin&version=2} {add=[13 (1429573081708363777)]} 0 1
[junit4:junit4] 2> 12716 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12717 T587 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60464_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60464"}
[junit4:junit4] 2> 12720 T606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12720 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12720 T622 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12720 T593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12762 T602 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=3&state=recovering&nodeName=127.0.0.1:60464_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 12794 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[10008 (-1429573081813221377)]} 0 0
[junit4:junit4] 2> 12794 T580 C39 P55456 /update {wt=javabin&version=2} {delete=[8 (-1429573081813221376)]} 0 0
[junit4:junit4] 2> C38_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:60464_, base_url=http://127.0.0.1:60464}
[junit4:junit4] 2> 12824 T615 C38 P60464 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@15fecea lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ba240),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 12824 T615 C38 P60464 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 12825 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[8 (-1429573081818464257)]} 0 3
[junit4:junit4] 2> 12826 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10008 (-1429573081818464256)]} 0 3
[junit4:junit4] 2> 12826 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[8 (-1429573081818464257)]} 0 29
[junit4:junit4] 2> 12827 T599 C40 P52685 /update {wt=javabin&version=2} {delete=[10008 (-1429573081818464256)]} 0 30
[junit4:junit4] 2> 12830 T581 C39 P55456 /update {wt=javabin&version=2} {add=[14 (1429573081849921536)]} 0 1
[junit4:junit4] 2> 12831 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10014 (1429573081849921537)]} 0 2
[junit4:junit4] 2> 12840 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10014 (1429573081855164417)]} 0 2
[junit4:junit4] 2> 12841 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1429573081855164416)]} 0 2
[junit4:junit4] 2> 12841 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10014 (1429573081855164417)]} 0 8
[junit4:junit4] 2> 12841 T602 C40 P52685 /update {wt=javabin&version=2} {add=[14 (1429573081855164416)]} 0 8
[junit4:junit4] 2> 12935 T582 C39 P55456 /update {wt=javabin&version=2} {add=[15 (1429573081960022016)]} 0 1
[junit4:junit4] 2> 12935 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10015 (1429573081960022017)]} 0 1
[junit4:junit4] 2> 12941 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1429573081964216320)]} 0 1
[junit4:junit4] 2> 12942 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10015 (1429573081964216321)]} 0 2
[junit4:junit4] 2> 12942 T600 C40 P52685 /update {wt=javabin&version=2} {add=[15 (1429573081964216320)]} 0 5
[junit4:junit4] 2> 12943 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10015 (1429573081964216321)]} 0 5
[junit4:junit4] 2> 12995 T581 C39 P55456 /update {wt=javabin&version=2} {add=[16 (1429573082022936577)]} 0 1
[junit4:junit4] 2> 12996 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10016 (1429573082022936576)]} 0 2
[junit4:junit4] 2> 13001 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1429573082027130880)]} 0 1
[junit4:junit4] 2> 13002 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10016 (1429573082027130881)]} 0 1
[junit4:junit4] 2> 13002 T602 C40 P52685 /update {wt=javabin&version=2} {add=[16 (1429573082027130880)]} 0 5
[junit4:junit4] 2> 13002 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10016 (1429573082027130881)]} 0 4
[junit4:junit4] 2> 13095 T582 C39 P55456 /update {wt=javabin&version=2} {add=[17 (1429573082127794176)]} 0 1
[junit4:junit4] 2> 13095 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10017 (1429573082127794177)]} 0 1
[junit4:junit4] 2> 13101 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1429573082130939904)]} 0 1
[junit4:junit4] 2> 13101 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10017 (1429573082131988480)]} 0 1
[junit4:junit4] 2> 13102 T600 C40 P52685 /update {wt=javabin&version=2} {add=[17 (1429573082130939904)]} 0 5
[junit4:junit4] 2> 13102 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10017 (1429573082131988480)]} 0 4
[junit4:junit4] 2> 13131 T581 C39 P55456 /update {wt=javabin&version=2} {add=[18 (1429573082165542912)]} 0 1
[junit4:junit4] 2> 13132 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10018 (1429573082165542913)]} 0 2
[junit4:junit4] 2> 13137 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10018 (1429573082169737217)]} 0 1
[junit4:junit4] 2> 13138 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10018 (1429573082169737217)]} 0 4
[junit4:junit4] 2> 13138 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1429573082169737216)]} 0 1
[junit4:junit4] 2> 13138 T599 C40 P52685 /update {wt=javabin&version=2} {add=[18 (1429573082169737216)]} 0 4
[junit4:junit4] 2> 13209 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[10017 (-1429573082248380416)]} 0 1
[junit4:junit4] 2> 13209 T580 C39 P55456 /update {wt=javabin&version=2} {delete=[17 (-1429573082248380417)]} 0 0
[junit4:junit4] 2> 13215 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[17 (-1429573082251526145)]} 0 1
[junit4:junit4] 2> 13215 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10017 (-1429573082251526144)]} 0 1
[junit4:junit4] 2> 13216 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[10017 (-1429573082251526144)]} 0 4
[junit4:junit4] 2> 13216 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[17 (-1429573082251526145)]} 0 4
[junit4:junit4] 2> 13219 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10019 (1429573082257817600)]} 0 1
[junit4:junit4] 2> 13220 T579 C39 P55456 /update {wt=javabin&version=2} {add=[19 (1429573082257817601)]} 0 2
[junit4:junit4] 2> 13225 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10019 (1429573082262011904)]} 0 1
[junit4:junit4] 2> 13226 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10019 (1429573082262011904)]} 0 5
[junit4:junit4] 2> 13226 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1429573082262011905)]} 0 1
[junit4:junit4] 2> 13226 T599 C40 P52685 /update {wt=javabin&version=2} {add=[19 (1429573082262011905)]} 0 4
[junit4:junit4] 2> 13257 T580 C39 P55456 /update {wt=javabin&version=2} {delete=[18 (-1429573082297663489)]} 0 1
[junit4:junit4] 2> 13257 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[10018 (-1429573082297663488)]} 0 1
[junit4:junit4] 2> 13261 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10018 (-1429573082300809217)]} 0 0
[junit4:junit4] 2> 13261 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[18 (-1429573082300809216)]} 0 0
[junit4:junit4] 2> 13262 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[10018 (-1429573082300809217)]} 0 3
[junit4:junit4] 2> 13262 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[18 (-1429573082300809216)]} 0 3
[junit4:junit4] 2> 13265 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10020 (1429573082306052096)]} 0 1
[junit4:junit4] 2> 13266 T579 C39 P55456 /update {wt=javabin&version=2} {add=[20 (1429573082307100672)]} 0 2
[junit4:junit4] 2> 13271 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10020 (1429573082310246400)]} 0 1
[junit4:junit4] 2> 13272 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1429573082310246401)]} 0 1
[junit4:junit4] 2> 13272 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10020 (1429573082310246400)]} 0 5
[junit4:junit4] 2> 13272 T599 C40 P52685 /update {wt=javabin&version=2} {add=[20 (1429573082310246401)]} 0 4
[junit4:junit4] 2> 13281 T580 C39 P55456 /update {wt=javabin&version=2} {add=[21 (1429573082322829313)]} 0 1
[junit4:junit4] 2> 13281 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10021 (1429573082322829312)]} 0 1
[junit4:junit4] 2> 13287 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1429573082327023616)]} 0 1
[junit4:junit4] 2> 13288 T600 C40 P52685 /update {wt=javabin&version=2} {add=[21 (1429573082327023616)]} 0 5
[junit4:junit4] 2> 13288 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10021 (1429573082327023617)]} 0 2
[junit4:junit4] 2> 13289 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10021 (1429573082327023617)]} 0 5
[junit4:junit4] 2> 13334 T581 C39 P55456 /update {wt=javabin&version=2} {add=[22 (1429573082378403840)]} 0 1
[junit4:junit4] 2> 13334 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10022 (1429573082378403841)]} 0 1
[junit4:junit4] 2> 13340 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1429573082382598144)]} 0 1
[junit4:junit4] 2> 13341 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10022 (1429573082382598145)]} 0 1
[junit4:junit4] 2> 13341 T602 C40 P52685 /update {wt=javabin&version=2} {add=[22 (1429573082382598144)]} 0 5
[junit4:junit4] 2> 13341 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10022 (1429573082382598145)]} 0 4
[junit4:junit4] 2> 13385 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[10021 (-1429573082432929792)]} 0 0
[junit4:junit4] 2> 13385 T580 C39 P55456 /update {wt=javabin&version=2} {delete=[21 (-1429573082432929793)]} 0 0
[junit4:junit4] 2> 13390 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10021 (-1429573082435026944)]} 0 0
[junit4:junit4] 2> 13390 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[21 (-1429573082436075520)]} 0 0
[junit4:junit4] 2> 13391 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[10021 (-1429573082435026944)]} 0 4
[junit4:junit4] 2> 13391 T602 C40 P52685 /update {wt=javabin&version=2} {delete=[21 (-1429573082436075520)]} 0 3
[junit4:junit4] 2> 13394 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10023 (1429573082441318400)]} 0 1
[junit4:junit4] 2> 13395 T579 C39 P55456 /update {wt=javabin&version=2} {add=[23 (1429573082442366976)]} 0 2
[junit4:junit4] 2> 13401 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1429573082445512705)]} 0 1
[junit4:junit4] 2> 13401 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10023 (1429573082445512704)]} 0 1
[junit4:junit4] 2> 13402 T600 C40 P52685 /update {wt=javabin&version=2} {add=[23 (1429573082445512705)]} 0 5
[junit4:junit4] 2> 13402 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10023 (1429573082445512704)]} 0 5
[junit4:junit4] 2> 13502 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10024 (1429573082555613184)]} 0 1
[junit4:junit4] 2> 13503 T582 C39 P55456 /update {wt=javabin&version=2} {add=[24 (1429573082555613185)]} 0 2
[junit4:junit4] 2> 13510 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10024 (1429573082558758912)]} 0 2
[junit4:junit4] 2> 13510 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1429573082558758913)]} 0 1
[junit4:junit4] 2> 13511 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10024 (1429573082558758912)]} 0 6
[junit4:junit4] 2> 13511 T601 C40 P52685 /update {wt=javabin&version=2} {add=[24 (1429573082558758913)]} 0 6
[junit4:junit4] 2> 13516 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10025 (1429573082569244672)]} 0 1
[junit4:junit4] 2> 13516 T579 C39 P55456 /update {wt=javabin&version=2} {add=[25 (1429573082569244673)]} 0 1
[junit4:junit4] 2> 13523 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10025 (1429573082572390400)]} 0 2
[junit4:junit4] 2> 13523 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10025 (1429573082572390400)]} 0 5
[junit4:junit4] 2> 13524 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1429573082574487552)]} 0 1
[junit4:junit4] 2> 13525 T600 C40 P52685 /update {wt=javabin&version=2} {add=[25 (1429573082574487552)]} 0 5
[junit4:junit4] 2> 13547 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10026 (1429573082601750528)]} 0 2
[junit4:junit4] 2> 13548 T582 C39 P55456 /update {wt=javabin&version=2} {add=[26 (1429573082602799104)]} 0 1
[junit4:junit4] 2> 13555 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10026 (1429573082606993408)]} 0 2
[junit4:junit4] 2> 13556 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1429573082606993409)]} 0 2
[junit4:junit4] 2> 13556 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10026 (1429573082606993408)]} 0 6
[junit4:junit4] 2> 13556 T601 C40 P52685 /update {wt=javabin&version=2} {add=[26 (1429573082606993409)]} 0 6
[junit4:junit4] 2> 13625 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10027 (1429573082683539456)]} 0 1
[junit4:junit4] 2> 13626 T579 C39 P55456 /update {wt=javabin&version=2} {add=[27 (1429573082683539457)]} 0 2
[junit4:junit4] 2> 13632 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1429573082687733761)]} 0 1
[junit4:junit4] 2> 13633 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10027 (1429573082687733760)]} 0 2
[junit4:junit4] 2> 13633 T600 C40 P52685 /update {wt=javabin&version=2} {add=[27 (1429573082687733761)]} 0 5
[junit4:junit4] 2> 13633 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10027 (1429573082687733760)]} 0 5
[junit4:junit4] 2> 13650 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10028 (1429573082709753856)]} 0 1
[junit4:junit4] 2> 13650 T580 C39 P55456 /update {wt=javabin&version=2} {add=[28 (1429573082709753857)]} 0 1
[junit4:junit4] 2> 13657 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10028 (1429573082713948160)]} 0 2
[junit4:junit4] 2> 13657 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1429573082713948161)]} 0 1
[junit4:junit4] 2> 13657 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10028 (1429573082713948160)]} 0 5
[junit4:junit4] 2> 13658 T601 C40 P52685 /update {wt=javabin&version=2} {add=[28 (1429573082713948161)]} 0 6
[junit4:junit4] 2> 13704 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10029 (1429573082767425536)]} 0 1
[junit4:junit4] 2> 13705 T579 C39 P55456 /update {wt=javabin&version=2} {add=[29 (1429573082767425537)]} 0 2
[junit4:junit4] 2> 13711 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10029 (1429573082770571265)]} 0 1
[junit4:junit4] 2> 13711 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1429573082770571264)]} 0 1
[junit4:junit4] 2> 13712 T600 C40 P52685 /update {wt=javabin&version=2} {add=[10029 (1429573082770571265)]} 0 5
[junit4:junit4] 2> 13712 T599 C40 P52685 /update {wt=javabin&version=2} {add=[29 (1429573082770571264)]} 0 5
[junit4:junit4] 2> 13761 T564 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 60464
[junit4:junit4] 2> 13761 T564 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=4394265
[junit4:junit4] 2> 13809 T580 C39 P55456 /update {wt=javabin&version=2} {add=[30 (1429573082876477440)]} 0 1
[junit4:junit4] 2> 13810 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10030 (1429573082877526016)]} 0 2
[junit4:junit4] 2> 13816 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1429573082880671744)]} 0 1
[junit4:junit4] 2> 13816 T602 C40 P52685 /update {wt=javabin&version=2} {add=[30 (1429573082880671744)]} 0 4
[junit4:junit4] 2> 13816 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10030 (1429573082881720320)]} 0 1
[junit4:junit4] 2> 13817 T600 C40 P52685 /update {wt=javabin&version=2} {add=[10030 (1429573082881720320)]} 0 5
[junit4:junit4] 2> 13823 T581 C39 P55456 /update {wt=javabin&version=2} {delete=[22 (-1429573082892206080)]} 0 0
[junit4:junit4] 2> 13823 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[10022 (-1429573082892206081)]} 0 0
[junit4:junit4] 2> 13828 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[22 (-1429573082894303232)]} 0 1
[junit4:junit4] 2> 13828 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10022 (-1429573082895351808)]} 0 0
[junit4:junit4] 2> 13828 T599 C40 P52685 /update {wt=javabin&version=2} {delete=[22 (-1429573082894303232)]} 0 3
[junit4:junit4] 2> 13829 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[10022 (-1429573082895351808)]} 0 3
[junit4:junit4] 2> 13831 T580 C39 P55456 /update {wt=javabin&version=2} {add=[31 (1429573082900594688)]} 0 1
[junit4:junit4] 2> 13832 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10031 (1429573082900594689)]} 0 1
[junit4:junit4] 2> 13838 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1429573082903740416)]} 0 2
[junit4:junit4] 2> 13838 T602 C40 P52685 /update {wt=javabin&version=2} {add=[31 (1429573082903740416)]} 0 4
[junit4:junit4] 2> 13844 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10031 (1429573082903740417)]} 0 2
[junit4:junit4] 2> 13845 T600 C40 P52685 /update {wt=javabin&version=2} {add=[10031 (1429573082903740417)]} 0 11
[junit4:junit4] 2> 13928 T581 C39 P55456 /update {wt=javabin&version=2} {add=[32 (1429573083002306560)]} 0 1
[junit4:junit4] 2> 13934 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10032 (1429573083007549440)]} 0 1
[junit4:junit4] 2> 13935 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1429573083006500864)]} 0 0
[junit4:junit4] 2> 13936 T599 C40 P52685 /update {wt=javabin&version=2} {add=[32 (1429573083006500864)]} 0 5
[junit4:junit4] 2> 13940 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10032 (1429573083010695168)]} 0 1
[junit4:junit4] 2> 13941 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10032 (1429573083010695168)]} 0 5
[junit4:junit4] 2> 13952 T582 C39 P55456 /update {wt=javabin&version=2} {add=[33 (1429573083026423808)]} 0 1
[junit4:junit4] 2> 13957 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10033 (1429573083031666688)]} 0 1
[junit4:junit4] 2> 13959 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1429573083030618112)]} 0 1
[junit4:junit4] 2> 13960 T600 C40 P52685 /update {wt=javabin&version=2} {add=[33 (1429573083030618112)]} 0 5
[junit4:junit4] 2> 13964 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10033 (1429573083035860992)]} 0 1
[junit4:junit4] 2> 13965 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10033 (1429573083035860992)]} 0 5
[junit4:junit4] 2> 14041 T581 C39 P55456 /update {wt=javabin&version=2} {delete=[26 (-1429573083120795648)]} 0 0
[junit4:junit4] 2> 14046 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[26 (-1429573083123941376)]} 0 0
[junit4:junit4] 2> 14046 T580 C39 P55456 /update {wt=javabin&version=2} {delete=[10026 (-1429573083126038528)]} 0 0
[junit4:junit4] 2> 14047 T599 C40 P52685 /update {wt=javabin&version=2} {delete=[26 (-1429573083123941376)]} 0 3
[junit4:junit4] 2> 14050 T582 C39 P55456 /update {wt=javabin&version=2} {add=[34 (1429573083129184256)]} 0 1
[junit4:junit4] 2> 14051 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10026 (-1429573083129184256)]} 0 0
[junit4:junit4] 2> 14052 T602 C40 P52685 /update {wt=javabin&version=2} {delete=[10026 (-1429573083129184256)]} 0 3
[junit4:junit4] 2> 14055 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10034 (1429573083134427136)]} 0 1
[junit4:junit4] 2> 14056 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1429573083133378560)]} 0 1
[junit4:junit4] 2> 14056 T600 C40 P52685 /update {wt=javabin&version=2} {add=[34 (1429573083133378560)]} 0 4
[junit4:junit4] 2> 14062 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10034 (1429573083138621440)]} 0 1
[junit4:junit4] 2> 14063 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10034 (1429573083138621440)]} 0 5
[junit4:junit4] 2> 14139 T581 C39 P55456 /update {wt=javabin&version=2} {add=[35 (1429573083222507520)]} 0 1
[junit4:junit4] 2> 14145 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1429573083226701824)]} 0 1
[junit4:junit4] 2> 14145 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10035 (1429573083229847552)]} 0 1
[junit4:junit4] 2> 14146 T599 C40 P52685 /update {wt=javabin&version=2} {add=[35 (1429573083226701824)]} 0 4
[junit4:junit4] 2> 14150 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[28 (-1429573083235090432)]} 0 1
[junit4:junit4] 2> 14152 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10035 (1429573083232993280)]} 0 1
[junit4:junit4] 2> 14153 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10035 (1429573083232993280)]} 0 5
[junit4:junit4] 2> 14155 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[28 (-1429573083237187584)]} 0 1
[junit4:junit4] 2> 14155 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[28 (-1429573083237187584)]} 0 3
[junit4:junit4] 2> 14157 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[10028 (-1429573083242430464)]} 0 1
[junit4:junit4] 2> 14158 T581 C39 P55456 /update {wt=javabin&version=2} {add=[36 (1429573083243479040)]} 0 0
[junit4:junit4] 2> 14161 T615 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10028 (-1429573083244527616)]} 0 0
[junit4:junit4] 2> 14162 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[10028 (-1429573083244527616)]} 0 3
[junit4:junit4] 2> 14164 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1429573083246624768)]} 0 0
[junit4:junit4] 2> 14165 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10036 (1429573083249770496)]} 0 1
[junit4:junit4] 2> 14165 T599 C40 P52685 /update {wt=javabin&version=2} {add=[36 (1429573083246624768)]} 0 5
[junit4:junit4] 2> 14171 T618 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10036 (1429573083252916224)]} 0 1
[junit4:junit4] 2> 14172 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10036 (1429573083252916224)]} 0 5
[junit4:junit4] 2> 14223 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14224 T587 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60464_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60464"}
[junit4:junit4] 2> 14228 T593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14228 T622 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14228 T606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14228 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14263 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[29 (-1429573083353579520)]} 0 0
[junit4:junit4] 2> 14266 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[29 (-1429573083356725248)]} 0 0
[junit4:junit4] 2> 14270 T581 C39 P55456 /update {wt=javabin&version=2} {delete=[10029 (-1429573083360919552)]} 0 1
[junit4:junit4] 2> 14270 T580 C39 P55456 /update {wt=javabin&version=2} {add=[37 (1429573083359870976)]} 0 1
[junit4:junit4] 2> 14273 T599 C40 P52685 /update {wt=javabin&version=2} {delete=[10029 (-1429573083364065280)]} 0 1
[junit4:junit4] 2> 14277 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10037 (1429573083367211008)]} 0 2
[junit4:junit4] 2> 14274 T602 C40 P52685 /update {wt=javabin&version=2} {add=[37 (1429573083364065281)]} 0 1
[junit4:junit4] 2> 14281 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10037 (1429573083371405312)]} 0 1
[junit4:junit4] 2> 14370 T579 C39 P55456 /update {wt=javabin&version=2} {add=[38 (1429573083464728576)]} 0 1
[junit4:junit4] 2> 14373 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10038 (1429573083468922880)]} 0 0
[junit4:junit4] 2> 14374 T600 C40 P52685 /update {wt=javabin&version=2} {add=[38 (1429573083468922880)]} 0 1
[junit4:junit4] 2> 14377 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10038 (1429573083472068608)]} 0 1
[junit4:junit4] 2> 14474 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[30 (-1429573083574829056)]} 0 0
[junit4:junit4] 2> 14477 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[10030 (-1429573083577974784)]} 0 1
[junit4:junit4] 2> 14477 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[30 (-1429573083577974784)]} 0 0
[junit4:junit4] 2> 14479 T599 C40 P52685 /update {wt=javabin&version=2} {delete=[10030 (-1429573083580071936)]} 0 0
[junit4:junit4] 2> 14480 T580 C39 P55456 /update {wt=javabin&version=2} {add=[39 (1429573083580071936)]} 0 1
[junit4:junit4] 2> 14482 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10039 (1429573083582169088)]} 0 1
[junit4:junit4] 2> 14483 T600 C40 P52685 /update {wt=javabin&version=2} {add=[39 (1429573083583217664)]} 0 1
[junit4:junit4] 2> 14484 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10039 (1429573083585314816)]} 0 0
[junit4:junit4] 2> 14586 T582 C39 P55456 /update {wt=javabin&version=2} {add=[40 (1429573083691220992)]} 0 1
[junit4:junit4] 2> 14587 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10040 (1429573083692269568)]} 0 1
[junit4:junit4] 2> 14589 T601 C40 P52685 /update {wt=javabin&version=2} {add=[40 (1429573083695415296)]} 0 1
[junit4:junit4] 2> 14591 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10040 (1429573083696463872)]} 0 1
[junit4:junit4] 2> 14615 T581 C39 P55456 /update {wt=javabin&version=2} {add=[41 (1429573083722678272)]} 0 1
[junit4:junit4] 2> 14616 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10041 (1429573083722678273)]} 0 1
[junit4:junit4] 2> 14618 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10041 (1429573083725824000)]} 0 0
[junit4:junit4] 2> 14619 T600 C40 P52685 /update {wt=javabin&version=2} {add=[41 (1429573083725824001)]} 0 1
[junit4:junit4] 2> 14628 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10042 (1429573083735261184)]} 0 1
[junit4:junit4] 2> 14628 T579 C39 P55456 /update {wt=javabin&version=2} {add=[42 (1429573083735261185)]} 0 1
[junit4:junit4] 2> 14631 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10042 (1429573083738406912)]} 0 1
[junit4:junit4] 2> 14632 T599 C40 P52685 /update {wt=javabin&version=2} {add=[42 (1429573083739455488)]} 0 2
[junit4:junit4] 2> 14671 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10043 (1429573083780349952)]} 0 1
[junit4:junit4] 2> 14672 T580 C39 P55456 /update {wt=javabin&version=2} {add=[43 (1429573083780349953)]} 0 2
[junit4:junit4] 2> 14675 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10043 (1429573083784544256)]} 0 1
[junit4:junit4] 2> 14675 T601 C40 P52685 /update {wt=javabin&version=2} {add=[43 (1429573083784544257)]} 0 1
[junit4:junit4] 2> 14682 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10044 (1429573083791884288)]} 0 1
[junit4:junit4] 2> 14682 T579 C39 P55456 /update {wt=javabin&version=2} {add=[44 (1429573083791884289)]} 0 1
[junit4:junit4] 2> 14686 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10044 (1429573083796078592)]} 0 1
[junit4:junit4] 2> 14686 T600 C40 P52685 /update {wt=javabin&version=2} {add=[44 (1429573083796078593)]} 0 1
[junit4:junit4] 2> C38_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:60464_, base_url=http://127.0.0.1:60464}
[junit4:junit4] 2> 14763 T625 C38 P60464 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52685/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 14767 T625 C38 P60464 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 14774 T625 C38 P60464 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60464 START replicas=[http://127.0.0.1:52685/collection1/] nUpdates=100
[junit4:junit4] 2> 14783 T625 C38 P60464 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 14783 T625 C38 P60464 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 14783 T601 C40 P52685 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=3
[junit4:junit4] 2> 14783 T625 C38 P60464 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 14783 T625 C38 P60464 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 14784 T625 C38 P60464 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=tlog{file=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/tlog/tlog.0000000000000000000 refcount=1}}
[junit4:junit4] 2> 14784 T625 C38 P60464 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52685/collection1/. core=collection1
[junit4:junit4] 2> 14784 T625 C38 P60464 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14787 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10045 (1429573083901984768)]} 0 1
[junit4:junit4] 2> 14788 T580 C39 P55456 /update {wt=javabin&version=2} {add=[45 (1429573083904081920)]} 0 0
[junit4:junit4] 2> 14791 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10045 (1429573083906179072)]} 0 1
[junit4:junit4] 2> 14792 T600 C40 P52685 /update {wt=javabin&version=2} {add=[45 (1429573083907227648)]} 0 1
[junit4:junit4] 2> 14793 T602 C40 P52685 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14828 T602 C40 P52685 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7785a1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@55d171),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7785a1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@55d171),segFN=segments_2,generation=2,filenames=[_1.doc, _1.nvm, _0.fnm, _1.nvd, _0_1.del, _1_1.del, _0.nvm, _1.fnm, _1.fdx, _1.fdt, _1.pos, _0.pos, _1.si, _0.nvd, _0.tim, segments_2, _0.fdx, _0.si, _1.tip, _0.tip, _0.doc, _1.tim, _0.fdt]
[junit4:junit4] 2> 14829 T602 C40 P52685 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_1.doc, _1.nvm, _0.fnm, _1.nvd, _0_1.del, _1_1.del, _0.nvm, _1.fnm, _1.fdx, _1.fdt, _1.pos, _0.pos, _1.si, _0.nvd, _0.tim, segments_2, _0.fdx, _0.si, _1.tip, _0.tip, _0.doc, _1.tim, _0.fdt]
[junit4:junit4] 2> 14832 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10046 (1429573083949170688)]} 0 1
[junit4:junit4] 2> 14833 T602 C40 P52685 oass.SolrIndexSearcher.<init> Opening Searcher@1fd8312 realtime
[junit4:junit4] 2> 14833 T602 C40 P52685 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14834 T602 C40 P52685 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 41
[junit4:junit4] 2> 14835 T582 C39 P55456 /update {wt=javabin&version=2} {add=[46 (1429573083953364992)]} 0 1
[junit4:junit4] 2> 14836 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10046 (1429573083953364992)]} 0 2
[junit4:junit4] 2> 14840 T599 C40 P52685 /update {wt=javabin&version=2} {add=[46 (1429573083958607872)]} 0 0
[junit4:junit4] 2> 14859 T625 C38 P60464 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 14859 T625 C38 P60464 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 14867 T625 C38 P60464 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 14869 T600 C40 P52685 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 14869 T600 C40 P52685 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 14870 T625 C38 P60464 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 14870 T625 C38 P60464 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 14871 T625 C38 P60464 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 14873 T601 C40 P52685 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 14874 T625 C38 P60464 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 23
[junit4:junit4] 2> 14875 T625 C38 P60464 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/index.20130315073213631 forceNew: false
[junit4:junit4] 2> 14875 T625 C38 P60464 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@aab251 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1778e41) fullCopy=true
[junit4:junit4] 2> 14881 T602 C40 P52685 REQ /replication {file=_1.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 14886 T599 C40 P52685 REQ /replication {file=_1.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14890 T600 C40 P52685 REQ /replication {file=_0.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 14893 T601 C40 P52685 REQ /replication {file=_1.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14896 T602 C40 P52685 REQ /replication {file=_0_1.del&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14899 T599 C40 P52685 REQ /replication {file=_0.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14930 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10047 (1429573084051931136)]} 0 1
[junit4:junit4] 2> 14933 T600 C40 P52685 /update {wt=javabin&version=2} {add=[10047 (1429573084055076864)]} 0 1
[junit4:junit4] 2> 14934 T580 C39 P55456 /update {wt=javabin&version=2} {add=[47 (1429573084056125440)]} 0 1
[junit4:junit4] 2> 14937 T601 C40 P52685 /update {wt=javabin&version=2} {add=[47 (1429573084059271168)]} 0 1
[junit4:junit4] 2> 14948 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[10031 (-1429573084071854080)]} 0 0
[junit4:junit4] 2> 14951 T602 C40 P52685 /update {wt=javabin&version=2} {delete=[10031 (-1429573084074999808)]} 0 1
[junit4:junit4] 2> 14951 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[31 (-1429573084074999808)]} 0 0
[junit4:junit4] 2> 14952 T600 C40 P52685 REQ /replication {file=_1_1.del&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14954 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10048 (1429573084077096960)]} 0 1
[junit4:junit4] 2> 14954 T601 C40 P52685 /update {wt=javabin&version=2} {delete=[31 (-1429573084078145536)]} 0 0
[junit4:junit4] 2> 14955 T599 C40 P52685 REQ /replication {file=_1.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14957 T580 C39 P55456 /update {wt=javabin&version=2} {add=[48 (1429573084081291264)]} 0 1
[junit4:junit4] 2> 14957 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10048 (1429573084081291264)]} 0 1
[junit4:junit4] 2> 14959 T600 C40 P52685 REQ /replication {file=_1.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 14961 T601 C40 P52685 /update {wt=javabin&version=2} {add=[48 (1429573084084436992)]} 0 1
[junit4:junit4] 2> 14962 T599 C40 P52685 REQ /replication {file=_0.pos&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 14964 T602 C40 P52685 REQ /replication {file=_1.pos&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14967 T600 C40 P52685 REQ /replication {file=_1.fdt&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14970 T601 C40 P52685 REQ /replication {file=_1.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14973 T599 C40 P52685 REQ /replication {file=_0.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14976 T602 C40 P52685 REQ /replication {file=_0.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14979 T600 C40 P52685 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14982 T601 C40 P52685 REQ /replication {file=_0.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14985 T599 C40 P52685 REQ /replication {file=_0.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14988 T602 C40 P52685 REQ /replication {file=_0.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14991 T600 C40 P52685 REQ /replication {file=_0.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14994 T601 C40 P52685 REQ /replication {file=_1.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 14996 T599 C40 P52685 REQ /replication {file=_0.fdt&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14999 T602 C40 P52685 REQ /replication {file=_1.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 15000 T625 C38 P60464 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 15001 T625 C38 P60464 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130315073213631
[junit4:junit4] 2> 15003 T625 C38 P60464 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 15003 T625 C38 P60464 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 15004 T625 C38 P60464 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 15005 T625 C38 P60464 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/index/ new=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/index.20130315073213631
[junit4:junit4] 2> 15006 T625 C38 P60464 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@aab251 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1778e41),segFN=segments_2,generation=2,filenames=[_1.doc, _1.nvm, _0.fnm, _1.nvd, _0_1.del, _1_1.del, _0.nvm, _1.fnm, _1.fdx, _1.pos, _1.fdt, _0.pos, _1.si, _0.tim, _0.nvd, segments_2, _0.fdx, _0.si, _1.tip, _0.doc, _0.tip, _1.tim, _0.fdt]
[junit4:junit4] 2> 15007 T625 C38 P60464 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_1.doc, _1.nvm, _0.fnm, _1.nvd, _0_1.del, _1_1.del, _0.nvm, _1.fnm, _1.fdx, _1.pos, _1.fdt, _0.pos, _1.si, _0.tim, _0.nvd, segments_2, _0.fdx, _0.si, _1.tip, _0.doc, _0.tip, _1.tim, _0.fdt]
[junit4:junit4] 2> 15008 T625 C38 P60464 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 15009 T625 C38 P60464 oass.SolrIndexSearcher.<init> Opening Searcher@ee01cc main
[junit4:junit4] 2> 15010 T624 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ee01cc main{StandardDirectoryReader(segments_2:5:nrt _0(4.3):C66/19 _1(4.3):C24/9)}
[junit4:junit4] 2> 15011 T625 C38 P60464 oash.SnapPuller$2.preClose removing old index files MockDirWrapper(org.apache.lucene.store.RAMDirectory@15fecea lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ba240)
[junit4:junit4] 2> 15013 T625 C38 P60464 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/index
[junit4:junit4] 2> 15013 T625 C38 P60464 oash.SnapPuller$2.postClose removing old index directory MockDirWrapper(org.apache.lucene.store.RAMDirectory@15fecea lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ba240)
[junit4:junit4] 2> 15015 T625 C38 P60464 oasc.RecoveryStrategy.replay Replaying buffered documents. core=collection1
[junit4:junit4] 2> 15016 T633 C38 P60464 oasu.UpdateLog$LogReplayer.doReplay WARNING Starting log replay tlog{file=./org.apache.solr.cloud.RecoveryZkTest-1363347118760/jetty2/tlog/tlog.0000000000000000000 refcount=2} active=true starting pos=6490
[junit4:junit4] 2> 15017 T633 C38 P60464 oasu.DirectUpdateHandler2.commit start commit{flags=2,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 15018 T633 C38 P60464 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@aab251 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1778e41),segFN=segments_2,generation=2,filenames=[_1.doc, _1.nvm, _0.fnm, _1.nvd, _0_1.del, _1_1.del, _0.nvm, _1.fnm, _1.fdx, _1.pos, _1.fdt, _0.pos, _1.si, _0.tim, _0.nvd, segments_2, _0.fdx, _0.si, _1.tip, _0.doc, _0.tip, _1.tim, _0.fdt]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@aab251 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1778e41),segFN=segments_3,generation=3,filenames=[_1.doc, _1.nvm, _0.fnm, _1.nvd, _0_1.del, _1_1.del, _0.nvm, _1.fnm, _1.fdx, _1.pos, _1.fdt, _0.pos, _1.si, _0.tim, _0.nvd, _0.fdx, _0.si, _1.tip, _0.doc, _0.tip, _1.tim, segments_3, _0.fdt]
[junit4:junit4] 2> 15019 T633 C38 P60464 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_1.doc, _1.nvm, _0.fnm, _1.nvd, _0_1.del, _1_1.del, _0.nvm, _1.fnm, _1.fdx, _1.pos, _1.fdt, _0.pos, _1.si, _0.tim, _0.nvd, _0.fdx, _0.si, _1.tip, _0.doc, _0.tip, _1.tim, segments_3, _0.fdt]
[junit4:junit4] 2> 15020 T633 C38 P60464 oass.SolrIndexSearcher.<init> Opening Searcher@132d549 main
[junit4:junit4] 2> 15021 T633 C38 P60464 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15021 T624 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@132d549 main{StandardDirectoryReader(segments_2:5:nrt _0(4.3):C66/19 _1(4.3):C24/9)}
[junit4:junit4] 2> 15022 T633 C38 P60464 oasu.UpdateLog$LogReplayer.run WARNING Log replay finished. recoveryInfo=RecoveryInfo{adds=0 deletes=0 deleteByQuery=0 errors=0 positionOfStart=6490}
[junit4:junit4] 2> 15022 T625 C38 P60464 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 15023 T625 C38 P60464 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 15023 T625 C38 P60464 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15023 T579 C39 P55456 /update {wt=javabin&version=2} {add=[10049 (1429573084150497280)]} 0 1
[junit4:junit4] 2> 15025 T625 C38 P60464 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 15027 T582 C39 P55456 /update {wt=javabin&version=2} {add=[49 (1429573084153643008)]} 0 2
[junit4:junit4] 2> 15027 T600 C40 P52685 /update {wt=javabin&version=2} {add=[10049 (1429573084153643008)]} 0 1
[junit4:junit4] 2> 15030 T601 C40 P52685 /update {wt=javabin&version=2} {add=[49 (1429573084156788736)]} 0 1
[junit4:junit4] 2> 15090 T580 C39 P55456 /update {wt=javabin&version=2} {delete=[10032 (-1429573084220751872)]} 0 0
[junit4:junit4] 2> 15093 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[32 (-1429573084223897600)]} 0 1
[junit4:junit4] 2> 15093 T599 C40 P52685 /update {wt=javabin&version=2} {delete=[10032 (-1429573084223897600)]} 0 0
[junit4:junit4] 2> 15095 T602 C40 P52685 /update {wt=javabin&version=2} {delete=[32 (-1429573084225994752)]} 0 0
[junit4:junit4] 2> 15097 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10050 (1429573084227043328)]} 0 1
[junit4:junit4] 2> 15101 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10050 (1429573084231237632)]} 0 1
[junit4:junit4] 2> 15101 T582 C39 P55456 /update {wt=javabin&version=2} {add=[50 (1429573084231237632)]} 0 1
[junit4:junit4] 2> 15104 T599 C40 P52685 /update {wt=javabin&version=2} {add=[50 (1429573084235431936)]} 0 0
[junit4:junit4] 2> 15171 T580 C39 P55456 /update {wt=javabin&version=2} {delete=[10033 (-1429573084305686528)]} 0 0
[junit4:junit4] 2> 15174 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[33 (-1429573084308832256)]} 0 0
[junit4:junit4] 2> 15174 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[10033 (-1429573084308832256)]} 0 0
[junit4:junit4] 2> 15176 T602 C40 P52685 /update {wt=javabin&version=2} {delete=[33 (-1429573084310929408)]} 0 0
[junit4:junit4] 2> 15178 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10051 (1429573084311977984)]} 0 1
[junit4:junit4] 2> 15180 T582 C39 P55456 /update {wt=javabin&version=2} {add=[51 (1429573084314075136)]} 0 1
[junit4:junit4] 2> 15181 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10051 (1429573084315123712)]} 0 1
[junit4:junit4] 2> 15183 T600 C40 P52685 /update {wt=javabin&version=2} {add=[51 (1429573084317220864)]} 0 1
[junit4:junit4] 2> 15204 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10052 (1429573084340289536)]} 0 1
[junit4:junit4] 2> 15206 T581 C39 P55456 /update {wt=javabin&version=2} {add=[52 (1429573084341338112)]} 0 1
[junit4:junit4] 2> 15207 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10052 (1429573084343435264)]} 0 0
[junit4:junit4] 2> 15209 T601 C40 P52685 /update {wt=javabin&version=2} {add=[52 (1429573084344483840)]} 0 1
[junit4:junit4] 2> 15306 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10053 (1429573084446195712)]} 0 1
[junit4:junit4] 2> 15307 T579 C39 P55456 /update {wt=javabin&version=2} {add=[53 (1429573084447244288)]} 0 1
[junit4:junit4] 2> 15309 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10053 (1429573084450390016)]} 0 0
[junit4:junit4] 2> 15310 T600 C40 P52685 /update {wt=javabin&version=2} {add=[53 (1429573084450390017)]} 0 1
[junit4:junit4] 2> 15345 T581 C39 P55456 /update {wt=javabin&version=2} {add=[54 (1429573084487090177)]} 0 1
[junit4:junit4] 2> 15345 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10054 (1429573084487090176)]} 0 1
[junit4:junit4] 2> 15348 T602 C40 P52685 /update {wt=javabin&version=2} {add=[54 (1429573084490235904)]} 0 1
[junit4:junit4] 2> 15349 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10054 (1429573084491284480)]} 0 1
[junit4:junit4] 2> 15399 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[34 (-1429573084544761856)]} 0 0
[junit4:junit4] 2> 15399 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[10034 (-1429573084544761857)]} 0 0
[junit4:junit4] 2> 15402 T599 C40 P52685 /update {wt=javabin&version=2} {delete=[10034 (-1429573084547907584)]} 0 1
[junit4:junit4] 2> 15402 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[34 (-1429573084547907585)]} 0 0
[junit4:junit4] 2> 15405 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10055 (1429573084550004736)]} 0 1
[junit4:junit4] 2> 15405 T580 C39 P55456 /update {wt=javabin&version=2} {add=[55 (1429573084550004737)]} 0 1
[junit4:junit4] 2> 15408 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10055 (1429573084553150464)]} 0 1
[junit4:junit4] 2> 15408 T601 C40 P52685 /update {wt=javabin&version=2} {add=[55 (1429573084554199040)]} 0 0
[junit4:junit4] 2> 15505 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[10036 (-1429573084654862336)]} 0 1
[junit4:junit4] 2> 15505 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[36 (-1429573084655910912)]} 0 0
[junit4:junit4] 2> 15507 T599 C40 P52685 /update {wt=javabin&version=2} {delete=[10036 (-1429573084658008064)]} 0 0
[junit4:junit4] 2> 15507 T602 C40 P52685 /update {wt=javabin&version=2} {delete=[36 (-1429573084658008065)]} 0 0
[junit4:junit4] 2> 15510 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10056 (1429573084661153792)]} 0 0
[junit4:junit4] 2> 15511 T581 C39 P55456 /update {wt=javabin&version=2} {add=[56 (1429573084661153793)]} 0 1
[junit4:junit4] 2> 15514 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10056 (1429573084664299520)]} 0 1
[junit4:junit4] 2> 15514 T600 C40 P52685 /update {wt=javabin&version=2} {add=[56 (1429573084664299521)]} 0 1
[junit4:junit4] 2> 15558 T579 C39 P55456 /update {wt=javabin&version=2} {add=[57 (1429573084710436864)]} 0 1
[junit4:junit4] 2> 15559 T582 C39 P55456 /update {wt=javabin&version=2} {add=[10057 (1429573084710436865)]} 0 2
[junit4:junit4] 2> 15561 T599 C40 P52685 /update {wt=javabin&version=2} {add=[57 (1429573084714631168)]} 0 0
[junit4:junit4] 2> 15562 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10057 (1429573084714631169)]} 0 1
[junit4:junit4] 2> 15577 T580 C39 P55456 /update {wt=javabin&version=2} {add=[58 (1429573084730359808)]} 0 1
[junit4:junit4] 2> 15578 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10058 (1429573084731408384)]} 0 2
[junit4:junit4] 2> 15580 T601 C40 P52685 /update {wt=javabin&version=2} {add=[58 (1429573084734554112)]} 0 1
[junit4:junit4] 2> 15581 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10058 (1429573084734554113)]} 0 1
[junit4:junit4] 2> 15657 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[37 (-1429573084815294464)]} 0 0
[junit4:junit4] 2> 15657 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[10037 (-1429573084815294465)]} 0 0
[junit4:junit4] 2> 15660 T602 C40 P52685 /update {wt=javabin&version=2} {delete=[10037 (-1429573084818440192)]} 0 1
[junit4:junit4] 2> 15660 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[37 (-1429573084818440193)]} 0 1
[junit4:junit4] 2> 15663 T581 C39 P55456 /update {wt=javabin&version=2} {add=[10059 (1429573084820537345)]} 0 1
[junit4:junit4] 2> 15663 T580 C39 P55456 /update {wt=javabin&version=2} {add=[59 (1429573084820537344)]} 0 1
[junit4:junit4] 2> 15667 T601 C40 P52685 /update {wt=javabin&version=2} {add=[10059 (1429573084824731648)]} 0 2
[junit4:junit4] 2> 15667 T599 C40 P52685 /update {wt=javabin&version=2} {add=[59 (1429573084824731649)]} 0 1
[junit4:junit4] 2> 15684 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[39 (-1429573084842557440)]} 0 1
[junit4:junit4] 2> 15684 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[10039 (-1429573084842557441)]} 0 1
[junit4:junit4] 2> 15686 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[10039 (-1429573084845703169)]} 0 0
[junit4:junit4] 2> 15686 T602 C40 P52685 /update {wt=javabin&version=2} {delete=[39 (-1429573084845703168)]} 0 0
[junit4:junit4] 2> 15690 T581 C39 P55456 /update {wt=javabin&version=2} {add=[60 (1429573084848848896)]} 0 1
[junit4:junit4] 2> 15690 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10060 (1429573084848848897)]} 0 1
[junit4:junit4] 2> 15693 T599 C40 P52685 /update {wt=javabin&version=2} {add=[10060 (1429573084851994624)]} 0 1
[junit4:junit4] 2> 15693 T601 C40 P52685 /update {wt=javabin&version=2} {add=[60 (1429573084851994625)]} 0 1
[junit4:junit4] 2> 15733 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15734 T587 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60464_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60464"}
[junit4:junit4] 2> 15737 T606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15737 T622 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15737 T593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15737 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15763 T564 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15763 T564 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15767 T564 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@10c4920
[junit4:junit4] 2> 15770 T579 C39 P55456 /update {wt=javabin&version=2} {delete=[10041 (-1429573084933783552)]} 0 1
[junit4:junit4] 2> 15770 T582 C39 P55456 /update {wt=javabin&version=2} {delete=[41 (-1429573084933783553)]} 0 0
[junit4:junit4] 2> 15774 T564 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=46,cumulative_deletesById=14,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 15775 T564 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 15775 T564 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> C38_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60464_, base_url=http://127.0.0.1:60464}
[junit4:junit4] 2> 15776 T616 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[41 (-1429573084935880705)]} 0 2
[junit4:junit4] 2> 15776 T564 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 15776 T617 C38 P60464 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {} 0 2
[junit4:junit4] 2> 15776 T602 C40 P52685 /update {wt=javabin&version=2} {delete=[41 (-1429573084935880705)]} 0 4
[junit4:junit4] 2> 15777 T617 C38 P60464 oasc.SolrException.log SEVERE org.apache.solr.common.SolrException: SolrCoreState already closed
[junit4:junit4] 2> at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:85)
[junit4:junit4] 2> at org.apache.solr.update.DirectUpdateHandler2.delete(DirectUpdateHandler2.java:288)
[junit4:junit4] 2> at org.apache.solr.update.processor.RunUpdateProcessor.processDelete(RunUpdateProcessorFactory.java:77)
[junit4:junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processDelete(UpdateRequestProcessor.java:55)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalDelete(DistributedUpdateProcessor.java:456)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.versionDelete(DistributedUpdateProcessor.java:1031)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:717)
[junit4:junit4] 2> at org.apache.solr.update.processor.LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:121)
[junit4:junit4] 2> at org.apache.solr.handler.loader.XMLLoader.processDelete(XMLLoader.java:346)
[junit4:junit4] 2> at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:277)
[junit4:junit4] 2> at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:173)
[junit4:junit4] 2> at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
[junit4:junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
[junit4:junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1811)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:637)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:343)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 15777 T564 C38 P60464 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@aab251 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1778e41),segFN=segments_3,generation=3,filenames=[_1.doc, _1.nvm, _0.fnm, _1.nvd, _0_1.del, _1_1.del, _0.nvm, _1.fnm, _1.fdx, _1.pos, _1.fdt, _0.pos, _1.si, _0.tim, _0.nvd, _0.fdx, _0.si, _1.tip, _0.doc, _0.tip, _1.tim, segments_3, _0.fdt]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@aab251 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1778e41),segFN=segments_4,generation=4,filenames=[_1.doc, _1.nvm, _0.fnm, _1.nvd, _0_1.del, _0.nvm, _1.fnm, _1.fdx, _1_2.del, _1.pos, _1.fdt, _0.pos, _1.si, _0.tim, _0.nvd, _0.fdx, _0.si, _1.tip, _0.doc, _0.tip, _1.tim, _0.fdt, segments_4]
[junit4:junit4] 2> 15778 T617 C38 P60464 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@10c4920
[junit4:junit4] 2> 15778 T564 C38 P60464 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_1.doc, _1.nvm, _0.fnm, _1.nvd, _0_1.del, _0.nvm, _1.fnm, _1.fdx, _1_2.del, _1.pos, _1.fdt, _0.pos, _1.si, _0.tim, _0.nvd, _0.fdx, _0.si, _1.tip, _0.doc, _0.tip, _1.tim, _0.fdt, segments_4]
[junit4:junit4] 2> 15778 T617 C38 P60464 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=2,deletesByQuery=0,errors=0,cumulative_adds=46,cumulative_deletesById=16,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 15780 T581 C39 P55456 /update {wt=javabin&version=2} {add=[61 (1429573084943220736)]} 0 1
[junit4:junit4] 2> 15780 T617 C38 P60464 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 15780 T564 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 15782 T569 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6dd21aad0008
[junit4:junit4] 2> 15782 T600 C40 P52685 oasc.SolrException.log SEVERE shard update error StdNode: http://127.0.0.1:60464/collection1/:org.apache.solr.common.SolrException: Server at http://127.0.0.1:60464/collection1 returned non ok status:503, message:Service Unavailable
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:373)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] 2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:332)
[junit4:junit4] 2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:306)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 15783 T593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15783 T566 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:47528 which had sessionid 0x13d6dd21aad0008
[junit4:junit4] 2> 15783 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15783 T606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15784 T600 C40 P52685 oasup.DistributedUpdateProcessor.doFinish try and ask http://127.0.0.1:60464 to recover
[junit4:junit4] 2> 15784 T600 C40 P52685 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15785 T606 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 15785 T564 oaz.ZooKeeper.close Session: 0x13d6dd21aad0008 closed
[junit4:junit4] 2> 15786 T586 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 15786 T593 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 15787 T601 C40 P52685 oasup.DistributedUpdateProcessor.doDefensiveChecks SEVERE Request says it is coming from leader, but we are the leader: distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2
[junit4:junit4] 2> 15787 T601 C40 P52685 /update {distrib.from=http://127.0.0.1:52685/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {} 0 0
[junit4:junit4] 2> 15788 T601 C40 P52685 oasc.SolrException.log SEVERE org.apache.solr.common.SolrException: Request says it is coming from leader, but we are the leader
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.doDefensiveChecks(DistributedUpdateProcessor.java:288)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:228)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:339)
[junit4:junit4] 2> at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)
[junit4:junit4] 2> at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:246)
[junit4:junit4] 2> at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:173)
[junit4:junit4] 2> at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
[junit4:junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
[junit4:junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1811)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:637)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:343)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 15791 T600 C40 P52685 oasup.DistributedUpdateProcessor.doFinish Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:60464
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:409)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:440)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1086)
[junit4:junit4] 2> at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)
[junit4:junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
[junit4:junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1811)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:637)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:343)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> Caused by: org.apache.http.conn.HttpHostConnectException: Connection to http://127.0.0.1:60464 refused
[junit4:junit4] 2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:190)
[junit4:junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
[junit4:junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
[junit4:junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4] 2> ... 35 more
[junit4:junit4] 2> Caused by: java.net.ConnectException: Connection refused
[junit4:junit4] 2> at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4:junit4] 2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
[junit4:junit4] 2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
[junit4:junit4] 2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4:junit4] 2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
[junit4:junit4] 2> at java.net.Socket.connect(Socket.java:579)
[junit4:junit4] 2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
[junit4:junit4] 2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
[junit4:junit4] 2> ... 42 more
[junit4:junit4] 2>
[junit4:junit4] 2> 15793 T600 C40 P52685 /update {wt=javabin&version=2} {delete=[10041 (-1429573084935880704)]} 0 21
[junit4:junit4] 2> 15798 T599 C40 P52685 oasc.SolrException.log SEVERE shard update error StdNode: http://127.0.0.1:60464/collection1/:org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:60464/collection1
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:416)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] 2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:332)
[junit4:junit4] 2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:306)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond
[junit4:junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:95)
[junit4:junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
[junit4:junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
[junit4:junit4] 2> at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
[junit4:junit4] 2> at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
[junit4:junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
[junit4:junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
[junit4:junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
[junit4:junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
[junit4:junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4] 2> ... 11 more
[junit4:junit4] 2>
[junit4:junit4] 2> 15798 T580 C39 P55456 /update {wt=javabin&version=2} {add=[10061 (1429573084961046528)]} 0 2
[junit4:junit4] 2> 15798 T599 C40 P52685 oasup.DistributedUpdateProcessor.doFinish try and ask http://127.0.0.1:60464 to recover
[junit4:junit4] 2> 15799 T599 C40 P52685 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15802 T602 C40 P52685 /update {wt=javabin&version=2} {add=[10061 (1429573084966289408)]} 0 1
[junit4:junit4] 2> 15802 T599 C40 P52685 oasup.DistributedUpdateProcessor.doFinish Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:60464
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:409)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:440)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1086)
[junit4:junit4] 2> at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)
[junit4:junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
[junit4:junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1811)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:637)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:343)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> Caused by: org.apache.http.conn.HttpHostConnectException: Connection to http://127.0.0.1:60464 refused
[junit4:junit4] 2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:190)
[junit4:junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
[junit4:junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
[junit4:junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHtt
[...truncated too long message...]
yncRequestProcessor exited!
[junit4:junit4] 2> 48050 T2371 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 2> 48052 T2371 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49261 49261
[junit4:junit4] 2> 48054 T2373 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4] 2> 48055 T2371 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4] 2> 48055 T2371 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4] 2> 48055 T2371 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 48056 T2371 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 48056 T2371 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=953AC8948B467D9E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_SA -Dtests.timezone=Pacific/Tahiti -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 48.1s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([953AC8948B467D9E:14DC468CFC191DA2]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:92)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:54)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 48063 T2371 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 48075 T2370 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> 48639 T2374 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ar_SA, timezone=Pacific/Tahiti
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic i386/Oracle Corporation 1.7.0_15 (32-bit)/cpus=8,threads=6,free=77985696,total=260243456
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestStressVersions, DistributedTermsComponentTest, ZkCLITest, SynonymTokenizerTest, CoreAdminHandlerTest, TestCopyFieldCollectionResource, TestValueSourceCache, PluginInfoTest, BadComponentTest, IndexSchemaTest, TestBadConfig, TestRemoteStreaming, MoreLikeThisHandlerTest, TestPHPSerializedResponseWriter, BasicFunctionalityTest, TestFieldCollectionResource, RAMDirectoryFactoryTest, UUIDFieldTest, FastVectorHighlighterTest, TestQuerySenderListener, SOLR749Test, TestSolrQueryParser, SoftAutoCommitTest, TestXIncludeConfig, SuggesterFSTTest, CacheHeaderTest, TermVectorComponentTest, FieldMutatingUpdateProcessorTest, TestLRUCache, TestReversedWildcardFilterFactory, OverseerCollectionProcessorTest, DistributedSpellCheckComponentTest, TestPropInjectDefaults, TestSolrDeletionPolicy1, RecoveryZkTest, MBeansHandlerTest, TestCharFilters, SliceStateTest, ClusterStateUpdateTest, LoggingHandlerTest, TermsComponentTest, TestFieldTypeCollectionResource, DocumentBuilderTest, FileBasedSpellCheckerTest, AliasIntegrationTest, TestCoreContainer, SystemInfoHandlerTest, TestPseudoReturnFields, UnloadDistributedZkTest, BinaryUpdateRequestHandlerTest, PreAnalyzedFieldTest, SolrIndexSplitterTest, TestFastWriter, CSVRequestHandlerTest, PrimUtilsTest, CircularListTest, OverseerTest, TestLMDirichletSimilarityFactory, PrimitiveFieldTypeTest, SimpleFacetsTest, AutoCommitTest, TestSolrCoreProperties, StatelessScriptUpdateProcessorFactoryTest, ResponseLogComponentTest, ShardRoutingTest, TestSearchPerf, BasicDistributedZkTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 48.85s, 1 test, 1 failure <<< FAILURES!
[...truncated 422 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 2 suite-level errors, 1 failure, 13 ignored (7 assumptions)
Total time: 42 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_15 -server -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b79) - Build #
4686 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4686/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseSerialGC
3 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:33327/vx/onenodecollectioncore returned non ok status:404, message:Can not find: /vx/onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:33327/vx/onenodecollectioncore returned non ok status:404, message:Can not find: /vx/onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([5CBA2236D369BD76:DD5CAC2EA436DD4A]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([5CBA2236D369BD76:DD5CAC2EA436DD4A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([5CBA2236D369BD76:DD5CAC2EA436DD4A]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9275 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 0 T1716 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 4 T1716 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1363341311382
[junit4:junit4] 2> 5 T1716 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 5 T1717 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 7 T1717 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 7 T1717 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 7 T1717 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 8 T1717 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 9 T1717 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1363341311382/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 105 T1716 oasc.ZkTestServer.run start zk server on port:39546
[junit4:junit4] 2> 106 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2a8c633b
[junit4:junit4] 2> 107 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 107 T1722 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 108 T1722 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 108 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60342
[junit4:junit4] 2> 109 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60342
[junit4:junit4] 2> 109 T1720 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 197 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c0000 with negotiated timeout 10000 for client /127.0.0.1:60342
[junit4:junit4] 2> 197 T1722 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c0000, negotiated timeout = 10000
[junit4:junit4] 2> 197 T1723 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a8c633b name:ZooKeeperConnection Watcher:127.0.0.1:39546 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 198 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 198 T1716 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 203 T1721 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6d797d9c0000
[junit4:junit4] 2> 203 T1723 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 203 T1716 oaz.ZooKeeper.close Session: 0x13d6d797d9c0000 closed
[junit4:junit4] 2> 204 T1718 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60342 which had sessionid 0x13d6d797d9c0000
[junit4:junit4] 2> 205 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@244b881a
[junit4:junit4] 2> 206 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 206 T1724 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 207 T1724 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 207 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60343
[junit4:junit4] 2> 207 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60343
[junit4:junit4] 2> 208 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c0001 with negotiated timeout 10000 for client /127.0.0.1:60343
[junit4:junit4] 2> 208 T1724 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c0001, negotiated timeout = 10000
[junit4:junit4] 2> 209 T1725 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@244b881a name:ZooKeeperConnection Watcher:127.0.0.1:39546/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 209 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 210 T1716 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 213 T1716 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 216 T1716 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 219 T1716 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 222 T1716 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 222 T1716 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 227 T1716 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 228 T1716 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 232 T1716 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 233 T1716 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 236 T1716 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 237 T1716 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 239 T1716 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 240 T1716 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 243 T1716 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 244 T1716 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 248 T1716 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 248 T1716 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 251 T1716 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 252 T1716 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 255 T1716 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 256 T1716 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 259 T1721 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6d797d9c0001
[junit4:junit4] 2> 260 T1725 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 260 T1718 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60343 which had sessionid 0x13d6d797d9c0001
[junit4:junit4] 2> 260 T1716 oaz.ZooKeeper.close Session: 0x13d6d797d9c0001 closed
[junit4:junit4] 2> 361 T1716 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 372 T1716 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56608
[junit4:junit4] 2> 373 T1716 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 373 T1716 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 373 T1716 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363341311639
[junit4:junit4] 2> 374 T1716 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363341311639/solr.xml
[junit4:junit4] 2> 374 T1716 oasc.CoreContainer.<init> New CoreContainer 2089459474
[junit4:junit4] 2> 374 T1716 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363341311639/'
[junit4:junit4] 2> 375 T1716 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363341311639/'
[junit4:junit4] 2> 397 T1716 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 398 T1716 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 398 T1716 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 398 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 399 T1716 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 399 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 399 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 400 T1716 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 400 T1716 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 400 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 407 T1716 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 418 T1716 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:39546/solr
[junit4:junit4] 2> 418 T1716 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 419 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@285b804a
[junit4:junit4] 2> 420 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 420 T1735 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 421 T1735 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 421 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60350
[junit4:junit4] 2> 421 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60350
[junit4:junit4] 2> 422 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c0002 with negotiated timeout 20000 for client /127.0.0.1:60350
[junit4:junit4] 2> 422 T1735 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c0002, negotiated timeout = 20000
[junit4:junit4] 2> 422 T1736 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@285b804a name:ZooKeeperConnection Watcher:127.0.0.1:39546 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 422 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 423 T1721 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6d797d9c0002
[junit4:junit4] 2> 423 T1736 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 423 T1718 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60350 which had sessionid 0x13d6d797d9c0002
[junit4:junit4] 2> 423 T1716 oaz.ZooKeeper.close Session: 0x13d6d797d9c0002 closed
[junit4:junit4] 2> 424 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 426 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2348deb9
[junit4:junit4] 2> 427 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 427 T1737 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 428 T1737 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 428 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60352
[junit4:junit4] 2> 428 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60352
[junit4:junit4] 2> 429 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c0003 with negotiated timeout 20000 for client /127.0.0.1:60352
[junit4:junit4] 2> 429 T1737 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c0003, negotiated timeout = 20000
[junit4:junit4] 2> 429 T1738 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2348deb9 name:ZooKeeperConnection Watcher:127.0.0.1:39546/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 429 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 431 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 431 T1716 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 433 T1716 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56608_
[junit4:junit4] 2> 433 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56608_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56608_
[junit4:junit4] 2> 434 T1716 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56608_
[junit4:junit4] 2> 435 T1716 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 438 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 438 T1716 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 446 T1716 oasc.Overseer.start Overseer (id=89347936183123971-127.0.0.1:56608_-n_0000000000) starting
[junit4:junit4] 2> 447 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 449 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 449 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 450 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 450 T1740 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 451 T1716 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 452 T1716 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 454 T1716 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 457 T1739 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 462 T1741 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363341311639/collection1
[junit4:junit4] 2> 462 T1741 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 463 T1741 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 463 T1741 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 464 T1741 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363341311639/collection1/'
[junit4:junit4] 2> 465 T1741 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363341311639/collection1/lib/README' to classloader
[junit4:junit4] 2> 465 T1741 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363341311639/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 498 T1741 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 523 T1741 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 524 T1741 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 537 T1741 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 861 T1741 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 867 T1741 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 869 T1741 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 880 T1741 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 883 T1741 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 885 T1741 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 886 T1741 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 887 T1741 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 887 T1741 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 888 T1741 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 888 T1741 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 888 T1741 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 888 T1741 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363341311639/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363341311382/control/data/
[junit4:junit4] 2> 888 T1741 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14977312
[junit4:junit4] 2> 889 T1741 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 889 T1741 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/control/data forceNew: false
[junit4:junit4] 2> 889 T1741 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363341311382/control/data/index/
[junit4:junit4] 2> 889 T1741 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363341311382/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 890 T1741 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/control/data/index forceNew: false
[junit4:junit4] 2> 891 T1741 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@374f903d lockFactory=org.apache.lucene.store.NativeFSLockFactory@701218c9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 891 T1741 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 893 T1741 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 893 T1741 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 894 T1741 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 894 T1741 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 894 T1741 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 894 T1741 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 894 T1741 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 895 T1741 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 895 T1741 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 897 T1741 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 899 T1741 oass.SolrIndexSearcher.<init> Opening Searcher@24fcb2a5 main
[junit4:junit4] 2> 899 T1741 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363341311382/control/data/tlog
[junit4:junit4] 2> 900 T1741 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 900 T1741 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 902 T1742 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@24fcb2a5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 903 T1741 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 903 T1741 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 904 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 1961 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1963 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56608",
[junit4:junit4] 2> "node_name":"127.0.0.1:56608_"}
[junit4:junit4] 2> 1963 T1739 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1963 T1739 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1964 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1970 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2907 T1741 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2907 T1741 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56608 collection:control_collection shard:shard1
[junit4:junit4] 2> 2908 T1741 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2915 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2916 T1741 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2917 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2919 T1741 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2919 T1741 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2919 T1741 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56608/collection1/
[junit4:junit4] 2> 2920 T1741 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2920 T1741 oasc.SyncStrategy.syncToMe http://127.0.0.1:56608/collection1/ has no replicas
[junit4:junit4] 2> 2920 T1741 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56608/collection1/
[junit4:junit4] 2> 2920 T1741 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2925 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3474 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3481 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3531 T1741 oasc.ZkController.register We are http://127.0.0.1:56608/collection1/ and leader is http://127.0.0.1:56608/collection1/
[junit4:junit4] 2> 3531 T1741 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56608
[junit4:junit4] 2> 3532 T1741 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3532 T1741 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3532 T1741 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3534 T1741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3536 T1716 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3536 T1716 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3537 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3543 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3545 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@266c2c62
[junit4:junit4] 2> 3546 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3546 T1744 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3547 T1744 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 3547 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60362
[junit4:junit4] 2> 3548 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60362
[junit4:junit4] 2> 3549 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c0004 with negotiated timeout 10000 for client /127.0.0.1:60362
[junit4:junit4] 2> 3549 T1744 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c0004, negotiated timeout = 10000
[junit4:junit4] 2> 3549 T1745 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@266c2c62 name:ZooKeeperConnection Watcher:127.0.0.1:39546/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3550 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3551 T1716 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3553 T1716 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3621 T1716 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3623 T1716 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48926
[junit4:junit4] 2> 3623 T1716 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3624 T1716 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3624 T1716 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363341314932
[junit4:junit4] 2> 3624 T1716 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363341314932/solr.xml
[junit4:junit4] 2> 3625 T1716 oasc.CoreContainer.<init> New CoreContainer 1883617997
[junit4:junit4] 2> 3625 T1716 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363341314932/'
[junit4:junit4] 2> 3625 T1716 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363341314932/'
[junit4:junit4] 2> 3642 T1716 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3642 T1716 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3642 T1716 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3643 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3643 T1716 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3643 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3644 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3644 T1716 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3644 T1716 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3644 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3664 T1716 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3673 T1716 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:39546/solr
[junit4:junit4] 2> 3673 T1716 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3674 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4e1903fd
[junit4:junit4] 2> 3674 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3675 T1755 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3675 T1755 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 3676 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60363
[junit4:junit4] 2> 3676 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60363
[junit4:junit4] 2> 3677 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c0005 with negotiated timeout 20000 for client /127.0.0.1:60363
[junit4:junit4] 2> 3677 T1755 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c0005, negotiated timeout = 20000
[junit4:junit4] 2> 3677 T1756 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e1903fd name:ZooKeeperConnection Watcher:127.0.0.1:39546 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3677 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3678 T1721 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6d797d9c0005
[junit4:junit4] 2> 3678 T1756 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3679 T1718 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60363 which had sessionid 0x13d6d797d9c0005
[junit4:junit4] 2> 3678 T1716 oaz.ZooKeeper.close Session: 0x13d6d797d9c0005 closed
[junit4:junit4] 2> 3679 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3681 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4bd0463b
[junit4:junit4] 2> 3682 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3682 T1757 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3682 T1757 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 3682 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60364
[junit4:junit4] 2> 3683 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60364
[junit4:junit4] 2> 3683 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c0006 with negotiated timeout 20000 for client /127.0.0.1:60364
[junit4:junit4] 2> 3683 T1757 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c0006, negotiated timeout = 20000
[junit4:junit4] 2> 3684 T1758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bd0463b name:ZooKeeperConnection Watcher:127.0.0.1:39546/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3684 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3684 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3685 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3686 T1716 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4688 T1716 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48926_
[junit4:junit4] 2> 4690 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48926_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48926_
[junit4:junit4] 2> 4691 T1716 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48926_
[junit4:junit4] 2> 4695 T1745 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4695 T1738 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4695 T1758 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4695 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4702 T1759 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363341314932/collection1
[junit4:junit4] 2> 4703 T1759 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4704 T1759 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4704 T1759 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4705 T1759 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363341314932/collection1/'
[junit4:junit4] 2> 4706 T1759 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363341314932/collection1/lib/README' to classloader
[junit4:junit4] 2> 4707 T1759 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363341314932/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4740 T1759 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 4765 T1759 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4766 T1759 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4770 T1759 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4986 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4986 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56608__collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56608",
[junit4:junit4] 2> "node_name":"127.0.0.1:56608_"}
[junit4:junit4] 2> 4989 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4989 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4989 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5098 T1759 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5103 T1759 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5105 T1759 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5116 T1759 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5119 T1759 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5121 T1759 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5122 T1759 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5122 T1759 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5122 T1759 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5123 T1759 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5123 T1759 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5123 T1759 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5124 T1759 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363341314932/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty1/
[junit4:junit4] 2> 5124 T1759 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14977312
[junit4:junit4] 2> 5124 T1759 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5125 T1759 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty1 forceNew: false
[junit4:junit4] 2> 5125 T1759 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty1/index/
[junit4:junit4] 2> 5125 T1759 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5125 T1759 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty1/index forceNew: false
[junit4:junit4] 2> 5126 T1759 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5126 T1759 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5128 T1759 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5128 T1759 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5129 T1759 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5129 T1759 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5129 T1759 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5130 T1759 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5130 T1759 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5130 T1759 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5130 T1759 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5132 T1759 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5135 T1759 oass.SolrIndexSearcher.<init> Opening Searcher@4bb4d42a main
[junit4:junit4] 2> 5135 T1759 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty1/tlog
[junit4:junit4] 2> 5135 T1759 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5135 T1759 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5139 T1760 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4bb4d42a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5140 T1759 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5140 T1759 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6492 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6493 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48926",
[junit4:junit4] 2> "node_name":"127.0.0.1:48926_"}
[junit4:junit4] 2> 6493 T1739 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 6493 T1739 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6499 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6499 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6499 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7141 T1759 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7142 T1759 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48926 collection:collection1 shard:shard1
[junit4:junit4] 2> 7143 T1759 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7151 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7152 T1759 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7152 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7155 T1759 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7155 T1759 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7155 T1759 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48926/collection1/
[junit4:junit4] 2> 7156 T1759 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7156 T1759 oasc.SyncStrategy.syncToMe http://127.0.0.1:48926/collection1/ has no replicas
[junit4:junit4] 2> 7156 T1759 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48926/collection1/
[junit4:junit4] 2> 7156 T1759 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7161 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8003 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8011 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8011 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8011 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8016 T1759 oasc.ZkController.register We are http://127.0.0.1:48926/collection1/ and leader is http://127.0.0.1:48926/collection1/
[junit4:junit4] 2> 8017 T1759 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48926
[junit4:junit4] 2> 8017 T1759 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8017 T1759 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8017 T1759 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8018 T1759 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8019 T1716 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 8020 T1716 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8020 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8089 T1716 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8091 T1716 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41804
[junit4:junit4] 2> 8092 T1716 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8092 T1716 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8093 T1716 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363341319402
[junit4:junit4] 2> 8093 T1716 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363341319402/solr.xml
[junit4:junit4] 2> 8093 T1716 oasc.CoreContainer.<init> New CoreContainer 29786119
[junit4:junit4] 2> 8093 T1716 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363341319402/'
[junit4:junit4] 2> 8094 T1716 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363341319402/'
[junit4:junit4] 2> 8110 T1716 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8111 T1716 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8111 T1716 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8111 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8111 T1716 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8112 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8112 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8112 T1716 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8113 T1716 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8113 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8118 T1716 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8126 T1716 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:39546/solr
[junit4:junit4] 2> 8126 T1716 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8127 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4f36a8ac
[junit4:junit4] 2> 8128 T1771 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8127 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8129 T1771 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 8129 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60368
[junit4:junit4] 2> 8129 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60368
[junit4:junit4] 2> 8130 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c0007 with negotiated timeout 20000 for client /127.0.0.1:60368
[junit4:junit4] 2> 8130 T1771 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c0007, negotiated timeout = 20000
[junit4:junit4] 2> 8131 T1772 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f36a8ac name:ZooKeeperConnection Watcher:127.0.0.1:39546 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8131 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8132 T1721 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6d797d9c0007
[junit4:junit4] 2> 8133 T1772 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8133 T1718 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60368 which had sessionid 0x13d6d797d9c0007
[junit4:junit4] 2> 8133 T1716 oaz.ZooKeeper.close Session: 0x13d6d797d9c0007 closed
[junit4:junit4] 2> 8134 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8136 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2fd765
[junit4:junit4] 2> 8137 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8137 T1773 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8138 T1773 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 8138 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60369
[junit4:junit4] 2> 8138 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60369
[junit4:junit4] 2> 8139 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c0008 with negotiated timeout 20000 for client /127.0.0.1:60369
[junit4:junit4] 2> 8139 T1773 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c0008, negotiated timeout = 20000
[junit4:junit4] 2> 8140 T1774 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fd765 name:ZooKeeperConnection Watcher:127.0.0.1:39546/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8140 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8141 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8142 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8145 T1716 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9148 T1716 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41804_
[junit4:junit4] 2> 9150 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c0008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41804_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41804_
[junit4:junit4] 2> 9151 T1716 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41804_
[junit4:junit4] 2> 9154 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9154 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9154 T1758 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9154 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9155 T1774 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9155 T1738 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9155 T1745 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9171 T1775 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363341319402/collection1
[junit4:junit4] 2> 9171 T1775 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9172 T1775 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9172 T1775 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9173 T1775 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363341319402/collection1/'
[junit4:junit4] 2> 9173 T1775 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363341319402/collection1/lib/README' to classloader
[junit4:junit4] 2> 9174 T1775 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363341319402/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9202 T1775 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 9229 T1775 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9230 T1775 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9234 T1775 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9516 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9517 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:48926__collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48926",
[junit4:junit4] 2> "node_name":"127.0.0.1:48926_"}
[junit4:junit4] 2> 9520 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9520 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9520 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9520 T1774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9593 T1775 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9599 T1775 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9601 T1775 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9611 T1775 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9614 T1775 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9617 T1775 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9618 T1775 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9619 T1775 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9619 T1775 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9620 T1775 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9620 T1775 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9620 T1775 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9620 T1775 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363341319402/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty2/
[junit4:junit4] 2> 9620 T1775 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14977312
[junit4:junit4] 2> 9621 T1775 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9622 T1775 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty2 forceNew: false
[junit4:junit4] 2> 9622 T1775 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty2/index/
[junit4:junit4] 2> 9622 T1775 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9622 T1775 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty2/index forceNew: false
[junit4:junit4] 2> 9624 T1775 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f9801ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e0d8e6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9624 T1775 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9626 T1775 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9626 T1775 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9627 T1775 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9627 T1775 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9627 T1775 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9628 T1775 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9628 T1775 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9628 T1775 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9629 T1775 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9631 T1775 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9633 T1775 oass.SolrIndexSearcher.<init> Opening Searcher@5654848 main
[junit4:junit4] 2> 9634 T1775 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty2/tlog
[junit4:junit4] 2> 9634 T1775 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9634 T1775 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9638 T1776 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5654848 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9640 T1775 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9640 T1775 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11025 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11026 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41804",
[junit4:junit4] 2> "node_name":"127.0.0.1:41804_"}
[junit4:junit4] 2> 11026 T1739 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 11027 T1739 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11032 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11032 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11032 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11032 T1774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11641 T1775 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11641 T1775 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41804 collection:collection1 shard:shard1
[junit4:junit4] 2> 11645 T1775 oasc.ZkController.register We are http://127.0.0.1:41804/collection1/ and leader is http://127.0.0.1:48926/collection1/
[junit4:junit4] 2> 11645 T1775 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41804
[junit4:junit4] 2> 11646 T1775 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 11646 T1775 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C59 name=collection1 org.apache.solr.core.SolrCore@20bbeb70 url=http://127.0.0.1:41804/collection1 node=127.0.0.1:41804_ C59_STATE=coll:collection1 core:collection1 props:{core=collection1, state=down, collection=collection1, base_url=http://127.0.0.1:41804, node_name=127.0.0.1:41804_}
[junit4:junit4] 2> 11646 T1777 C59 P41804 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 11647 T1775 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11647 T1777 C59 P41804 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 11648 T1777 C59 P41804 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 11648 T1777 C59 P41804 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11648 T1716 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 11649 T1716 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 11650 T1777 C59 P41804 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11650 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11728 T1716 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 11730 T1716 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60497
[junit4:junit4] 2> 11731 T1716 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 11732 T1716 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 11732 T1716 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363341323033
[junit4:junit4] 2> 11732 T1716 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363341323033/solr.xml
[junit4:junit4] 2> 11733 T1716 oasc.CoreContainer.<init> New CoreContainer 1809450727
[junit4:junit4] 2> 11733 T1716 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363341323033/'
[junit4:junit4] 2> 11733 T1716 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363341323033/'
[junit4:junit4] 2> 11753 T1716 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 11753 T1716 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 11754 T1716 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 11754 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 11755 T1716 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 11755 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 11756 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 11756 T1716 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 11756 T1716 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 11757 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 11765 T1716 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 11774 T1716 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:39546/solr
[junit4:junit4] 2> 11774 T1716 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 11775 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@b41bff7
[junit4:junit4] 2> 11775 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11776 T1788 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 11776 T1788 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 11777 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60388
[junit4:junit4] 2> 11777 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60388
[junit4:junit4] 2> 11778 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c0009 with negotiated timeout 20000 for client /127.0.0.1:60388
[junit4:junit4] 2> 11778 T1788 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c0009, negotiated timeout = 20000
[junit4:junit4] 2> 11778 T1789 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b41bff7 name:ZooKeeperConnection Watcher:127.0.0.1:39546 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11778 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11779 T1721 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6d797d9c0009
[junit4:junit4] 2> 11779 T1789 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 11779 T1718 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60388 which had sessionid 0x13d6d797d9c0009
[junit4:junit4] 2> 11779 T1716 oaz.ZooKeeper.close Session: 0x13d6d797d9c0009 closed
[junit4:junit4] 2> 11780 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 11782 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@798c844b
[junit4:junit4] 2> 11783 T1790 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 11783 T1790 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 11784 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60389
[junit4:junit4] 2> 11784 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60389
[junit4:junit4] 2> 11784 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11784 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c000a with negotiated timeout 20000 for client /127.0.0.1:60389
[junit4:junit4] 2> 11784 T1790 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c000a, negotiated timeout = 20000
[junit4:junit4] 2> 11785 T1791 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@798c844b name:ZooKeeperConnection Watcher:127.0.0.1:39546/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11785 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11785 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c000a type:create cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11786 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c000a type:create cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11787 T1716 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 12537 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12538 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:41804__collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41804",
[junit4:junit4] 2> "node_name":"127.0.0.1:41804_"}
[junit4:junit4] 2> 12543 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12543 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12543 T1774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12543 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12543 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12657 T1751 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&onlyIfLeader=true&checkLive=true&nodeName=127.0.0.1:41804_&action=PREPRECOVERY&state=recovering&coreNodeName=127.0.0.1:41804__collection1&core=collection1&wt=javabin} status=0 QTime=1000
[junit4:junit4] 2> 12789 T1716 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60497_
[junit4:junit4] 2> 12790 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c000a type:delete cxid:0xd zxid:0x87 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60497_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60497_
[junit4:junit4] 2> 12791 T1716 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60497_
[junit4:junit4] 2> 12794 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12794 T1774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12794 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12794 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12794 T1745 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12795 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12796 T1774 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12797 T1791 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12797 T1738 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12797 T1758 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12803 T1792 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363341323033/collection1
[junit4:junit4] 2> 12804 T1792 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 12805 T1792 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 12805 T1792 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 12806 T1792 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363341323033/collection1/'
[junit4:junit4] 2> 12807 T1792 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363341323033/collection1/lib/README' to classloader
[junit4:junit4] 2> 12808 T1792 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363341323033/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 12857 T1792 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 12883 T1792 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 12884 T1792 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 12887 T1792 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13235 T1792 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 13241 T1792 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 13243 T1792 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 13251 T1792 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13254 T1792 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13257 T1792 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13257 T1792 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 13258 T1792 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 13258 T1792 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13259 T1792 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 13259 T1792 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 13259 T1792 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 13259 T1792 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363341323033/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty3/
[junit4:junit4] 2> 13260 T1792 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14977312
[junit4:junit4] 2> 13260 T1792 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 13261 T1792 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty3 forceNew: false
[junit4:junit4] 2> 13261 T1792 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty3/index/
[junit4:junit4] 2> 13261 T1792 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 13261 T1792 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty3/index forceNew: false
[junit4:junit4] 2> 13262 T1792 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ceeac73 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f0960f5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13263 T1792 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13264 T1792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 13265 T1792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 13265 T1792 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 13266 T1792 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 13266 T1792 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 13266 T1792 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 13266 T1792 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 13267 T1792 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 13267 T1792 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 13270 T1792 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 13272 T1792 oass.SolrIndexSearcher.<init> Opening Searcher@3a3f626b main
[junit4:junit4] 2> 13272 T1792 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty3/tlog
[junit4:junit4] 2> 13273 T1792 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 13273 T1792 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 13277 T1793 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a3f626b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 13279 T1792 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 13279 T1792 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14048 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14048 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60497",
[junit4:junit4] 2> "node_name":"127.0.0.1:60497_"}
[junit4:junit4] 2> 14049 T1739 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 14049 T1739 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 14053 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14053 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14053 T1774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14054 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14053 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14306 T1792 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 14307 T1792 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60497 collection:collection1 shard:shard1
[junit4:junit4] 2> 14309 T1792 oasc.ZkController.register We are http://127.0.0.1:60497/collection1/ and leader is http://127.0.0.1:48926/collection1/
[junit4:junit4] 2> 14309 T1792 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60497
[junit4:junit4] 2> 14310 T1792 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 14310 T1792 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C60 name=collection1 org.apache.solr.core.SolrCore@32d6fd83 url=http://127.0.0.1:60497/collection1 node=127.0.0.1:60497_ C60_STATE=coll:collection1 core:collection1 props:{core=collection1, state=down, collection=collection1, base_url=http://127.0.0.1:60497, node_name=127.0.0.1:60497_}
[junit4:junit4] 2> 14310 T1794 C60 P60497 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 14310 T1792 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14311 T1794 C60 P60497 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 14311 T1794 C60 P60497 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 14311 T1794 C60 P60497 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14312 T1716 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 14312 T1794 C60 P60497 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14312 T1716 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14312 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14371 T1716 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14373 T1716 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39042
[junit4:junit4] 2> 14374 T1716 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14375 T1716 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14375 T1716 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363341325693
[junit4:junit4] 2> 14375 T1716 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363341325693/solr.xml
[junit4:junit4] 2> 14375 T1716 oasc.CoreContainer.<init> New CoreContainer 2075146013
[junit4:junit4] 2> 14376 T1716 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363341325693/'
[junit4:junit4] 2> 14376 T1716 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363341325693/'
[junit4:junit4] 2> 14393 T1716 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 14393 T1716 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14393 T1716 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14394 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14394 T1716 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14394 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14394 T1716 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14395 T1716 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14395 T1716 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14395 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14400 T1716 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14409 T1716 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:39546/solr
[junit4:junit4] 2> 14409 T1716 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14410 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@654da187
[junit4:junit4] 2> 14410 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14411 T1805 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14411 T1805 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 14412 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60393
[junit4:junit4] 2> 14412 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60393
[junit4:junit4] 2> 14413 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c000b with negotiated timeout 20000 for client /127.0.0.1:60393
[junit4:junit4] 2> 14413 T1805 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c000b, negotiated timeout = 20000
[junit4:junit4] 2> 14414 T1806 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@654da187 name:ZooKeeperConnection Watcher:127.0.0.1:39546 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14414 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14415 T1721 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6d797d9c000b
[junit4:junit4] 2> 14415 T1806 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14415 T1718 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:60393 which had sessionid 0x13d6d797d9c000b
[junit4:junit4] 2> 14415 T1716 oaz.ZooKeeper.close Session: 0x13d6d797d9c000b closed
[junit4:junit4] 2> 14416 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 14418 T1716 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:39546/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@24110d2e
[junit4:junit4] 2> 14419 T1716 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14419 T1807 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:39546. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14419 T1807 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:39546, initiating session
[junit4:junit4] 2> 14419 T1718 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:60394
[junit4:junit4] 2> 14420 T1718 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:60394
[junit4:junit4] 2> 14420 T1720 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6d797d9c000c with negotiated timeout 20000 for client /127.0.0.1:60394
[junit4:junit4] 2> 14420 T1807 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:39546, sessionid = 0x13d6d797d9c000c, negotiated timeout = 20000
[junit4:junit4] 2> 14420 T1808 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24110d2e name:ZooKeeperConnection Watcher:127.0.0.1:39546/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14421 T1716 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14421 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14422 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c000c type:create cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14423 T1716 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> C59_STATE=coll:collection1 core:collection1 props:{core=collection1, state=recovering, collection=collection1, shard=shard1, base_url=http://127.0.0.1:41804, node_name=127.0.0.1:41804_}
[junit4:junit4] 2> 14659 T1777 C59 P41804 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48926/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 14659 T1777 C59 P41804 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:41804 START replicas=[http://127.0.0.1:48926/collection1/] nUpdates=100
[junit4:junit4] 2> 14659 T1777 C59 P41804 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 14660 T1777 C59 P41804 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 14660 T1777 C59 P41804 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 14660 T1777 C59 P41804 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 14660 T1777 C59 P41804 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 14660 T1777 C59 P41804 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:48926/collection1/. core=collection1
[junit4:junit4] 2> 14660 T1777 C59 P41804 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C61 name=collection1 org.apache.solr.core.SolrCore@3788a416 url=http://127.0.0.1:48926/collection1 node=127.0.0.1:48926_ C61_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, collection=collection1, shard=shard1, base_url=http://127.0.0.1:48926, node_name=127.0.0.1:48926_, leader=true}
[junit4:junit4] 2> 14664 T1752 C61 P48926 REQ /get {getVersions=100&version=2&distrib=false&wt=javabin&qt=/get} status=0 QTime=1
[junit4:junit4] 2> 14664 T1753 C61 P48926 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14666 T1753 C61 P48926 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14667 T1753 C61 P48926 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14667 T1753 C61 P48926 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 14667 T1753 C61 P48926 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 14668 T1753 C61 P48926 oass.SolrIndexSearcher.<init> Opening Searcher@105617f1 realtime
[junit4:junit4] 2> 14668 T1753 C61 P48926 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14668 T1753 C61 P48926 /update {version=2&commit_end_point=true&softCommit=false&wt=javabin&commit=true&waitSearcher=true&openSearcher=false} {commit=} 0 4
[junit4:junit4] 2> 14669 T1777 C59 P41804 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 14670 T1777 C59 P41804 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 14673 T1754 C61 P48926 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 14674 T1754 C61 P48926 REQ /replication {version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=3
[junit4:junit4] 2> 14674 T1777 C59 P41804 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 14675 T1777 C59 P41804 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 14675 T1777 C59 P41804 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 14677 T1753 C61 P48926 REQ /replication {version=2&generation=2&wt=javabin&qt=/replication&command=filelist} status=0 QTime=0
[junit4:junit4] 2> 14677 T1777 C59 P41804 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 14678 T1777 C59 P41804 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty2/index.20130315165526056 forceNew: false
[junit4:junit4] 2> 14679 T1777 C59 P41804 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@74fc66e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4485618f) fullCopy=false
[junit4:junit4] 2> 14681 T1752 C61 P48926 REQ /replication {generation=2&checksum=true&wt=filestream&qt=/replication&file=segments_2&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 14682 T1777 C59 P41804 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 14683 T1777 C59 P41804 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 14683 T1777 C59 P41804 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 14684 T1777 C59 P41804 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f9801ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e0d8e6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f9801ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e0d8e6),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 14685 T1777 C59 P41804 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 14685 T1777 C59 P41804 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 14685 T1777 C59 P41804 oass.SolrIndexSearcher.<init> Opening Searcher@485cb497 main
[junit4:junit4] 2> 14686 T1776 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@485cb497 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 14686 T1777 C59 P41804 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@74fc66e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4485618f)
[junit4:junit4] 2> 14686 T1777 C59 P41804 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 14687 T1777 C59 P41804 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 14687 T1777 C59 P41804 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 14687 T1777 C59 P41804 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14689 T1777 C59 P41804 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 15425 T1716 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39042_
[junit4:junit4] 2> 15426 T1721 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6d797d9c000c type:delete cxid:0xb zxid:0x97 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:39042_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:39042_
[junit4:junit4] 2> 15427 T1716 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39042_
[junit4:junit4] 2> 15428 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15428 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15428 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15428 T1738 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15428 T1774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15428 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15428 T1808 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15429 T1745 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15430 T1791 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15430 T1758 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15430 T1774 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15433 T1811 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363341325693/collection1
[junit4:junit4] 2> 15433 T1811 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 15434 T1811 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15434 T1811 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 15435 T1811 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363341325693/collection1/'
[junit4:junit4] 2> 15435 T1811 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363341325693/collection1/lib/README' to classloader
[junit4:junit4] 2> 15436 T1811 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363341325693/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 15462 T1811 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 15514 T1811 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15515 T1811 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15521 T1811 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15556 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15557 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:60497__collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60497",
[junit4:junit4] 2> "node_name":"127.0.0.1:60497_"}
[junit4:junit4] 2> 15559 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:41804__collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:41804",
[junit4:junit4] 2> "node_name":"127.0.0.1:41804_"}
[junit4:junit4] 2> 15562 T1808 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15562 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15562 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15562 T1774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15562 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15562 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15837 T1811 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15842 T1811 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15856 T1811 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15866 T1811 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15869 T1811 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15872 T1811 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15872 T1811 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15872 T1811 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15873 T1811 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15873 T1811 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15873 T1811 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15874 T1811 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15874 T1811 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363341325693/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty4/
[junit4:junit4] 2> 15874 T1811 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@14977312
[junit4:junit4] 2> 15874 T1811 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15875 T1811 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty4 forceNew: false
[junit4:junit4] 2> 15875 T1811 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty4/index/
[junit4:junit4] 2> 15875 T1811 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15875 T1811 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty4/index forceNew: false
[junit4:junit4] 2> 15876 T1811 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3bfd1006 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5599c65c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15877 T1811 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15878 T1811 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15878 T1811 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15879 T1811 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15879 T1811 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15880 T1811 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15880 T1811 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15880 T1811 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15880 T1811 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15881 T1811 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15883 T1811 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15884 T1811 oass.SolrIndexSearcher.<init> Opening Searcher@6e83bb4d main
[junit4:junit4] 2> 15885 T1811 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty4/tlog
[junit4:junit4] 2> 15885 T1811 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15885 T1811 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15888 T1812 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e83bb4d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15890 T1811 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15890 T1811 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16316 T1751 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&onlyIfLeader=true&checkLive=true&nodeName=127.0.0.1:60497_&action=PREPRECOVERY&state=recovering&coreNodeName=127.0.0.1:60497__collection1&core=collection1&wt=javabin} status=0 QTime=2000
[junit4:junit4] 2> 17065 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17066 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39042",
[junit4:junit4] 2> "node_name":"127.0.0.1:39042_"}
[junit4:junit4] 2> 17066 T1739 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 17066 T1739 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 17069 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17069 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17069 T1774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17069 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17069 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17069 T1808 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17891 T1811 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 17891 T1811 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39042 collection:collection1 shard:shard1
[junit4:junit4] 2> 17896 T1811 oasc.ZkController.register We are http://127.0.0.1:39042/collection1/ and leader is http://127.0.0.1:48926/collection1/
[junit4:junit4] 2> 17896 T1811 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39042
[junit4:junit4] 2> 17896 T1811 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 17896 T1811 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C62 name=collection1 org.apache.solr.core.SolrCore@5d99ee08 url=http://127.0.0.1:39042/collection1 node=127.0.0.1:39042_ C62_STATE=coll:collection1 core:collection1 props:{core=collection1, state=down, collection=collection1, base_url=http://127.0.0.1:39042, node_name=127.0.0.1:39042_}
[junit4:junit4] 2> 17897 T1813 C62 P39042 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 17898 T1813 C62 P39042 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17898 T1811 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17898 T1813 C62 P39042 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17899 T1813 C62 P39042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17900 T1716 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 17900 T1813 C62 P39042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17900 T1716 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17902 T1716 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17909 T1716 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17911 T1716 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 17911 T1716 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 17912 T1716 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C60_STATE=coll:collection1 core:collection1 props:{core=collection1, state=recovering, collection=collection1, shard=shard1, base_url=http://127.0.0.1:60497, node_name=127.0.0.1:60497_}
[junit4:junit4] 2> 18317 T1794 C60 P60497 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48926/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 18317 T1794 C60 P60497 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60497 START replicas=[http://127.0.0.1:48926/collection1/] nUpdates=100
[junit4:junit4] 2> 18317 T1794 C60 P60497 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 18318 T1794 C60 P60497 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 18318 T1794 C60 P60497 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 18318 T1794 C60 P60497 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 18318 T1794 C60 P60497 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 18318 T1794 C60 P60497 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:48926/collection1/. core=collection1
[junit4:junit4] 2> 18318 T1794 C60 P60497 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18320 T1752 C61 P48926 REQ /get {getVersions=100&version=2&distrib=false&wt=javabin&qt=/get} status=0 QTime=0
[junit4:junit4] 2> 18322 T1754 C61 P48926 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 18323 T1754 C61 P48926 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18323 T1754 C61 P48926 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18323 T1754 C61 P48926 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18324 T1754 C61 P48926 /update {version=2&commit_end_point=true&softCommit=false&wt=javabin&commit=true&waitSearcher=true&openSearcher=false} {commit=} 0 2
[junit4:junit4] 2> 18325 T1794 C60 P60497 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18325 T1794 C60 P60497 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 18327 T1752 C61 P48926 REQ /replication {version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=0
[junit4:junit4] 2> 18328 T1794 C60 P60497 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 18328 T1794 C60 P60497 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 18328 T1794 C60 P60497 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 18330 T1754 C61 P48926 REQ /replication {version=2&generation=3&wt=javabin&qt=/replication&command=filelist} status=0 QTime=0
[junit4:junit4] 2> 18331 T1794 C60 P60497 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 18332 T1794 C60 P60497 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty3/index.20130315165529709 forceNew: false
[junit4:junit4] 2> 18332 T1794 C60 P60497 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@77fecf47 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fb87009) fullCopy=false
[junit4:junit4] 2> 18334 T1753 C61 P48926 REQ /replication {generation=3&checksum=true&wt=filestream&qt=/replication&file=segments_3&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 18336 T1794 C60 P60497 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 18337 T1794 C60 P60497 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 18338 T1794 C60 P60497 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 18339 T1794 C60 P60497 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ceeac73 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f0960f5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ceeac73 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f0960f5),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18340 T1794 C60 P60497 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18340 T1794 C60 P60497 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 18340 T1794 C60 P60497 oass.SolrIndexSearcher.<init> Opening Searcher@257b05d4 main
[junit4:junit4] 2> 18342 T1793 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@257b05d4 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 18342 T1794 C60 P60497 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@77fecf47 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fb87009)
[junit4:junit4] 2> 18342 T1794 C60 P60497 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 18342 T1794 C60 P60497 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 18342 T1794 C60 P60497 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 18342 T1794 C60 P60497 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18344 T1794 C60 P60497 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 18573 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18574 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:39042__collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39042",
[junit4:junit4] 2> "node_name":"127.0.0.1:39042_"}
[junit4:junit4] 2> 18577 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:60497__collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60497",
[junit4:junit4] 2> "node_name":"127.0.0.1:60497_"}
[junit4:junit4] 2> 18586 T1774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18586 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18587 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18587 T1808 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18587 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18586 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18911 T1751 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&onlyIfLeader=true&checkLive=true&nodeName=127.0.0.1:39042_&action=PREPRECOVERY&state=recovering&coreNodeName=127.0.0.1:39042__collection1&core=collection1&wt=javabin} status=0 QTime=1000
[junit4:junit4] 2> 18914 T1716 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19916 T1716 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C62_STATE=coll:collection1 core:collection1 props:{core=collection1, state=recovering, collection=collection1, shard=shard1, base_url=http://127.0.0.1:39042, node_name=127.0.0.1:39042_}
[junit4:junit4] 2> 20912 T1813 C62 P39042 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48926/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20912 T1813 C62 P39042 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:39042 START replicas=[http://127.0.0.1:48926/collection1/] nUpdates=100
[junit4:junit4] 2> 20913 T1813 C62 P39042 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20913 T1813 C62 P39042 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20913 T1813 C62 P39042 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20913 T1813 C62 P39042 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20913 T1813 C62 P39042 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20914 T1813 C62 P39042 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:48926/collection1/. core=collection1
[junit4:junit4] 2> 20914 T1813 C62 P39042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20915 T1752 C61 P48926 REQ /get {getVersions=100&version=2&distrib=false&wt=javabin&qt=/get} status=0 QTime=0
[junit4:junit4] 2> 20918 T1716 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20919 T1751 C61 P48926 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 20919 T1751 C61 P48926 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 20920 T1751 C61 P48926 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 20921 T1751 C61 P48926 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20921 T1751 C61 P48926 /update {version=2&commit_end_point=true&softCommit=false&wt=javabin&commit=true&waitSearcher=true&openSearcher=false} {commit=} 0 2
[junit4:junit4] 2> 20922 T1813 C62 P39042 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20922 T1813 C62 P39042 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20925 T1754 C61 P48926 REQ /replication {version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=0
[junit4:junit4] 2> 20926 T1813 C62 P39042 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 20926 T1813 C62 P39042 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20926 T1813 C62 P39042 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20928 T1753 C61 P48926 REQ /replication {version=2&generation=4&wt=javabin&qt=/replication&command=filelist} status=0 QTime=0
[junit4:junit4] 2> 20929 T1813 C62 P39042 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20931 T1813 C62 P39042 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363341311382/jetty4/index.20130315165532308 forceNew: false
[junit4:junit4] 2> 20931 T1813 C62 P39042 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@7939b456 lockFactory=org.apache.lucene.store.NativeFSLockFactory@560b3170) fullCopy=false
[junit4:junit4] 2> 20933 T1751 C61 P48926 REQ /replication {generation=4&checksum=true&wt=filestream&qt=/replication&file=segments_4&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 20935 T1813 C62 P39042 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20936 T1813 C62 P39042 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20936 T1813 C62 P39042 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20937 T1813 C62 P39042 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3bfd1006 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5599c65c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3bfd1006 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5599c65c),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 20938 T1813 C62 P39042 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 20938 T1813 C62 P39042 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20939 T1813 C62 P39042 oass.SolrIndexSearcher.<init> Opening Searcher@7ad94931 main
[junit4:junit4] 2> 20940 T1812 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ad94931 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 20940 T1813 C62 P39042 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@7939b456 lockFactory=org.apache.lucene.store.NativeFSLockFactory@560b3170)
[junit4:junit4] 2> 20940 T1813 C62 P39042 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20940 T1813 C62 P39042 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20940 T1813 C62 P39042 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20940 T1813 C62 P39042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20942 T1813 C62 P39042 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 21594 T1739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21595 T1739 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core_node_name":"127.0.0.1:39042__collection1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39042",
[junit4:junit4] 2> "node_name":"127.0.0.1:39042_"}
[junit4:junit4] 2> 21597 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21597 T1791 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21597 T1774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21597 T1745 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21598 T1808 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21597 T1738 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21919 T1716 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21920 T1716 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C63 name=collection1 org.apache.solr.core.SolrCore@176793a8 url=http://127.0.0.1:56608/collection1 node=127.0.0.1:56608_ C63_STATE=coll:control_collection core:collection1 props:{core=collection1, state=active, collection=control_collection, shard=shard1, base_url=http://127.0.0.1:56608, node_name=127.0.0.1:56608_, leader=true}
[junit4:junit4] 2> 21924 T1732 C63 P56608 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21926 T1732 C63 P56608 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@374f903d lockFactory=org.apache.lucene.store.NativeFSLockFactory@701218c9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21927 T1732 C63 P56608 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21927 T1732 C63 P56608 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@374f903d lockFactory=org.apache.lucene.store.NativeFSLockFactory@701218c9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@374f903d lockFactory=org.apache.lucene.store.NativeFSLockFactory@701218c9),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 21927 T1732 C63 P56608 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 21928 T1732 C63 P56608 oass.SolrIndexSearcher.<init> Opening Searcher@398dcf7e main
[junit4:junit4] 2> 21928 T1732 C63 P56608 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21929 T1742 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@398dcf7e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 21929 T1732 C63 P56608 /update {version=2&softCommit=false&wt=javabin&commit=true&waitSearcher=true} {commit=} 0 5
[junit4:junit4] 2> 21933 T1751 C61 P48926 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21934 T1751 C61 P48926 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 21934 T1751 C61 P48926 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 21935 T1751 C61 P48926 oass.SolrIndexSearcher.<init> Opening Searcher@196bd77d main
[junit4:junit4] 2> 21935 T1751 C61 P48926 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21936 T1760 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@196bd77d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 21936 T1751 C61 P48926 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:41804/collection1/, StdNode: http://127.0.0.1:60497/collection1/, StdNode: http://127.0.0.1:39042/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> C59_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, collection=collection1, shard=shard1, base_url=http://127.0.0.1:41804, node_name=127.0.0.1:41804_}
[junit4:junit4] 2> 21945 T1767 C59 P41804 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21946 T1767 C59 P41804 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f9801ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e0d8e6),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f9801ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e0d8e6),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> C62_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, collection=collection1, shard=shard1, base_url=http://127.0.0.1:39042, node_name=127.0.0.1:39042_}
[junit4:junit4] 2> 21947 T1801 C62 P39042 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C60_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, collection=collection1, shard=shard1, base_url=http://127.0.0.1:60497, node_name=127.0.0.1:60497_}
[junit4:junit4] 2> 21947 T1787 C60 P60497 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21947 T1767 C59 P41804 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 21949 T1767 C59 P41804 oass.SolrIndexSearcher.<init> Opening Searcher@43b44b7b main
[junit4:junit4] 2> 21949 T1787 C60 P60497 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ceeac73 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f0960f5),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ceeac73 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f0960f5),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 21949 T1801 C62 P39042 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3bfd1006 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5599c65c),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3bfd1006 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5599c65c),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 21949 T1767 C59 P41804 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21949 T1787 C60 P60497 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 21950 T1801 C62 P39042 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 21950 T1787 C60 P60497 oass.SolrIndexSearcher.<init> Opening Searcher@5c1fda5f main
[junit4:junit4] 2> 21950 T1801 C62 P39042 oass.SolrIndexSearcher.<init> Opening Searcher@59597e8d main
[junit4:junit4] 2> 21950 T1776 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@43b44b7b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 21950 T1787 C60 P60497 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21950 T1801 C62 P39042 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21951 T1812 oasc.JmxMonitoredMap.put WARNING Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:id=org.apache.solr.search.SolrIndexSearcher,type=searcher
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:512)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:239)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1763)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:129)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1640)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 21951 T1767 C59 P41804 /update {version=2&commit_end_point=true&softCommit=false&wt=javabin&expungeDeletes=false&commit=true&waitSearcher=true} {commit=} 0 6
[junit4:junit4] 2> 21951 T1793 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5c1fda5f main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 21951 T1812 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59597e8d main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 21952 T1787 C60 P60497 /update {version=2&commit_end_point=true&softCommit=false&wt=javabin&expungeDeletes=false&commit=true&waitSearcher=true} {commit=} 0 5
[junit4:junit4] 2> 21952 T1801 C62 P39042 /update {version=2&commit_end_point=true&softCommit=false&wt=javabin&expungeDeletes=false&commit=true&waitSearcher=true} {commit=} 0 5
[junit4:junit4] 2> 21953 T1751 C61 P48926 /update {version=2&softCommit=false&wt=javabin&commit=true&waitSearcher=true} {commit=} 0 20
[junit4:junit4] 2> 21953 T1716 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21956 T1753 C61 P48926 REQ /select {version=2&q=*:*&distrib=false&wt=javabin&tests=checkShardConsistency&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 21958 T1768 C59 P41804 REQ /select {version=2&q=*:*&distrib=false&wt=javabin&tests=checkShardConsistency&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 21961 T1784 C60 P60497 REQ /select {version=2&q=*:*&distrib=false&wt=javabin&tests=checkShardConsistency&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 21963 T1804 C62 P39042 REQ /select {version=2&q=*:*&distrib=false&wt=javabin&tests=checkShardConsistency&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 23968 T1733 C63 P56608 oass.SolrIndexSearcher.<init> Opening Searcher@5f639e8 realtime
[junit4:junit4] 2> 23968 T1733 C63 P56608 /update {version=2&wt=javabin} {deleteByQuery=*:* (-1429567004050718720)} 0 2
[junit4:junit4] 2> 23975 T1801 C62 P39042 /update {version=2&update.distrib=FROMLEADER&_version_=-1429567004054913024&update.from=http://127.0.0.1:48926/collection1/&wt=javabin} {deleteByQuery=*:* (-1429567004054913024)} 0 1
[junit4:junit4] 2> 23975 T1784 C60 P60497 /update {version=2&update.distrib=FROMLEADER&_version_=-1429567004054913024&update.from=http://127.0.0.1:48926/collection1/&wt=javabin} {deleteByQuery=*:* (-1429567004054913024)} 0 1
[junit4:junit4] 2> 23975 T1769 C59 P41804 /update {version=2&update.distrib=FROMLEADER&_version_=-1429567004054913024&update.from=http://127.0.0.1:48926/collection1/&wt=javabin} {deleteByQuery=*:* (-1429567004054913024)} 0 1
[junit4:junit4] 2> 23976 T1754 C61 P48926 /update {version=2&wt=javabin} {deleteByQuery=*:* (-1429567004054913024)} 0 5
[junit4:junit4] 2> 23981 T1734 C63 P56608 /update {version=2&wt=javabin} {add=[0 (1429567004064350208)]} 0 2
[junit4:junit4] 2> 23991 T1787 C60 P60497 /update {version=2&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:48926/collection1/&wt=javabin} {add=[0 (1429567004068544512)]} 0 2
[junit4:junit4] 2> 23990 T1803 C62 P39042 /update {version=2&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:48926/collection1/&wt=javabin} {add=[0 (1429567004068544512)]} 0 2
[junit4:junit4] 2> 23992 T1770 C59 P41804 /update {version=2&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:48926/collection1/&wt=javabin} {add=[0 (1429567004068544512)]} 0 2
[junit4:junit4] 2> 23992 T1752 C61 P48926 /update {version=2&wt=javabin} {add=[0 (1429567004068544512)]} 0 8
[junit4:junit4] 2> 23996 T1731 C63 P56608 /update {version=2&wt=javabin} {add=[1 (1429567004080078848)]} 0 1
[junit4:junit4] 2> 24004 T1767 C59 P41804 /update {version=2&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:48926/collection1/&wt=javabin} {add=[1 (1429567004084273152)]} 0 1
[junit4:junit4] 2> 24004 T1802 C62 P39042 /update {version=2&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:48926/collection1/&wt=javabin} {add=[1 (1429567004084273152)]} 0 1
[junit4:junit4] 2> 24004 T1785 C60 P60497 /update {version=2&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:48926/collection1/&wt=javabin} {add=[1 (1429567004084273152)]} 0 1
[junit4:junit4] 2> 24005 T1751 C61 P48926 /update {version=2&wt=javabin} {add=[1 (1429567004084273152)]} 0 6
[junit4:junit4] 2> 24010 T1733 C63 P56608 /update {version=2&wt=javabin} {add=[2 (1429567004093710336)]} 0 2
[junit4:junit4] 2> 24019 T1786 C60 P60497 /update {version=2&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:48926/collection1/&wt=javabin} {add=[2 (1429567004100001792)]} 0 1
[junit4:junit4] 2> 24019 T1804 C62 P39042 /update {version=2&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:48926/collection1/&wt=javabin} {add=[2 (1429567004100001792)]} 0 1
[junit4:junit4] 2> 24020 T1753 C61 P48926 /update {version=2&test.distrib.skip.servers=http://127.0.0.1:41804/collection1/&wt=javabin} {add=[2 (1429567004100001792)]} 0 7
[junit4:junit4] 2> 24024 T1734 C63 P56608 /update {version=2&wt=javabin} {add=[3 (1429567004109438976)]} 0 1
[junit4:junit4] 2> 24032 T1801 C62 P39042 /update {version=2&update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:48926/collection1/&wt=javabin} {add=[3 (1429567004114681856)]} 0 1
[junit4:junit4] 2> 24033 T1754 C61 P48926 /update {version=2&test.distrib.skip.servers=http://127.0.0.1:41804/collection1/&test.distrib.skip.servers=http://127.0.0.1:60497/collection1/&wt=javabin} {add=[3 (1429567004114681856)]} 0 6
[junit4:junit4] 2> 24036 T1732 C63 P56608 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24040 T1732 C63 P56608 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@374f903d lockFactory=org.apache.lucene.store.NativeFSLockFactory@701218c9),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@374f903d lockFactory=org.apache.lucene.store.NativeFSLockFactory@701218c9),segFN=segments_3,generation=3,filenames=[_0.nvm, _0.fdt, _0_Memory_1.ram, _0_MockVariableIntBlock_0.frq, _0_MockVariableIntBlock_0.tii, segments_3, _0_MockVariableIntBlock_0.doc, _0_Lucene41_0.tim, _0.si, _0_MockVariableIntBlock_0.pos, _0_Lucene41_0.doc, _0_MockVariableIntBlock_0.pyl, _0_Memory_0.ram, _0_Lucene41_0.pos, _0.fnm, _0_MockVariableIntBlock_0.skp, _0_MockVariableIntBlock_0.tib, _0.fdx, _0.nvd, _0_Lucene41_0.tip]
[junit4:junit4] 2> 24040 T1732 C63 P56608 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.nvm, _0.fdt, _0_Memory_1.ram, _0_MockVariableIntBlock_0.frq, _0_MockVariableIntBlock_0.tii, segments_3, _0_MockVariableIntBlock_0.doc, _0_Lucene41_0.tim, _0.si, _0_MockVariableIntBlock_0.pos, _0_Lucene41_0.doc, _0_MockVariableIntBlock_0.pyl, _0_Memory_0.ram, _0_Lucene41_0.pos, _0.fnm, _0_MockVariableIntBlock_0.skp, _0_MockVariableIntBlock_0.tib, _0.fdx, _0.nvd, _0_Lucene41_0.tip]
[junit4:junit4] 2> 24042 T1732 C63 P56608 oass.SolrIndexSearcher.<init> Opening Searcher@6e919e44 main
[junit4:junit4] 2> 24042 T1732 C63 P56608 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24043 T1742 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e919e44 main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 24043 T1732 C63 P56608 /update {version=2&softCommit=false&wt=javabin&commit=true&waitSearcher=true} {commit=} 0 7
[junit4:junit4] 2> 24046 T1752 C61 P48926 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24051 T1752 C61 P48926 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=5
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@576a0ed8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2195f17a),segFN=segments_6,generation=6,filenames=[_0.nvm, _0.fdt, _0_Memory_1.ram, _0_MockVariableIntBlock_0.frq, _0_MockVariableIntBlock_0.tii, _0_MockVariableIntBlock_0.doc, _0_Lucene41_0.tim, _0.si, _0_MockVariableIntBlock_0.pos, _0_Lucene41_0.doc, _0_MockVariableIntBlock_0.pyl, _0_Memory_0.ram, _0_Lucene41_0.pos, _0.fnm, _0_MockVariableIntBlock_0.skp, _0_MockVariableIntBlock_0.tib, _0.fdx, _0.nvd, _0_Lucene41_0.tip, segments_6]
[junit4:junit4] 2> 24052 T1752 C61 P48926 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0.nvm, _0.fdt, _0_Memory_1.ram, _0_MockVariableIntBlock_0.frq, _0_MockVariableIntBlock_0.tii, _0_MockVariableIntBlock_0.doc, _0_Lucene41_0.tim, _0.si, _0_MockVariableIntBlock_0.pos, _0_Lucene41_0.doc, _0_MockVariableIntBlock_0.pyl, _0_Memory_0.ram, _0_Lucene41_0.pos, _0.fnm, _0_MockVariableIntBlock_0.skp, _0_MockVariableIntBlock_0.tib, _0.fdx, _0.nvd, _0_Lucene41_0.tip, segments_6]
[junit4:junit4] 2> 24053 T1752 C61 P48926 oass.SolrIndexSearcher.<init> Opening Searcher@3282cc9c main
[junit4:junit4] 2> 24054 T1752 C61 P48926 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24054 T1760 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3282cc9c main{StandardDirectoryReader(segments_6:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 24055 T1752 C61 P48926 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:41804/collection1/, StdNode: http://127.0.0.1:60497/collection1/, StdNode: http://127.0.0.1:39042/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 24057 T1784 C60 P60497 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24057 T1803 C62 P39042 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24057 T1768 C59 P41804 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24062 T1784 C60 P60497 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ceeac73 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f0960f5),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ceeac73 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f0960f5),segFN=segments_5,generation=5,filenames=[_0.nvm, _0.fdt, _0_Memory_1.ram, segments_5, _0_MockVariableIntBlock_0.frq, _0_MockVariableIntBlock_0.tii, _0_MockVariableIntBlock_0.doc, _0_Lucene41_0.tim, _0.si, _0_MockVariableIntBlock_0.pos, _0_Lucene41_0.doc, _0_MockVariableIntBlock_0.pyl, _0_Memory_0.ram, _0_Lucene41_0.pos, _0.fnm, _0_MockVariableIntBlock_0.skp, _0_MockVariableIntBlock_0.tib, _0.fdx, _0.nvd, _0_Lucene41_0.tip]
[junit4:junit4] 2> 24063 T1784 C60 P60497 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[_0.nvm, _0.fdt, _0_Memory_1.ram, segments_5, _0_MockVariableIntBlock_0.frq, _0_MockVariableIntBlock_0.tii, _0_MockVariableIntBlock_0.doc, _0_Lucene41_0.tim, _0.si, _0_MockVariableIntBlock_0.pos, _0_Lucene41_0.doc, _0_MockV
[...truncated too long message...]
| UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([5CBA2236D369BD76:DD5CAC2EA436DD4A]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 134868 T2676 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 134881 T2675 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 135604 T2679 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 135970 T2758 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 135970 T2758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 135971 T2758 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 135971 T2758 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_l=MockFixedIntBlock(blockSize=1411), intDefault=Lucene41(blocksize=128), id=PostingsFormat(name=Memory doPackFST= false), a_t=MockFixedIntBlock(blockSize=1411), range_facet_sl=PostingsFormat(name=Memory doPackFST= false), other_tl1=Lucene41(blocksize=128), _version_=Lucene41(blocksize=128), multiDefault=MockFixedIntBlock(blockSize=1411), timestamp=MockFixedIntBlock(blockSize=1411), text=PostingsFormat(name=Memory doPackFST= true), a_si=Lucene41(blocksize=128), range_facet_si=MockFixedIntBlock(blockSize=1411)}, docValues:{}, sim=DefaultSimilarity, locale=sq_AL, timezone=Australia/Eucla
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=63028544,total=205221888
[junit4:junit4] 2> NOTE: All tests run in this JVM: [UpdateRequestProcessorFactoryTest, LukeRequestHandlerTest, FastVectorHighlighterTest, BasicFunctionalityTest, TestRealTimeGet, SynonymTokenizerTest, SolrCoreTest, AliasIntegrationTest, ResponseLogComponentTest, ZkControllerTest, ShowFileRequestHandlerTest, DistributedSpellCheckComponentTest, TestSolrQueryParser, CSVRequestHandlerTest, SuggesterFSTTest, ClusterStateUpdateTest, ScriptEngineTest, DocValuesTest, TestRandomDVFaceting, ShardRoutingTest, TestFuzzyAnalyzedSuggestions, DistributedTermsComponentTest, UUIDFieldTest, TestPluginEnable, TestSort, PrimUtilsTest, TestFieldTypeCollectionResource, TestDynamicFieldResource, TestCharFilters, TestValueSourceCache, TestPropInjectDefaults, SearchHandlerTest, WordBreakSolrSpellCheckerTest, ReturnFieldsTest, TestLRUCache, SliceStateUpdateTest, OverseerCollectionProcessorTest, SystemInfoHandlerTest, SolrIndexSplitterTest, TestLMDirichletSimilarityFactory, IndexSchemaTest, TermsComponentTest, OverseerTest, SpellingQueryConverterTest, AnalysisAfterCoreReloadTest, TestPerFieldSimilarity, TestFieldResource, MinimalSchemaTest, SyncSliceTest, TestSweetSpotSimilarityFactory, QueryEqualityTest, TestJoin, AlternateDirectoryTest, CoreAdminHandlerTest, LoggingHandlerTest, PreAnalyzedFieldTest, RAMDirectoryFactoryTest, FieldMutatingUpdateProcessorTest, DistributedQueryElevationComponentTest, TestReplicationHandler, TestDocumentBuilder, PrimitiveFieldTypeTest, TestFastWriter, SolrInfoMBeanTest, CircularListTest, JsonLoaderTest, TestCollationKeyRangeQueries, BasicDistributedZk2Test, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 136.16s, 1 test, 1 failure <<< FAILURES!
[...truncated 413 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 error, 2 failures, 13 ignored (7 assumptions)
Total time: 95 minutes 29 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.6.0_41) - Build # 4685
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4685/
Java: 64bit/jdk1.6.0_41 -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([7CDDF00E5F1F038C:FD3B7E16284063B0]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:662)
Build Log:
[...truncated 8703 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 0 T1679 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_/
[junit4:junit4] 2> 5 T1679 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1363332431187
[junit4:junit4] 2> 6 T1679 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 7 T1680 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 7 T1680 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 7 T1680 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 8 T1680 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 8 T1680 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 8 T1680 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1363332431187/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 107 T1679 oasc.ZkTestServer.run start zk server on port:36566
[junit4:junit4] 2> 107 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@fb91ad2
[junit4:junit4] 2> 108 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 108 T1685 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 108 T1685 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 109 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39295
[junit4:junit4] 2> 109 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39295
[junit4:junit4] 2> 109 T1683 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 111 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd560000 with negotiated timeout 10000 for client /127.0.0.1:39295
[junit4:junit4] 2> 111 T1685 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd560000, negotiated timeout = 10000
[junit4:junit4] 2> 111 T1686 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fb91ad2 name:ZooKeeperConnection Watcher:127.0.0.1:36566 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 111 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 112 T1679 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 114 T1684 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1fd560000
[junit4:junit4] 2> 114 T1686 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 114 T1679 oaz.ZooKeeper.close Session: 0x13d6cf1fd560000 closed
[junit4:junit4] 2> 115 T1681 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:39295 which had sessionid 0x13d6cf1fd560000
[junit4:junit4] 2> 115 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@623e154c
[junit4:junit4] 2> 115 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 116 T1687 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 116 T1687 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 116 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39296
[junit4:junit4] 2> 116 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39296
[junit4:junit4] 2> 117 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd560001 with negotiated timeout 10000 for client /127.0.0.1:39296
[junit4:junit4] 2> 117 T1687 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd560001, negotiated timeout = 10000
[junit4:junit4] 2> 117 T1688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@623e154c name:ZooKeeperConnection Watcher:127.0.0.1:36566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 117 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 118 T1679 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 122 T1679 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 124 T1679 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 126 T1679 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 128 T1679 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 129 T1679 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 132 T1679 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 133 T1679 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 136 T1679 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 136 T1679 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 138 T1679 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 139 T1679 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 141 T1679 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 142 T1679 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 144 T1679 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 145 T1679 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 147 T1679 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 148 T1679 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 150 T1679 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 151 T1679 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 153 T1679 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 153 T1679 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 155 T1684 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1fd560001
[junit4:junit4] 2> 156 T1688 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 156 T1679 oaz.ZooKeeper.close Session: 0x13d6cf1fd560001 closed
[junit4:junit4] 2> 156 T1681 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:39296 which had sessionid 0x13d6cf1fd560001
[junit4:junit4] 2> 235 T1679 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 237 T1679 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46315
[junit4:junit4] 2> 238 T1679 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 238 T1679 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 239 T1679 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363332431337
[junit4:junit4] 2> 239 T1679 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363332431337/solr.xml
[junit4:junit4] 2> 239 T1679 oasc.CoreContainer.<init> New CoreContainer 409536173
[junit4:junit4] 2> 240 T1679 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363332431337/'
[junit4:junit4] 2> 240 T1679 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363332431337/'
[junit4:junit4] 2> 259 T1679 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 260 T1679 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 260 T1679 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 261 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 261 T1679 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 262 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 262 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 262 T1679 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 263 T1679 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 263 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 271 T1679 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 283 T1679 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:36566/solr
[junit4:junit4] 2> 283 T1679 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 283 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@799fb0c4
[junit4:junit4] 2> 284 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 284 T1698 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 285 T1698 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 285 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39297
[junit4:junit4] 2> 285 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39297
[junit4:junit4] 2> 286 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd560002 with negotiated timeout 20000 for client /127.0.0.1:39297
[junit4:junit4] 2> 286 T1698 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd560002, negotiated timeout = 20000
[junit4:junit4] 2> 287 T1699 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@799fb0c4 name:ZooKeeperConnection Watcher:127.0.0.1:36566 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 287 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 288 T1684 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1fd560002
[junit4:junit4] 2> 288 T1699 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 289 T1681 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:39297 which had sessionid 0x13d6cf1fd560002
[junit4:junit4] 2> 288 T1679 oaz.ZooKeeper.close Session: 0x13d6cf1fd560002 closed
[junit4:junit4] 2> 289 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 292 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@22162639
[junit4:junit4] 2> 292 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 293 T1700 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 293 T1700 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 293 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39298
[junit4:junit4] 2> 293 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39298
[junit4:junit4] 2> 294 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd560003 with negotiated timeout 20000 for client /127.0.0.1:39298
[junit4:junit4] 2> 294 T1700 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd560003, negotiated timeout = 20000
[junit4:junit4] 2> 294 T1701 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22162639 name:ZooKeeperConnection Watcher:127.0.0.1:36566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 294 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 296 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 297 T1679 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 298 T1679 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46315__
[junit4:junit4] 2> 299 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:46315__ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:46315__
[junit4:junit4] 2> 299 T1679 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46315__
[junit4:junit4] 2> 302 T1679 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 307 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 307 T1679 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 311 T1679 oasc.Overseer.start Overseer (id=89347354210467843-127.0.0.1:46315__-n_0000000000) starting
[junit4:junit4] 2> 312 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 312 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 313 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 314 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 315 T1703 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 315 T1679 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 318 T1679 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 319 T1679 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 321 T1702 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 324 T1704 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363332431337/collection1
[junit4:junit4] 2> 324 T1704 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 324 T1704 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 324 T1704 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 325 T1704 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363332431337/collection1/'
[junit4:junit4] 2> 326 T1704 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1363332431337/collection1/lib/README' to classloader
[junit4:junit4] 2> 326 T1704 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1363332431337/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 353 T1704 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 399 T1704 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 400 T1704 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 403 T1704 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 813 T1704 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 818 T1704 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 820 T1704 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 849 T1704 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 862 T1704 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 871 T1704 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 872 T1704 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 872 T1704 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 872 T1704 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 873 T1704 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 873 T1704 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 873 T1704 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 874 T1704 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363332431337/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363332431187/control/data/
[junit4:junit4] 2> 874 T1704 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@506835fb
[junit4:junit4] 2> 874 T1704 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 875 T1704 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/control/data forceNew: false
[junit4:junit4] 2> 875 T1704 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363332431187/control/data/index/
[junit4:junit4] 2> 875 T1704 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363332431187/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 875 T1704 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/control/data/index forceNew: false
[junit4:junit4] 2> 877 T1704 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4d93e103 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5be7d4e8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 877 T1704 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 879 T1704 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 879 T1704 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 879 T1704 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 880 T1704 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 880 T1704 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 881 T1704 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 881 T1704 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 882 T1704 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 882 T1704 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 885 T1704 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 898 T1704 oass.SolrIndexSearcher.<init> Opening Searcher@182a796a main
[junit4:junit4] 2> 898 T1704 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363332431187/control/data/tlog
[junit4:junit4] 2> 899 T1704 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 899 T1704 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 906 T1704 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 906 T1704 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 907 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 907 T1705 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@182a796a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1824 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1825 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:46315__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46315/_"}
[junit4:junit4] 2> 1825 T1702 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1825 T1702 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1826 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1830 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1910 T1704 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1910 T1704 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46315/_ collection:control_collection shard:shard1
[junit4:junit4] 2> 1911 T1704 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1918 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 1923 T1704 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1924 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1929 T1704 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1930 T1704 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1930 T1704 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46315/_/collection1/
[junit4:junit4] 2> 1930 T1704 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1930 T1704 oasc.SyncStrategy.syncToMe http://127.0.0.1:46315/_/collection1/ has no replicas
[junit4:junit4] 2> 1931 T1704 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46315/_/collection1/
[junit4:junit4] 2> 1931 T1704 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1941 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3333 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3338 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3347 T1704 oasc.ZkController.register We are http://127.0.0.1:46315/_/collection1/ and leader is http://127.0.0.1:46315/_/collection1/
[junit4:junit4] 2> 3347 T1704 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46315/_
[junit4:junit4] 2> 3347 T1704 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3347 T1704 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3347 T1704 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3348 T1704 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3349 T1679 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3349 T1679 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3350 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3352 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3352 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@b70afe0
[junit4:junit4] 2> 3353 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3353 T1707 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 3353 T1707 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 3354 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39319
[junit4:junit4] 2> 3354 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39319
[junit4:junit4] 2> 3354 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd560004 with negotiated timeout 10000 for client /127.0.0.1:39319
[junit4:junit4] 2> 3354 T1707 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd560004, negotiated timeout = 10000
[junit4:junit4] 2> 3355 T1708 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b70afe0 name:ZooKeeperConnection Watcher:127.0.0.1:36566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3355 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3356 T1679 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3358 T1679 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3417 T1679 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3419 T1679 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35885
[junit4:junit4] 2> 3419 T1679 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3420 T1679 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3420 T1679 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363332434539
[junit4:junit4] 2> 3420 T1679 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363332434539/solr.xml
[junit4:junit4] 2> 3421 T1679 oasc.CoreContainer.<init> New CoreContainer 1294632188
[junit4:junit4] 2> 3421 T1679 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363332434539/'
[junit4:junit4] 2> 3421 T1679 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363332434539/'
[junit4:junit4] 2> 3437 T1679 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3438 T1679 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3438 T1679 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3438 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3439 T1679 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3439 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3439 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3440 T1679 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3440 T1679 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3440 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3446 T1679 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3457 T1679 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:36566/solr
[junit4:junit4] 2> 3458 T1679 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3458 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3bf6c07a
[junit4:junit4] 2> 3459 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3459 T1718 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 3460 T1718 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 3460 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39320
[junit4:junit4] 2> 3460 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39320
[junit4:junit4] 2> 3461 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd560005 with negotiated timeout 20000 for client /127.0.0.1:39320
[junit4:junit4] 2> 3461 T1718 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd560005, negotiated timeout = 20000
[junit4:junit4] 2> 3461 T1719 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bf6c07a name:ZooKeeperConnection Watcher:127.0.0.1:36566 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3462 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3463 T1684 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1fd560005
[junit4:junit4] 2> 3463 T1681 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:39320 which had sessionid 0x13d6cf1fd560005
[junit4:junit4] 2> 3464 T1719 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3464 T1679 oaz.ZooKeeper.close Session: 0x13d6cf1fd560005 closed
[junit4:junit4] 2> 3464 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3467 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@c47ef0f
[junit4:junit4] 2> 3468 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3468 T1720 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 3469 T1720 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 3469 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39321
[junit4:junit4] 2> 3469 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39321
[junit4:junit4] 2> 3470 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd560006 with negotiated timeout 20000 for client /127.0.0.1:39321
[junit4:junit4] 2> 3470 T1720 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd560006, negotiated timeout = 20000
[junit4:junit4] 2> 3470 T1721 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c47ef0f name:ZooKeeperConnection Watcher:127.0.0.1:36566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3470 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3471 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3473 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3475 T1679 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4477 T1679 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35885__
[junit4:junit4] 2> 4478 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35885__ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35885__
[junit4:junit4] 2> 4478 T1679 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35885__
[junit4:junit4] 2> 4480 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4481 T1708 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4481 T1721 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4481 T1701 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4485 T1722 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363332434539/collection1
[junit4:junit4] 2> 4485 T1722 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4486 T1722 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4486 T1722 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4487 T1722 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363332434539/collection1/'
[junit4:junit4] 2> 4487 T1722 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1363332434539/collection1/lib/README' to classloader
[junit4:junit4] 2> 4488 T1722 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1363332434539/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4510 T1722 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 4549 T1722 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4550 T1722 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4553 T1722 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4842 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4842 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:46315___collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:46315__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46315/_"}
[junit4:junit4] 2> 4845 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4845 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4845 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4903 T1722 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 4908 T1722 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 4910 T1722 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 4921 T1722 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 4924 T1722 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 4927 T1722 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 4928 T1722 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 4928 T1722 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 4928 T1722 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 4929 T1722 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 4929 T1722 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 4929 T1722 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 4929 T1722 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363332434539/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty1/
[junit4:junit4] 2> 4930 T1722 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@506835fb
[junit4:junit4] 2> 4930 T1722 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 4931 T1722 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty1 forceNew: false
[junit4:junit4] 2> 4931 T1722 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty1/index/
[junit4:junit4] 2> 4931 T1722 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 4931 T1722 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty1/index forceNew: false
[junit4:junit4] 2> 4932 T1722 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 4932 T1722 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 4934 T1722 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 4934 T1722 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 4935 T1722 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 4935 T1722 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 4935 T1722 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 4936 T1722 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 4936 T1722 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 4936 T1722 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 4936 T1722 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 4938 T1722 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 4940 T1722 oass.SolrIndexSearcher.<init> Opening Searcher@5495768a main
[junit4:junit4] 2> 4940 T1722 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty1/tlog
[junit4:junit4] 2> 4941 T1722 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 4941 T1722 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 4944 T1723 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5495768a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 4945 T1722 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 4946 T1722 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6348 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6348 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:35885__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35885/_"}
[junit4:junit4] 2> 6348 T1702 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 6349 T1702 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6352 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6352 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6352 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6947 T1722 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 6947 T1722 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35885/_ collection:collection1 shard:shard1
[junit4:junit4] 2> 6948 T1722 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 6953 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 6954 T1722 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 6954 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6955 T1722 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 6955 T1722 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 6955 T1722 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35885/_/collection1/
[junit4:junit4] 2> 6956 T1722 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 6956 T1722 oasc.SyncStrategy.syncToMe http://127.0.0.1:35885/_/collection1/ has no replicas
[junit4:junit4] 2> 6956 T1722 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35885/_/collection1/
[junit4:junit4] 2> 6956 T1722 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 6958 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7855 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7861 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7861 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7861 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7870 T1722 oasc.ZkController.register We are http://127.0.0.1:35885/_/collection1/ and leader is http://127.0.0.1:35885/_/collection1/
[junit4:junit4] 2> 7870 T1722 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35885/_
[junit4:junit4] 2> 7870 T1722 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 7871 T1722 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 7871 T1722 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7872 T1722 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7873 T1679 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 7873 T1679 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 7873 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 7934 T1679 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 7936 T1679 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52120
[junit4:junit4] 2> 7937 T1679 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 7937 T1679 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 7937 T1679 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363332439057
[junit4:junit4] 2> 7937 T1679 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363332439057/solr.xml
[junit4:junit4] 2> 7938 T1679 oasc.CoreContainer.<init> New CoreContainer 1609263818
[junit4:junit4] 2> 7938 T1679 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363332439057/'
[junit4:junit4] 2> 7938 T1679 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363332439057/'
[junit4:junit4] 2> 7954 T1679 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 7954 T1679 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 7955 T1679 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 7955 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 7955 T1679 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 7956 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 7956 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 7956 T1679 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 7956 T1679 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 7957 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 7962 T1679 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 7972 T1679 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:36566/solr
[junit4:junit4] 2> 7972 T1679 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 7973 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@144b4345
[junit4:junit4] 2> 7973 T1734 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 7974 T1734 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 7974 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39342
[junit4:junit4] 2> 7974 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7974 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39342
[junit4:junit4] 2> 7975 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd560007 with negotiated timeout 20000 for client /127.0.0.1:39342
[junit4:junit4] 2> 7975 T1734 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd560007, negotiated timeout = 20000
[junit4:junit4] 2> 7975 T1735 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@144b4345 name:ZooKeeperConnection Watcher:127.0.0.1:36566 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7975 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7976 T1684 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1fd560007
[junit4:junit4] 2> 7977 T1735 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 7977 T1681 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:39342 which had sessionid 0x13d6cf1fd560007
[junit4:junit4] 2> 7977 T1679 oaz.ZooKeeper.close Session: 0x13d6cf1fd560007 closed
[junit4:junit4] 2> 7977 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 7979 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@76d1b910
[junit4:junit4] 2> 7980 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7980 T1736 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 7981 T1736 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 7981 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39343
[junit4:junit4] 2> 7981 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39343
[junit4:junit4] 2> 7982 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd560008 with negotiated timeout 20000 for client /127.0.0.1:39343
[junit4:junit4] 2> 7982 T1736 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd560008, negotiated timeout = 20000
[junit4:junit4] 2> 7982 T1737 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76d1b910 name:ZooKeeperConnection Watcher:127.0.0.1:36566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7982 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7983 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7984 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7985 T1679 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 8987 T1679 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52120__
[junit4:junit4] 2> 8988 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd560008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52120__ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52120__
[junit4:junit4] 2> 8989 T1679 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52120__
[junit4:junit4] 2> 8990 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8990 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8991 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8992 T1737 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8993 T1721 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8993 T1708 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8993 T1701 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8997 T1738 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363332439057/collection1
[junit4:junit4] 2> 8997 T1738 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9001 T1738 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9005 T1738 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9009 T1738 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363332439057/collection1/'
[junit4:junit4] 2> 9009 T1738 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1363332439057/collection1/lib/README' to classloader
[junit4:junit4] 2> 9010 T1738 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1363332439057/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9048 T1738 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 9112 T1738 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9122 T1738 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9128 T1738 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9370 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9370 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:35885___collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:35885__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35885/_"}
[junit4:junit4] 2> 9374 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9374 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9374 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9374 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9628 T1738 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9636 T1738 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9640 T1738 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9655 T1738 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9659 T1738 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9664 T1738 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9665 T1738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9666 T1738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9666 T1738 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9667 T1738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9667 T1738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9667 T1738 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9668 T1738 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363332439057/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty2/
[junit4:junit4] 2> 9668 T1738 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@506835fb
[junit4:junit4] 2> 9669 T1738 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9669 T1738 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty2 forceNew: false
[junit4:junit4] 2> 9669 T1738 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty2/index/
[junit4:junit4] 2> 9670 T1738 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9670 T1738 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty2/index forceNew: false
[junit4:junit4] 2> 9672 T1738 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45833571 lockFactory=org.apache.lucene.store.NativeFSLockFactory@703ba76e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9672 T1738 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9675 T1738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9675 T1738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9676 T1738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9677 T1738 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9677 T1738 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9677 T1738 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9678 T1738 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9678 T1738 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9679 T1738 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9681 T1738 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9683 T1738 oass.SolrIndexSearcher.<init> Opening Searcher@17bf3476 main
[junit4:junit4] 2> 9684 T1738 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty2/tlog
[junit4:junit4] 2> 9684 T1738 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9684 T1738 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9691 T1738 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9691 T1739 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17bf3476 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9691 T1738 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10881 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10882 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52120__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52120/_"}
[junit4:junit4] 2> 10882 T1702 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 10882 T1702 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 10885 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10885 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10885 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10885 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11693 T1738 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11693 T1738 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52120/_ collection:collection1 shard:shard1
[junit4:junit4] 2> 11696 T1738 oasc.ZkController.register We are http://127.0.0.1:52120/_/collection1/ and leader is http://127.0.0.1:35885/_/collection1/
[junit4:junit4] 2> 11696 T1738 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52120/_
[junit4:junit4] 2> 11696 T1738 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 11696 T1738 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C99 name=collection1 org.apache.solr.core.SolrCore@55b23d2d url=http://127.0.0.1:52120/_/collection1 node=127.0.0.1:52120__ C99_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52120__, base_url=http://127.0.0.1:52120/_}
[junit4:junit4] 2> 11697 T1740 C99 P52120 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 11697 T1740 C99 P52120 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 11697 T1738 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11697 T1740 C99 P52120 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 11697 T1740 C99 P52120 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11698 T1740 C99 P52120 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11698 T1679 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 11699 T1679 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 11699 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11796 T1679 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 11798 T1679 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35714
[junit4:junit4] 2> 11799 T1679 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 11799 T1679 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 11799 T1679 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363332442883
[junit4:junit4] 2> 11800 T1679 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363332442883/solr.xml
[junit4:junit4] 2> 11800 T1679 oasc.CoreContainer.<init> New CoreContainer 301101610
[junit4:junit4] 2> 11800 T1679 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363332442883/'
[junit4:junit4] 2> 11800 T1679 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363332442883/'
[junit4:junit4] 2> 11819 T1679 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 11820 T1679 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 11820 T1679 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 11821 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 11821 T1679 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 11822 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 11822 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 11822 T1679 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 11823 T1679 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 11823 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 11828 T1679 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 11838 T1679 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:36566/solr
[junit4:junit4] 2> 11839 T1679 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 11839 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@64935569
[junit4:junit4] 2> 11840 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11840 T1751 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 11840 T1751 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 11840 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39356
[junit4:junit4] 2> 11841 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39356
[junit4:junit4] 2> 11841 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd560009 with negotiated timeout 20000 for client /127.0.0.1:39356
[junit4:junit4] 2> 11841 T1751 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd560009, negotiated timeout = 20000
[junit4:junit4] 2> 11842 T1752 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64935569 name:ZooKeeperConnection Watcher:127.0.0.1:36566 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11842 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11843 T1684 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1fd560009
[junit4:junit4] 2> 11844 T1752 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 11844 T1681 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:39356 which had sessionid 0x13d6cf1fd560009
[junit4:junit4] 2> 11844 T1679 oaz.ZooKeeper.close Session: 0x13d6cf1fd560009 closed
[junit4:junit4] 2> 11844 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 11846 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e85d73
[junit4:junit4] 2> 11847 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11847 T1753 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 11847 T1753 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 11848 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39357
[junit4:junit4] 2> 11848 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39357
[junit4:junit4] 2> 11849 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd56000a with negotiated timeout 20000 for client /127.0.0.1:39357
[junit4:junit4] 2> 11849 T1753 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd56000a, negotiated timeout = 20000
[junit4:junit4] 2> 11849 T1754 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e85d73 name:ZooKeeperConnection Watcher:127.0.0.1:36566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11849 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11850 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd56000a type:create cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11850 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd56000a type:create cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11852 T1679 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 12389 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12389 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52120___collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52120__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52120/_"}
[junit4:junit4] 2> 12392 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12392 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12392 T1754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12392 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12392 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12702 T1714 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:52120___collection1&state=recovering&nodeName=127.0.0.1:52120__&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1000
[junit4:junit4] 2> 12854 T1679 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35714__
[junit4:junit4] 2> 12854 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd56000a type:delete cxid:0xd zxid:0x87 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:35714__ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:35714__
[junit4:junit4] 2> 12855 T1679 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35714__
[junit4:junit4] 2> 12857 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12857 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12857 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12857 T1754 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12858 T1754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12858 T1737 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12858 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12859 T1701 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12859 T1708 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12859 T1721 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12862 T1755 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363332442883/collection1
[junit4:junit4] 2> 12863 T1755 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 12863 T1755 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 12863 T1755 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 12864 T1755 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363332442883/collection1/'
[junit4:junit4] 2> 12864 T1755 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1363332442883/collection1/lib/README' to classloader
[junit4:junit4] 2> 12865 T1755 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1363332442883/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 12888 T1755 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 12922 T1755 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 12923 T1755 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 12938 T1755 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13323 T1755 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 13328 T1755 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 13330 T1755 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 13341 T1755 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13345 T1755 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13348 T1755 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13349 T1755 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 13349 T1755 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 13349 T1755 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13350 T1755 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 13350 T1755 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 13350 T1755 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 13351 T1755 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363332442883/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty3/
[junit4:junit4] 2> 13351 T1755 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@506835fb
[junit4:junit4] 2> 13351 T1755 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 13352 T1755 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty3 forceNew: false
[junit4:junit4] 2> 13352 T1755 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty3/index/
[junit4:junit4] 2> 13352 T1755 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 13352 T1755 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty3/index forceNew: false
[junit4:junit4] 2> 13353 T1755 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6615b6c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57c61ce7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13353 T1755 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13355 T1755 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 13355 T1755 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 13356 T1755 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 13356 T1755 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 13356 T1755 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 13357 T1755 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 13357 T1755 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 13357 T1755 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 13358 T1755 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 13359 T1755 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 13362 T1755 oass.SolrIndexSearcher.<init> Opening Searcher@2427cb7f main
[junit4:junit4] 2> 13362 T1755 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty3/tlog
[junit4:junit4] 2> 13362 T1755 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 13362 T1755 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 13366 T1756 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2427cb7f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 13368 T1755 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 13369 T1755 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13896 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13899 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:35714__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35714/_"}
[junit4:junit4] 2> 13899 T1702 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 13899 T1702 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 13905 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13905 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13905 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13906 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13906 T1754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14382 T1755 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 14382 T1755 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35714/_ collection:collection1 shard:shard1
[junit4:junit4] 2> 14385 T1755 oasc.ZkController.register We are http://127.0.0.1:35714/_/collection1/ and leader is http://127.0.0.1:35885/_/collection1/
[junit4:junit4] 2> 14386 T1755 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35714/_
[junit4:junit4] 2> 14386 T1755 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 14386 T1755 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C100 name=collection1 org.apache.solr.core.SolrCore@6571a182 url=http://127.0.0.1:35714/_/collection1 node=127.0.0.1:35714__ C100_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:35714__, base_url=http://127.0.0.1:35714/_}
[junit4:junit4] 2> 14387 T1757 C100 P35714 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 14387 T1755 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14387 T1757 C100 P35714 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 14388 T1757 C100 P35714 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 14388 T1757 C100 P35714 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14388 T1679 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 14389 T1757 C100 P35714 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14389 T1679 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14389 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14494 T1679 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14496 T1679 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47127
[junit4:junit4] 2> 14497 T1679 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14497 T1679 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14498 T1679 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363332445573
[junit4:junit4] 2> 14498 T1679 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363332445573/solr.xml
[junit4:junit4] 2> 14498 T1679 oasc.CoreContainer.<init> New CoreContainer 25205279
[junit4:junit4] 2> 14499 T1679 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363332445573/'
[junit4:junit4] 2> 14499 T1679 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363332445573/'
[junit4:junit4] 2> 14539 T1679 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 14540 T1679 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14540 T1679 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14540 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14540 T1679 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14541 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14541 T1679 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14541 T1679 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14542 T1679 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14542 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14548 T1679 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14561 T1679 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:36566/solr
[junit4:junit4] 2> 14562 T1679 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14563 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7adb13c1
[junit4:junit4] 2> 14564 T1768 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 14564 T1768 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 14564 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39375
[junit4:junit4] 2> 14565 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39375
[junit4:junit4] 2> 14566 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd56000b with negotiated timeout 20000 for client /127.0.0.1:39375
[junit4:junit4] 2> 14569 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14570 T1768 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd56000b, negotiated timeout = 20000
[junit4:junit4] 2> 14571 T1769 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7adb13c1 name:ZooKeeperConnection Watcher:127.0.0.1:36566 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14572 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14576 T1684 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1fd56000b
[junit4:junit4] 2> 14577 T1681 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:39375 which had sessionid 0x13d6cf1fd56000b
[junit4:junit4] 2> 14580 T1769 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14580 T1679 oaz.ZooKeeper.close Session: 0x13d6cf1fd56000b closed
[junit4:junit4] 2> 14581 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 14583 T1679 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:36566/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@36aaff68
[junit4:junit4] 2> 14584 T1679 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14584 T1770 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:36566. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 14585 T1770 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:36566, initiating session
[junit4:junit4] 2> 14585 T1681 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:39376
[junit4:junit4] 2> 14585 T1681 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:39376
[junit4:junit4] 2> 14586 T1683 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1fd56000c with negotiated timeout 20000 for client /127.0.0.1:39376
[junit4:junit4] 2> 14586 T1770 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:36566, sessionid = 0x13d6cf1fd56000c, negotiated timeout = 20000
[junit4:junit4] 2> 14586 T1771 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36aaff68 name:ZooKeeperConnection Watcher:127.0.0.1:36566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14586 T1679 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14587 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd56000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14588 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd56000c type:create cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14589 T1679 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> C99_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52120__, base_url=http://127.0.0.1:52120/_}
[junit4:junit4] 2> 14703 T1740 C99 P52120 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35885/_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 14703 T1740 C99 P52120 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52120/_ START replicas=[http://127.0.0.1:35885/_/collection1/] nUpdates=100
[junit4:junit4] 2> 14703 T1740 C99 P52120 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 14704 T1740 C99 P52120 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 14704 T1740 C99 P52120 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 14704 T1740 C99 P52120 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 14704 T1740 C99 P52120 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 14704 T1740 C99 P52120 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35885/_/collection1/. core=collection1
[junit4:junit4] 2> 14705 T1740 C99 P52120 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C101 name=collection1 org.apache.solr.core.SolrCore@6e42ea4a url=http://127.0.0.1:35885/_/collection1 node=127.0.0.1:35885__ C101_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:35885__, base_url=http://127.0.0.1:35885/_, leader=true}
[junit4:junit4] 2> 14714 T1717 C101 P35885 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14715 T1716 C101 P35885 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=5
[junit4:junit4] 2> 14716 T1717 C101 P35885 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14717 T1717 C101 P35885 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14717 T1717 C101 P35885 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 14718 T1717 C101 P35885 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 14718 T1717 C101 P35885 oass.SolrIndexSearcher.<init> Opening Searcher@36491631 realtime
[junit4:junit4] 2> 14718 T1717 C101 P35885 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14719 T1717 C101 P35885 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 14719 T1740 C99 P52120 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 14720 T1740 C99 P52120 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 14722 T1714 C101 P35885 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 14722 T1714 C101 P35885 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 14723 T1740 C99 P52120 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 14723 T1740 C99 P52120 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 14723 T1740 C99 P52120 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 14726 T1716 C101 P35885 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 14726 T1740 C99 P52120 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 14728 T1740 C99 P52120 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty2/index.20130315082725908 forceNew: false
[junit4:junit4] 2> 14728 T1740 C99 P52120 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b970b87 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e99d4dd) fullCopy=false
[junit4:junit4] 2> 14731 T1717 C101 P35885 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14737 T1740 C99 P52120 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 14742 T1740 C99 P52120 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 14742 T1740 C99 P52120 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 14744 T1740 C99 P52120 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45833571 lockFactory=org.apache.lucene.store.NativeFSLockFactory@703ba76e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45833571 lockFactory=org.apache.lucene.store.NativeFSLockFactory@703ba76e),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 14744 T1740 C99 P52120 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 14744 T1740 C99 P52120 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 14745 T1740 C99 P52120 oass.SolrIndexSearcher.<init> Opening Searcher@64368944 main
[junit4:junit4] 2> 14746 T1739 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@64368944 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 14747 T1740 C99 P52120 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b970b87 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e99d4dd)
[junit4:junit4] 2> 14747 T1740 C99 P52120 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 14747 T1740 C99 P52120 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 14747 T1740 C99 P52120 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 14747 T1740 C99 P52120 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14749 T1740 C99 P52120 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 15410 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15410 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:35714___collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:35714__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35714/_"}
[junit4:junit4] 2> 15413 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52120___collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52120__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52120/_"}
[junit4:junit4] 2> 15416 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15416 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15416 T1754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15416 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15416 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15416 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15592 T1679 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47127__
[junit4:junit4] 2> 15592 T1684 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1fd56000c type:delete cxid:0xd zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:47127__ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:47127__
[junit4:junit4] 2> 15593 T1679 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47127__
[junit4:junit4] 2> 15594 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15595 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15595 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15595 T1737 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15595 T1754 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15595 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15595 T1771 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15595 T1754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15596 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15597 T1701 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15597 T1708 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15597 T1721 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15600 T1774 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363332445573/collection1
[junit4:junit4] 2> 15601 T1774 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 15601 T1774 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15601 T1774 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 15602 T1774 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363332445573/collection1/'
[junit4:junit4] 2> 15603 T1774 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1363332445573/collection1/lib/README' to classloader
[junit4:junit4] 2> 15603 T1774 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1363332445573/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 15628 T1774 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 15670 T1774 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15671 T1774 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15674 T1774 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 16025 T1774 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 16030 T1774 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 16032 T1774 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 16042 T1774 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16045 T1774 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16048 T1774 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16049 T1774 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16049 T1774 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16049 T1774 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16050 T1774 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16050 T1774 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16051 T1774 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 16051 T1774 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363332445573/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty4/
[junit4:junit4] 2> 16051 T1774 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@506835fb
[junit4:junit4] 2> 16051 T1774 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 16052 T1774 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty4 forceNew: false
[junit4:junit4] 2> 16052 T1774 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty4/index/
[junit4:junit4] 2> 16052 T1774 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 16053 T1774 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty4/index forceNew: false
[junit4:junit4] 2> 16054 T1774 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6568a626 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e43d432),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 16054 T1774 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 16056 T1774 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 16056 T1774 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 16056 T1774 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 16057 T1774 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 16057 T1774 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 16058 T1774 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 16058 T1774 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 16058 T1774 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 16059 T1774 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 16060 T1774 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 16063 T1774 oass.SolrIndexSearcher.<init> Opening Searcher@5de4dca7 main
[junit4:junit4] 2> 16063 T1774 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty4/tlog
[junit4:junit4] 2> 16063 T1774 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 16064 T1774 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 16068 T1775 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5de4dca7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 16070 T1774 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 16070 T1774 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16394 T1715 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:35714___collection1&state=recovering&nodeName=127.0.0.1:35714__&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2001
[junit4:junit4] 2> 16924 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16924 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:47127__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47127/_"}
[junit4:junit4] 2> 16925 T1702 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 16925 T1702 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16929 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16929 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16929 T1754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16929 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16929 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16929 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17072 T1774 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 17072 T1774 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47127/_ collection:collection1 shard:shard1
[junit4:junit4] 2> 17074 T1774 oasc.ZkController.register We are http://127.0.0.1:47127/_/collection1/ and leader is http://127.0.0.1:35885/_/collection1/
[junit4:junit4] 2> 17074 T1774 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47127/_
[junit4:junit4] 2> 17074 T1774 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 17075 T1774 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C102 name=collection1 org.apache.solr.core.SolrCore@1bb9487c url=http://127.0.0.1:47127/_/collection1 node=127.0.0.1:47127__ C102_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:47127__, base_url=http://127.0.0.1:47127/_}
[junit4:junit4] 2> 17075 T1776 C102 P47127 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 17076 T1776 C102 P47127 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17076 T1774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17076 T1776 C102 P47127 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17076 T1776 C102 P47127 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17076 T1679 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 17077 T1776 C102 P47127 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17077 T1679 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17077 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17079 T1679 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17080 T1679 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 17080 T1679 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 17081 T1679 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18082 T1679 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C100_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:35714__, base_url=http://127.0.0.1:35714/_}
[junit4:junit4] 2> 18395 T1757 C100 P35714 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35885/_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 18395 T1757 C100 P35714 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35714/_ START replicas=[http://127.0.0.1:35885/_/collection1/] nUpdates=100
[junit4:junit4] 2> 18395 T1757 C100 P35714 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 18395 T1757 C100 P35714 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 18396 T1757 C100 P35714 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 18396 T1757 C100 P35714 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 18396 T1757 C100 P35714 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 18396 T1757 C100 P35714 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35885/_/collection1/. core=collection1
[junit4:junit4] 2> 18396 T1757 C100 P35714 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18397 T1714 C101 P35885 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 18400 T1715 C101 P35885 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 18401 T1715 C101 P35885 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18401 T1715 C101 P35885 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18401 T1715 C101 P35885 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18402 T1715 C101 P35885 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 2
[junit4:junit4] 2> 18403 T1757 C100 P35714 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18403 T1757 C100 P35714 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 18405 T1714 C101 P35885 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 18406 T1757 C100 P35714 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 18406 T1757 C100 P35714 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 18407 T1757 C100 P35714 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 18412 T1715 C101 P35885 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0
[junit4:junit4] 2> 18414 T1757 C100 P35714 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 18416 T1757 C100 P35714 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty3/index.20130315082729595 forceNew: false
[junit4:junit4] 2> 18416 T1757 C100 P35714 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@47851c98 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6d42b225) fullCopy=false
[junit4:junit4] 2> 18430 T1716 C101 P35885 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 18433 T1757 C100 P35714 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 18437 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18438 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47127___collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:47127__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47127/_"}
[junit4:junit4] 2> 18438 T1757 C100 P35714 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 18438 T1757 C100 P35714 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 18439 T1757 C100 P35714 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6615b6c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57c61ce7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6615b6c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57c61ce7),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18440 T1757 C100 P35714 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18441 T1757 C100 P35714 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 18441 T1757 C100 P35714 oass.SolrIndexSearcher.<init> Opening Searcher@dec8c4e main
[junit4:junit4] 2> 18442 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18442 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18442 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18442 T1754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18442 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18442 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18443 T1756 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@dec8c4e main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 18444 T1757 C100 P35714 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@47851c98 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6d42b225)
[junit4:junit4] 2> 18444 T1757 C100 P35714 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 18445 T1757 C100 P35714 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 18445 T1757 C100 P35714 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 18446 T1757 C100 P35714 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18447 T1757 C100 P35714 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19080 T1717 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:47127___collection1&state=recovering&nodeName=127.0.0.1:47127__&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2000
[junit4:junit4] 2> 19083 T1679 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19946 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19947 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:35714___collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:35714__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35714/_"}
[junit4:junit4] 2> 19949 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19949 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19949 T1754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19949 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19949 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19949 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20085 T1679 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C102_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:47127__, base_url=http://127.0.0.1:47127/_}
[junit4:junit4] 2> 21081 T1776 C102 P47127 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35885/_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 21082 T1776 C102 P47127 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:47127/_ START replicas=[http://127.0.0.1:35885/_/collection1/] nUpdates=100
[junit4:junit4] 2> 21082 T1776 C102 P47127 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 21082 T1776 C102 P47127 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 21082 T1776 C102 P47127 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 21082 T1776 C102 P47127 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 21082 T1776 C102 P47127 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 21083 T1776 C102 P47127 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35885/_/collection1/. core=collection1
[junit4:junit4] 2> 21083 T1776 C102 P47127 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21084 T1717 C101 P35885 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 21086 T1679 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21086 T1716 C101 P35885 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21087 T1716 C101 P35885 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 21087 T1716 C101 P35885 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 21088 T1716 C101 P35885 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21088 T1716 C101 P35885 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 2
[junit4:junit4] 2> 21089 T1776 C102 P47127 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 21089 T1776 C102 P47127 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 21091 T1715 C101 P35885 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 21091 T1776 C102 P47127 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 21091 T1776 C102 P47127 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 21091 T1776 C102 P47127 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 21093 T1717 C101 P35885 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=0
[junit4:junit4] 2> 21094 T1776 C102 P47127 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 21095 T1776 C102 P47127 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363332431187/jetty4/index.20130315082732275 forceNew: false
[junit4:junit4] 2> 21095 T1776 C102 P47127 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@f223abb lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ad74394) fullCopy=false
[junit4:junit4] 2> 21097 T1716 C101 P35885 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=1
[junit4:junit4] 2> 21097 T1776 C102 P47127 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 21098 T1776 C102 P47127 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 21098 T1776 C102 P47127 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 21099 T1776 C102 P47127 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6568a626 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e43d432),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6568a626 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e43d432),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 21099 T1776 C102 P47127 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 21099 T1776 C102 P47127 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 21099 T1776 C102 P47127 oass.SolrIndexSearcher.<init> Opening Searcher@55c71997 main
[junit4:junit4] 2> 21100 T1775 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@55c71997 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 21100 T1776 C102 P47127 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@f223abb lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ad74394)
[junit4:junit4] 2> 21101 T1776 C102 P47127 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 21101 T1776 C102 P47127 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 21101 T1776 C102 P47127 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 21101 T1776 C102 P47127 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 21102 T1776 C102 P47127 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 21453 T1702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21453 T1702 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47127___collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:47127__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47127/_"}
[junit4:junit4] 2> 21456 T1721 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21456 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21456 T1754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21456 T1737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21456 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21456 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22087 T1679 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22088 T1679 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C103 name=collection1 org.apache.solr.core.SolrCore@54cfb482 url=http://127.0.0.1:46315/_/collection1 node=127.0.0.1:46315__ C103_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:46315__, base_url=http://127.0.0.1:46315/_, leader=true}
[junit4:junit4] 2> 22093 T1694 C103 P46315 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22095 T1694 C103 P46315 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4d93e103 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5be7d4e8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22095 T1694 C103 P46315 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22095 T1694 C103 P46315 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4d93e103 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5be7d4e8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4d93e103 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5be7d4e8),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22096 T1694 C103 P46315 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22096 T1694 C103 P46315 oass.SolrIndexSearcher.<init> Opening Searcher@7105159b main
[junit4:junit4] 2> 22096 T1694 C103 P46315 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22097 T1705 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7105159b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 22097 T1694 C103 P46315 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 22100 T1714 C101 P35885 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22101 T1714 C101 P35885 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 22101 T1714 C101 P35885 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 22101 T1714 C101 P35885 oass.SolrIndexSearcher.<init> Opening Searcher@32e893a main
[junit4:junit4] 2> 22102 T1714 C101 P35885 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22102 T1723 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32e893a main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22102 T1714 C101 P35885 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:52120/_/collection1/, StdNode: http://127.0.0.1:35714/_/collection1/, StdNode: http://127.0.0.1:47127/_/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> C102_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:47127__, base_url=http://127.0.0.1:47127/_}
[junit4:junit4] 2> 22108 T1767 C102 P47127 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C99_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52120__, base_url=http://127.0.0.1:52120/_}
[junit4:junit4] 2> 22108 T1732 C99 P52120 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C100_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:35714__, base_url=http://127.0.0.1:35714/_}
[junit4:junit4] 2> 22108 T1750 C100 P35714 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22109 T1767 C102 P47127 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6568a626 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e43d432),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6568a626 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e43d432),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 22109 T1732 C99 P52120 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45833571 lockFactory=org.apache.lucene.store.NativeFSLockFactory@703ba76e),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45833571 lockFactory=org.apache.lucene.store.NativeFSLockFactory@703ba76e),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 22109 T1767 C102 P47127 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 22109 T1750 C100 P35714 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6615b6c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57c61ce7),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6615b6c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57c61ce7),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 22109 T1732 C99 P52120 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 22110 T1767 C102 P47127 oass.SolrIndexSearcher.<init> Opening Searcher@54e8d586 main
[junit4:junit4] 2> 22110 T1732 C99 P52120 oass.SolrIndexSearcher.<init> Opening Searcher@18c09635 main
[junit4:junit4] 2> 22110 T1750 C100 P35714 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 22110 T1732 C99 P52120 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22110 T1767 C102 P47127 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22111 T1775 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54e8d586 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 22111 T1739 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18c09635 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22111 T1767 C102 P47127 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 2> 22110 T1750 C100 P35714 oass.SolrIndexSearcher.<init> Opening Searcher@52e4ea0c main
[junit4:junit4] 2> 22111 T1732 C99 P52120 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 2> 22112 T1750 C100 P35714 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22112 T1756 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@52e4ea0c main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 22113 T1750 C100 P35714 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 22113 T1714 C101 P35885 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 22114 T1679 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22116 T1715 C101 P35885 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 22117 T1733 C99 P52120 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 22118 T1748 C100 P35714 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 22119 T1765 C102 P47127 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 24122 T1694 C103 P46315 oass.SolrIndexSearcher.<init> Opening Searcher@513f39c realtime
[junit4:junit4] 2> 24123 T1694 C103 P46315 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429557692651798528)} 0 1
[junit4:junit4] 2> 24128 T1747 C100 P35714 /update {update.distrib=FROMLEADER&_version_=-1429557692654944256&update.from=http://127.0.0.1:35885/_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429557692654944256)} 0 1
[junit4:junit4] 2> 24128 T1732 C99 P52120 /update {update.distrib=FROMLEADER&_version_=-1429557692654944256&update.from=http://127.0.0.1:35885/_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429557692654944256)} 0 1
[junit4:junit4] 2> 24128 T1764 C102 P47127 /update {update.distrib=FROMLEADER&_version_=-1429557692654944256&update.from=http://127.0.0.1:35885/_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429557692654944256)} 0 1
[junit4:junit4] 2> 24128 T1714 C101 P35885 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429557692654944256)} 0 3
[junit4:junit4] 2> 24131 T1695 C103 P46315 /update {wt=javabin&version=2} {add=[0 (1429557692661235712)]} 0 1
[junit4:junit4] 2> 24137 T1766 C102 P47127 /update {distrib.from=http://127.0.0.1:35885/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429557692663332864)]} 0 1
[junit4:junit4] 2> 24137 T1749 C100 P35714 /update {distrib.from=http://127.0.0.1:35885/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429557692663332864)]} 0 1
[junit4:junit4] 2> 24137 T1730 C99 P52120 /update {distrib.from=http://127.0.0.1:35885/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429557692663332864)]} 0 1
[junit4:junit4] 2> 24138 T1715 C101 P35885 /update {wt=javabin&version=2} {add=[0 (1429557692663332864)]} 0 5
[junit4:junit4] 2> 24140 T1696 C103 P46315 /update {wt=javabin&version=2} {add=[1 (1429557692670672896)]} 0 1
[junit4:junit4] 2> 24145 T1767 C102 P47127 /update {distrib.from=http://127.0.0.1:35885/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429557692672770048)]} 0 1
[junit4:junit4] 2> 24145 T1731 C99 P52120 /update {distrib.from=http://127.0.0.1:35885/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429557692672770048)]} 0 1
[junit4:junit4] 2> 24145 T1750 C100 P35714 /update {distrib.from=http://127.0.0.1:35885/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429557692672770048)]} 0 1
[junit4:junit4] 2> 24145 T1717 C101 P35885 /update {wt=javabin&version=2} {add=[1 (1429557692672770048)]} 0 3
[junit4:junit4] 2> 24148 T1697 C103 P46315 /update {wt=javabin&version=2} {add=[2 (1429557692679061504)]} 0 1
[junit4:junit4] 2> 24153 T1748 C100 P35714 /update {distrib.from=http://127.0.0.1:35885/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429557692681158656)]} 0 1
[junit4:junit4] 2> 24153 T1765 C102 P47127 /update {distrib.from=http://127.0.0.1:35885/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429557692681158656)]} 0 1
[junit4:junit4] 2> 24154 T1716 C101 P35885 /update {test.distrib.skip.servers=http://127.0.0.1:52120/_/collection1/&wt=javabin&version=2} {add=[2 (1429557692681158656)]} 0 4
[junit4:junit4] 2> 24157 T1694 C103 P46315 /update {wt=javabin&version=2} {add=[3 (1429557692687450112)]} 0 1
[junit4:junit4] 2> 24162 T1764 C102 P47127 /update {distrib.from=http://127.0.0.1:35885/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1429557692690595840)]} 0 1
[junit4:junit4] 2> 24162 T1714 C101 P35885 /update {test.distrib.skip.servers=http://127.0.0.1:52120/_/collection1/&test.distrib.skip.servers=http://127.0.0.1:35714/_/collection1/&wt=javabin&version=2} {add=[3 (1429557692690595840)]} 0 3
[junit4:junit4] 2> 24164 T1695 C103 P46315 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24168 T1695 C103 P46315 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4d93e103 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5be7d4e8),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4d93e103 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5be7d4e8),segFN=segments_3,generation=3,filenames=[_0_NestedPulsing_0.doc, _0.fnm, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_MockVariableIntBlock_0.pyl, _0_NestedPulsing_0.pos, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0_SimpleText_0.pst, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, _0.fdt, _0_MockVariableIntBlock_0.tii, segments_3]
[junit4:junit4] 2> 24168 T1695 C103 P46315 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_NestedPulsing_0.doc, _0.fnm, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_MockVariableIntBlock_0.pyl, _0_NestedPulsing_0.pos, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0_SimpleText_0.pst, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, _0.fdt, _0_MockVariableIntBlock_0.tii, segments_3]
[junit4:junit4] 2> 24169 T1695 C103 P46315 oass.SolrIndexSearcher.<init> Opening Searcher@79befd30 main
[junit4:junit4] 2> 24170 T1695 C103 P46315 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24170 T1705 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@79befd30 main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 24171 T1695 C103 P46315 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 24173 T1715 C101 P35885 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24176 T1715 C101 P35885 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=5
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e5e3fbd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b0ca714),segFN=segments_6,generation=6,filenames=[_0_NestedPulsing_0.doc, _0.fnm, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_MockVariableIntBlock_0.pyl, _0_NestedPulsing_0.pos, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0_SimpleText_0.pst, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, segments_6, _0.fdt, _0_MockVariableIntBlock_0.tii]
[junit4:junit4] 2> 24176 T1715 C101 P35885 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0_NestedPulsing_0.doc, _0.fnm, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_MockVariableIntBlock_0.pyl, _0_NestedPulsing_0.pos, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0_SimpleText_0.pst, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, segments_6, _0.fdt, _0_MockVariableIntBlock_0.tii]
[junit4:junit4] 2> 24177 T1715 C101 P35885 oass.SolrIndexSearcher.<init> Opening Searcher@d05caa3 main
[junit4:junit4] 2> 24178 T1715 C101 P35885 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24178 T1723 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d05caa3 main{StandardDirectoryReader(segments_6:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 24178 T1715 C101 P35885 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:52120/_/collection1/, StdNode: http://127.0.0.1:35714/_/collection1/, StdNode: http://127.0.0.1:47127/_/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 24180 T1733 C99 P52120 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24180 T1766 C102 P47127 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24180 T1747 C100 P35714 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24184 T1747 C100 P35714 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6615b6c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57c61ce7),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6615b6c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57c61ce7),segFN=segments_5,generation=5,filenames=[_0_NestedPulsing_0.doc, _0.fnm, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_MockVariableIntBlock_0.pyl, _0_NestedPulsing_0.pos, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0_SimpleText_0.pst, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, segments_5, _0.fdt, _0_MockVariableIntBlock_0.tii]
[junit4:junit4] 2> 24184 T1766 C102 P47127 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6568a626 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e43d432),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6568a626 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e43d432),segFN=segments_6,generation=6,filenames=[_0_NestedPulsing_0.doc, _0.fnm, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_MockVariableIntBlock_0.pyl, _0_NestedPulsing_0.pos, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0_SimpleText_0.pst, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, segments_6, _0.fdt, _0_MockVariableIntBlock_0.tii]
[junit4:junit4] 2> 24184 T1733 C99 P52120 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45833571 lockFactory=org.apache.lucene.store.NativeFSLockFactory@703ba76e),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45833571 lockFactory=org.apache.lucene.store.NativeFSLockFactory@703ba76e),segFN=segments_4,generation=4,filenames=[_0_NestedPulsing_0.doc, _0.fnm, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_MockVariableIntBlock_0.pyl, _0_NestedPulsing_0.pos, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0_SimpleText_0.pst, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, _0.fdt, _0_MockVariableIntBlock_0.tii, segments_4]
[junit4:junit4] 2> 24184 T1747 C100 P35714 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[_0_NestedPulsing_0.doc, _0.fnm, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_MockVariableIntBlock_0.pyl, _0_NestedPulsing_0.pos, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0_SimpleText_0.pst, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, segments_5, _0.fdt, _0_MockVariableIntBlock_0.tii]
[junit4:junit4] 2> 24185 T1733 C99 P52120 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0_NestedPulsing_0.doc, _0.fnm, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_MockVariableIntBlock_0.pyl, _0_NestedPulsing_0.pos, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0_SimpleText_0.pst, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, _0.fdt, _0_MockVariableIntBlock_0.tii, segments_4]
[junit4:junit4] 2> 24185 T1766 C102 P47127 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0_NestedPulsing_0.doc, _0.fnm, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_NestedPulsing_0.tip, _0_NestedPulsing_0.tim, _0_MockVariableIntBlock_0.pyl, _0_NestedPulsing_0.pos, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0_SimpleText_0.pst, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, segments_6, _0.fdt, _0_MockVariableIntBlock_0.tii]
[junit4:junit4] 2> 24186 T1747 C100 P35714 oass.SolrIndexSearcher.<init> Opening Searcher@50ea5f23 main
[junit4:junit4] 2> 24186 T1766 C102 P47127 oass.SolrIndexSearcher.<init> Opening Searcher@44dacaca main
[junit4:junit4] 2> 24186 T1747 C100 P35714 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24187 T1766 C102 P47127 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24187 T1756 oasc.JmxMonitoredMap.put WARNING Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:453)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.internal_addObject(DefaultMBeanServerInterceptor.java:1484)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:963)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:917)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:312)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:483)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:239)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1763)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:129)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1640)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4:junit4] 2>
[junit4:junit4] 2> 24187 T1775 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@44dacaca main{StandardDirectoryReader(segments_6:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 24187 T1733 C99 P52120 oass.SolrIndexSearcher.<init> Opening Searcher@643f6eaa main
[junit4:junit4] 2> 24188 T1756 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@50ea5f23 main{StandardDirectoryReader(segments_5:3:nrt _0(4.3):C3)}
[junit4:junit4] 2> 24188 T1766 C102 P47127 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 24188 T1733 C99 P52120 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24188 T1747 C100 P35714 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 24188 T1739 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@643f6eaa main{StandardDirectoryReader(segments_4:3:nrt _0(4.3):C2)}
[junit4:junit4] 2> 24189 T1733 C99 P52120 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 24189 T1715 C101 P35885 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4] 2> 24190 T1679 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 24190 T1679 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24191 T1679 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 24193 T1717 C101 P35885 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 24195 T1732 C99 P52120 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0
[junit4:junit4] 2> 24197 T1749 C100 P35714 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=3 status=0 QTime=0
[junit4:junit4] 2> 24199 T1767 C102 P47127 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 24201 T1679 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 24206 T1750 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 24207 T1750 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 24211 T1714 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 24211 T1714 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35885/_/collection1/
[junit4:junit4] 2> 24211 T1714 oasu
[...truncated too long message...]
4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:662)
[junit4:junit4] 2> 48569 T1679 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 48572 T1678 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 48659 T1754 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 48660 T1754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 48660 T1754 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 48660 T1754 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 48819 T1682 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 49748 T1771 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 49748 T1771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 49748 T1771 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 49748 T1771 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_l=Pulsing41(freqCutoff=16 minBlockSize=75 maxBlockSize=197), text=MockVariableIntBlock(baseBlockSize=54), _version_=PostingsFormat(name=SimpleText), rnd_b=PostingsFormat(name=NestedPulsing), intDefault=Pulsing41(freqCutoff=16 minBlockSize=75 maxBlockSize=197), id=PostingsFormat(name=NestedPulsing), timestamp=Pulsing41(freqCutoff=16 minBlockSize=75 maxBlockSize=197), a_t=Pulsing41(freqCutoff=16 minBlockSize=75 maxBlockSize=197), range_facet_sl=PostingsFormat(name=NestedPulsing), range_facet_si=Pulsing41(freqCutoff=16 minBlockSize=75 maxBlockSize=197), other_tl1=Pulsing41(freqCutoff=16 minBlockSize=75 maxBlockSize=197), multiDefault=Pulsing41(freqCutoff=16 minBlockSize=75 maxBlockSize=197), a_si=PostingsFormat(name=SimpleText)}, docValues:{}, sim=DefaultSimilarity, locale=el, timezone=Europe/Tirane
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Sun Microsystems Inc. 1.6.0_41 (64-bit)/cpus=8,threads=7,free=80132976,total=200892416
[junit4:junit4] 2> NOTE: All tests run in this JVM: [SolrCoreCheckLockOnStartupTest, TestCSVLoader, DisMaxRequestHandlerTest, TestWordDelimiterFilterFactory, RequestHandlersTest, CurrencyFieldXmlFileTest, StatsComponentTest, TestBM25SimilarityFactory, SuggesterTSTTest, DocumentAnalysisRequestHandlerTest, TestHashPartitioner, SolrRequestParserTest, TestBinaryField, TestSuggestSpellingConverter, TestIndexSearcher, SpellPossibilityIteratorTest, HardAutoCommitTest, SuggesterWFSTTest, SpellCheckComponentTest, TestDefaultSimilarityFactory, TestLuceneMatchVersion, XmlUpdateRequestHandlerTest, DirectSolrSpellCheckerTest, SolrIndexConfigTest, TestArbitraryIndexDir, CurrencyFieldOpenExchangeTest, TestRTGBase, TestAnalyzedSuggestions, DOMUtilTest, CoreContainerCoreInitFailuresTest, TestJmxIntegration, OutputWriterTest, SpellCheckCollatorTest, TestSolrXMLSerializer, TestSolrJ, HighlighterConfigTest, TestFastOutputStream, TestUtils, DebugComponentTest, TestQuerySenderNoQuery, MultiTermTest, TestSolrDiscoveryProperties, TestDynamicFieldCollectionResource, ZkNodePropsTest, TestMergePolicyConfig, BasicZkTest, TestRandomFaceting, TestStressLucene, CopyFieldTest, TestNumberUtils, TestCSVResponseWriter, TestShardHandlerFactory, TestMultiCoreConfBootstrap, TestSystemIdResolver, TestFieldResource, TestIndexingPerformance, OpenExchangeRatesOrgProviderTest, SolrCmdDistributorTest, FieldAnalysisRequestHandlerTest, ChaosMonkeySafeLeaderTest, NoCacheHeaderTest, TimeZoneUtilsTest, TestFieldTypeResource, UniqFieldsUpdateProcessorFactoryTest, SortByFunctionTest, BasicDistributedZkTest, BasicDistributedZk2Test, SyncSliceTest]
[junit4:junit4] Completed on J1 in 49.86s, 1 test, 1 failure <<< FAILURES!
[...truncated 422 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 40 minutes 11 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.6.0_41 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build #
4684 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4684/
Java: 32bit/jdk1.8.0-ea-b79 -server -XX:+UseParallelGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([CC6008A501E9361:8D208E922741F35D]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9202 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 0 T1026 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 6 T1026 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1363326399044
[junit4:junit4] 2> 7 T1026 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 8 T1027 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 9 T1027 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 9 T1027 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 10 T1027 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 10 T1027 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 11 T1027 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1363326399043/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 108 T1026 oasc.ZkTestServer.run start zk server on port:59828
[junit4:junit4] 2> 109 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@675008
[junit4:junit4] 2> 111 T1032 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 111 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 112 T1032 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 112 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44577
[junit4:junit4] 2> 113 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44577
[junit4:junit4] 2> 113 T1030 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 117 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f2490000 with negotiated timeout 10000 for client /127.0.0.1:44577
[junit4:junit4] 2> 117 T1032 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f2490000, negotiated timeout = 10000
[junit4:junit4] 2> 117 T1033 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@675008 name:ZooKeeperConnection Watcher:127.0.0.1:59828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 117 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 118 T1026 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 120 T1031 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c95f2490000
[junit4:junit4] 2> 121 T1033 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 121 T1028 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44577 which had sessionid 0x13d6c95f2490000
[junit4:junit4] 2> 120 T1026 oaz.ZooKeeper.close Session: 0x13d6c95f2490000 closed
[junit4:junit4] 2> 121 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@a0a134
[junit4:junit4] 2> 122 T1034 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 122 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 122 T1034 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 122 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44578
[junit4:junit4] 2> 123 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44578
[junit4:junit4] 2> 123 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f2490001 with negotiated timeout 10000 for client /127.0.0.1:44578
[junit4:junit4] 2> 123 T1034 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f2490001, negotiated timeout = 10000
[junit4:junit4] 2> 124 T1035 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a0a134 name:ZooKeeperConnection Watcher:127.0.0.1:59828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 124 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 124 T1026 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 127 T1026 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 129 T1026 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 130 T1026 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 132 T1026 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 133 T1026 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 136 T1026 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 137 T1026 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 140 T1026 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 141 T1026 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 144 T1026 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 144 T1026 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 147 T1026 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 148 T1026 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 150 T1026 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 150 T1026 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 153 T1026 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 153 T1026 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 157 T1026 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 157 T1026 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 159 T1026 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 160 T1026 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 163 T1031 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c95f2490001
[junit4:junit4] 2> 163 T1035 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 163 T1026 oaz.ZooKeeper.close Session: 0x13d6c95f2490001 closed
[junit4:junit4] 2> 163 T1028 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44578 which had sessionid 0x13d6c95f2490001
[junit4:junit4] 2> 235 T1026 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 239 T1026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48124
[junit4:junit4] 2> 240 T1026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 240 T1026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 241 T1026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363326399201
[junit4:junit4] 2> 241 T1026 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363326399201/solr.xml
[junit4:junit4] 2> 241 T1026 oasc.CoreContainer.<init> New CoreContainer 16407352
[junit4:junit4] 2> 242 T1026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363326399201/'
[junit4:junit4] 2> 242 T1026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363326399201/'
[junit4:junit4] 2> 264 T1026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 264 T1026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 265 T1026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 265 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 265 T1026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 266 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 266 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 266 T1026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 266 T1026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 267 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 273 T1026 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 282 T1026 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59828/solr
[junit4:junit4] 2> 283 T1026 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 283 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@18262f7
[junit4:junit4] 2> 284 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 284 T1045 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 284 T1045 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 285 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44579
[junit4:junit4] 2> 285 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44579
[junit4:junit4] 2> 287 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f2490002 with negotiated timeout 20000 for client /127.0.0.1:44579
[junit4:junit4] 2> 287 T1045 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f2490002, negotiated timeout = 20000
[junit4:junit4] 2> 287 T1046 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18262f7 name:ZooKeeperConnection Watcher:127.0.0.1:59828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 287 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 288 T1031 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c95f2490002
[junit4:junit4] 2> 289 T1046 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 289 T1028 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44579 which had sessionid 0x13d6c95f2490002
[junit4:junit4] 2> 289 T1026 oaz.ZooKeeper.close Session: 0x13d6c95f2490002 closed
[junit4:junit4] 2> 289 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 292 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@37826c
[junit4:junit4] 2> 293 T1047 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 293 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 293 T1047 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 293 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44580
[junit4:junit4] 2> 294 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44580
[junit4:junit4] 2> 294 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f2490003 with negotiated timeout 20000 for client /127.0.0.1:44580
[junit4:junit4] 2> 294 T1047 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f2490003, negotiated timeout = 20000
[junit4:junit4] 2> 294 T1048 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37826c name:ZooKeeperConnection Watcher:127.0.0.1:59828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 295 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 296 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 297 T1026 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 298 T1026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48124_
[junit4:junit4] 2> 299 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48124_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48124_
[junit4:junit4] 2> 299 T1026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48124_
[junit4:junit4] 2> 301 T1026 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 305 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 306 T1026 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 307 T1026 oasc.Overseer.start Overseer (id=89346958888075267-127.0.0.1:48124_-n_0000000000) starting
[junit4:junit4] 2> 308 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 308 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 309 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 310 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 310 T1050 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 311 T1026 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 313 T1026 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 314 T1026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 316 T1049 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 318 T1051 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363326399201/collection1
[junit4:junit4] 2> 318 T1051 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 319 T1051 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 319 T1051 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 319 T1051 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363326399201/collection1/'
[junit4:junit4] 2> 320 T1051 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363326399201/collection1/lib/README' to classloader
[junit4:junit4] 2> 320 T1051 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363326399201/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 341 T1051 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 367 T1051 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 367 T1051 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 371 T1051 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 649 T1051 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 654 T1051 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 657 T1051 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 667 T1051 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 669 T1051 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 672 T1051 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 672 T1051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 673 T1051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 674 T1051 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 674 T1051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 675 T1051 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 675 T1051 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 675 T1051 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363326399201/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363326399043/control/data/
[junit4:junit4] 2> 675 T1051 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@161dda
[junit4:junit4] 2> 675 T1051 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 676 T1051 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/control/data forceNew: false
[junit4:junit4] 2> 676 T1051 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363326399043/control/data/index/
[junit4:junit4] 2> 676 T1051 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363326399043/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 676 T1051 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/control/data/index forceNew: false
[junit4:junit4] 2> 678 T1051 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1838199 lockFactory=org.apache.lucene.store.NativeFSLockFactory@177e5b1; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 678 T1051 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 679 T1051 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 679 T1051 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 680 T1051 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 680 T1051 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 680 T1051 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 681 T1051 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 681 T1051 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 681 T1051 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 681 T1051 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 683 T1051 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 685 T1051 oass.SolrIndexSearcher.<init> Opening Searcher@1848229 main
[junit4:junit4] 2> 686 T1051 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363326399043/control/data/tlog
[junit4:junit4] 2> 686 T1051 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 686 T1051 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 689 T1052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1848229 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 689 T1051 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 689 T1051 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 690 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 1818 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1819 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:48124_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48124",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 1819 T1049 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1819 T1049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1820 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1823 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2692 T1051 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2692 T1051 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48124 collection:control_collection shard:shard1
[junit4:junit4] 2> 2693 T1051 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2697 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2697 T1051 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2698 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2699 T1051 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2699 T1051 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2699 T1051 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48124/collection1/
[junit4:junit4] 2> 2699 T1051 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2700 T1051 oasc.SyncStrategy.syncToMe http://127.0.0.1:48124/collection1/ has no replicas
[junit4:junit4] 2> 2700 T1051 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48124/collection1/
[junit4:junit4] 2> 2700 T1051 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2703 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3326 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3335 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3356 T1051 oasc.ZkController.register We are http://127.0.0.1:48124/collection1/ and leader is http://127.0.0.1:48124/collection1/
[junit4:junit4] 2> 3356 T1051 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48124
[junit4:junit4] 2> 3356 T1051 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3356 T1051 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3357 T1051 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3358 T1051 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3359 T1026 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3360 T1026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3360 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3364 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3365 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1194eb8
[junit4:junit4] 2> 3367 T1054 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3366 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3367 T1054 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 3367 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44583
[junit4:junit4] 2> 3367 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44583
[junit4:junit4] 2> 3368 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f2490004 with negotiated timeout 10000 for client /127.0.0.1:44583
[junit4:junit4] 2> 3368 T1054 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f2490004, negotiated timeout = 10000
[junit4:junit4] 2> 3369 T1055 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1194eb8 name:ZooKeeperConnection Watcher:127.0.0.1:59828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3369 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3371 T1026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3373 T1026 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3439 T1026 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3441 T1026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40543
[junit4:junit4] 2> 3441 T1026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3442 T1026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3442 T1026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363326402410
[junit4:junit4] 2> 3442 T1026 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363326402410/solr.xml
[junit4:junit4] 2> 3443 T1026 oasc.CoreContainer.<init> New CoreContainer 23005685
[junit4:junit4] 2> 3443 T1026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363326402410/'
[junit4:junit4] 2> 3443 T1026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363326402410/'
[junit4:junit4] 2> 3459 T1026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3460 T1026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3460 T1026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3460 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3461 T1026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3461 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3461 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3462 T1026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3462 T1026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3462 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3468 T1026 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3477 T1026 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59828/solr
[junit4:junit4] 2> 3477 T1026 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3477 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@124151f
[junit4:junit4] 2> 3478 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3478 T1065 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3479 T1065 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 3479 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44584
[junit4:junit4] 2> 3479 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44584
[junit4:junit4] 2> 3480 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f2490005 with negotiated timeout 20000 for client /127.0.0.1:44584
[junit4:junit4] 2> 3480 T1065 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f2490005, negotiated timeout = 20000
[junit4:junit4] 2> 3480 T1066 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@124151f name:ZooKeeperConnection Watcher:127.0.0.1:59828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3480 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3481 T1031 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c95f2490005
[junit4:junit4] 2> 3482 T1066 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3482 T1028 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44584 which had sessionid 0x13d6c95f2490005
[junit4:junit4] 2> 3482 T1026 oaz.ZooKeeper.close Session: 0x13d6c95f2490005 closed
[junit4:junit4] 2> 3482 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3485 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@692e14
[junit4:junit4] 2> 3486 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3486 T1067 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3486 T1067 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 3486 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44585
[junit4:junit4] 2> 3487 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44585
[junit4:junit4] 2> 3487 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f2490006 with negotiated timeout 20000 for client /127.0.0.1:44585
[junit4:junit4] 2> 3487 T1067 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f2490006, negotiated timeout = 20000
[junit4:junit4] 2> 3488 T1068 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@692e14 name:ZooKeeperConnection Watcher:127.0.0.1:59828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3488 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3488 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3489 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3490 T1026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4493 T1026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40543_
[junit4:junit4] 2> 4494 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40543_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40543_
[junit4:junit4] 2> 4495 T1026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40543_
[junit4:junit4] 2> 4498 T1055 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4498 T1048 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4498 T1068 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4498 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4503 T1069 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363326402410/collection1
[junit4:junit4] 2> 4503 T1069 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4504 T1069 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4504 T1069 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4505 T1069 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363326402410/collection1/'
[junit4:junit4] 2> 4505 T1069 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363326402410/collection1/lib/README' to classloader
[junit4:junit4] 2> 4505 T1069 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363326402410/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4533 T1069 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 4558 T1069 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4559 T1069 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4562 T1069 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4840 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4841 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:48124_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48124",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 4845 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4845 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4845 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4849 T1069 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 4854 T1069 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 4856 T1069 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 4870 T1069 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 4874 T1069 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 4876 T1069 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 4877 T1069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 4878 T1069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 4878 T1069 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 4879 T1069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 4879 T1069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 4880 T1069 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 4880 T1069 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363326402410/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty1/
[junit4:junit4] 2> 4880 T1069 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@161dda
[junit4:junit4] 2> 4881 T1069 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 4881 T1069 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty1 forceNew: false
[junit4:junit4] 2> 4882 T1069 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty1/index/
[junit4:junit4] 2> 4882 T1069 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 4882 T1069 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty1/index forceNew: false
[junit4:junit4] 2> 4884 T1069 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 4885 T1069 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 4887 T1069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 4888 T1069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 4888 T1069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 4889 T1069 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 4890 T1069 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 4890 T1069 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 4890 T1069 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 4890 T1069 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 4891 T1069 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 4893 T1069 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 4896 T1069 oass.SolrIndexSearcher.<init> Opening Searcher@79ddf2 main
[junit4:junit4] 2> 4896 T1069 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty1/tlog
[junit4:junit4] 2> 4896 T1069 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 4896 T1069 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 4899 T1070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@79ddf2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 4900 T1069 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 4901 T1069 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6348 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6349 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40543_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40543",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 6349 T1049 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 6349 T1049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6352 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6352 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6353 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6902 T1069 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 6902 T1069 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40543 collection:collection1 shard:shard1
[junit4:junit4] 2> 6903 T1069 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 6908 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 6909 T1069 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 6909 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6911 T1069 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 6911 T1069 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 6911 T1069 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40543/collection1/
[junit4:junit4] 2> 6911 T1069 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 6911 T1069 oasc.SyncStrategy.syncToMe http://127.0.0.1:40543/collection1/ has no replicas
[junit4:junit4] 2> 6912 T1069 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40543/collection1/
[junit4:junit4] 2> 6912 T1069 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 6914 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7856 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7863 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7863 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7863 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7868 T1069 oasc.ZkController.register We are http://127.0.0.1:40543/collection1/ and leader is http://127.0.0.1:40543/collection1/
[junit4:junit4] 2> 7868 T1069 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40543
[junit4:junit4] 2> 7868 T1069 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 7869 T1069 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 7869 T1069 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 7871 T1069 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7872 T1026 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 7873 T1026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 7873 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 7933 T1026 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 7935 T1026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60950
[junit4:junit4] 2> 7936 T1026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 7936 T1026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 7936 T1026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363326406913
[junit4:junit4] 2> 7936 T1026 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363326406913/solr.xml
[junit4:junit4] 2> 7937 T1026 oasc.CoreContainer.<init> New CoreContainer 8037208
[junit4:junit4] 2> 7937 T1026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363326406913/'
[junit4:junit4] 2> 7937 T1026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363326406913/'
[junit4:junit4] 2> 7953 T1026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 7954 T1026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 7954 T1026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 7955 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 7955 T1026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 7955 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 7955 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 7956 T1026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 7956 T1026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 7956 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 7963 T1026 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 7972 T1026 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59828/solr
[junit4:junit4] 2> 7972 T1026 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 7973 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1027cd1
[junit4:junit4] 2> 7973 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7974 T1081 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 7974 T1081 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 7974 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44594
[junit4:junit4] 2> 7975 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44594
[junit4:junit4] 2> 7976 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f2490007 with negotiated timeout 20000 for client /127.0.0.1:44594
[junit4:junit4] 2> 7976 T1081 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f2490007, negotiated timeout = 20000
[junit4:junit4] 2> 7976 T1082 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1027cd1 name:ZooKeeperConnection Watcher:127.0.0.1:59828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7977 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7977 T1031 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c95f2490007
[junit4:junit4] 2> 7978 T1082 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 7978 T1028 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44594 which had sessionid 0x13d6c95f2490007
[junit4:junit4] 2> 7978 T1026 oaz.ZooKeeper.close Session: 0x13d6c95f2490007 closed
[junit4:junit4] 2> 7978 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 7981 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@fed40d
[junit4:junit4] 2> 7982 T1083 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 7982 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 7982 T1083 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 7982 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44595
[junit4:junit4] 2> 7982 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44595
[junit4:junit4] 2> 7983 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f2490008 with negotiated timeout 20000 for client /127.0.0.1:44595
[junit4:junit4] 2> 7983 T1083 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f2490008, negotiated timeout = 20000
[junit4:junit4] 2> 7983 T1084 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fed40d name:ZooKeeperConnection Watcher:127.0.0.1:59828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 7983 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 7984 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7985 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7986 T1026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 8988 T1026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60950_
[junit4:junit4] 2> 8989 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f2490008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60950_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60950_
[junit4:junit4] 2> 8989 T1026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60950_
[junit4:junit4] 2> 8992 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8992 T1048 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8993 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8993 T1055 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8993 T1084 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8993 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 8994 T1068 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 8998 T1085 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363326406913/collection1
[junit4:junit4] 2> 8998 T1085 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 8998 T1085 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 8999 T1085 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 8999 T1085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363326406913/collection1/'
[junit4:junit4] 2> 9000 T1085 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363326406913/collection1/lib/README' to classloader
[junit4:junit4] 2> 9000 T1085 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363326406913/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9032 T1085 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 9073 T1085 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9074 T1085 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9079 T1085 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9367 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9368 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40543_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40543",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 9371 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9371 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9371 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9372 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9410 T1085 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9418 T1085 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9421 T1085 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9434 T1085 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9437 T1085 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9440 T1085 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9441 T1085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9441 T1085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9442 T1085 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9442 T1085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9443 T1085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9443 T1085 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9443 T1085 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363326406913/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty2/
[junit4:junit4] 2> 9443 T1085 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@161dda
[junit4:junit4] 2> 9443 T1085 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9444 T1085 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty2 forceNew: false
[junit4:junit4] 2> 9444 T1085 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty2/index/
[junit4:junit4] 2> 9444 T1085 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9444 T1085 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty2/index forceNew: false
[junit4:junit4] 2> 9446 T1085 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1acb6c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f4abba; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9446 T1085 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9448 T1085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9448 T1085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9449 T1085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9449 T1085 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9449 T1085 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9449 T1085 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9450 T1085 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9450 T1085 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9451 T1085 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9453 T1085 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9456 T1085 oass.SolrIndexSearcher.<init> Opening Searcher@1a13ed9 main
[junit4:junit4] 2> 9456 T1085 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty2/tlog
[junit4:junit4] 2> 9456 T1085 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9456 T1085 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9459 T1086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a13ed9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9461 T1085 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9461 T1085 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10876 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10877 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60950_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60950",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 10877 T1049 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 10877 T1049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 10883 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10883 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10883 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10883 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11462 T1085 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11462 T1085 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60950 collection:collection1 shard:shard1
[junit4:junit4] 2> 11464 T1085 oasc.ZkController.register We are http://127.0.0.1:60950/collection1/ and leader is http://127.0.0.1:40543/collection1/
[junit4:junit4] 2> 11465 T1085 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60950
[junit4:junit4] 2> 11465 T1085 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 11465 T1085 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C59 name=collection1 org.apache.solr.core.SolrCore@c9178c url=http://127.0.0.1:60950/collection1 node=127.0.0.1:60950_ C59_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:60950_, base_url=http://127.0.0.1:60950, core=collection1, state=down}
[junit4:junit4] 2> 11465 T1087 C59 P60950 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 11465 T1085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11466 T1087 C59 P60950 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 11466 T1087 C59 P60950 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 11466 T1087 C59 P60950 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11467 T1026 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 11467 T1087 C59 P60950 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11467 T1026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 11468 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11528 T1026 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 11530 T1026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45691
[junit4:junit4] 2> 11530 T1026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 11531 T1026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 11531 T1026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363326410509
[junit4:junit4] 2> 11531 T1026 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363326410509/solr.xml
[junit4:junit4] 2> 11531 T1026 oasc.CoreContainer.<init> New CoreContainer 18896781
[junit4:junit4] 2> 11532 T1026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363326410509/'
[junit4:junit4] 2> 11532 T1026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363326410509/'
[junit4:junit4] 2> 11549 T1026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 11549 T1026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 11550 T1026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 11550 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 11550 T1026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 11551 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 11551 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 11551 T1026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 11551 T1026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 11552 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 11557 T1026 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 11566 T1026 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59828/solr
[junit4:junit4] 2> 11566 T1026 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 11567 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@86c02d
[junit4:junit4] 2> 11567 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11568 T1098 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 11568 T1098 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 11568 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44598
[junit4:junit4] 2> 11569 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44598
[junit4:junit4] 2> 11569 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f2490009 with negotiated timeout 20000 for client /127.0.0.1:44598
[junit4:junit4] 2> 11569 T1098 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f2490009, negotiated timeout = 20000
[junit4:junit4] 2> 11570 T1099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@86c02d name:ZooKeeperConnection Watcher:127.0.0.1:59828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11570 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11571 T1031 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c95f2490009
[junit4:junit4] 2> 11571 T1099 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 11571 T1028 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44598 which had sessionid 0x13d6c95f2490009
[junit4:junit4] 2> 11571 T1026 oaz.ZooKeeper.close Session: 0x13d6c95f2490009 closed
[junit4:junit4] 2> 11572 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 11574 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@ae22a9
[junit4:junit4] 2> 11575 T1100 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 11575 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11576 T1100 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 11576 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44599
[junit4:junit4] 2> 11576 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44599
[junit4:junit4] 2> 11577 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f249000a with negotiated timeout 20000 for client /127.0.0.1:44599
[junit4:junit4] 2> 11577 T1100 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f249000a, negotiated timeout = 20000
[junit4:junit4] 2> 11577 T1101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ae22a9 name:ZooKeeperConnection Watcher:127.0.0.1:59828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11577 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11578 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f249000a type:create cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11578 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f249000a type:create cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11580 T1026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 12386 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12387 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60950_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60950",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 12389 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12390 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12390 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12390 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12390 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12473 T1061 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&checkLive=true&nodeName=127.0.0.1:60950_&onlyIfLeader=true&wt=javabin&state=recovering&core=collection1&coreNodeName=3&action=PREPRECOVERY} status=0 QTime=1000
[junit4:junit4] 2> 12582 T1026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45691_
[junit4:junit4] 2> 12583 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f249000a type:delete cxid:0xd zxid:0x87 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45691_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45691_
[junit4:junit4] 2> 12583 T1026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45691_
[junit4:junit4] 2> 12585 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12585 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12585 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12585 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12585 T1055 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12586 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12587 T1101 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12587 T1068 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12587 T1048 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12587 T1084 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12590 T1102 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363326410509/collection1
[junit4:junit4] 2> 12591 T1102 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 12591 T1102 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 12591 T1102 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 12592 T1102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363326410509/collection1/'
[junit4:junit4] 2> 12592 T1102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363326410509/collection1/lib/README' to classloader
[junit4:junit4] 2> 12593 T1102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363326410509/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 12616 T1102 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 12653 T1102 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 12654 T1102 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 12658 T1102 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 12943 T1102 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 12948 T1102 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 12950 T1102 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 12963 T1102 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12965 T1102 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12968 T1102 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12969 T1102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 12970 T1102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 12970 T1102 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12971 T1102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 12971 T1102 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 12971 T1102 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 12971 T1102 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363326410509/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty3/
[junit4:junit4] 2> 12972 T1102 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@161dda
[junit4:junit4] 2> 12972 T1102 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 12972 T1102 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty3 forceNew: false
[junit4:junit4] 2> 12973 T1102 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty3/index/
[junit4:junit4] 2> 12973 T1102 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 12973 T1102 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty3/index forceNew: false
[junit4:junit4] 2> 12974 T1102 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@12c94d lockFactory=org.apache.lucene.store.NativeFSLockFactory@46e3ab; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 12974 T1102 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 12976 T1102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 12976 T1102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 12976 T1102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 12977 T1102 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 12977 T1102 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 12977 T1102 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 12977 T1102 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 12978 T1102 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 12978 T1102 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 12980 T1102 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 12982 T1102 oass.SolrIndexSearcher.<init> Opening Searcher@1d37316 main
[junit4:junit4] 2> 12982 T1102 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty3/tlog
[junit4:junit4] 2> 12983 T1102 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 12983 T1102 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 12986 T1103 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d37316 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 12987 T1102 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 12987 T1102 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13894 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13895 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45691_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45691",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 13895 T1049 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 13895 T1049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 13898 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13898 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13898 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13898 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13899 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13989 T1102 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 13989 T1102 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45691 collection:collection1 shard:shard1
[junit4:junit4] 2> 13992 T1102 oasc.ZkController.register We are http://127.0.0.1:45691/collection1/ and leader is http://127.0.0.1:40543/collection1/
[junit4:junit4] 2> 13993 T1102 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45691
[junit4:junit4] 2> 13993 T1102 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 13993 T1102 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C60 name=collection1 org.apache.solr.core.SolrCore@143f678 url=http://127.0.0.1:45691/collection1 node=127.0.0.1:45691_ C60_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:45691_, base_url=http://127.0.0.1:45691, core=collection1, state=down}
[junit4:junit4] 2> 13993 T1104 C60 P45691 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 13994 T1104 C60 P45691 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 13994 T1102 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13994 T1104 C60 P45691 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 13994 T1104 C60 P45691 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13995 T1026 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 13995 T1104 C60 P45691 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 13995 T1026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 13996 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14056 T1026 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14058 T1026 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40393
[junit4:junit4] 2> 14058 T1026 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14059 T1026 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14059 T1026 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363326413037
[junit4:junit4] 2> 14059 T1026 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363326413037/solr.xml
[junit4:junit4] 2> 14060 T1026 oasc.CoreContainer.<init> New CoreContainer 16676206
[junit4:junit4] 2> 14060 T1026 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363326413037/'
[junit4:junit4] 2> 14060 T1026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363326413037/'
[junit4:junit4] 2> 14077 T1026 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 14077 T1026 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14078 T1026 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14078 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14078 T1026 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14079 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14079 T1026 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14079 T1026 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14079 T1026 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14080 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14085 T1026 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14094 T1026 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59828/solr
[junit4:junit4] 2> 14095 T1026 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14095 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@148cdc8
[junit4:junit4] 2> 14096 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14096 T1115 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14097 T1115 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 14097 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44602
[junit4:junit4] 2> 14097 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44602
[junit4:junit4] 2> 14098 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f249000b with negotiated timeout 20000 for client /127.0.0.1:44602
[junit4:junit4] 2> 14098 T1115 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f249000b, negotiated timeout = 20000
[junit4:junit4] 2> 14098 T1116 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@148cdc8 name:ZooKeeperConnection Watcher:127.0.0.1:59828 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14098 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14099 T1031 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c95f249000b
[junit4:junit4] 2> 14100 T1116 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14100 T1028 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44602 which had sessionid 0x13d6c95f249000b
[junit4:junit4] 2> 14100 T1026 oaz.ZooKeeper.close Session: 0x13d6c95f249000b closed
[junit4:junit4] 2> 14100 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 14103 T1026 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59828/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@e5b3fb
[junit4:junit4] 2> 14104 T1026 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14104 T1117 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59828. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14104 T1117 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59828, initiating session
[junit4:junit4] 2> 14104 T1028 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44603
[junit4:junit4] 2> 14105 T1028 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44603
[junit4:junit4] 2> 14105 T1030 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c95f249000c with negotiated timeout 20000 for client /127.0.0.1:44603
[junit4:junit4] 2> 14105 T1117 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59828, sessionid = 0x13d6c95f249000c, negotiated timeout = 20000
[junit4:junit4] 2> 14106 T1118 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e5b3fb name:ZooKeeperConnection Watcher:127.0.0.1:59828/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14106 T1026 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14107 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f249000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14107 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f249000c type:create cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14109 T1026 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> C59_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:60950_, shard=shard1, base_url=http://127.0.0.1:60950, core=collection1, state=recovering}
[junit4:junit4] 2> 14474 T1087 C59 P60950 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40543/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 14474 T1087 C59 P60950 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60950 START replicas=[http://127.0.0.1:40543/collection1/] nUpdates=100
[junit4:junit4] 2> 14475 T1087 C59 P60950 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 14475 T1087 C59 P60950 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 14475 T1087 C59 P60950 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 14475 T1087 C59 P60950 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 14475 T1087 C59 P60950 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 14475 T1087 C59 P60950 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40543/collection1/. core=collection1
[junit4:junit4] 2> 14476 T1087 C59 P60950 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C61 name=collection1 org.apache.solr.core.SolrCore@1977743 url=http://127.0.0.1:40543/collection1 node=127.0.0.1:40543_ C61_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:40543_, shard=shard1, base_url=http://127.0.0.1:40543, core=collection1, state=active, leader=true}
[junit4:junit4] 2> 14479 T1063 C61 P40543 REQ /get {version=2&qt=/get&wt=javabin&getVersions=100&distrib=false} status=0 QTime=1
[junit4:junit4] 2> 14479 T1064 C61 P40543 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 14481 T1064 C61 P40543 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14482 T1064 C61 P40543 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14483 T1064 C61 P40543 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 14483 T1064 C61 P40543 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 14484 T1064 C61 P40543 oass.SolrIndexSearcher.<init> Opening Searcher@1e9cad1 realtime
[junit4:junit4] 2> 14484 T1064 C61 P40543 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 14484 T1064 C61 P40543 /update {version=2&waitSearcher=true&commit_end_point=true&softCommit=false&commit=true&openSearcher=false&wt=javabin} {commit=} 0 5
[junit4:junit4] 2> 14485 T1087 C59 P60950 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 14486 T1087 C59 P60950 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 14489 T1062 C61 P40543 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 14489 T1062 C61 P40543 REQ /replication {version=2&qt=/replication&command=indexversion&wt=javabin} status=0 QTime=2
[junit4:junit4] 2> 14490 T1087 C59 P60950 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 14490 T1087 C59 P60950 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 14490 T1087 C59 P60950 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 14492 T1064 C61 P40543 REQ /replication {version=2&qt=/replication&command=filelist&wt=javabin&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14493 T1087 C59 P60950 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 14494 T1087 C59 P60950 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty2/index.20130315014653530 forceNew: false
[junit4:junit4] 2> 14494 T1087 C59 P60950 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@95afba lockFactory=org.apache.lucene.store.NativeFSLockFactory@17c53c) fullCopy=false
[junit4:junit4] 2> 14496 T1063 C61 P40543 REQ /replication {qt=/replication&command=filecontent&wt=filestream&checksum=true&file=segments_2&generation=2} status=0 QTime=0
[junit4:junit4] 2> 14497 T1087 C59 P60950 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 14498 T1087 C59 P60950 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 14498 T1087 C59 P60950 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 14499 T1087 C59 P60950 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1acb6c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f4abba; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1acb6c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f4abba; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 14499 T1087 C59 P60950 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 14500 T1087 C59 P60950 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 14500 T1087 C59 P60950 oass.SolrIndexSearcher.<init> Opening Searcher@bc6af9 main
[junit4:junit4] 2> 14500 T1086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@bc6af9 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 14501 T1087 C59 P60950 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@95afba lockFactory=org.apache.lucene.store.NativeFSLockFactory@17c53c)
[junit4:junit4] 2> 14501 T1087 C59 P60950 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 14501 T1087 C59 P60950 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 14501 T1087 C59 P60950 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 14501 T1087 C59 P60950 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14502 T1087 C59 P60950 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 15111 T1026 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40393_
[junit4:junit4] 2> 15112 T1031 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c95f249000c type:delete cxid:0xb zxid:0x97 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40393_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40393_
[junit4:junit4] 2> 15113 T1026 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40393_
[junit4:junit4] 2> 15114 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15114 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15114 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15115 T1055 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15115 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15115 T1068 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15116 T1118 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15116 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15117 T1084 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15117 T1101 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15117 T1048 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15122 T1121 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363326413037/collection1
[junit4:junit4] 2> 15122 T1121 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 15122 T1121 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15123 T1121 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 15123 T1121 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363326413037/collection1/'
[junit4:junit4] 2> 15124 T1121 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363326413037/collection1/lib/README' to classloader
[junit4:junit4] 2> 15124 T1121 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363326413037/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 15145 T1121 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 15171 T1121 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15172 T1121 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15175 T1121 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15402 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15403 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45691_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45691",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 15406 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:60950_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60950",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 15409 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15409 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15409 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15410 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15410 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15410 T1118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15458 T1121 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15464 T1121 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15466 T1121 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15475 T1121 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15478 T1121 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15480 T1121 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15481 T1121 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15481 T1121 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15482 T1121 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15482 T1121 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15482 T1121 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15483 T1121 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15483 T1121 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363326413037/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty4/
[junit4:junit4] 2> 15483 T1121 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@161dda
[junit4:junit4] 2> 15483 T1121 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15484 T1121 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty4 forceNew: false
[junit4:junit4] 2> 15484 T1121 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty4/index/
[junit4:junit4] 2> 15484 T1121 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15484 T1121 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty4/index forceNew: false
[junit4:junit4] 2> 15486 T1121 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1f21740 lockFactory=org.apache.lucene.store.NativeFSLockFactory@138f332; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15486 T1121 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15487 T1121 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15487 T1121 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15488 T1121 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15488 T1121 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15488 T1121 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15489 T1121 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15489 T1121 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15489 T1121 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15489 T1121 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15492 T1121 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15493 T1121 oass.SolrIndexSearcher.<init> Opening Searcher@16e7fb2 main
[junit4:junit4] 2> 15494 T1121 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty4/tlog
[junit4:junit4] 2> 15494 T1121 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15494 T1121 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15497 T1122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16e7fb2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15498 T1121 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15498 T1121 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16001 T1061 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&checkLive=true&nodeName=127.0.0.1:45691_&onlyIfLeader=true&wt=javabin&state=recovering&core=collection1&coreNodeName=4&action=PREPRECOVERY} status=0 QTime=2000
[junit4:junit4] 2> 16915 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16916 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40393_",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40393",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 16916 T1049 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 16916 T1049 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16919 T1118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16919 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16919 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16919 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16919 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16919 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17500 T1121 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 17500 T1121 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40393 collection:collection1 shard:shard1
[junit4:junit4] 2> 17504 T1121 oasc.ZkController.register We are http://127.0.0.1:40393/collection1/ and leader is http://127.0.0.1:40543/collection1/
[junit4:junit4] 2> 17504 T1121 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40393
[junit4:junit4] 2> 17504 T1121 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 17504 T1121 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C62 name=collection1 org.apache.solr.core.SolrCore@c54bc url=http://127.0.0.1:40393/collection1 node=127.0.0.1:40393_ C62_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:40393_, base_url=http://127.0.0.1:40393, core=collection1, state=down}
[junit4:junit4] 2> 17505 T1123 C62 P40393 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 17505 T1121 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17505 T1123 C62 P40393 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17505 T1123 C62 P40393 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17506 T1123 C62 P40393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17506 T1026 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 17507 T1123 C62 P40393 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17507 T1026 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17517 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17522 T1026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17524 T1026 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 17524 T1026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 17525 T1026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C60_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:45691_, shard=shard1, base_url=http://127.0.0.1:45691, core=collection1, state=recovering}
[junit4:junit4] 2> 18002 T1104 C60 P45691 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40543/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 18002 T1104 C60 P45691 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:45691 START replicas=[http://127.0.0.1:40543/collection1/] nUpdates=100
[junit4:junit4] 2> 18003 T1104 C60 P45691 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 18003 T1104 C60 P45691 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 18003 T1104 C60 P45691 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 18003 T1104 C60 P45691 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 18003 T1104 C60 P45691 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 18003 T1104 C60 P45691 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40543/collection1/. core=collection1
[junit4:junit4] 2> 18003 T1104 C60 P45691 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18005 T1063 C61 P40543 REQ /get {version=2&qt=/get&wt=javabin&getVersions=100&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 18007 T1061 C61 P40543 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 18008 T1061 C61 P40543 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18008 T1061 C61 P40543 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18009 T1061 C61 P40543 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18009 T1061 C61 P40543 /update {version=2&waitSearcher=true&commit_end_point=true&softCommit=false&commit=true&openSearcher=false&wt=javabin} {commit=} 0 2
[junit4:junit4] 2> 18009 T1104 C60 P45691 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18010 T1104 C60 P45691 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 18011 T1063 C61 P40543 REQ /replication {version=2&qt=/replication&command=indexversion&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 18012 T1104 C60 P45691 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 18012 T1104 C60 P45691 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 18012 T1104 C60 P45691 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 18014 T1061 C61 P40543 REQ /replication {version=2&qt=/replication&command=filelist&wt=javabin&generation=3} status=0 QTime=0
[junit4:junit4] 2> 18014 T1104 C60 P45691 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 18015 T1104 C60 P45691 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty3/index.20130315014657052 forceNew: false
[junit4:junit4] 2> 18015 T1104 C60 P45691 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@b11162 lockFactory=org.apache.lucene.store.NativeFSLockFactory@176fc1c) fullCopy=false
[junit4:junit4] 2> 18017 T1064 C61 P40543 REQ /replication {qt=/replication&command=filecontent&wt=filestream&checksum=true&file=segments_3&generation=3} status=0 QTime=0
[junit4:junit4] 2> 18019 T1104 C60 P45691 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 18019 T1104 C60 P45691 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 18019 T1104 C60 P45691 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 18020 T1104 C60 P45691 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@12c94d lockFactory=org.apache.lucene.store.NativeFSLockFactory@46e3ab; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@12c94d lockFactory=org.apache.lucene.store.NativeFSLockFactory@46e3ab; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18021 T1104 C60 P45691 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18021 T1104 C60 P45691 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 18021 T1104 C60 P45691 oass.SolrIndexSearcher.<init> Opening Searcher@1087c9e main
[junit4:junit4] 2> 18022 T1103 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1087c9e main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 18022 T1104 C60 P45691 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@b11162 lockFactory=org.apache.lucene.store.NativeFSLockFactory@176fc1c)
[junit4:junit4] 2> 18022 T1104 C60 P45691 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 18022 T1104 C60 P45691 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 18023 T1104 C60 P45691 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 18023 T1104 C60 P45691 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18024 T1104 C60 P45691 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 18423 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18423 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40393_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40393",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 18426 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:45691_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45691",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 18429 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18429 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18429 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18429 T1118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18429 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18429 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18521 T1062 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {version=2&checkLive=true&nodeName=127.0.0.1:40393_&onlyIfLeader=true&wt=javabin&state=recovering&core=collection1&coreNodeName=5&action=PREPRECOVERY} status=0 QTime=1000
[junit4:junit4] 2> 18526 T1026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19528 T1026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C62_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:40393_, shard=shard1, base_url=http://127.0.0.1:40393, core=collection1, state=recovering}
[junit4:junit4] 2> 20522 T1123 C62 P40393 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40543/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20522 T1123 C62 P40393 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40393 START replicas=[http://127.0.0.1:40543/collection1/] nUpdates=100
[junit4:junit4] 2> 20522 T1123 C62 P40393 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20523 T1123 C62 P40393 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20523 T1123 C62 P40393 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20523 T1123 C62 P40393 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20523 T1123 C62 P40393 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20523 T1123 C62 P40393 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40543/collection1/. core=collection1
[junit4:junit4] 2> 20523 T1123 C62 P40393 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20524 T1063 C61 P40543 REQ /get {version=2&qt=/get&wt=javabin&getVersions=100&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 20526 T1064 C61 P40543 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 20527 T1064 C61 P40543 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 20527 T1064 C61 P40543 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 20527 T1064 C61 P40543 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20528 T1064 C61 P40543 /update {version=2&waitSearcher=true&commit_end_point=true&softCommit=false&commit=true&openSearcher=false&wt=javabin} {commit=} 0 2
[junit4:junit4] 2> 20528 T1123 C62 P40393 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20529 T1123 C62 P40393 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20530 T1026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20530 T1063 C61 P40543 REQ /replication {version=2&qt=/replication&command=indexversion&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 20531 T1123 C62 P40393 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 20531 T1123 C62 P40393 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20531 T1123 C62 P40393 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20533 T1061 C61 P40543 REQ /replication {version=2&qt=/replication&command=filelist&wt=javabin&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20533 T1123 C62 P40393 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20534 T1123 C62 P40393 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363326399043/jetty4/index.20130315014659571 forceNew: false
[junit4:junit4] 2> 20535 T1123 C62 P40393 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2e38e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d6949e) fullCopy=false
[junit4:junit4] 2> 20537 T1064 C61 P40543 REQ /replication {qt=/replication&command=filecontent&wt=filestream&checksum=true&file=segments_4&generation=4} status=0 QTime=0
[junit4:junit4] 2> 20538 T1123 C62 P40393 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20538 T1123 C62 P40393 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20538 T1123 C62 P40393 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20539 T1123 C62 P40393 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1f21740 lockFactory=org.apache.lucene.store.NativeFSLockFactory@138f332; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1f21740 lockFactory=org.apache.lucene.store.NativeFSLockFactory@138f332; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 20540 T1123 C62 P40393 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 20540 T1123 C62 P40393 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20540 T1123 C62 P40393 oass.SolrIndexSearcher.<init> Opening Searcher@1b2cc5b main
[junit4:junit4] 2> 20541 T1122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b2cc5b main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 20541 T1123 C62 P40393 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@2e38e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d6949e)
[junit4:junit4] 2> 20541 T1123 C62 P40393 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20541 T1123 C62 P40393 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20541 T1123 C62 P40393 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20541 T1123 C62 P40393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20543 T1123 C62 P40393 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 21435 T1049 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21436 T1049 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40393_",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40393",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 21439 T1055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21439 T1084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21439 T1101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21439 T1068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21440 T1048 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21439 T1118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21532 T1026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21533 T1026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C63 name=collection1 org.apache.solr.core.SolrCore@62dc6d url=http://127.0.0.1:48124/collection1 node=127.0.0.1:48124_ C63_STATE=coll:control_collection core:collection1 props:{collection=control_collection, node_name=127.0.0.1:48124_, shard=shard1, base_url=http://127.0.0.1:48124, core=collection1, state=active, leader=true}
[junit4:junit4] 2> 21537 T1043 C63 P48124 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21538 T1043 C63 P48124 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1838199 lockFactory=org.apache.lucene.store.NativeFSLockFactory@177e5b1; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21539 T1043 C63 P48124 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21539 T1043 C63 P48124 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1838199 lockFactory=org.apache.lucene.store.NativeFSLockFactory@177e5b1; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1838199 lockFactory=org.apache.lucene.store.NativeFSLockFactory@177e5b1; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 21540 T1043 C63 P48124 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 21540 T1043 C63 P48124 oass.SolrIndexSearcher.<init> Opening Searcher@580bc0 main
[junit4:junit4] 2> 21541 T1043 C63 P48124 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21541 T1052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@580bc0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 21542 T1043 C63 P48124 /update {version=2&waitSearcher=true&softCommit=false&commit=true&wt=javabin} {commit=} 0 6
[junit4:junit4] 2> 21545 T1064 C61 P40543 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21545 T1064 C61 P40543 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 21546 T1064 C61 P40543 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 21546 T1064 C61 P40543 oass.SolrIndexSearcher.<init> Opening Searcher@1348940 main
[junit4:junit4] 2> 21546 T1064 C61 P40543 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21547 T1070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1348940 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 21547 T1064 C61 P40543 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:60950/collection1/, StdNode: http://127.0.0.1:45691/collection1/, StdNode: http://127.0.0.1:40393/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> C60_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:45691_, shard=shard1, base_url=http://127.0.0.1:45691, core=collection1, state=active}
[junit4:junit4] 2> 21552 T1095 C60 P45691 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C62_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:40393_, shard=shard1, base_url=http://127.0.0.1:40393, core=collection1, state=active}
[junit4:junit4] 2> 21553 T1111 C62 P40393 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21555 T1111 C62 P40393 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1f21740 lockFactory=org.apache.lucene.store.NativeFSLockFactory@138f332; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1f21740 lockFactory=org.apache.lucene.store.NativeFSLockFactory@138f332; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 21555 T1111 C62 P40393 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 21556 T1095 C60 P45691 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@12c94d lockFactory=org.apache.lucene.store.NativeFSLockFactory@46e3ab; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@12c94d lockFactory=org.apache.lucene.store.NativeFSLockFactory@46e3ab; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 21556 T1095 C60 P45691 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> C59_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:60950_, shard=shard1, base_url=http://127.0.0.1:60950, core=collection1, state=active}
[junit4:junit4] 2> 21556 T1080 C59 P60950 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21557 T1111 C62 P40393 oass.SolrIndexSearcher.<init> Opening Searcher@6fc9d3 main
[junit4:junit4] 2> 21557 T1080 C59 P60950 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1acb6c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f4abba; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1acb6c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f4abba; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 21557 T1095 C60 P45691 oass.SolrIndexSearcher.<init> Opening Searcher@139c05f main
[junit4:junit4] 2> 21558 T1080 C59 P60950 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 21558 T1095 C60 P45691 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21557 T1111 C62 P40393 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21558 T1103 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@139c05f main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 21558 T1122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6fc9d3 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 21558 T1080 C59 P60950 oass.SolrIndexSearcher.<init> Opening Searcher@deb0e8 main
[junit4:junit4] 2> 21559 T1095 C60 P45691 /update {version=2&waitSearcher=true&commit_end_point=true&expungeDeletes=false&softCommit=false&commit=true&wt=javabin} {commit=} 0 7
[junit4:junit4] 2> 21559 T1080 C59 P60950 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21559 T1086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@deb0e8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 21560 T1080 C59 P60950 /update {version=2&waitSearcher=true&commit_end_point=true&expungeDeletes=false&softCommit=false&commit=true&wt=javabin} {commit=} 0 4
[junit4:junit4] 2> 21560 T1111 C62 P40393 /update {version=2&waitSearcher=true&commit_end_point=true&expungeDeletes=false&softCommit=false&commit=true&wt=javabin} {commit=} 0 7
[junit4:junit4] 2> 21560 T1064 C61 P40543 /update {version=2&waitSearcher=true&softCommit=false&commit=true&wt=javabin} {commit=} 0 15
[junit4:junit4] 2> 21561 T1026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21563 T1063 C61 P40543 REQ /select {version=2&tests=checkShardConsistency&wt=javabin&distrib=false&q=*:*&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 21564 T1078 C59 P60950 REQ /select {version=2&tests=checkShardConsistency&wt=javabin&distrib=false&q=*:*&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 21566 T1097 C60 P45691 REQ /select {version=2&tests=checkShardConsistency&wt=javabin&distrib=false&q=*:*&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 21568 T1113 C62 P40393 REQ /select {version=2&tests=checkShardConsistency&wt=javabin&distrib=false&q=*:*&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 23572 T1042 C63 P48124 oass.SolrIndexSearcher.<init> Opening Searcher@1922761 realtime
[junit4:junit4] 2> 23572 T1042 C63 P48124 /update {version=2&wt=javabin} {deleteByQuery=*:* (-1429551366912606208)} 0 2
[junit4:junit4] 2> 23577 T1078 C59 P60950 /update {version=2&update.distrib=FROMLEADER&update.from=http://127.0.0.1:40543/collection1/&wt=javabin&_version_=-1429551366916800512} {deleteByQuery=*:* (-1429551366916800512)} 0 0
[junit4:junit4] 2> 23578 T1112 C62 P40393 /update {version=2&update.distrib=FROMLEADER&update.from=http://127.0.0.1:40543/collection1/&wt=javabin&_version_=-1429551366916800512} {deleteByQuery=*:* (-1429551366916800512)} 0 1
[junit4:junit4] 2> 23578 T1096 C60 P45691 /update {version=2&update.distrib=FROMLEADER&update.from=http://127.0.0.1:40543/collection1/&wt=javabin&_version_=-1429551366916800512} {deleteByQuery=*:* (-1429551366916800512)} 0 1
[junit4:junit4] 2> 23578 T1062 C61 P40543 /update {version=2&wt=javabin} {deleteByQuery=*:* (-1429551366916800512)} 0 3
[junit4:junit4] 2> 23582 T1043 C63 P48124 /update {version=2&wt=javabin} {add=[0 (1429551366923091968)]} 0 2
[junit4:junit4] 2> 23588 T1113 C62 P40393 /update {version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:40543/collection1/} {add=[0 (1429551366926237696)]} 0 1
[junit4:junit4] 2> 23589 T1094 C60 P45691 /update {version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:40543/collection1/} {add=[0 (1429551366926237696)]} 0 2
[junit4:junit4] 2> 23589 T1080 C59 P60950 /update {version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:40543/collection1/} {add=[0 (1429551366926237696)]} 0 2
[junit4:junit4] 2> 23590 T1061 C61 P40543 /update {version=2&wt=javabin} {add=[0 (1429551366926237696)]} 0 6
[junit4:junit4] 2> 23593 T1044 C63 P48124 /update {version=2&wt=javabin} {add=[1 (1429551366934626304)]} 0 1
[junit4:junit4] 2> 23598 T1095 C60 P45691 /update {version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:40543/collection1/} {add=[1 (1429551366937772032)]} 0 0
[junit4:junit4] 2> 23599 T1077 C59 P60950 /update {version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:40543/collection1/} {add=[1 (1429551366937772032)]} 0 1
[junit4:junit4] 2> 23600 T1114 C62 P40393 /update {version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:40543/collection1/} {add=[1 (1429551366937772032)]} 0 1
[junit4:junit4] 2> 23600 T1064 C61 P40543 /update {version=2&wt=javabin} {add=[1 (1429551366937772032)]} 0 5
[junit4:junit4] 2> 23603 T1041 C63 P48124 /update {version=2&wt=javabin} {add=[2 (1429551366945112064)]} 0 1
[junit4:junit4] 2> 23608 T1097 C60 P45691 /update {version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:40543/collection1/} {add=[2 (1429551366948257792)]} 0 0
[junit4:junit4] 2> 23608 T1111 C62 P40393 /update {version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:40543/collection1/} {add=[2 (1429551366948257792)]} 0 0
[junit4:junit4] 2> 23609 T1063 C61 P40543 /update {version=2&test.distrib.skip.servers=http://127.0.0.1:60950/collection1/&wt=javabin} {add=[2 (1429551366948257792)]} 0 4
[junit4:junit4] 2> 23612 T1042 C63 P48124 /update {version=2&wt=javabin} {add=[3 (1429551366954549248)]} 0 1
[junit4:junit4] 2> 23617 T1112 C62 P40393 /update {version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:40543/collection1/} {add=[3 (1429551366957694976)]} 0 0
[junit4:junit4] 2> 23618 T1062 C61 P40543 /update {version=2&test.distrib.skip.servers=http://127.0.0.1:60950/collection1/&test.distrib.skip.servers=http://127.0.0.1:45691/collection1/&wt=javabin} {add=[3 (1429551366957694976)]} 0 4
[junit4:junit4] 2> 23620 T1043 C63 P48124 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23623 T1043 C63 P48124 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1838199 lockFactory=org.apache.lucene.store.NativeFSLockFactory@177e5b1; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1838199 lockFactory=org.apache.lucene.store.NativeFSLockFactory@177e5b1; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_3,generation=3,filenames=[_0.fdt, _0.prx, _0.fnm, segments_3, _0.fdx, _0.frq, _0.tim, _0.tip, _0_nrm.cfe, _0.si, _0_nrm.cfs]
[junit4:junit4] 2> 23623 T1043 C63 P48124 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fdt, _0.prx, _0.fnm, segments_3, _0.fdx, _0.frq, _0.tim, _0.tip, _0_nrm.cfe, _0.si, _0_nrm.cfs]
[junit4:junit4] 2> 23674 T1043 C63 P48124 oass.SolrIndexSearcher.<init> Opening Searcher@1daf7a9 main
[junit4:junit4] 2> 23675 T1043 C63 P48124 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23676 T1052 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1daf7a9 main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 23676 T1043 C63 P48124 /update {version=2&waitSearcher=true&softCommit=false&commit=true&wt=javabin} {commit=} 0 56
[junit4:junit4] 2> 23678 T1061 C61 P40543 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23681 T1061 C61 P40543 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=5
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@843ab5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@121939c; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_6,generation=6,filenames=[segments_6, _0.fdt, _0.prx, _0.fnm, _0.fdx, _0.frq, _0.tim, _0.tip, _0_nrm.cfe, _0.si, _0_nrm.cfs]
[junit4:junit4] 2> 23682 T1061 C61 P40543 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[segments_6, _0.fdt, _0.prx, _0.fnm, _0.fdx, _0.frq, _0.tim, _0.tip, _0_nrm.cfe, _0.si, _0_nrm.cfs]
[junit4:junit4] 2> 23683 T1061 C61 P40543 oass.SolrIndexSearcher.<init> Opening Searcher@8b35cd main
[junit4:junit4] 2> 23683 T1061 C61 P40543 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23684 T1070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@8b35cd main{StandardDirectoryReader(segments_6:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 23684 T1061 C61 P40543 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:60950/collection1/, StdNode: http://127.0.0.1:45691/collection1/, StdNode: http://127.0.0.1:40393/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 23686 T1096 C60 P45691 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23686 T1113 C62 P40393 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23687 T1079 C59 P60950 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23690 T1096 C60 P45691 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@12c94d lockFactory=org.apache.lucene.store.NativeFSLockFactory@46e3ab; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@12c94d lockFactory=org.apache.lucene.store.NativeFSLockFactory@46e3ab; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_5,generation=5,filenames=[_0.fdt, _0.prx, _0.fnm, _0.fdx, _0.frq, segments_5, _0.tim, _0.tip, _0_nrm.cfe, _0.si, _0_nrm.cfs]
[junit4:junit4] 2> 23690 T1096 C60 P45691 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[_0.fdt, _0.prx, _0.fnm, _0.fdx, _0.frq, segments_5, _0.tim, _0.tip, _0_nrm.cfe, _0.si, _0_nrm.cfs]
[junit4:junit4] 2> 23691 T1079 C59 P60950 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1acb6c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f4abba; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1acb6c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f4abba; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_4,generation=4,filenames=[_0.fdt, _0.prx, segments_4, _0.fnm, _0.fdx, _0.frq, _0.tim, _0.tip, _0_nrm.cfe, _0.si, _0_nrm.cfs]
[junit4:junit4] 2> 23691 T1113 C62 P40393 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1f21740 lockFactory=org.apache.lucene.store.NativeFSLockFactory@138f332; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> commit{dir=MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@1f21740 lockFactory=org.apache.lucene.store.NativeFSLockFactory@138f332; maxCacheMB=0.8095703125 maxMergeSizeMB=0.701171875)),segFN=segments_6,generation=6,filenames=[segments_6, _0.fdt, _0.prx, _0.fnm, _0.fdx, _0.frq, _0.tim, _0.tip, _0_nrm.cfe, _0.si, _0_nrm.cfs]
[junit4:junit4] 2> 23691 T1079 C59 P60950 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0.fdt, _0.prx, segments_4, _0.fnm, _0.fdx, _0.frq, _0.tim, _0.tip, _0_nrm.cfe, _0.si, _0_nrm.cfs]
[junit4:junit4] 2> 23691 T1096 C60 P45691 oass.SolrIndexSearcher.<init> Opening Searcher@9099aa main
[junit4:junit4] 2> 23691 T1113 C62 P40393 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[segments_6, _0.fdt, _0.prx, _0.fnm, _0.fdx, _0.frq, _0.tim, _0.tip, _0_nrm.cfe, _0.si, _0_nrm.cfs]
[junit4:junit4] 2> 23692 T1096 C60 P45691 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23693 T1103 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9099aa main{StandardDirectoryReader(segments_5:3:nrt _0(4.3):C3)}
[junit4:junit4] 2> 23693 T1079 C59 P60950 oass.SolrIndexSearcher.<init> Opening Searcher@4d3661 main
[junit4:junit4] 2> 23693 T1113 C62 P40393 oass.SolrIndexSearcher.<init> Opening Searcher@28d826 main
[junit4:junit4] 2> 23693 T1079 C59 P60950 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23693 T1113 C62 P40393 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23693 T1086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4d3661 main{StandardDirectoryReader(segments_4:3:nrt _0(4.3):C2)}
[junit4:junit4] 2> 23694 T1122 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@28d826 main{StandardDirectoryReader(segments_6:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 23693 T1096 C60 P45691 /update {version=2&waitSearcher=true&commit_end_point=true&expungeDeletes=false&softCommit=false&commit=true&wt=javabin} {commit=} 0 7
[junit4:junit4] 2> 23694 T1079 C59 P60950 /update {version=2&waitSearcher=true&commit_end_point=true&expungeDeletes=false&softCommit=false&commit=true&wt=javabin} {commit=} 0 8
[junit4:junit4] 2> 23694 T1113 C62 P40393 /update {version=2&waitSearcher=true&commit_end_point=true&expungeDeletes=false&softCommit=false&commit=true&wt=javabin} {commit=} 0 8
[junit4:junit4] 2> 23695 T1061 C61 P40543 /update {version=2&waitSearcher=true&softCommit=false&commit=true&wt=javabin} {commit=} 0 17
[junit4:junit4] 2> 23695 T1026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 23696 T1026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23696 T1026 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 23699 T1064 C61 P40543 REQ /select {version=2&tests=checkShardConsistency&wt=javabin&distrib=false&q=*:*&rows=0} hits=4 status=0 QTime=1
[junit4:junit4] 2> 23701 T1078 C59 P60950 REQ /select {version=2&tests=checkShardConsistency&wt=javabin&distrib=false&q=*:*&rows=0} hits=2 status=0 QTime=0
[junit4:junit4] 2> 23703 T1094 C60 P45691 REQ /select {version=2&tests=checkShardConsistency&wt=javabin&distrib=false&q=*:*&rows=0} hits=3 status=0 QTime=0
[junit4:junit4] 2> 23705 T1114 C62 P40393 REQ /select {version=2&tests=checkShardConsistency&wt=javabin&distrib=false&q=*:*&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 23707 T1026 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23711 T1095 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : version=2&collection=collection1&shard=shard1&wt=javabin&action=SYNCSHARD
[junit4:junit4] 2> 23711 T1095 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23715 T1063 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 23715 T1063 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40543/collection1/
[junit4:junit4] 2> 23716 T1063 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40543 START replicas=[http://127.0.0.1:60950/collection1/, http://127.0.0.1:45691/collection1/, http://127.0.0.1:40393/collection1/] nUpdates=100
[junit4:junit4] 2> 23717 T1080 C59 P60950 REQ /get {version=2&qt=/get&wt=javabin&getVersions=100&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 23718 T1096 C60 P45691 REQ /get {version=2&qt=/get&wt=javabin&getVersions=100&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 23718 T1113 C62 P40393 REQ /get {version=2&qt=/get&wt=javabin&getVersions=100&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 23719 T1063 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40543 Received 3 versions from 127.0.0.1:60950/collection1/
[junit4:junit4] 2> 23719 T1063 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40543 Our versions are newer. ourLowThreshold=1429551366916800512 otherHigh=1429551366937772032
[junit4:junit4] 2> 23719 T1063 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40543 Received 4 versions from 127.0.0.1:45691/collection1/
[junit4:junit4] 2> 23719 T1063 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40543 Our versions are newer. ourLowThreshold=1429551366916800512 otherHigh=1429551366948257792
[junit4:junit4] 2> 23720 T1063 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40543 Received 5 versions from 127.0.0.1:40393/collection1/
[junit4:junit4] 2> 23720 T1063 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40543 Our versions are newer. ourLowThreshold=1429551366916800512 otherHigh=1429551366948257792
[junit4:junit4] 2> 23720 T1063 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40543 DONE. sync succeeded
[junit4:junit4] 2> 23720 T1063 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 23721 T1063 oasc.SyncStrategy.syncToMe http://127.0.0.1:40543/collection1/: try and ask http://127.0.0.1:60950/collection1/ to sync
[junit4:junit4] 2> 23721 T1063 oasc.SyncStrategy.syncToMe http://127.0.0.1:40543/collection1/: try and ask http://127.0.0.1:45691/collection1/ to sync
[junit4:junit4] 2> 23721 T1063 oasc.SyncStrategy.syncToMe http://127.0.0.1:40543/collection1/: try and ask http://127.0.0.1:40393/collection1/ to sync
[junit4:junit4] 2> 23723 T1097 C60 P45691 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:45691 START replicas=[http://127.0.0.1:40543/collection1/] nUpdates=100
[junit4:junit4] 2> 23723 T1114 C62 P40393 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40393 START replicas=[http://127.0.0.1:40543/collection1/] nUpdates=100
[junit4:junit4] 2> 23723 T1079 C59 P60950 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60950 START replicas=[http://127.0.0.1:40543/collection1/] nUpdates=100
[junit4:junit4] 2> 23725 T1061 C61 P40543 REQ /get {version=2&qt=/get&wt=javabin&getVersions=100&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 23725 T1064 C61 P40543 REQ /get {version=2&qt=/get&wt=javabin&getVersions=100&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 23725 T1062 C61 P40543 REQ /get {version=2&qt=/get&wt=javabin&getVersions=100&distrib=false} status=0 QTime=0
[junit4:junit4] 2> 23725 T1114 C62 P40393 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40393 Received 5 versions from 127.0.0.1:40543/collection1/
[junit4:junit4] 2> 23726 T1079 C59 P60950 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60950 Received 5 versions from 127.0.0.1:40543/collection1/
[junit4:junit4] 2> 23726 T1114 C62 P40393 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40393 Our versions are newer. ourLowThreshold=1429551366916800512 otherHigh=1429551366948257792
[junit4:junit4] 2> 23726 T1079 C59 P60950 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:60950 Requesting updates from 127.0.0.1:40543/collection1/n=2 versions=[1429551366957694976, 1429551366948257792]
[junit4:junit4] 2> 23726 T1114 C62 P40393 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40393 DONE. sync succeeded
[junit4:junit4] 2> 23726 T1097 C60 P45691 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:45691 Received 5 versions from 127.0.0.1:40543/collection1/
[junit4:junit4] 2> 23727 T1114 C62 P40393 REQ /get {version=2&sync=http://127.0.0.1:40543/collection1/&qt=/get&wt=javabin&getVersions=100&distrib=false} status=0 QTime=4
[junit4:junit4] 2> 23727 T1097 C60 P45691 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:45691 Requesting updates from 127.0.0.1:40543/collection1/n=1 versions=[1429551366957694976]
[junit4:junit4] 2> 23727 T1063 oasc.SyncStrategy.syncToMe http://127.0.0.1:40543/collection1/: sync completed with http://127.0.0.1:40393/collection1/
[junit4:jun
[...truncated too long message...]
cessor.shutdown shutdown of request processor complete
[junit4:junit4] 2> 47302 T1026 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:59828 59828
[junit4:junit4] 2> 47303 T1028 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4] 2> 47303 T1026 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4] 2> 47304 T1026 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4] 2> 47304 T1026 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 47304 T1026 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 47304 T1026 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=CC6008A501E9361 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_AU -Dtests.timezone=America/Indiana/Winamac -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 47.3s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([CC6008A501E9361:8D208E922741F35D]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:92)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:54)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 47312 T1026 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 47315 T1025 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 47963 T1029 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 48521 T1118 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 48522 T1118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 48522 T1118 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 48522 T1118 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=en_AU, timezone=America/Indiana/Winamac
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=6,free=56062728,total=256638976
[junit4:junit4] 2> NOTE: All tests run in this JVM: [RecoveryZkTest, AnalysisAfterCoreReloadTest, TestSolrIndexConfig, BadComponentTest, CircularListTest, TestCopyFieldCollectionResource, JsonLoaderTest, TestSolrCoreProperties, SpellingQueryConverterTest, SliceStateUpdateTest, DistributedTermsComponentTest, TestCoreContainer, ResourceLoaderTest, TestSurroundQueryParser, ZkCLITest, TestGroupingSearch, DistributedSpellCheckComponentTest, TestIBSimilarityFactory, TestFieldCollectionResource, DirectUpdateHandlerOptimizeTest, LegacyHTMLStripCharFilterTest, ShardRoutingTest, TestJoin, MoreLikeThisHandlerTest, PreAnalyzedFieldTest, CoreAdminHandlerTest, SOLR749Test, TestCharFilters, TestConfig, SchemaVersionSpecificBehaviorTest, TestLRUCache, FieldMutatingUpdateProcessorTest, MinimalSchemaTest, DocValuesTest, TestLFUCache, QueryElevationComponentTest, TestTrie, SimpleFacetsTest, SoftAutoCommitTest, TestDynamicFieldCollectionResource, ReturnFieldsTest, TestPluginEnable, TestSweetSpotSimilarityFactory, QueryParsingTest, ChaosMonkeyNothingIsSafeTest, TestValueSourceCache, PrimitiveFieldTypeTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 48.59s, 1 test, 1 failure <<< FAILURES!
[...truncated 527 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 failure, 14 ignored (8 assumptions)
Total time: 69 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -server -XX:+UseParallelGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build #
4683 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4683/
Java: 32bit/jdk1.8.0-ea-b79 -server -XX:+UseG1GC -XX:MarkStackSize=256K
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.RecoveryZkTest
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=110, name=coreLoadExecutor-63-thread-1, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=110, name=coreLoadExecutor-63-thread-1, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1569)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:520)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:986)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:878)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:870)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:34)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:272)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:224)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:244)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:458)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:744)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:619)
at org.apache.solr.core.CoreContainer.createFromZk(CoreContainer.java:872)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:955)
at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:579)
at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:574)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.AssertionError: Directory not closed: MockDirWrapper(org.apache.lucene.store.RAMDirectory@84c847 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19f0fa9)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.RecoveryZkTest
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=112, name=RecoveryThread, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=112, name=RecoveryThread, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1569)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:520)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:986)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:878)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:870)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:34)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:272)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:224)
at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:383)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:281)
at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:153)
at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:409)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
Caused by: java.lang.AssertionError: Directory not closed: MockDirWrapper(org.apache.lucene.store.RAMDirectory@17ec096 lockFactory=org.apache.lucene.store.NativeFSLockFactory@29ecf1)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([479F16D15BA3894C:C67998C92CFCE970]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 8913 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4:junit4] 2> 0 T51 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ak_zme/ea
[junit4:junit4] 2> 4 T51 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-RecoveryZkTest-1363317315984
[junit4:junit4] 2> 7 T51 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 10 T52 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 29 T52 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 29 T52 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4] 2> 30 T52 oaz.Environment.logEnv Server environment:java.version=1.8.0-ea
[junit4:junit4] 2> 30 T52 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4] 2> 30 T52 oaz.Environment.logEnv Server environment:java.home=/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/jre
[junit4:junit4] 2> 30 T52 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 31 T52 oaz.Environment.logEnv Server environment:java.library.path=/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4] 2> 31 T52 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4] 2> 32 T52 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4] 2> 32 T52 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4] 2> 32 T52 oaz.Environment.logEnv Server environment:os.arch=i386
[junit4:junit4] 2> 32 T52 oaz.Environment.logEnv Server environment:os.version=3.2.0-38-generic
[junit4:junit4] 2> 32 T52 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4] 2> 33 T52 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4] 2> 33 T52 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 44 T52 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 45 T52 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 45 T52 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 47 T52 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 80 T52 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-1363317315984/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 109 T51 oasc.ZkTestServer.run start zk server on port:59628
[junit4:junit4] 2> 136 T51 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 137 T51 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4] 2> 137 T51 oaz.Environment.logEnv Client environment:java.version=1.8.0-ea
[junit4:junit4] 2> 138 T51 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4] 2> 138 T51 oaz.Environment.logEnv Client environment:java.home=/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/jre
[junit4:junit4] 2> 138 T51 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 139 T51 oaz.Environment.logEnv Client environment:java.library.path=/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4] 2> 140 T51 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4] 2> 140 T51 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4] 2> 140 T51 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4] 2> 141 T51 oaz.Environment.logEnv Client environment:os.arch=i386
[junit4:junit4] 2> 141 T51 oaz.Environment.logEnv Client environment:os.version=3.2.0-38-generic
[junit4:junit4] 2> 141 T51 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4] 2> 142 T51 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4] 2> 142 T51 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 144 T51 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59628 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@fdd3f1
[junit4:junit4] 2> 165 T51 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 169 T57 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59628. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 170 T57 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59628, initiating session
[junit4:junit4] 2> 170 T53 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44265
[junit4:junit4] 2> 179 T53 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44265
[junit4:junit4] 2> 184 T55 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 275 T55 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c0b59e50000 with negotiated timeout 10000 for client /127.0.0.1:44265
[junit4:junit4] 2> 276 T57 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59628, sessionid = 0x13d6c0b59e50000, negotiated timeout = 10000
[junit4:junit4] 2> 280 T58 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fdd3f1 name:ZooKeeperConnection Watcher:127.0.0.1:59628 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 280 T51 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 282 T51 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 312 T56 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c0b59e50000
[junit4:junit4] 2> 313 T58 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 313 T51 oaz.ZooKeeper.close Session: 0x13d6c0b59e50000 closed
[junit4:junit4] 2> 314 T53 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44265 which had sessionid 0x13d6c0b59e50000
[junit4:junit4] 2> 315 T51 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59628/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@15f8ad
[junit4:junit4] 2> 315 T51 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 316 T59 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59628. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 316 T59 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59628, initiating session
[junit4:junit4] 2> 316 T53 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44266
[junit4:junit4] 2> 317 T53 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44266
[junit4:junit4] 2> 318 T55 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c0b59e50001 with negotiated timeout 10000 for client /127.0.0.1:44266
[junit4:junit4] 2> 318 T59 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59628, sessionid = 0x13d6c0b59e50001, negotiated timeout = 10000
[junit4:junit4] 2> 319 T60 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15f8ad name:ZooKeeperConnection Watcher:127.0.0.1:59628/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 319 T51 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 322 T51 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 326 T51 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 330 T51 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 333 T51 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 337 T51 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 338 T51 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 344 T51 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 347 T51 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 351 T51 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 352 T51 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 356 T51 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 357 T51 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 362 T51 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 363 T51 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 368 T51 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 368 T51 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 372 T51 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 373 T51 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 378 T51 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 378 T51 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 383 T51 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 383 T51 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 387 T56 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c0b59e50001
[junit4:junit4] 2> 396 T60 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 396 T51 oaz.ZooKeeper.close Session: 0x13d6c0b59e50001 closed
[junit4:junit4] 2> 396 T53 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44266 which had sessionid 0x13d6c0b59e50001
[junit4:junit4] 2> 475 T51 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 482 T51 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40345
[junit4:junit4] 2> 483 T51 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 484 T51 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 485 T51 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363317316376
[junit4:junit4] 2> 485 T51 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363317316376/solr.xml
[junit4:junit4] 2> 486 T51 oasc.CoreContainer.<init> New CoreContainer 27434023
[junit4:junit4] 2> 487 T51 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363317316376/'
[junit4:junit4] 2> 487 T51 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363317316376/'
[junit4:junit4] 2> 518 T51 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 519 T51 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 519 T51 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 520 T51 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 520 T51 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 521 T51 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 522 T51 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 522 T51 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 523 T51 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 523 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 624 T51 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 639 T51 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59628/solr
[junit4:junit4] 2> 647 T51 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 647 T51 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59628 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@f4a0da
[junit4:junit4] 2> 649 T51 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 649 T70 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59628. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 650 T70 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59628, initiating session
[junit4:junit4] 2> 650 T53 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44267
[junit4:junit4] 2> 650 T53 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44267
[junit4:junit4] 2> 652 T55 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c0b59e50002 with negotiated timeout 20000 for client /127.0.0.1:44267
[junit4:junit4] 2> 652 T70 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59628, sessionid = 0x13d6c0b59e50002, negotiated timeout = 20000
[junit4:junit4] 2> 653 T71 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f4a0da name:ZooKeeperConnection Watcher:127.0.0.1:59628 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 653 T51 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 655 T56 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c0b59e50002
[junit4:junit4] 2> 655 T71 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 655 T53 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44267 which had sessionid 0x13d6c0b59e50002
[junit4:junit4] 2> 655 T51 oaz.ZooKeeper.close Session: 0x13d6c0b59e50002 closed
[junit4:junit4] 2> 657 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 664 T51 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59628/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a88b49
[junit4:junit4] 2> 665 T72 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59628. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 666 T72 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59628, initiating session
[junit4:junit4] 2> 666 T53 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44268
[junit4:junit4] 2> 666 T53 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44268
[junit4:junit4] 2> 666 T51 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 667 T55 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c0b59e50003 with negotiated timeout 20000 for client /127.0.0.1:44268
[junit4:junit4] 2> 667 T72 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59628, sessionid = 0x13d6c0b59e50003, negotiated timeout = 20000
[junit4:junit4] 2> 668 T73 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a88b49 name:ZooKeeperConnection Watcher:127.0.0.1:59628/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 668 T51 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 676 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 682 T51 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 685 T51 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40345_ak_zme%2Fea
[junit4:junit4] 2> 687 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40345_ak_zme%2Fea Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40345_ak_zme%2Fea
[junit4:junit4] 2> 688 T51 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40345_ak_zme%2Fea
[junit4:junit4] 2> 698 T51 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 770 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 786 T51 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 806 T51 oasc.Overseer.start Overseer (id=89346363625897987-127.0.0.1:40345_ak_zme%2Fea-n_0000000000) starting
[junit4:junit4] 2> 807 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 821 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 826 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 830 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 831 T75 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 832 T51 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 837 T51 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 840 T51 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 849 T74 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 855 T76 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363317316376/collection1
[junit4:junit4] 2> 856 T76 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 857 T76 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 857 T76 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 859 T76 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363317316376/collection1/'
[junit4:junit4] 2> 860 T76 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1363317316376/collection1/lib/README' to classloader
[junit4:junit4] 2> 860 T76 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1363317316376/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 904 T76 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 954 T76 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 956 T76 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 971 T76 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1472 T76 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1481 T76 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1484 T76 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1508 T76 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1514 T76 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1520 T76 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1522 T76 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1522 T76 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1523 T76 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1525 T76 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1525 T76 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1525 T76 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1526 T76 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1363317316376/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/control/data/
[junit4:junit4] 2> 1528 T76 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16e4bc
[junit4:junit4] 2> 1529 T76 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1530 T76 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363317315984/control/data forceNew: false
[junit4:junit4] 2> 1531 T76 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/control/data/index/
[junit4:junit4] 2> 1531 T76 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1363317315984/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1532 T76 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363317315984/control/data/index forceNew: false
[junit4:junit4] 2> 1533 T76 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@8de441 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14b2efa),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1534 T76 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1545 T76 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1546 T76 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1546 T76 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1547 T76 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1547 T76 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1548 T76 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1548 T76 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1549 T76 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1549 T76 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1552 T76 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1554 T76 oass.SolrIndexSearcher.<init> Opening Searcher@19ac98 main
[junit4:junit4] 2> 1557 T76 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/control/data/tlog
[junit4:junit4] 2> 1563 T76 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1564 T76 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1574 T76 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1574 T76 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1576 T77 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@19ac98 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1577 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2359 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2360 T74 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40345_ak_zme%2Fea",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40345/ak_zme/ea",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 2360 T74 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2369 T74 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2370 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2384 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2582 T76 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2583 T76 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40345/ak_zme/ea collection:control_collection shard:shard1
[junit4:junit4] 2> 2589 T76 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 2599 T76 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2610 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2611 T76 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2612 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2614 T76 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2615 T76 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2617 T76 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40345/ak_zme/ea/collection1/
[junit4:junit4] 2> 2618 T76 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2618 T76 oasc.SyncStrategy.syncToMe http://127.0.0.1:40345/ak_zme/ea/collection1/ has no replicas
[junit4:junit4] 2> 2618 T76 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40345/ak_zme/ea/collection1/
[junit4:junit4] 2> 2619 T76 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2626 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3890 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3901 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3909 T76 oasc.ZkController.register We are http://127.0.0.1:40345/ak_zme/ea/collection1/ and leader is http://127.0.0.1:40345/ak_zme/ea/collection1/
[junit4:junit4] 2> 3910 T76 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40345/ak_zme/ea
[junit4:junit4] 2> 3911 T76 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3911 T76 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3911 T76 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3914 T76 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3915 T51 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3916 T51 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3931 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3938 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3940 T51 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59628/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ec97b0
[junit4:junit4] 2> 3941 T51 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3941 T79 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59628. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3942 T79 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59628, initiating session
[junit4:junit4] 2> 3942 T53 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44270
[junit4:junit4] 2> 3942 T53 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44270
[junit4:junit4] 2> 3943 T55 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c0b59e50004 with negotiated timeout 10000 for client /127.0.0.1:44270
[junit4:junit4] 2> 3944 T79 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59628, sessionid = 0x13d6c0b59e50004, negotiated timeout = 10000
[junit4:junit4] 2> 3944 T80 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ec97b0 name:ZooKeeperConnection Watcher:127.0.0.1:59628/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3944 T51 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3947 T51 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3951 T51 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4014 T51 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4016 T51 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56616
[junit4:junit4] 2> 4017 T51 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4018 T51 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4019 T51 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363317319930
[junit4:junit4] 2> 4019 T51 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363317319930/solr.xml
[junit4:junit4] 2> 4020 T51 oasc.CoreContainer.<init> New CoreContainer 4558474
[junit4:junit4] 2> 4020 T51 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363317319930/'
[junit4:junit4] 2> 4021 T51 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363317319930/'
[junit4:junit4] 2> 4045 T51 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4045 T51 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4045 T51 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4046 T51 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4046 T51 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4047 T51 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4047 T51 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4047 T51 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4048 T51 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4048 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4055 T51 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4084 T51 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59628/solr
[junit4:junit4] 2> 4084 T51 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4085 T51 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59628 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@18b8db5
[junit4:junit4] 2> 4086 T90 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59628. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4086 T51 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4087 T53 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44271
[junit4:junit4] 2> 4086 T90 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59628, initiating session
[junit4:junit4] 2> 4087 T53 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44271
[junit4:junit4] 2> 4088 T55 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c0b59e50005 with negotiated timeout 20000 for client /127.0.0.1:44271
[junit4:junit4] 2> 4088 T90 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59628, sessionid = 0x13d6c0b59e50005, negotiated timeout = 20000
[junit4:junit4] 2> 4089 T91 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18b8db5 name:ZooKeeperConnection Watcher:127.0.0.1:59628 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4089 T51 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4090 T56 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c0b59e50005
[junit4:junit4] 2> 4091 T53 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44271 which had sessionid 0x13d6c0b59e50005
[junit4:junit4] 2> 4091 T91 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4091 T51 oaz.ZooKeeper.close Session: 0x13d6c0b59e50005 closed
[junit4:junit4] 2> 4092 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4096 T51 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59628/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1142849
[junit4:junit4] 2> 4097 T92 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59628. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4097 T51 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4097 T92 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59628, initiating session
[junit4:junit4] 2> 4097 T53 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44272
[junit4:junit4] 2> 4098 T53 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44272
[junit4:junit4] 2> 4099 T55 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c0b59e50006 with negotiated timeout 20000 for client /127.0.0.1:44272
[junit4:junit4] 2> 4099 T92 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59628, sessionid = 0x13d6c0b59e50006, negotiated timeout = 20000
[junit4:junit4] 2> 4099 T93 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1142849 name:ZooKeeperConnection Watcher:127.0.0.1:59628/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4100 T51 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4101 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4102 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4104 T51 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5109 T51 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56616_ak_zme%2Fea
[junit4:junit4] 2> 5110 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56616_ak_zme%2Fea Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56616_ak_zme%2Fea
[junit4:junit4] 2> 5111 T51 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56616_ak_zme%2Fea
[junit4:junit4] 2> 5117 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5118 T80 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5121 T93 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5122 T73 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5136 T94 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363317319930/collection1
[junit4:junit4] 2> 5138 T94 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5140 T94 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5140 T94 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5143 T94 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363317319930/collection1/'
[junit4:junit4] 2> 5144 T94 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1363317319930/collection1/lib/README' to classloader
[junit4:junit4] 2> 5144 T94 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1363317319930/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5213 T94 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 5266 T94 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5267 T94 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5301 T94 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5410 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5411 T74 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40345_ak_zme%2Fea",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40345/ak_zme/ea",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 5420 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5420 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5420 T80 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6061 T94 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6075 T94 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6087 T94 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6175 T94 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6190 T94 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6196 T94 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6200 T94 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6207 T94 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6207 T94 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6210 T94 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6211 T94 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6211 T94 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6212 T94 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1363317319930/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty1/
[junit4:junit4] 2> 6212 T94 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16e4bc
[junit4:junit4] 2> 6213 T94 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6214 T94 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty1 forceNew: false
[junit4:junit4] 2> 6218 T94 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty1/index/
[junit4:junit4] 2> 6219 T94 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6220 T94 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty1/index forceNew: false
[junit4:junit4] 2> 6238 T94 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a38980 lockFactory=org.apache.lucene.store.NativeFSLockFactory@193c295),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6242 T94 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6245 T94 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6246 T94 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6248 T94 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6249 T94 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6250 T94 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6250 T94 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6251 T94 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6251 T94 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6252 T94 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6268 T94 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6273 T94 oass.SolrIndexSearcher.<init> Opening Searcher@121c905 main
[junit4:junit4] 2> 6273 T94 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty1/tlog
[junit4:junit4] 2> 6274 T94 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6274 T94 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6284 T94 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6284 T94 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6290 T95 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@121c905 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6931 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6932 T74 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:56616_ak_zme%2Fea",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56616/ak_zme/ea",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 6933 T74 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 6933 T74 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 7022 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7022 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7022 T80 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7287 T94 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7287 T94 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56616/ak_zme/ea collection:collection1 shard:shard1
[junit4:junit4] 2> 7290 T94 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7307 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7309 T94 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7310 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7313 T94 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7313 T94 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7313 T94 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56616/ak_zme/ea/collection1/
[junit4:junit4] 2> 7314 T94 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7314 T94 oasc.SyncStrategy.syncToMe http://127.0.0.1:56616/ak_zme/ea/collection1/ has no replicas
[junit4:junit4] 2> 7314 T94 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56616/ak_zme/ea/collection1/
[junit4:junit4] 2> 7315 T94 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7333 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8534 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8551 T80 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8551 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8551 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8560 T94 oasc.ZkController.register We are http://127.0.0.1:56616/ak_zme/ea/collection1/ and leader is http://127.0.0.1:56616/ak_zme/ea/collection1/
[junit4:junit4] 2> 8560 T94 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56616/ak_zme/ea
[junit4:junit4] 2> 8560 T94 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8561 T94 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8561 T94 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8564 T94 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8566 T51 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 8567 T51 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8567 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8663 T51 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8668 T51 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55548
[junit4:junit4] 2> 8669 T51 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8670 T51 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8670 T51 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363317324553
[junit4:junit4] 2> 8671 T51 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363317324553/solr.xml
[junit4:junit4] 2> 8671 T51 oasc.CoreContainer.<init> New CoreContainer 32599935
[junit4:junit4] 2> 8672 T51 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363317324553/'
[junit4:junit4] 2> 8673 T51 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363317324553/'
[junit4:junit4] 2> 8706 T51 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8717 T51 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8718 T51 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8718 T51 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8719 T51 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8719 T51 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8720 T51 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8721 T51 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8721 T51 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8722 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8734 T51 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8763 T51 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59628/solr
[junit4:junit4] 2> 8764 T51 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8765 T51 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59628 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1578eae
[junit4:junit4] 2> 8769 T106 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59628. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8773 T51 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8776 T53 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44273
[junit4:junit4] 2> 8776 T106 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59628, initiating session
[junit4:junit4] 2> 8779 T53 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44273
[junit4:junit4] 2> 8781 T55 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c0b59e50007 with negotiated timeout 20000 for client /127.0.0.1:44273
[junit4:junit4] 2> 8782 T106 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59628, sessionid = 0x13d6c0b59e50007, negotiated timeout = 20000
[junit4:junit4] 2> 8782 T107 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1578eae name:ZooKeeperConnection Watcher:127.0.0.1:59628 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8782 T51 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8785 T56 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c0b59e50007
[junit4:junit4] 2> 8786 T53 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44273 which had sessionid 0x13d6c0b59e50007
[junit4:junit4] 2> 8792 T51 oaz.ZooKeeper.close Session: 0x13d6c0b59e50007 closed
[junit4:junit4] 2> 8793 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8794 T107 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8798 T51 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59628/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1899e54
[junit4:junit4] 2> 8806 T51 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8810 T108 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59628. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8810 T108 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59628, initiating session
[junit4:junit4] 2> 8811 T53 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:44274
[junit4:junit4] 2> 8811 T53 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:44274
[junit4:junit4] 2> 8812 T55 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6c0b59e50008 with negotiated timeout 20000 for client /127.0.0.1:44274
[junit4:junit4] 2> 8816 T108 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59628, sessionid = 0x13d6c0b59e50008, negotiated timeout = 20000
[junit4:junit4] 2> 8817 T109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1899e54 name:ZooKeeperConnection Watcher:127.0.0.1:59628/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8817 T51 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8827 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8831 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8834 T51 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9839 T51 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55548_ak_zme%2Fea
[junit4:junit4] 2> 9840 T56 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6c0b59e50008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55548_ak_zme%2Fea Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55548_ak_zme%2Fea
[junit4:junit4] 2> 9841 T51 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55548_ak_zme%2Fea
[junit4:junit4] 2> 9845 T80 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9845 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9847 T93 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9847 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9852 T73 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9853 T109 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9853 T80 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9874 T110 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363317324553/collection1
[junit4:junit4] 2> 9875 T110 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9880 T110 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9881 T110 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9883 T110 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363317324553/collection1/'
[junit4:junit4] 2> 9884 T110 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1363317324553/collection1/lib/README' to classloader
[junit4:junit4] 2> 9884 T110 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1363317324553/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9924 T110 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 9996 T110 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9998 T110 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10010 T110 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10089 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10090 T74 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:56616_ak_zme%2Fea",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56616/ak_zme/ea",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 10096 T80 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10096 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10097 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10098 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10874 T110 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10891 T110 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10895 T110 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10961 T110 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10978 T110 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10999 T110 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11011 T110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 11012 T110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 11013 T110 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11015 T110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 11016 T110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 11016 T110 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 11016 T110 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1363317324553/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/
[junit4:junit4] 2> 11017 T110 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16e4bc
[junit4:junit4] 2> 11017 T110 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 11018 T110 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2 forceNew: false
[junit4:junit4] 2> 11018 T110 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/index/
[junit4:junit4] 2> 11019 T110 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 11019 T110 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/index forceNew: false
[junit4:junit4] 2> 11021 T110 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@52f481 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18c0b28),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 11022 T110 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 11025 T110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 11026 T110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 11027 T110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 11028 T110 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 11029 T110 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 11029 T110 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 11030 T110 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 11030 T110 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 11031 T110 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 11040 T110 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 11055 T110 oass.SolrIndexSearcher.<init> Opening Searcher@ee9ce3 main
[junit4:junit4] 2> 11056 T110 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/tlog
[junit4:junit4] 2> 11056 T110 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 11057 T110 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 11069 T111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ee9ce3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 11077 T110 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 11077 T110 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11615 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11617 T74 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:55548_ak_zme%2Fea",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55548/ak_zme/ea",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 11617 T74 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 11617 T74 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11626 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11627 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11627 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11629 T80 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12080 T110 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 12080 T110 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55548/ak_zme/ea collection:collection1 shard:shard1
[junit4:junit4] 2> 12088 T110 oasc.ZkController.register We are http://127.0.0.1:55548/ak_zme/ea/collection1/ and leader is http://127.0.0.1:56616/ak_zme/ea/collection1/
[junit4:junit4] 2> 12088 T110 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55548/ak_zme/ea
[junit4:junit4] 2> 12088 T110 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 12089 T110 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@1144696 url=http://127.0.0.1:55548/ak_zme/ea/collection1 node=127.0.0.1:55548_ak_zme%2Fea C6_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:55548_ak_zme%2Fea, base_url=http://127.0.0.1:55548/ak_zme/ea, state=down, collection=collection1}
[junit4:junit4] 2> 12092 T112 C6 P55548 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 12096 T110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12096 T112 C6 P55548 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 12097 T112 C6 P55548 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 12097 T112 C6 P55548 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12098 T51 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 12098 T51 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12099 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12099 T112 C6 P55548 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12116 T51 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12331 T51 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 55548
[junit4:junit4] 2> 12331 T51 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=32599935
[junit4:junit4] 2> ASYNC NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@fad71d url=http://127.0.0.1:40345/ak_zme/ea/collection1 node=127.0.0.1:40345_ak_zme%2Fea C7_STATE=coll:control_collection core:collection1 props:{core=collection1, node_name=127.0.0.1:40345_ak_zme%2Fea, base_url=http://127.0.0.1:40345/ak_zme/ea, shard=shard1, state=active, collection=control_collection, leader=true}
[junit4:junit4] 2> 12562 T66 C7 P40345 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@8de441 lockFactory=org.apache.lucene.store.NativeFSLockFactory@14b2efa),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 12568 T66 C7 P40345 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 12632 T66 C7 P40345 /update {version=2&wt=javabin} {add=[1 (1429541831089061888)]} 0 87
[junit4:junit4] 2> 12632 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10001 (1429541831090110464)]} 0 73
[junit4:junit4] 2> ASYNC NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@c1c535 url=http://127.0.0.1:56616/ak_zme/ea/collection1 node=127.0.0.1:56616_ak_zme%2Fea C8_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:56616_ak_zme%2Fea, base_url=http://127.0.0.1:56616/ak_zme/ea, shard=shard1, state=active, collection=collection1, leader=true}
[junit4:junit4] 2> 12697 T87 C8 P56616 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a38980 lockFactory=org.apache.lucene.store.NativeFSLockFactory@193c295),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 12700 T87 C8 P56616 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 12706 T87 C8 P56616 /update {version=2&wt=javabin} {add=[1 (1429541831228522496)]} 0 15
[junit4:junit4] 2> 12720 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10001 (1429541831228522497)]} 0 29
[junit4:junit4] 2> 12751 T68 C7 P40345 /update {version=2&wt=javabin} {add=[2 (1429541831288291328)]} 0 3
[junit4:junit4] 2> 12757 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10002 (1429541831294582784)]} 0 2
[junit4:junit4] 2> 12763 T88 C8 P56616 /update {version=2&wt=javabin} {add=[2 (1429541831299825664)]} 0 3
[junit4:junit4] 2> 12767 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10002 (1429541831305068544)]} 0 2
[junit4:junit4] 2> 12850 T66 C7 P40345 /update {version=2&wt=javabin} {add=[3 (1429541831392100352)]} 0 3
[junit4:junit4] 2> 12857 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10003 (1429541831398391808)]} 0 3
[junit4:junit4] 2> 12858 T86 C8 P56616 /update {version=2&wt=javabin} {add=[3 (1429541831400488960)]} 0 2
[junit4:junit4] 2> 12864 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10003 (1429541831406780416)]} 0 3
[junit4:junit4] 2> 12890 T67 C7 P40345 /update {version=2&wt=javabin} {add=[4 (1429541831434043392)]} 0 3
[junit4:junit4] 2> 12895 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10004 (1429541831439286272)]} 0 2
[junit4:junit4] 2> 12896 T87 C8 P56616 /update {version=2&wt=javabin} {add=[4 (1429541831440334848)]} 0 2
[junit4:junit4] 2> 12900 T88 C8 P56616 /update {version=2&wt=javabin} {add=[10004 (1429541831444529152)]} 0 2
[junit4:junit4] 2> 12993 T69 C7 P40345 /update {version=2&wt=javabin} {add=[5 (1429541831540998144)]} 0 4
[junit4:junit4] 2> 12995 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10005 (1429541831544143872)]} 0 3
[junit4:junit4] 2> 12999 T87 C8 P56616 /update {version=2&wt=javabin} {add=[5 (1429541831548338176)]} 0 3
[junit4:junit4] 2> 13001 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10005 (1429541831550435328)]} 0 2
[junit4:junit4] 2> 13090 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[5 (-1429541831644807168)]} 0 1
[junit4:junit4] 2> 13092 T66 C7 P40345 /update {version=2&wt=javabin} {delete=[10005 (-1429541831647952896)]} 0 1
[junit4:junit4] 2> 13094 T88 C8 P56616 /update {version=2&wt=javabin} {delete=[5 (-1429541831650050048)]} 0 0
[junit4:junit4] 2> 13097 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[10005 (-1429541831653195776)]} 0 1
[junit4:junit4] 2> 13102 T68 C7 P40345 /update {version=2&wt=javabin} {add=[6 (1429541831655292928)]} 0 3
[junit4:junit4] 2> 13105 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10006 (1429541831658438656)]} 0 3
[junit4:junit4] 2> 13109 T87 C8 P56616 /update {version=2&wt=javabin} {add=[6 (1429541831663681536)]} 0 3
[junit4:junit4] 2> 13111 T88 C8 P56616 /update {version=2&wt=javabin} {add=[10006 (1429541831665778688)]} 0 3
[junit4:junit4] 2> 13136 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13138 T74 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:55548_ak_zme%2Fea",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55548/ak_zme/ea",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 13144 T80 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13144 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13145 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13144 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13190 T69 C7 P40345 /update {version=2&wt=javabin} {add=[7 (1429541831747567616)]} 0 3
[junit4:junit4] 2> 13205 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10007 (1429541831764344832)]} 0 2
[junit4:junit4] 2> C6_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:55548_ak_zme%2Fea, base_url=http://127.0.0.1:55548/ak_zme/ea, shard=shard1, state=recovering, collection=collection1}
[junit4:junit4] 2> 13264 T103 C6 P55548 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@52f481 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18c0b28),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13265 T103 C6 P55548 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13270 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[7 (1429541831760150528)]} 0 11
[junit4:junit4] 2> 13272 T86 C8 P56616 /update {version=2&wt=javabin} {add=[7 (1429541831760150528)]} 0 76
[junit4:junit4] 2> 13284 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10007 (1429541831774830592)]} 0 26
[junit4:junit4] 2> 13285 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10007 (1429541831774830592)]} 0 72
[junit4:junit4] 2> 13343 T51 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 13344 T51 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13346 T51 oasc.RecoveryStrategy.close WARNING Stopping recovery for zkNodeName=3core=collection1
[junit4:junit4] 2> 13365 T68 C7 P40345 /update {version=2&wt=javabin} {add=[8 (1429541831932116992)]} 0 2
[junit4:junit4] 2> 13382 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[8 (1429541831939457024)]} 0 3
[junit4:junit4] 2> 13384 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10008 (1429541831949942784)]} 0 5
[junit4:junit4] 2> 13385 T88 C8 P56616 /update {version=2&wt=javabin} {add=[8 (1429541831939457024)]} 0 16
[junit4:junit4] 2> 13399 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10008 (1429541831959379968)]} 0 3
[junit4:junit4] 2> 13401 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10008 (1429541831959379968)]} 0 13
[junit4:junit4] 2> 13436 T69 C7 P40345 /update {version=2&wt=javabin} {add=[9 (1429541832006565888)]} 0 2
[junit4:junit4] 2> 13448 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10009 (1429541832019148800)]} 0 3
[junit4:junit4] 2> 13449 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[9 (1429541832014954496)]} 0 3
[junit4:junit4] 2> 13450 T86 C8 P56616 /update {version=2&wt=javabin} {add=[9 (1429541832014954496)]} 0 9
[junit4:junit4] 2> 13456 T68 C7 P40345 /update {version=2&wt=javabin} {delete=[8 (-1429541832028585984)]} 0 1
[junit4:junit4] 2> 13461 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10009 (1429541832025440256)]} 0 4
[junit4:junit4] 2> 13464 T88 C8 P56616 /update {version=2&wt=javabin} {add=[10009 (1429541832025440256)]} 0 12
[junit4:junit4] 2> 13468 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[8 (-1429541832036974592)]} 0 1
[junit4:junit4] 2> 13469 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[8 (-1429541832036974592)]} 0 7
[junit4:junit4] 2> 13470 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[10008 (-1429541832044314624)]} 0 0
[junit4:junit4] 2> 13476 T69 C7 P40345 /update {version=2&wt=javabin} {add=[10 (1429541832048508928)]} 0 3
[junit4:junit4] 2> 13478 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[10008 (-1429541832048508928)]} 0 1
[junit4:junit4] 2> 13479 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[10008 (-1429541832048508928)]} 0 6
[junit4:junit4] 2> 13486 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10010 (1429541832058994688)]} 0 2
[junit4:junit4] 2> 13492 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10 (1429541832057946112)]} 0 4
[junit4:junit4] 2> 13494 T88 C8 P56616 /update {version=2&wt=javabin} {add=[10 (1429541832057946112)]} 0 12
[junit4:junit4] 2> 13498 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10010 (1429541832065286144)]} 0 3
[junit4:junit4] 2> 13500 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10010 (1429541832065286144)]} 0 10
[junit4:junit4] 2> 13501 T89 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {onlyIfLeader=true&core=collection1&nodeName=127.0.0.1:55548_ak_zme%252Fea&version=2&state=recovering&checkLive=true&action=PREPRECOVERY&wt=javabin&coreNodeName=3} status=0 QTime=1005
[junit4:junit4] 2> 13517 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[9 (-1429541832093597696)]} 0 1
[junit4:junit4] 2> 13522 T66 C7 P40345 /update {version=2&wt=javabin} {delete=[10009 (-1429541832098840576)]} 0 1
[junit4:junit4] 2> 13524 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[9 (-1429541832097792000)]} 0 0
[junit4:junit4] 2> 13525 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[9 (-1429541832097792000)]} 0 5
[junit4:junit4] 2> 13530 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[10009 (-1429541832104083456)]} 0 0
[junit4:junit4] 2> 13532 T69 C7 P40345 /update {version=2&wt=javabin} {add=[11 (1429541832107229184)]} 0 3
[junit4:junit4] 2> 13532 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[10009 (-1429541832104083456)]} 0 7
[junit4:junit4] 2> 13539 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10011 (1429541832114569216)]} 0 4
[junit4:junit4] 2> 13547 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[11 (1429541832113520640)]} 0 3
[junit4:junit4] 2> 13548 T89 C8 P56616 /update {version=2&wt=javabin} {add=[11 (1429541832113520640)]} 0 13
[junit4:junit4] 2> 13558 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10011 (1429541832120860672)]} 0 2
[junit4:junit4] 2> 13560 T88 C8 P56616 /update {version=2&wt=javabin} {add=[10011 (1429541832120860672)]} 0 18
[junit4:junit4] 2> 13600 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[10 (-1429541832180629504)]} 0 0
[junit4:junit4] 2> 13608 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[10 (-1429541832184823808)]} 0 0
[junit4:junit4] 2> 13610 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[10 (-1429541832184823808)]} 0 6
[junit4:junit4] 2> 13612 T66 C7 P40345 /update {version=2&wt=javabin} {delete=[10010 (-1429541832192163840)]} 0 2
[junit4:junit4] 2> 13619 T69 C7 P40345 /update {version=2&wt=javabin} {add=[12 (1429541832197406720)]} 0 3
[junit4:junit4] 2> 13628 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[10010 (-1429541832197406720)]} 0 1
[junit4:junit4] 2> 13629 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[10010 (-1429541832197406720)]} 0 14
[junit4:junit4] 2> 13635 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[12 (1429541832204746752)]} 0 3
[junit4:junit4] 2> 13640 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10012 (1429541832220475392)]} 0 2
[junit4:junit4] 2> 13643 T89 C8 P56616 /update {version=2&wt=javabin} {add=[12 (1429541832204746752)]} 0 20
[junit4:junit4] 2> 13656 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10012 (1429541832227815424)]} 0 2
[junit4:junit4] 2> 13660 T88 C8 P56616 /update {version=2&wt=javabin} {add=[10012 (1429541832227815424)]} 0 16
[junit4:junit4] 2> 13687 T66 C7 P40345 /update {version=2&wt=javabin} {add=[13 (1429541832269758464)]} 0 3
[junit4:junit4] 2> 13703 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[13 (1429541832279195648)]} 0 3
[junit4:junit4] 2> 13704 T86 C8 P56616 /update {version=2&wt=javabin} {add=[13 (1429541832279195648)]} 0 10
[junit4:junit4] 2> 13707 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10013 (1429541832289681408)]} 0 3
[junit4:junit4] 2> 13721 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10013 (1429541832297021440)]} 0 3
[junit4:junit4] 2> 13722 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10013 (1429541832297021440)]} 0 11
[junit4:junit4] 2> 13747 T69 C7 P40345 /update {version=2&wt=javabin} {add=[14 (1429541832332673024)]} 0 2
[junit4:junit4] 2> 13761 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[14 (1429541832338964480)]} 0 3
[junit4:junit4] 2> 13763 T89 C8 P56616 /update {version=2&wt=javabin} {add=[14 (1429541832338964480)]} 0 12
[junit4:junit4] 2> 13766 T66 C7 P40345 /update {version=2&wt=javabin} {delete=[12 (-1429541832354693120)]} 0 0
[junit4:junit4] 2> 13768 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10014 (1429541832353644544)]} 0 3
[junit4:junit4] 2> 13774 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[12 (-1429541832358887424)]} 0 0
[junit4:junit4] 2> 13778 T88 C8 P56616 /update {version=2&wt=javabin} {delete=[12 (-1429541832358887424)]} 0 8
[junit4:junit4] 2> 13779 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10014 (1429541832359936000)]} 0 2
[junit4:junit4] 2> 13780 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10014 (1429541832359936000)]} 0 9
[junit4:junit4] 2> 13784 T68 C7 P40345 /update {version=2&wt=javabin} {add=[15 (1429541832371470336)]} 0 2
[junit4:junit4] 2> 13785 T69 C7 P40345 /update {version=2&wt=javabin} {delete=[10012 (-1429541832374616064)]} 0 2
[junit4:junit4] 2> 13794 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[10012 (-1429541832378810368)]} 0 1
[junit4:junit4] 2> 13798 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[15 (1429541832379858944)]} 0 3
[junit4:junit4] 2> 13799 T88 C8 P56616 /update {version=2&wt=javabin} {add=[15 (1429541832379858944)]} 0 10
[junit4:junit4] 2> 13800 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[10012 (-1429541832378810368)]} 0 11
[junit4:junit4] 2> 13807 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10015 (1429541832394539008)]} 0 3
[junit4:junit4] 2> 13821 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10015 (1429541832402927616)]} 0 3
[junit4:junit4] 2> 13822 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10015 (1429541832402927616)]} 0 11
[junit4:junit4] 2> 13864 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[15 (-1429541832457453568)]} 0 0
[junit4:junit4] 2> 13871 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[15 (-1429541832461647872)]} 0 0
[junit4:junit4] 2> 13873 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[15 (-1429541832461647872)]} 0 5
[junit4:junit4] 2> 13879 T68 C7 P40345 /update {version=2&wt=javabin} {add=[16 (1429541832471085056)]} 0 3
[junit4:junit4] 2> 13882 T69 C7 P40345 /update {version=2&wt=javabin} {delete=[10015 (-1429541832476327936)]} 0 0
[junit4:junit4] 2> 13889 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[10015 (-1429541832479473664)]} 0 1
[junit4:junit4] 2> 13890 T88 C8 P56616 /update {version=2&wt=javabin} {delete=[10015 (-1429541832479473664)]} 0 5
[junit4:junit4] 2> 13891 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[16 (1429541832478425088)]} 0 2
[junit4:junit4] 2> 13893 T89 C8 P56616 /update {version=2&wt=javabin} {add=[16 (1429541832478425088)]} 0 9
[junit4:junit4] 2> 13896 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10016 (1429541832488910848)]} 0 3
[junit4:junit4] 2> 13908 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10016 (1429541832495202304)]} 0 2
[junit4:junit4] 2> 13908 T66 C7 P40345 /update {version=2&wt=javabin} {add=[17 (1429541832501493760)]} 0 2
[junit4:junit4] 2> 13909 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10016 (1429541832495202304)]} 0 10
[junit4:junit4] 2> 13921 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[17 (1429541832508833792)]} 0 3
[junit4:junit4] 2> 13922 T88 C8 P56616 /update {version=2&wt=javabin} {add=[17 (1429541832508833792)]} 0 10
[junit4:junit4] 2> 13927 T69 C7 P40345 /update {version=2&wt=javabin} {add=[10017 (1429541832521416704)]} 0 3
[junit4:junit4] 2> 13939 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10017 (1429541832527708160)]} 0 2
[junit4:junit4] 2> 13940 T89 C8 P56616 /update {version=2&wt=javabin} {add=[10017 (1429541832527708160)]} 0 9
[junit4:junit4] 2> 14001 T68 C7 P40345 /update {version=2&wt=javabin} {add=[18 (1429541832599011328)]} 0 2
[junit4:junit4] 2> 14013 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[18 (1429541832605302784)]} 0 3
[junit4:junit4] 2> 14015 T86 C8 P56616 /update {version=2&wt=javabin} {add=[18 (1429541832605302784)]} 0 10
[junit4:junit4] 2> 14021 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10018 (1429541832619982848)]} 0 3
[junit4:junit4] 2> 14034 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10018 (1429541832627322880)]} 0 3
[junit4:junit4] 2> 14035 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10018 (1429541832627322880)]} 0 9
[junit4:junit4] 2> 14098 T69 C7 P40345 /update {version=2&wt=javabin} {delete=[17 (-1429541832702820352)]} 0 1
[junit4:junit4] 2> 14111 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[17 (-1429541832708063232)]} 0 1
[junit4:junit4] 2> 14112 T88 C8 P56616 /update {version=2&wt=javabin} {delete=[17 (-1429541832708063232)]} 0 9
[junit4:junit4] 2> 14120 T66 C7 P40345 /update {version=2&wt=javabin} {delete=[10017 (-1429541832724840448)]} 0 3
[junit4:junit4] 2> 14122 T68 C7 P40345 /update {version=2&wt=javabin} {add=[19 (1429541832721694720)]} 0 7
[junit4:junit4] 2> 14130 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[10017 (-1429541832729034752)]} 0 1
[junit4:junit4] 2> 14131 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[10017 (-1429541832729034752)]} 0 8
[junit4:junit4] 2> 14133 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[19 (1429541832732180480)]} 0 3
[junit4:junit4] 2> 14134 T86 C8 P56616 /update {version=2&wt=javabin} {add=[19 (1429541832732180480)]} 0 9
[junit4:junit4] 2> 14137 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10019 (1429541832741617664)]} 0 3
[junit4:junit4] 2> 14152 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10019 (1429541832750006272)]} 0 3
[junit4:junit4] 2> 14154 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10019 (1429541832750006272)]} 0 12
[junit4:junit4] 2> 14175 T69 C7 P40345 /update {version=2&wt=javabin} {add=[20 (1429541832781463552)]} 0 2
[junit4:junit4] 2> 14189 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[20 (1429541832789852160)]} 0 3
[junit4:junit4] 2> 14197 T88 C8 P56616 /update {version=2&wt=javabin} {add=[20 (1429541832789852160)]} 0 18
[junit4:junit4] 2> 14204 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10020 (1429541832810823680)]} 0 3
[junit4:junit4] 2> 14219 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10020 (1429541832821309440)]} 0 3
[junit4:junit4] 2> 14220 T89 C8 P56616 /update {version=2&wt=javabin} {add=[10020 (1429541832821309440)]} 0 9
[junit4:junit4] 2> 14271 T68 C7 P40345 /update {version=2&wt=javabin} {add=[21 (1429541832882126848)]} 0 2
[junit4:junit4] 2> 14283 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[21 (1429541832888418304)]} 0 3
[junit4:junit4] 2> 14285 T86 C8 P56616 /update {version=2&wt=javabin} {add=[21 (1429541832888418304)]} 0 10
[junit4:junit4] 2> 14298 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10021 (1429541832910438400)]} 0 3
[junit4:junit4] 2> 14310 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10021 (1429541832916729856)]} 0 3
[junit4:junit4] 2> 14311 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10021 (1429541832916729856)]} 0 9
[junit4:junit4] 2> 14345 T69 C7 P40345 /update {version=2&wt=javabin} {add=[22 (1429541832959721472)]} 0 3
[junit4:junit4] 2> 14364 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[22 (1429541832974401536)]} 0 2
[junit4:junit4] 2> 14366 T89 C8 P56616 /update {version=2&wt=javabin} {add=[22 (1429541832974401536)]} 0 9
[junit4:junit4] 2> 14375 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10022 (1429541832991178752)]} 0 2
[junit4:junit4] 2> 14387 T68 C7 P40345 /update {version=2&wt=javabin} {add=[23 (1429541833004810240)]} 0 2
[junit4:junit4] 2> 14393 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10022 (1429541833003761664)]} 0 3
[junit4:junit4] 2> 14394 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10022 (1429541833003761664)]} 0 10
[junit4:junit4] 2> 14400 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[23 (1429541833012150272)]} 0 2
[junit4:junit4] 2> 14402 T88 C8 P56616 /update {version=2&wt=javabin} {add=[23 (1429541833012150272)]} 0 9
[junit4:junit4] 2> 14408 T67 C7 P40345 /update {version=2&wt=javabin} {add=[24 (1429541833025781760)]} 0 2
[junit4:junit4] 2> 14414 T69 C7 P40345 /update {version=2&wt=javabin} {add=[10023 (1429541833032073216)]} 0 3
[junit4:junit4] 2> 14420 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[24 (1429541833033121792)]} 0 2
[junit4:junit4] 2> 14422 T89 C8 P56616 /update {version=2&wt=javabin} {add=[24 (1429541833033121792)]} 0 10
[junit4:junit4] 2> 14428 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10023 (1429541833041510400)]} 0 3
[junit4:junit4] 2> 14429 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10023 (1429541833041510400)]} 0 9
[junit4:junit4] 2> 14435 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10024 (1429541833054093312)]} 0 3
[junit4:junit4] 2> 14450 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10024 (1429541833060384768)]} 0 2
[junit4:junit4] 2> 14452 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10024 (1429541833060384768)]} 0 13
[junit4:junit4] 2> 14478 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[24 (-1429541833100230656)]} 0 1
[junit4:junit4] 2> 14493 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[24 (-1429541833105473536)]} 0 9
[junit4:junit4] 2> 14497 T88 C8 P56616 /update {version=2&wt=javabin} {delete=[24 (-1429541833105473536)]} 0 16
[junit4:junit4] 2> 14503 T66 C7 P40345 /update {version=2&wt=javabin} {add=[25 (1429541833125396480)]} 0 2
[junit4:junit4] 2> 14508 T69 C7 P40345 /update {version=2&wt=javabin} {delete=[10024 (-1429541833132736512)]} 0 1
[junit4:junit4] 2> 14515 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[10024 (-1429541833136930816)]} 0 0
[junit4:junit4] 2> 14516 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[25 (1429541833132736512)]} 0 2
[junit4:junit4] 2> 14517 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[10024 (-1429541833136930816)]} 0 5
[junit4:junit4] 2> 14517 T89 C8 P56616 /update {version=2&wt=javabin} {add=[25 (1429541833132736512)]} 0 10
[junit4:junit4] 2> 14523 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10025 (1429541833146368000)]} 0 3
[junit4:junit4] 2> 14535 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10025 (1429541833152659456)]} 0 2
[junit4:junit4] 2> 14536 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10025 (1429541833152659456)]} 0 9
[junit4:junit4] 2> 14549 T67 C7 P40345 /update {version=2&wt=javabin} {add=[26 (1429541833173630976)]} 0 2
[junit4:junit4] 2> 14565 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[26 (1429541833180971008)]} 0 2
[junit4:junit4] 2> 14567 T88 C8 P56616 /update {version=2&wt=javabin} {add=[26 (1429541833180971008)]} 0 13
[junit4:junit4] 2> 14571 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10026 (1429541833196699648)]} 0 2
[junit4:junit4] 2> 14582 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10026 (1429541833202991104)]} 0 3
[junit4:junit4] 2> 14583 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10026 (1429541833202991104)]} 0 8
[junit4:junit4] 2> 14589 T69 C7 P40345 /update {version=2&wt=javabin} {delete=[26 (-1429541833217671168)]} 0 0
[junit4:junit4] 2> 14610 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[26 (-1429541833234448384)]} 0 2
[junit4:junit4] 2> 14612 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[26 (-1429541833234448384)]} 0 19
[junit4:junit4] 2> 14616 T68 C7 P40345 /update {version=2&wt=javabin} {delete=[10026 (-1429541833245982720)]} 0 3
[junit4:junit4] 2> 14621 T67 C7 P40345 /update {version=2&wt=javabin} {add=[27 (1429541833249128448)]} 0 2
[junit4:junit4] 2> 14627 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[10026 (-1429541833253322752)]} 0 0
[junit4:junit4] 2> 14630 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[10026 (-1429541833253322752)]} 0 8
[junit4:junit4] 2> 14635 T69 C7 P40345 /update {version=2&wt=javabin} {add=[10027 (1429541833264857088)]} 0 2
[junit4:junit4] 2> 14642 T103 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[27 (1429541833257517056)]} 0 10
[junit4:junit4] 2> 14643 T88 C8 P56616 /update {version=2&wt=javabin} {add=[27 (1429541833257517056)]} 0 17
[junit4:junit4] 2> 14651 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {add=[10027 (1429541833270099968)]} 0 3
[junit4:junit4] 2> 14652 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10027 (1429541833270099968)]} 0 13
[junit4:junit4] 2> 14659 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14665 T74 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:55548_ak_zme%2Fea",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55548/ak_zme/ea",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 14667 T68 C7 P40345 /update {version=2&wt=javabin} {delete=[27 (-1429541833299460096)]} 0 1
[junit4:junit4] 2> 14674 T104 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[27 (-1429541833302605824)]} 0 1
[junit4:junit4] 2> 14674 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[27 (-1429541833302605824)]} 0 4
[junit4:junit4] 2> 14676 T66 C7 P40345 /update {version=2&wt=javabin} {delete=[10027 (-1429541833308897280)]} 0 1
[junit4:junit4] 2> 14678 T80 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14678 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14678 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14680 T67 C7 P40345 /update {version=2&wt=javabin} {add=[28 (1429541833310994432)]} 0 2
[junit4:junit4] 2> 14681 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14686 T88 C8 P56616 /update {version=2&wt=javabin} {add=[28 (1429541833318334464)]} 0 2
[junit4:junit4] 2> C6_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:55548_ak_zme%2Fea, base_url=http://127.0.0.1:55548/ak_zme/ea, shard=shard1, state=down, collection=collection1}
[junit4:junit4] 2> 14697 T105 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {delete=[10027 (-1429541833315188736)]} 0 10
[junit4:junit4] 2> 14698 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[10027 (-1429541833315188736)]} 0 19
[junit4:junit4] 2> 14703 T69 C7 P40345 /update {version=2&wt=javabin} {add=[10028 (1429541833336160256)]} 0 2
[junit4:junit4] 2> 14708 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10028 (1429541833341403136)]} 0 2
[junit4:junit4] 2> 14775 T68 C7 P40345 /update {version=2&wt=javabin} {add=[29 (1429541833410609152)]} 0 3
[junit4:junit4] 2> 14780 T88 C8 P56616 /update {version=2&wt=javabin} {add=[29 (1429541833415852032)]} 0 2
[junit4:junit4] 2> 14797 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10029 (1429541833433677824)]} 0 2
[junit4:junit4] 2> 14802 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10029 (1429541833438920704)]} 0 2
[junit4:junit4] 2> 14870 T67 C7 P40345 /update {version=2&wt=javabin} {add=[30 (1429541833511272448)]} 0 2
[junit4:junit4] 2> 14876 T89 C8 P56616 /update {version=2&wt=javabin} {add=[30 (1429541833516515328)]} 0 2
[junit4:junit4] 2> 14891 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10030 (1429541833533292544)]} 0 1
[junit4:junit4] 2> 14896 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10030 (1429541833538535424)]} 0 1
[junit4:junit4] 2> 14949 T66 C7 P40345 /update {version=2&wt=javabin} {add=[31 (1429541833594109952)]} 0 1
[junit4:junit4] 2> 14955 T88 C8 P56616 /update {version=2&wt=javabin} {add=[31 (1429541833599352832)]} 0 2
[junit4:junit4] 2> 14971 T69 C7 P40345 /update {version=2&wt=javabin} {add=[10031 (1429541833616130048)]} 0 2
[junit4:junit4] 2> 14976 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10031 (1429541833622421504)]} 0 1
[junit4:junit4] 2> 15014 T67 C7 P40345 /update {version=2&wt=javabin} {add=[32 (1429541833662267392)]} 0 2
[junit4:junit4] 2> 15021 T89 C8 P56616 /update {version=2&wt=javabin} {add=[32 (1429541833668558848)]} 0 3
[junit4:junit4] 2> 15036 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10032 (1429541833684287488)]} 0 2
[junit4:junit4] 2> 15042 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10032 (1429541833690578944)]} 0 3
[junit4:junit4] 2> 15089 T69 C7 P40345 /update {version=2&wt=javabin} {delete=[28 (-1429541833740910592)]} 0 1
[junit4:junit4] 2> 15092 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[28 (-1429541833745104896)]} 0 0
[junit4:junit4] 2> 15098 T67 C7 P40345 /update {version=2&wt=javabin} {add=[33 (1429541833750347776)]} 0 2
[junit4:junit4] 2> 15105 T89 C8 P56616 /update {version=2&wt=javabin} {add=[33 (1429541833757687808)]} 0 2
[junit4:junit4] 2> 15110 T68 C7 P40345 /update {version=2&wt=javabin} {delete=[10028 (-1429541833763979264)]} 0 0
[junit4:junit4] 2> 15114 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[10028 (-1429541833768173568)]} 0 0
[junit4:junit4] 2> 15122 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10033 (1429541833774465024)]} 0 2
[junit4:junit4] 2> 15127 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10033 (1429541833780756480)]} 0 2
[junit4:junit4] 2> 15196 T69 C7 P40345 /update {version=2&wt=javabin} {delete=[29 (-1429541833854156800)]} 0 1
[junit4:junit4] 2> 15200 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[29 (-1429541833858351104)]} 0 0
[junit4:junit4] 2> 15205 T67 C7 P40345 /update {version=2&wt=javabin} {add=[34 (1429541833862545408)]} 0 2
[junit4:junit4] 2> 15211 T88 C8 P56616 /update {version=2&wt=javabin} {add=[34 (1429541833868836864)]} 0 2
[junit4:junit4] 2> 15213 T68 C7 P40345 /update {version=2&wt=javabin} {delete=[10029 (-1429541833871982592)]} 0 0
[junit4:junit4] 2> 15219 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[10029 (-1429541833878274048)]} 0 1
[junit4:junit4] 2> 15224 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10034 (1429541833882468352)]} 0 2
[junit4:junit4] 2> 15230 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10034 (1429541833887711232)]} 0 2
[junit4:junit4] 2> 15265 T69 C7 P40345 /update {version=2&wt=javabin} {add=[35 (1429541833924411392)]} 0 2
[junit4:junit4] 2> 15270 T89 C8 P56616 /update {version=2&wt=javabin} {add=[35 (1429541833930702848)]} 0 2
[junit4:junit4] 2> 15283 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10035 (1429541833943285760)]} 0 2
[junit4:junit4] 2> 15289 T88 C8 P56616 /update {version=2&wt=javabin} {add=[10035 (1429541833949577216)]} 0 3
[junit4:junit4] 2> 15294 T66 C7 P40345 /update {version=2&wt=javabin} {add=[36 (1429541833955868672)]} 0 2
[junit4:junit4] 2> 15300 T87 C8 P56616 /update {version=2&wt=javabin} {add=[36 (1429541833961111552)]} 0 2
[junit4:junit4] 2> 15311 T69 C7 P40345 /update {version=2&wt=javabin} {add=[37 (1429541833973694464)]} 0 2
[junit4:junit4] 2> 15315 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10036 (1429541833976840192)]} 0 2
[junit4:junit4] 2> 15317 T86 C8 P56616 /update {version=2&wt=javabin} {add=[37 (1429541833979985920)]} 0 2
[junit4:junit4] 2> 15323 T89 C8 P56616 /update {version=2&wt=javabin} {add=[10036 (1429541833986277376)]} 0 2
[junit4:junit4] 2> 15326 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[32 (-1429541833990471680)]} 0 0
[junit4:junit4] 2> 15330 T88 C8 P56616 /update {version=2&wt=javabin} {delete=[32 (-1429541833994665984)]} 0 1
[junit4:junit4] 2> 15335 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10037 (1429541833997811712)]} 0 2
[junit4:junit4] 2> 15336 T69 C7 P40345 /update {version=2&wt=javabin} {add=[38 (1429541833997811713)]} 0 3
[junit4:junit4] 2> 15340 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10037 (1429541834003054592)]} 0 2
[junit4:junit4] 2> 15341 T86 C8 P56616 /update {version=2&wt=javabin} {add=[38 (1429541834005151744)]} 0 2
[junit4:junit4] 2> 15349 T68 C7 P40345 /update {version=2&wt=javabin} {delete=[10032 (-1429541834014588928)]} 0 1
[junit4:junit4] 2> 15352 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[10032 (-1429541834017734656)]} 0 0
[junit4:junit4] 2> 15357 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10038 (1429541834021928960)]} 0 2
[junit4:junit4] 2> 15363 T88 C8 P56616 /update {version=2&wt=javabin} {add=[10038 (1429541834027171840)]} 0 2
[junit4:junit4] 2> 15371 T66 C7 P40345 /update {version=2&wt=javabin} {delete=[35 (-1429541834037657600)]} 0 0
[junit4:junit4] 2> 15375 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[35 (-1429541834041851904)]} 0 0
[junit4:junit4] 2> 15381 T69 C7 P40345 /update {version=2&wt=javabin} {add=[39 (1429541834046046208)]} 0 3
[junit4:junit4] 2> 15386 T86 C8 P56616 /update {version=2&wt=javabin} {add=[39 (1429541834051289088)]} 0 2
[junit4:junit4] 2> 15394 T68 C7 P40345 /update {version=2&wt=javabin} {delete=[10035 (-1429541834061774848)]} 0 1
[junit4:junit4] 2> 15398 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[10035 (-1429541834065969152)]} 0 1
[junit4:junit4] 2> 15404 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10039 (1429541834070163456)]} 0 2
[junit4:junit4] 2> 15410 T88 C8 P56616 /update {version=2&wt=javabin} {add=[10039 (1429541834076454912)]} 0 2
[junit4:junit4] 2> 15430 T66 C7 P40345 /update {version=2&wt=javabin} {add=[40 (1429541834098475008)]} 0 2
[junit4:junit4] 2> 15436 T87 C8 P56616 /update {version=2&wt=javabin} {add=[40 (1429541834103717888)]} 0 2
[junit4:junit4] 2> 15451 T69 C7 P40345 /update {version=2&wt=javabin} {add=[10040 (1429541834119446528)]} 0 2
[junit4:junit4] 2> 15456 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10040 (1429541834125737984)]} 0 2
[junit4:junit4] 2> 15501 T68 C7 P40345 /update {version=2&wt=javabin} {delete=[37 (-1429541834173972480)]} 0 1
[junit4:junit4] 2> 15502 T112 C6 P55548 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:56616/ak_zme/ea/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 15505 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[37 (-1429541834177118208)]} 0 1
[junit4:junit4] 2> 15507 T112 C6 P55548 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 15510 T67 C7 P40345 /update {version=2&wt=javabin} {add=[41 (1429541834181312512)]} 0 2
[junit4:junit4] 2> 15518 T112 C6 P55548 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55548/ak_zme/ea START replicas=[http://127.0.0.1:56616/ak_zme/ea/collection1/] nUpdates=100
[junit4:junit4] 2> 15525 T66 C7 P40345 /update {version=2&wt=javabin} {delete=[10037 (-1429541834199138304)]} 0 0
[junit4:junit4] 2> 15527 T87 C8 P56616 /update {version=2&wt=javabin} {add=[41 (1429541834200186880)]} 0 3
[junit4:junit4] 2> 15529 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[10037 (-1429541834203332608)]} 0 0
[junit4:junit4] 2> 15533 T69 C7 P40345 /update {version=2&wt=javabin} {add=[10041 (1429541834206478336)]} 0 1
[junit4:junit4] 2> 15540 T112 C6 P55548 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 15541 T112 C6 P55548 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 15541 T112 C6 P55548 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 15541 T89 C8 P56616 /update {version=2&wt=javabin} {add=[10041 (1429541834213818368)]} 0 2
[junit4:junit4] 2> 15541 T112 C6 P55548 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 15542 T112 C6 P55548 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=tlog{file=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/tlog/tlog.0000000000000000000 refcount=1}}
[junit4:junit4] 2> 15542 T112 C6 P55548 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:56616/ak_zme/ea/collection1/. core=collection1
[junit4:junit4] 2> 15542 T112 C6 P55548 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15552 T87 C8 P56616 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 15553 T88 C8 P56616 REQ /get {getVersions=100&distrib=false&version=2&qt=/get&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 15583 T68 C7 P40345 /update {version=2&wt=javabin} {add=[42 (1429541834258907136)]} 0 2
[junit4:junit4] 2> 15590 T89 C8 P56616 /update {version=2&wt=javabin} {add=[42 (1429541834263101440)]} 0 4
[junit4:junit4] 2> 15597 T67 C7 P40345 /update {version=2&wt=javabin} {add=[10042 (1429541834272538624)]} 0 2
[junit4:junit4] 2> 15629 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10042 (1429541834292461568)]} 0 15
[junit4:junit4] 2> 15637 T66 C7 P40345 /update {version=2&wt=javabin} {add=[43 (1429541834314481664)]} 0 2
[junit4:junit4] 2> 15643 T88 C8 P56616 /update {version=2&wt=javabin} {add=[43 (1429541834320773120)]} 0 2
[junit4:junit4] 2> 15675 T69 C7 P40345 /update {version=2&wt=javabin} {add=[10043 (1429541834355376128)]} 0 2
[junit4:junit4] 2> 15680 T87 C8 P56616 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a38980 lockFactory=org.apache.lucene.store.NativeFSLockFactory@193c295),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a38980 lockFactory=org.apache.lucene.store.NativeFSLockFactory@193c295),segFN=segments_2,generation=2,filenames=[_0.doc, _0_1.del, _0.si, _0.fdx, _0.pos, _0.nvd, _0.tip, _0.fnm, segments_2, _0.fdt, _0.nvm, _0.tim]
[junit4:junit4] 2> 15681 T89 C8 P56616 /update {version=2&wt=javabin} {add=[10043 (1429541834360619008)]} 0 2
[junit4:junit4] 2> 15681 T87 C8 P56616 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.doc, _0_1.del, _0.si, _0.fdx, _0.pos, _0.nvd, _0.tip, _0.fnm, segments_2, _0.fdt, _0.nvm, _0.tim]
[junit4:junit4] 2> 15721 T87 C8 P56616 oass.SolrIndexSearcher.<init> Opening Searcher@7612f1 realtime
[junit4:junit4] 2> 15722 T87 C8 P56616 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15723 T87 C8 P56616 /update {waitSearcher=true&version=2&softCommit=false&openSearcher=false&commit=true&commit_end_point=true&wt=javabin} {commit=} 0 171
[junit4:junit4] 2> 15726 T68 C7 P40345 /update {version=2&wt=javabin} {delete=[38 (-1429541834409902080)]} 0 0
[junit4:junit4] 2> 15737 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[38 (-1429541834421436416)]} 0 0
[junit4:junit4] 2> 15743 T69 C7 P40345 /update {version=2&wt=javabin} {add=[44 (1429541834425630720)]} 0 2
[junit4:junit4] 2> 15750 T88 C8 P56616 /update {version=2&wt=javabin} {add=[44 (1429541834432970752)]} 0 2
[junit4:junit4] 2> 15762 T112 C6 P55548 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15763 T112 C6 P55548 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 15766 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[10038 (-1429541834451845120)]} 0 0
[junit4:junit4] 2> 15770 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[10038 (-1429541834456039424)]} 0 0
[junit4:junit4] 2> 15771 T112 C6 P55548 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 15775 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10044 (1429541834460233728)]} 0 2
[junit4:junit4] 2> 15778 T66 C7 P40345 /update {version=2&wt=javabin} {delete=[40 (-1429541834464428032)]} 0 1
[junit4:junit4] 2> 15781 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10044 (1429541834465476608)]} 0 2
[junit4:junit4] 2> 15782 T88 C8 P56616 /update {version=2&wt=javabin} {delete=[40 (-1429541834467573760)]} 0 1
[junit4:junit4] 2> 15788 T69 C7 P40345 /update {version=2&wt=javabin} {add=[45 (1429541834472816640)]} 0 1
[junit4:junit4] 2> 15794 T87 C8 P56616 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15795 T89 C8 P56616 /update {version=2&wt=javabin} {add=[45 (1429541834480156672)]} 0 2
[junit4:junit4] 2> 15795 T87 C8 P56616 REQ /replication {version=2&qt=/replication&command=indexversion&wt=javabin} status=0 QTime=22
[junit4:junit4] 2> 15798 T112 C6 P55548 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 15798 T112 C6 P55548 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 15798 T112 C6 P55548 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 15802 T86 C8 P56616 REQ /replication {generation=2&version=2&qt=/replication&command=filelist&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 15803 T112 C6 P55548 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 12
[junit4:junit4] 2> 15804 T112 C6 P55548 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/index.20130314201531783 forceNew: false
[junit4:junit4] 2> 15805 T112 C6 P55548 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@17ec096 lockFactory=org.apache.lucene.store.NativeFSLockFactory@29ecf1) fullCopy=true
[junit4:junit4] 2> 15810 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[10040 (-1429541834497982464)]} 0 1
[junit4:junit4] 2> 15813 T88 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0_1.del&command=filecontent&checksum=true&wt=filestream} status=0 QTime=3
[junit4:junit4] 2> 15814 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[10040 (-1429541834502176768)]} 0 1
[junit4:junit4] 2> 15826 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10045 (1429541834513711104)]} 0 2
[junit4:junit4] 2> 15837 T86 C8 P56616 /update {version=2&wt=javabin} {add=[10045 (1429541834521051136)]} 0 5
[junit4:junit4] 2> 15839 T87 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0.fdt&command=filecontent&checksum=true&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 15845 T89 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0.nvm&command=filecontent&checksum=true&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 15855 T88 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0.doc&command=filecontent&checksum=true&wt=filestream} status=0 QTime=1
[junit4:junit4] 2> 15863 T86 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0.si&command=filecontent&checksum=true&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 15873 T66 C7 P40345 /update {version=2&wt=javabin} {delete=[41 (-1429541834564042752)]} 0 0
[junit4:junit4] 2> 15877 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[41 (-1429541834568237056)]} 0 0
[junit4:junit4] 2> 15882 T69 C7 P40345 /update {version=2&wt=javabin} {add=[46 (1429541834572431360)]} 0 1
[junit4:junit4] 2> 15883 T89 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0.fdx&command=filecontent&checksum=true&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 15888 T88 C8 P56616 /update {version=2&wt=javabin} {add=[46 (1429541834577674240)]} 0 3
[junit4:junit4] 2> 15931 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[10041 (-1429541834624860160)]} 0 0
[junit4:junit4] 2> 15932 T68 C7 P40345 /update {version=2&wt=javabin} {delete=[44 (-1429541834625908736)]} 0 0
[junit4:junit4] 2> 15937 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[10041 (-1429541834631151616)]} 0 0
[junit4:junit4] 2> 15940 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[44 (-1429541834634297344)]} 0 0
[junit4:junit4] 2> 15944 T66 C7 P40345 /update {version=2&wt=javabin} {add=[10046 (1429541834637443072)]} 0 2
[junit4:junit4] 2> 15945 T88 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0.pos&command=filecontent&checksum=true&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 15950 T69 C7 P40345 /update {version=2&wt=javabin} {add=[47 (1429541834642685952)]} 0 2
[junit4:junit4] 2> 15950 T89 C8 P56616 /update {version=2&wt=javabin} {add=[10046 (1429541834642685952)]} 0 2
[junit4:junit4] 2> 15954 T86 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0.nvd&command=filecontent&checksum=true&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 15986 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[10044 (-1429541834682531840)]} 0 1
[junit4:junit4] 2> 15987 T87 C8 P56616 /update {version=2&wt=javabin} {add=[47 (1429541834682531840)]} 0 2
[junit4:junit4] 2> 16005 T88 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0.tip&command=filecontent&checksum=true&wt=filestream} status=0 QTime=1
[junit4:junit4] 2> 16005 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[10044 (-1429541834702454784)]} 0 1
[junit4:junit4] 2> 16009 T86 C8 P56616 REQ /replication {generation=2&qt=/replication&file=segments_2&command=filecontent&checksum=true&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 16011 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10047 (1429541834706649088)]} 0 2
[junit4:junit4] 2> 16018 T87 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0.fnm&command=filecontent&checksum=true&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 16021 T89 C8 P56616 /update {version=2&wt=javabin} {add=[10047 (1429541834718183424)]} 0 2
[junit4:junit4] 2> 16064 T88 C8 P56616 REQ /replication {generation=2&qt=/replication&file=_0.tim&command=filecontent&checksum=true&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 16066 T112 C6 P55548 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 16066 T112 C6 P55548 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20130314201531783
[junit4:junit4] 2> 16070 T112 C6 P55548 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 16070 T112 C6 P55548 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 16071 T112 C6 P55548 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4] 2> 16073 T112 C6 P55548 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/index/ new=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/index.20130314201531783
[junit4:junit4] 2> 16075 T112 C6 P55548 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17ec096 lockFactory=org.apache.lucene.store.NativeFSLockFactory@29ecf1),segFN=segments_2,generation=2,filenames=[_0.doc, _0_1.del, _0.si, _0.fdx, _0.pos, _0.nvd, _0.tip, _0.fnm, segments_2, _0.fdt, _0.nvm, _0.tim]
[junit4:junit4] 2> 16080 T112 C6 P55548 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.doc, _0_1.del, _0.si, _0.fdx, _0.pos, _0.nvd, _0.tip, _0.fnm, segments_2, _0.fdt, _0.nvm, _0.tim]
[junit4:junit4] 2> 16081 T112 C6 P55548 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 16084 T112 C6 P55548 oass.SolrIndexSearcher.<init> Opening Searcher@10e9d48 main
[junit4:junit4] 2> 16087 T111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10e9d48 main{StandardDirectoryReader(segments_2:4:nrt _0(4.3):C82/30)}
[junit4:junit4] 2> 16089 T66 C7 P40345 /update {version=2&wt=javabin} {add=[48 (1429541834789486592)]} 0 2
[junit4:junit4] 2> 16091 T112 C6 P55548 oash.SnapPuller$2.preClose removing old index files MockDirWrapper(org.apache.lucene.store.RAMDirectory@52f481 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18c0b28)
[junit4:junit4] 2> 16092 T112 C6 P55548 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/index
[junit4:junit4] 2> 16093 T112 C6 P55548 oash.SnapPuller$2.postClose removing old index directory MockDirWrapper(org.apache.lucene.store.RAMDirectory@52f481 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18c0b28)
[junit4:junit4] 2> 16095 T86 C8 P56616 /update {version=2&wt=javabin} {add=[48 (1429541834795778048)]} 0 2
[junit4:junit4] 2> 16130 T112 C6 P55548 oasc.RecoveryStrategy.replay Replaying buffered documents. core=collection1
[junit4:junit4] 2> 16131 T120 C6 P55548 oasu.UpdateLog$LogReplayer.doReplay WARNING Starting log replay tlog{file=./org.apache.solr.cloud.RecoveryZkTest-1363317315984/jetty2/tlog/tlog.0000000000000000000 refcount=2} active=true starting pos=4739
[junit4:junit4] 2> 16133 T120 C6 P55548 oasu.DirectUpdateHandler2.commit start commit{flags=2,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 16142 T69 C7 P40345 /update {version=2&wt=javabin} {delete=[45 (-1429541834846109696)]} 0 0
[junit4:junit4] 2> 16149 T120 C6 P55548 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17ec096 lockFactory=org.apache.lucene.store.NativeFSLockFactory@29ecf1),segFN=segments_2,generation=2,filenames=[_0.doc, _0_1.del, _0.si, _0.fdx, _0.pos, _0.nvd, _0.tip, _0.fnm, segments_2, _0.fdt, _0.nvm, _0.tim]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17ec096 lockFactory=org.apache.lucene.store.NativeFSLockFactory@29ecf1),segFN=segments_3,generation=3,filenames=[_0.doc, _0_1.del, _0.si, _0.fdx, _0.pos, _0.nvd, _0.tip, segments_3, _0.fnm, _0.fdt, _0.nvm, _0.tim]
[junit4:junit4] 2> 16149 T89 C8 P56616 /update {version=2&wt=javabin} {delete=[45 (-1429541834853449728)]} 0 0
[junit4:junit4] 2> 16150 T120 C6 P55548 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.doc, _0_1.del, _0.si, _0.fdx, _0.pos, _0.nvd, _0.tip, segments_3, _0.fnm, _0.fdt, _0.nvm, _0.tim]
[junit4:junit4] 2> 16151 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10048 (1429541834853449728)]} 0 3
[junit4:junit4] 2> 16156 T87 C8 P56616 /update {version=2&wt=javabin} {add=[10048 (1429541834858692608)]} 0 2
[junit4:junit4] 2> 16157 T120 C6 P55548 oass.SolrIndexSearcher.<init> Opening Searcher@f6e702 main
[junit4:junit4] 2> 16157 T120 C6 P55548 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 16158 T66 C7 P40345 /update {version=2&wt=javabin} {add=[49 (1429541834861838336)]} 0 2
[junit4:junit4] 2> 16159 T111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f6e702 main{StandardDirectoryReader(segments_2:4:nrt _0(4.3):C82/30)}
[junit4:junit4] 2> 16160 T120 C6 P55548 oasu.UpdateLog$LogReplayer.run WARNING Log replay finished. recoveryInfo=RecoveryInfo{adds=0 deletes=0 deleteByQuery=0 errors=0 positionOfStart=4739}
[junit4:junit4] 2> 16160 T112 C6 P55548 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 16160 T112 C6 P55548 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 16161 T112 C6 P55548 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16163 T112 C6 P55548 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 16164 T88 C8 P56616 /update {version=2&wt=javabin} {add=[49 (1429541834868129792)]} 0 2
[junit4:junit4] 2> 16166 T51 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1144696
[junit4:junit4] 2> 16175 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[10045 (-1429541834879664128)]} 0 1
[junit4:junit4] 2> 16180 T86 C8 P56616 /update {version=2&wt=javabin} {delete=[10045 (-1429541834885955584)]} 0 1
[junit4:junit4] 2> 16185 T68 C7 P40345 /update {version=2&wt=javabin} {add=[10049 (1429541834890149888)]} 0 2
[junit4:junit4] 2> 16186 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16187 T51 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=42,cumulative_deletesById=18,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 16188 T74 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:55548_ak_zme%2Fea",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55548/ak_zme/ea",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null}
[junit4:junit4] 2> 16191 T89 C8 P56616 /update {version=2&wt=javabin} {add=[10049 (1429541834895392768)]} 0 2
[junit4:junit4] 2> 16196 T69 C7 P40345 /update {version=2&wt=javabin} {delete=[48 (-1429541834901684224)]} 0 1
[junit4:junit4] 2> 16197 T51 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 16197 T51 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 16198 T51 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 16200 T87 C8 P56616 /update {version=2&wt=javabin} {delete=[48 (-1429541834906927104)]} 0 1
[junit4:junit4] 2> 16202 T80 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16203 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16203 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16203 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16206 T66 C7 P40345 /update {version=2&wt=javabin} {add=[50 (1429541834911121408)]} 0 2
[junit4:junit4] 2> C6_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:55548_ak_zme%2Fea, base_url=http://127.0.0.1:55548/ak_zme/ea, shard=shard1, state=active, collection=collection1}
[junit4:junit4] 2> 16217 T102 C6 P55548 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {} 0 3
[junit4:junit4] 2> 16219 T102 C6 P55548 oasc.SolrException.log SEVERE org.apache.solr.common.SolrException: SolrCoreState already closed
[junit4:junit4] 2> at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:85)
[junit4:junit4] 2> at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:153)
[junit4:junit4] 2> at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
[junit4:junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:451)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:587)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:346)
[junit4:junit4] 2> at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)
[junit4:junit4] 2> at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:246)
[junit4:junit4] 2> at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:173)
[junit4:junit4] 2> at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
[junit4:junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
[junit4:junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1811)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:637)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:343)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 16222 T102 C6 P55548 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1144696
[junit4:junit4] 2> 16222 T67 C7 P40345 /update {version=2&wt=javabin} {delete=[10048 (-1429541834929995776)]} 0 0
[junit4:junit4] 2> 16222 T102 C6 P55548 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=42,cumulative_deletesById=18,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 16225 T51 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 16226 T102 C6 P55548 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 16228 T56 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6c0b59e50008
[junit4:junit4] 2> 16233 T88 C8 P56616 oasc.SolrException.log SEVERE shard update error StdNode: http://127.0.0.1:55548/ak_zme/ea/collection1/:org.apache.solr.common.SolrException: Server at http://127.0.0.1:55548/ak_zme/ea/collection1 returned non ok status:503, message:Service Unavailable
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] 2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:332)
[junit4:junit4] 2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:306)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4:junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 16235 T88 C8 P56616 oasup.DistributedUpdateProcessor.doFinish try and ask http://127.0.0.1:55548/ak_zme/ea to recover
[junit4:junit4] 2> 16235 T88 C8 P56616 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16238 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16238 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16239 T51 oaz.ZooKeeper.close Session: 0x13d6c0b59e50008 closed
[junit4:junit4] 2> 16239 T53 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:44274 which had sessionid 0x13d6c0b59e50008
[junit4:junit4] 2> 16240 T89 C8 P56616 oasup.DistributedUpdateProcessor.doDefensiveChecks SEVERE Request says it is coming from leader, but we are the leader: version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER
[junit4:junit4] 2> 16240 T89 C8 P56616 /update {version=2&distrib.from=http://127.0.0.1:56616/ak_zme/ea/collection1/&wt=javabin&update.distrib=FROMLEADER} {} 0 1
[junit4:junit4] 2> 16241 T109 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 16241 T89 C8 P56616 oasc.SolrException.log SEVERE org.apache.solr.common.SolrException: Request says it is coming from leader, but we are the leader
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.doDefensiveChecks(DistributedUpdateProcessor.java:288)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:228)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.processDelete(DistributedUpdateProcessor.java:710)
[junit4:junit4] 2> at org.apache.solr.update.processor.LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:121)
[junit4:junit4] 2> at org.apache.solr.handler.loader.XMLLoader.processDelete(XMLLoader.java:346)
[junit4:junit4] 2> at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:277)
[junit4:junit4] 2> at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:173)
[junit4:junit4] 2> at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92)
[junit4:junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
[junit4:junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1811)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:637)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:343)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:856)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 16241 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16242 T80 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 16243 T80 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 16244 T109 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 16244 T93 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 16245 T109 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16247 T73 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 16255 T86 C8 P56616 oasc.SolrException.log SEVERE shard update error StdNode: http://127.0.0.1:55548/ak_zme/ea/collection1/:org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:55548/ak_zme/ea/collection1
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:417)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] 2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:332)
[junit4:junit4] 2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:306)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4:junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond
[junit4:junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:95)
[junit4:junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
[junit4:junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
[junit4:junit4] 2> at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
[junit4:junit4] 2> at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
[junit4:junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
[junit4:junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
[junit4:junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
[junit4:junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
[junit4:junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4] 2> ... 9 more
[junit4:junit4] 2>
[junit4:junit4] 2> 16256 T86 C8 P56616 oasup.DistributedUpdateProcessor.doFinish try and ask http://127.0.0.1:55548/ak_zme/ea to recover
[junit4:junit4] 2> 16256 T86 C8 P56616 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16261 T86 C8 P56616 oasup.DistributedUpdateProcessor.doFinish Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:55548/ak_zme/ea
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:410)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:440)
[junit4:junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1086)
[junit4:junit4] 2> at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)
[junit4:junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
[junit4:junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1811)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:637)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:343)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:jun
[...truncated too long message...]
ionError: Still found shard
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([479F16D15BA3894C:C67998C92CFCE970]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 140558 T2304 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 140566 T2303 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 140862 T2307 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 141664 T2386 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 141664 T2386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 141664 T2386 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 141665 T2386 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_sl=PostingsFormat(name=NestedPulsing), range_facet_l=PostingsFormat(name=Memory doPackFST= true), a_t=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Memory doPackFST= true), text=PostingsFormat(name=NestedPulsing), _version_=PostingsFormat(name=Memory doPackFST= true), a_si=PostingsFormat(name=MockSep), timestamp=PostingsFormat(name=Memory doPackFST= true), intDefault=PostingsFormat(name=Memory doPackFST= true), id=Pulsing41(freqCutoff=16 minBlockSize=31 maxBlockSize=116), multiDefault=PostingsFormat(name=MockSep), range_facet_si=PostingsFormat(name=MockSep)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=et, timezone=America/Ojinaga
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=309695432,total=507510784
[junit4:junit4] 2> NOTE: All tests run in this JVM: [ExternalFileFieldSortTest, TestFieldTypeCollectionResource, DirectUpdateHandlerOptimizeTest, SuggesterTest, BinaryUpdateRequestHandlerTest, TestWriterPerf, QueryEqualityTest, ReturnFieldsTest, RecoveryZkTest, TestSolrDeletionPolicy1, TestReversedWildcardFilterFactory, TestRealTimeGet, TestReplicationHandler, TestIBSimilarityFactory, CircularListTest, MinimalSchemaTest, TestDynamicFieldResource, FieldMutatingUpdateProcessorTest, SearchHandlerTest, ResourceLoaderTest, TestFieldCollectionResource, TestDocumentBuilder, TestFuzzyAnalyzedSuggestions, LoggingHandlerTest, TestQuerySenderListener, TestSearchPerf, QueryElevationComponentTest, LeaderElectionTest, PluginInfoTest, TestBadConfig, BadComponentTest, TestSolrCoreProperties, PrimUtilsTest, DocValuesTest, TestFastWriter, SOLR749Test, LegacyHTMLStripCharFilterTest, RegexBoostProcessorTest, PreAnalyzedFieldTest, SolrTestCaseJ4Test, TestSolrIndexConfig, AlternateDirectoryTest, SolrCoreTest, ResponseLogComponentTest, BasicDistributedZkTest, TestStressVersions, LukeRequestHandlerTest, SystemInfoHandlerTest, SolrInfoMBeanTest, DirectSolrConnectionTest, WordBreakSolrSpellCheckerTest, TermsComponentTest, SliceStateUpdateTest, MoreLikeThisHandlerTest, SpellingQueryConverterTest, TestLRUCache, TestQueryUtils, TestPerFieldSimilarity, ScriptEngineTest, ShardRoutingTest, TestRandomDVFaceting, SimpleFacetsTest, TestFunctionQuery, TermVectorComponentTest, SyncSliceTest, TestStressRecovery, UpdateRequestProcessorFactoryTest, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 141.85s, 1 test, 1 failure <<< FAILURES!
[...truncated 409 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 2 suite-level errors, 1 failure, 13 ignored (7 assumptions)
Total time: 41 minutes 44 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -server -XX:+UseG1GC -XX:MarkStackSize=256K
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b79) - Build #
4682 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4682/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseConcMarkSweepGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([51D6D53516D2EED3:D0305B2D618D8EEF]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:55579/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:55579/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([51D6D53516D2EED3:D0305B2D618D8EEF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 8972 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 1 T25 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 12 T25 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363311079225
[junit4:junit4] 2> 17 T25 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 21 T26 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 44 T26 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 44 T26 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4] 2> 44 T26 oaz.Environment.logEnv Server environment:java.version=1.8.0-ea
[junit4:junit4] 2> 45 T26 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4] 2> 45 T26 oaz.Environment.logEnv Server environment:java.home=/var/lib/jenkins/tools/java/64bit/jdk1.8.0-ea-b79/jre
[junit4:junit4] 2> 45 T26 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/64bit/jdk1.8.0-ea-b79/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 46 T26 oaz.Environment.logEnv Server environment:java.library.path=/var/lib/jenkins/tools/java/64bit/jdk1.8.0-ea-b79/jre/lib/amd64/server:/var/lib/jenkins/tools/java/64bit/jdk1.8.0-ea-b79/jre/lib/amd64:/var/lib/jenkins/tools/java/64bit/jdk1.8.0-ea-b79/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[junit4:junit4] 2> 46 T26 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4] 2> 47 T26 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4] 2> 47 T26 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4] 2> 47 T26 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4] 2> 47 T26 oaz.Environment.logEnv Server environment:os.version=3.2.0-38-generic
[junit4:junit4] 2> 48 T26 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4] 2> 48 T26 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4] 2> 48 T26 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 62 T26 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 63 T26 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 63 T26 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 482 T26 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 534 T25 oasc.ZkTestServer.run start zk server on port:49500
[junit4:junit4] 2> 542 T26 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 565 T25 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 566 T25 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4] 2> 567 T25 oaz.Environment.logEnv Client environment:java.version=1.8.0-ea
[junit4:junit4] 2> 567 T25 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4] 2> 568 T25 oaz.Environment.logEnv Client environment:java.home=/var/lib/jenkins/tools/java/64bit/jdk1.8.0-ea-b79/jre
[junit4:junit4] 2> 569 T25 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/64bit/jdk1.8.0-ea-b79/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 570 T25 oaz.Environment.logEnv Client environment:java.library.path=/var/lib/jenkins/tools/java/64bit/jdk1.8.0-ea-b79/jre/lib/amd64/server:/var/lib/jenkins/tools/java/64bit/jdk1.8.0-ea-b79/jre/lib/amd64:/var/lib/jenkins/tools/java/64bit/jdk1.8.0-ea-b79/jre/../lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64/server:/usr/lib/jvm/j2sdk1.6-sun/jre/lib/amd64:/usr/lib/jvm/j2sdk1.6-sun/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[junit4:junit4] 2> 571 T25 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4] 2> 571 T25 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4] 2> 572 T25 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4] 2> 573 T25 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4] 2> 573 T25 oaz.Environment.logEnv Client environment:os.version=3.2.0-38-generic
[junit4:junit4] 2> 574 T25 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4] 2> 574 T25 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4] 2> 575 T25 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 577 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@20508a93
[junit4:junit4] 2> 606 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 609 T31 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 612 T31 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 1476 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48275
[junit4:junit4] 2> 1489 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48275
[junit4:junit4] 2> 1496 T29 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 1584 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac31530000 with negotiated timeout 10000 for client /127.0.0.1:48275
[junit4:junit4] 2> 1584 T31 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac31530000, negotiated timeout = 10000
[junit4:junit4] 2> 1587 T32 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20508a93 name:ZooKeeperConnection Watcher:127.0.0.1:49500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1588 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1590 T25 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1615 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6bac31530000
[junit4:junit4] 2> 1617 T32 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1617 T25 oaz.ZooKeeper.close Session: 0x13d6bac31530000 closed
[junit4:junit4] 2> 1618 T27 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13d6bac31530000, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 1619 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b7a6612
[junit4:junit4] 2> 1621 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48275 which had sessionid 0x13d6bac31530000
[junit4:junit4] 2> 1621 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1621 T33 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1622 T33 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 1622 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48277
[junit4:junit4] 2> 1624 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48277
[junit4:junit4] 2> 1625 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac31530001 with negotiated timeout 10000 for client /127.0.0.1:48277
[junit4:junit4] 2> 1625 T33 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac31530001, negotiated timeout = 10000
[junit4:junit4] 2> 1626 T34 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b7a6612 name:ZooKeeperConnection Watcher:127.0.0.1:49500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1627 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1632 T25 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1638 T25 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1643 T25 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1648 T25 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1659 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1660 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1669 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1669 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1675 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1676 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1682 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1682 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1688 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1688 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1694 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1695 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1701 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1701 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1707 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1708 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1723 T25 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1724 T25 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1730 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6bac31530001
[junit4:junit4] 2> 1731 T34 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1731 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48277 which had sessionid 0x13d6bac31530001
[junit4:junit4] 2> 1731 T25 oaz.ZooKeeper.close Session: 0x13d6bac31530001 closed
[junit4:junit4] 2> 2161 T25 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 2281 T25 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49620
[junit4:junit4] 2> 2307 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2308 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2309 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363311080944
[junit4:junit4] 2> 2309 T25 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363311080944/solr.xml
[junit4:junit4] 2> 2310 T25 oasc.CoreContainer.<init> New CoreContainer 2026923896
[junit4:junit4] 2> 2311 T25 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363311080944/'
[junit4:junit4] 2> 2312 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363311080944/'
[junit4:junit4] 2> 2373 T25 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2374 T25 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2375 T25 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2376 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2377 T25 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2377 T25 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2378 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2379 T25 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2380 T25 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2381 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2395 T25 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 2417 T25 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49500/solr
[junit4:junit4] 2> 2429 T25 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2430 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4164149c
[junit4:junit4] 2> 2435 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2436 T45 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2437 T45 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 2437 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48278
[junit4:junit4] 2> 2438 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48278
[junit4:junit4] 2> 2439 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac31530002 with negotiated timeout 20000 for client /127.0.0.1:48278
[junit4:junit4] 2> 2439 T45 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac31530002, negotiated timeout = 20000
[junit4:junit4] 2> 2440 T46 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4164149c name:ZooKeeperConnection Watcher:127.0.0.1:49500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2441 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2443 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6bac31530002
[junit4:junit4] 2> 2444 T46 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2444 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48278 which had sessionid 0x13d6bac31530002
[junit4:junit4] 2> 2444 T25 oaz.ZooKeeper.close Session: 0x13d6bac31530002 closed
[junit4:junit4] 2> 2447 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2452 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@c6a59d6
[junit4:junit4] 2> 2458 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2459 T47 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 2460 T47 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 2460 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48280
[junit4:junit4] 2> 2461 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48280
[junit4:junit4] 2> 2464 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac31530003 with negotiated timeout 20000 for client /127.0.0.1:48280
[junit4:junit4] 2> 2464 T47 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac31530003, negotiated timeout = 20000
[junit4:junit4] 2> 2465 T48 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c6a59d6 name:ZooKeeperConnection Watcher:127.0.0.1:49500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2466 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2475 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2481 T25 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 2484 T25 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49620_
[junit4:junit4] 2> 2486 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49620_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49620_
[junit4:junit4] 2> 2487 T25 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49620_
[junit4:junit4] 2> 2492 T25 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 2503 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 2504 T25 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 2576 T25 oasc.Overseer.start Overseer (id=89345954923347971-127.0.0.1:49620_-n_0000000000) starting
[junit4:junit4] 2> 2577 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2585 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2586 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2591 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2592 T50 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 2592 T25 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 2596 T25 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 2599 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2607 T49 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 2613 T51 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363311080944/collection1
[junit4:junit4] 2> 2613 T51 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 2614 T51 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2615 T51 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 2617 T51 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363311080944/collection1/'
[junit4:junit4] 2> 2618 T51 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363311080944/collection1/lib/README' to classloader
[junit4:junit4] 2> 2619 T51 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363311080944/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 2680 T51 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 2755 T51 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2756 T51 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 2831 T51 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 3489 T51 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 3502 T51 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 3505 T51 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 3685 T51 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3692 T51 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3698 T51 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 3701 T51 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 3701 T51 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 3701 T51 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 3703 T51 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 3704 T51 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 3704 T51 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3705 T51 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363311080944/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/control/data/
[junit4:junit4] 2> 3708 T51 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38ceb297
[junit4:junit4] 2> 3711 T51 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3712 T51 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/control/data forceNew: false
[junit4:junit4] 2> 3712 T51 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/control/data/index/
[junit4:junit4] 2> 3713 T51 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 3713 T51 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/control/data/index forceNew: false
[junit4:junit4] 2> 3715 T51 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@fca708e lockFactory=org.apache.lucene.store.NativeFSLockFactory@16bc40e4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 3716 T51 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 3741 T51 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 3742 T51 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 3767 T51 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 3770 T51 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 3775 T51 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 3776 T51 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 3780 T51 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 3785 T51 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 3787 T51 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 3789 T51 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 3792 T51 oass.SolrIndexSearcher.<init> Opening Searcher@1f9cc362 main
[junit4:junit4] 2> 3800 T51 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/control/data/tlog
[junit4:junit4] 2> 3806 T51 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 3806 T51 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 3835 T52 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f9cc362 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 3841 T51 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 3841 T51 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3842 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 4114 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4116 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49620_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49620",
[junit4:junit4] 2> "collection":"control_collection"}
[junit4:junit4] 2> 4116 T49 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 4126 T49 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 4127 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 4141 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4847 T51 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 4847 T51 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49620 collection:control_collection shard:shard1
[junit4:junit4] 2> 4851 T51 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 4862 T51 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 4873 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 4874 T51 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 4875 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4878 T51 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 4879 T51 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 4880 T51 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49620/collection1/
[junit4:junit4] 2> 4880 T51 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 4881 T51 oasc.SyncStrategy.syncToMe http://127.0.0.1:49620/collection1/ has no replicas
[junit4:junit4] 2> 4881 T51 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49620/collection1/
[junit4:junit4] 2> 4881 T51 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 4889 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5647 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5658 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5694 T51 oasc.ZkController.register We are http://127.0.0.1:49620/collection1/ and leader is http://127.0.0.1:49620/collection1/
[junit4:junit4] 2> 5695 T51 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49620
[junit4:junit4] 2> 5696 T51 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 5696 T51 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 5696 T51 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 5699 T51 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5700 T25 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 5701 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 5714 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 5720 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 5722 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2e83ef05
[junit4:junit4] 2> 5723 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5723 T54 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5724 T54 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 5724 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48284
[junit4:junit4] 2> 5725 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48284
[junit4:junit4] 2> 5726 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac31530004 with negotiated timeout 10000 for client /127.0.0.1:48284
[junit4:junit4] 2> 5726 T54 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac31530004, negotiated timeout = 10000
[junit4:junit4] 2> 5727 T55 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e83ef05 name:ZooKeeperConnection Watcher:127.0.0.1:49500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5727 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5729 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5733 T25 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 5796 T25 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 5799 T25 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40757
[junit4:junit4] 2> 5800 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 5800 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 5801 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946
[junit4:junit4] 2> 5801 T25 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/solr.xml
[junit4:junit4] 2> 5801 T25 oasc.CoreContainer.<init> New CoreContainer 62692870
[junit4:junit4] 2> 5802 T25 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/'
[junit4:junit4] 2> 5802 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/'
[junit4:junit4] 2> 5824 T25 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 5824 T25 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 5825 T25 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 5825 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 5826 T25 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 5826 T25 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 5827 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 5827 T25 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 5828 T25 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 5828 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 5836 T25 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 5849 T25 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49500/solr
[junit4:junit4] 2> 5849 T25 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 5850 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@49b46595
[junit4:junit4] 2> 5851 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5851 T65 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5852 T65 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 5852 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48285
[junit4:junit4] 2> 5853 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48285
[junit4:junit4] 2> 5854 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac31530005 with negotiated timeout 20000 for client /127.0.0.1:48285
[junit4:junit4] 2> 5854 T65 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac31530005, negotiated timeout = 20000
[junit4:junit4] 2> 5855 T66 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49b46595 name:ZooKeeperConnection Watcher:127.0.0.1:49500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5855 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5857 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6bac31530005
[junit4:junit4] 2> 5858 T66 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 5858 T25 oaz.ZooKeeper.close Session: 0x13d6bac31530005 closed
[junit4:junit4] 2> 5858 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48285 which had sessionid 0x13d6bac31530005
[junit4:junit4] 2> 5859 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 5863 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5a10a9c8
[junit4:junit4] 2> 5864 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5864 T67 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5865 T67 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 5865 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48286
[junit4:junit4] 2> 5866 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48286
[junit4:junit4] 2> 5867 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac31530006 with negotiated timeout 20000 for client /127.0.0.1:48286
[junit4:junit4] 2> 5867 T67 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac31530006, negotiated timeout = 20000
[junit4:junit4] 2> 5868 T68 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a10a9c8 name:ZooKeeperConnection Watcher:127.0.0.1:49500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5868 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5869 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5871 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5874 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 6879 T25 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40757_
[junit4:junit4] 2> 6880 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40757_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40757_
[junit4:junit4] 2> 6881 T25 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40757_
[junit4:junit4] 2> 6886 T55 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 6887 T48 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 6887 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6889 T68 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 6899 T69 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/collection1
[junit4:junit4] 2> 6899 T69 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 6901 T69 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 6901 T69 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 6904 T69 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/collection1/'
[junit4:junit4] 2> 6905 T69 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/collection1/lib/README' to classloader
[junit4:junit4] 2> 6906 T69 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 6955 T69 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 6999 T69 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 7001 T69 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 7054 T69 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 7166 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7167 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49620_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:49620__collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49620",
[junit4:junit4] 2> "collection":"control_collection"}
[junit4:junit4] 2> 7173 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7173 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7174 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7511 T69 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 7522 T69 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 7525 T69 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 7560 T69 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 7565 T69 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 7571 T69 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 7573 T69 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 7574 T69 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 7574 T69 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 7576 T69 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 7576 T69 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 7577 T69 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 7577 T69 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty1/
[junit4:junit4] 2> 7577 T69 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38ceb297
[junit4:junit4] 2> 7579 T69 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 7579 T69 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty1 forceNew: false
[junit4:junit4] 2> 7580 T69 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty1/index/
[junit4:junit4] 2> 7580 T69 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 7580 T69 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty1/index forceNew: false
[junit4:junit4] 2> 7582 T69 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64d6ec34 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48ed0b44),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 7582 T69 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 7585 T69 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 7586 T69 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 7586 T69 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 7591 T69 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 7592 T69 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 7593 T69 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 7593 T69 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 7595 T69 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 7595 T69 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 7598 T69 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 7601 T69 oass.SolrIndexSearcher.<init> Opening Searcher@2b273d98 main
[junit4:junit4] 2> 7601 T69 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty1/tlog
[junit4:junit4] 2> 7602 T69 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 7602 T69 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 7616 T70 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b273d98 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 7621 T69 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 7622 T69 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8681 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8682 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40757_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40757",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 8683 T49 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 8683 T49 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 8689 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8690 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8689 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9624 T69 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 9624 T69 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40757 collection:collection1 shard:shard2
[junit4:junit4] 2> 9626 T69 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 9635 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 9635 T69 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 9636 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9638 T69 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 9638 T69 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 9639 T69 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40757/collection1/
[junit4:junit4] 2> 9639 T69 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 9639 T69 oasc.SyncStrategy.syncToMe http://127.0.0.1:40757/collection1/ has no replicas
[junit4:junit4] 2> 9640 T69 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40757/collection1/
[junit4:junit4] 2> 9640 T69 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 9645 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10197 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10210 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10210 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10210 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10249 T69 oasc.ZkController.register We are http://127.0.0.1:40757/collection1/ and leader is http://127.0.0.1:40757/collection1/
[junit4:junit4] 2> 10249 T69 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40757
[junit4:junit4] 2> 10249 T69 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 10250 T69 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 10250 T69 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10252 T69 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10254 T25 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 10255 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 10256 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 10335 T25 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 10338 T25 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55579
[junit4:junit4] 2> 10338 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 10339 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 10340 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363311089472
[junit4:junit4] 2> 10340 T25 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363311089472/solr.xml
[junit4:junit4] 2> 10340 T25 oasc.CoreContainer.<init> New CoreContainer 95572782
[junit4:junit4] 2> 10341 T25 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363311089472/'
[junit4:junit4] 2> 10341 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363311089472/'
[junit4:junit4] 2> 10364 T25 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 10365 T25 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 10365 T25 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 10366 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 10366 T25 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 10367 T25 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 10367 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 10368 T25 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 10369 T25 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 10369 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 10379 T25 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 10392 T25 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49500/solr
[junit4:junit4] 2> 10393 T25 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 10393 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@33b0d1f7
[junit4:junit4] 2> 10394 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10395 T81 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10396 T81 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 10396 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48289
[junit4:junit4] 2> 10396 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48289
[junit4:junit4] 2> 10398 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac31530007 with negotiated timeout 20000 for client /127.0.0.1:48289
[junit4:junit4] 2> 10398 T81 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac31530007, negotiated timeout = 20000
[junit4:junit4] 2> 10398 T82 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33b0d1f7 name:ZooKeeperConnection Watcher:127.0.0.1:49500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10399 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10400 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6bac31530007
[junit4:junit4] 2> 10401 T25 oaz.ZooKeeper.close Session: 0x13d6bac31530007 closed
[junit4:junit4] 2> 10401 T82 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 10401 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48289 which had sessionid 0x13d6bac31530007
[junit4:junit4] 2> 10402 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 10407 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2f1b9372
[junit4:junit4] 2> 10409 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10409 T83 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10410 T83 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 10410 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48290
[junit4:junit4] 2> 10411 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48290
[junit4:junit4] 2> 10412 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac31530008 with negotiated timeout 20000 for client /127.0.0.1:48290
[junit4:junit4] 2> 10412 T83 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac31530008, negotiated timeout = 20000
[junit4:junit4] 2> 10413 T84 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f1b9372 name:ZooKeeperConnection Watcher:127.0.0.1:49500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10413 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10414 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10415 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10418 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 11424 T25 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55579_
[junit4:junit4] 2> 11425 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55579_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55579_
[junit4:junit4] 2> 11427 T25 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55579_
[junit4:junit4] 2> 11432 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 11433 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 11434 T48 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 11435 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11436 T84 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 11440 T68 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 11440 T55 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 11449 T85 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363311089472/collection1
[junit4:junit4] 2> 11449 T85 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 11451 T85 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 11452 T85 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 11455 T85 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363311089472/collection1/'
[junit4:junit4] 2> 11456 T85 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363311089472/collection1/lib/README' to classloader
[junit4:junit4] 2> 11457 T85 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363311089472/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 11502 T85 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 11538 T85 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 11539 T85 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 11579 T85 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 11718 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11719 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40757_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:40757__collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40757",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 11725 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11726 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11725 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11725 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11994 T85 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 12005 T85 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 12008 T85 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 12041 T85 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12046 T85 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12051 T85 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12053 T85 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 12053 T85 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 12054 T85 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12056 T85 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 12056 T85 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 12056 T85 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 12057 T85 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363311089472/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty2/
[junit4:junit4] 2> 12057 T85 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38ceb297
[junit4:junit4] 2> 12058 T85 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 12059 T85 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty2 forceNew: false
[junit4:junit4] 2> 12059 T85 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty2/index/
[junit4:junit4] 2> 12059 T85 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 12060 T85 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty2/index forceNew: false
[junit4:junit4] 2> 12062 T85 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@333c4fe3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@60259ea3),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 12062 T85 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 12065 T85 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 12065 T85 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 12066 T85 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 12067 T85 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 12069 T85 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 12069 T85 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 12070 T85 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 12071 T85 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 12072 T85 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 12074 T85 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 12077 T85 oass.SolrIndexSearcher.<init> Opening Searcher@89a9deb main
[junit4:junit4] 2> 12077 T85 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty2/tlog
[junit4:junit4] 2> 12078 T85 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 12078 T85 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 12092 T86 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@89a9deb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 12097 T85 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 12098 T85 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13236 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13237 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55579_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55579",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 13237 T49 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 13238 T49 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 13243 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13244 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13244 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13244 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14100 T85 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 14100 T85 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55579 collection:collection1 shard:shard1
[junit4:junit4] 2> 14101 T85 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 14109 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4] 2> 14109 T85 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 14110 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14112 T85 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 14113 T85 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 14113 T85 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55579/collection1/
[junit4:junit4] 2> 14113 T85 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 14113 T85 oasc.SyncStrategy.syncToMe http://127.0.0.1:55579/collection1/ has no replicas
[junit4:junit4] 2> 14114 T85 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55579/collection1/
[junit4:junit4] 2> 14114 T85 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 14119 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14752 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14780 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14780 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14780 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14780 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14824 T85 oasc.ZkController.register We are http://127.0.0.1:55579/collection1/ and leader is http://127.0.0.1:55579/collection1/
[junit4:junit4] 2> 14825 T85 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55579
[junit4:junit4] 2> 14825 T85 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 14826 T85 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 14826 T85 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14830 T85 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14833 T25 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 14834 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14835 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14899 T25 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14902 T25 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49304
[junit4:junit4] 2> 14903 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14903 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14903 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363311094053
[junit4:junit4] 2> 14904 T25 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363311094053/solr.xml
[junit4:junit4] 2> 14904 T25 oasc.CoreContainer.<init> New CoreContainer 1737686271
[junit4:junit4] 2> 14905 T25 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363311094053/'
[junit4:junit4] 2> 14905 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363311094053/'
[junit4:junit4] 2> 14924 T25 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 14924 T25 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14924 T25 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14925 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14925 T25 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14926 T25 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14926 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14926 T25 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14927 T25 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14927 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14934 T25 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14945 T25 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49500/solr
[junit4:junit4] 2> 14946 T25 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14946 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@281e4c94
[junit4:junit4] 2> 14947 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14947 T97 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14948 T97 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 14948 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48295
[junit4:junit4] 2> 14949 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48295
[junit4:junit4] 2> 14950 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac31530009 with negotiated timeout 20000 for client /127.0.0.1:48295
[junit4:junit4] 2> 14950 T97 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac31530009, negotiated timeout = 20000
[junit4:junit4] 2> 14950 T98 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@281e4c94 name:ZooKeeperConnection Watcher:127.0.0.1:49500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14951 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14952 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6bac31530009
[junit4:junit4] 2> 14953 T98 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14953 T25 oaz.ZooKeeper.close Session: 0x13d6bac31530009 closed
[junit4:junit4] 2> 14953 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48295 which had sessionid 0x13d6bac31530009
[junit4:junit4] 2> 14954 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 14957 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5aab705b
[junit4:junit4] 2> 14958 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14958 T99 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 14959 T99 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 14959 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48296
[junit4:junit4] 2> 14960 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48296
[junit4:junit4] 2> 14961 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac3153000a with negotiated timeout 20000 for client /127.0.0.1:48296
[junit4:junit4] 2> 14961 T99 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac3153000a, negotiated timeout = 20000
[junit4:junit4] 2> 14961 T100 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5aab705b name:ZooKeeperConnection Watcher:127.0.0.1:49500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14961 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14962 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac3153000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14964 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac3153000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14966 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 15971 T25 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49304_
[junit4:junit4] 2> 15972 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac3153000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49304_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49304_
[junit4:junit4] 2> 15972 T25 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49304_
[junit4:junit4] 2> 15975 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15975 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15975 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15976 T100 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15977 T55 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15977 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15980 T48 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15980 T68 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15981 T84 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15985 T101 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363311094053/collection1
[junit4:junit4] 2> 15986 T101 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 15987 T101 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15987 T101 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 15989 T101 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363311094053/collection1/'
[junit4:junit4] 2> 15989 T101 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363311094053/collection1/lib/README' to classloader
[junit4:junit4] 2> 15990 T101 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363311094053/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 16025 T101 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 16067 T101 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 16068 T101 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 16106 T101 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 16293 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16294 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55579_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:55579__collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55579",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 16301 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16301 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16301 T100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16301 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16301 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16517 T101 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 16527 T101 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 16530 T101 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 16559 T101 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16564 T101 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16568 T101 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16570 T101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16570 T101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16571 T101 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16572 T101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16572 T101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16573 T101 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 16573 T101 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363311094053/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty3/
[junit4:junit4] 2> 16573 T101 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38ceb297
[junit4:junit4] 2> 16574 T101 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 16575 T101 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty3 forceNew: false
[junit4:junit4] 2> 16575 T101 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty3/index/
[junit4:junit4] 2> 16575 T101 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 16576 T101 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty3/index forceNew: false
[junit4:junit4] 2> 16578 T101 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30d4b892 lockFactory=org.apache.lucene.store.NativeFSLockFactory@317e9d27),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 16578 T101 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 16582 T101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 16582 T101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 16583 T101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 16584 T101 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 16585 T101 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 16585 T101 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 16586 T101 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 16587 T101 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 16587 T101 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 16589 T101 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 16593 T101 oass.SolrIndexSearcher.<init> Opening Searcher@1269e33c main
[junit4:junit4] 2> 16593 T101 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty3/tlog
[junit4:junit4] 2> 16594 T101 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 16595 T101 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 16606 T102 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1269e33c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 16610 T101 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 16610 T101 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17809 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17810 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49304_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49304",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 17810 T49 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 17811 T49 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 17816 T100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17817 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17817 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17817 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17817 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18613 T101 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 18613 T101 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49304 collection:collection1 shard:shard2
[junit4:junit4] 2> 18619 T101 oasc.ZkController.register We are http://127.0.0.1:49304/collection1/ and leader is http://127.0.0.1:40757/collection1/
[junit4:junit4] 2> 18619 T101 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49304
[junit4:junit4] 2> 18620 T101 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 18620 T101 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@6a130e04 url=http://127.0.0.1:49304/collection1 node=127.0.0.1:49304_ C0_STATE=coll:collection1 core:collection1 props:{state=down, node_name=127.0.0.1:49304_, core=collection1, base_url=http://127.0.0.1:49304, collection=collection1}
[junit4:junit4] 2> 18624 T103 C0 P49304 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 18625 T101 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18626 T103 C0 P49304 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 18627 T103 C0 P49304 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 18627 T103 C0 P49304 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18627 T25 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 18628 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 18628 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18631 T103 C0 P49304 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18692 T25 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 18695 T25 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34201
[junit4:junit4] 2> 18696 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 18696 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 18697 T25 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363311097844
[junit4:junit4] 2> 18697 T25 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363311097844/solr.xml
[junit4:junit4] 2> 18698 T25 oasc.CoreContainer.<init> New CoreContainer 2118246994
[junit4:junit4] 2> 18698 T25 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363311097844/'
[junit4:junit4] 2> 18699 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363311097844/'
[junit4:junit4] 2> 18722 T25 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 18722 T25 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 18722 T25 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 18723 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 18723 T25 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 18724 T25 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 18724 T25 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 18724 T25 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 18725 T25 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 18725 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 18732 T25 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 18743 T25 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49500/solr
[junit4:junit4] 2> 18744 T25 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 18744 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@667184c9
[junit4:junit4] 2> 18745 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 18745 T114 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 18746 T114 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 18746 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48297
[junit4:junit4] 2> 18747 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48297
[junit4:junit4] 2> 18748 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac3153000b with negotiated timeout 20000 for client /127.0.0.1:48297
[junit4:junit4] 2> 18748 T114 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac3153000b, negotiated timeout = 20000
[junit4:junit4] 2> 18748 T115 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@667184c9 name:ZooKeeperConnection Watcher:127.0.0.1:49500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 18749 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 18750 T30 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6bac3153000b
[junit4:junit4] 2> 18751 T25 oaz.ZooKeeper.close Session: 0x13d6bac3153000b closed
[junit4:junit4] 2> 18751 T27 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48297 which had sessionid 0x13d6bac3153000b
[junit4:junit4] 2> 18752 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 18753 T115 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 18757 T25 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49500/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1abe6aed
[junit4:junit4] 2> 18758 T25 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 18758 T116 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:49500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 18759 T116 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:49500, initiating session
[junit4:junit4] 2> 18759 T27 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48298
[junit4:junit4] 2> 18759 T27 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48298
[junit4:junit4] 2> 18760 T29 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6bac3153000c with negotiated timeout 20000 for client /127.0.0.1:48298
[junit4:junit4] 2> 18761 T116 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:49500, sessionid = 0x13d6bac3153000c, negotiated timeout = 20000
[junit4:junit4] 2> 18761 T117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1abe6aed name:ZooKeeperConnection Watcher:127.0.0.1:49500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 18761 T25 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 18762 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac3153000c type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18764 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac3153000c type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18767 T25 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 19325 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19327 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49304_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:49304__collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49304",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 19335 T100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19335 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19335 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19335 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19335 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19335 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19772 T25 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34201_
[junit4:junit4] 2> 19774 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac3153000c type:delete cxid:0xd zxid:0xa9 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34201_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34201_
[junit4:junit4] 2> 19778 T25 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34201_
[junit4:junit4] 2> 19783 T100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19783 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19796 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19795 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19797 T68 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 19797 T48 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 19802 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19803 T100 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 19803 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19806 T84 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 19805 T55 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 19809 T117 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 19818 T118 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363311097844/collection1
[junit4:junit4] 2> 19819 T118 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 19820 T118 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 19820 T118 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 19822 T118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363311097844/collection1/'
[junit4:junit4] 2> 19823 T118 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363311097844/collection1/lib/README' to classloader
[junit4:junit4] 2> 19824 T118 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363311097844/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 19864 T118 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 19910 T118 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 19911 T118 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 19915 T64 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:49304__collection1&state=recovering&onlyIfLeader=true&checkLive=true&core=collection1&wt=javabin&action=PREPRECOVERY&version=2&nodeName=127.0.0.1:49304_} status=0 QTime=1005
[junit4:junit4] 2> 19941 T118 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 20350 T118 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 20368 T118 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 20371 T118 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 20401 T118 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 20407 T118 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 20411 T118 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 20413 T118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 20413 T118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 20414 T118 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 20415 T118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 20415 T118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 20416 T118 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 20416 T118 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363311097844/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty4/
[junit4:junit4] 2> 20417 T118 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38ceb297
[junit4:junit4] 2> 20417 T118 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 20418 T118 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty4 forceNew: false
[junit4:junit4] 2> 20419 T118 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty4/index/
[junit4:junit4] 2> 20419 T118 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 20420 T118 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty4/index forceNew: false
[junit4:junit4] 2> 20422 T118 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33ec90ef lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e078e19),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20423 T118 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20427 T118 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 20427 T118 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 20428 T118 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 20430 T118 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 20431 T118 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 20432 T118 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 20432 T118 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 20434 T118 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 20434 T118 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 20437 T118 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 20440 T118 oass.SolrIndexSearcher.<init> Opening Searcher@239c0c10 main
[junit4:junit4] 2> 20440 T118 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty4/tlog
[junit4:junit4] 2> 20441 T118 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 20441 T118 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 20450 T119 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@239c0c10 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 20454 T118 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 20454 T118 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20851 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20853 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34201_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34201",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 20853 T49 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 20853 T49 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 20859 T100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20859 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20859 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20859 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20859 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20859 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21456 T118 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 21456 T118 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34201 collection:collection1 shard:shard1
[junit4:junit4] 2> 21462 T118 oasc.ZkController.register We are http://127.0.0.1:34201/collection1/ and leader is http://127.0.0.1:55579/collection1/
[junit4:junit4] 2> 21462 T118 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34201
[junit4:junit4] 2> 21463 T118 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 21463 T118 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@201cd964 url=http://127.0.0.1:34201/collection1 node=127.0.0.1:34201_ C1_STATE=coll:collection1 core:collection1 props:{state=down, node_name=127.0.0.1:34201_, core=collection1, base_url=http://127.0.0.1:34201, collection=collection1}
[junit4:junit4] 2> 21464 T120 C1 P34201 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 21464 T120 C1 P34201 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 21465 T118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21465 T120 C1 P34201 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 21465 T120 C1 P34201 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 21466 T120 C1 P34201 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21466 T25 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 21467 T25 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 21468 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21473 T25 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21476 T25 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21482 T61 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/onenodecollectioncore
[junit4:junit4] 2> 21482 T61 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 21484 T61 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 21484 T61 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 21486 T61 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 21486 T61 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 21490 T61 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 21492 T61 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/onenodecollectioncore/'
[junit4:junit4] 2> 21522 T61 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 21558 T61 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 21559 T61 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 21583 T61 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> C0_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, node_name=127.0.0.1:49304_, core=collection1, base_url=http://127.0.0.1:49304, collection=collection1}
[junit4:junit4] 2> 21961 T103 C0 P49304 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40757/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 21964 T103 C0 P49304 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 21969 T103 C0 P49304 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:49304 START replicas=[http://127.0.0.1:40757/collection1/] nUpdates=100
[junit4:junit4] 2> 21977 T103 C0 P49304 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 21978 T103 C0 P49304 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 21978 T103 C0 P49304 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 21979 T103 C0 P49304 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 21979 T103 C0 P49304 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 21979 T103 C0 P49304 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40757/collection1/. core=collection1
[junit4:junit4] 2> 21979 T103 C0 P49304 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21994 T61 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> ASYNC NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@c3c9c69 url=http://127.0.0.1:40757/collection1 node=127.0.0.1:40757_ C2_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, node_name=127.0.0.1:40757_, core=collection1, base_url=http://127.0.0.1:40757, collection=collection1, leader=true}
[junit4:junit4] 2> 21997 T63 C2 P40757 REQ /get {distrib=false&qt=/get&wt=javabin&getVersions=100&version=2} status=0 QTime=3
[junit4:junit4] 2> 22004 T61 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 22007 T61 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 22010 T64 C2 P40757 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22014 T64 C2 P40757 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64d6ec34 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48ed0b44),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22015 T64 C2 P40757 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22016 T64 C2 P40757 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64d6ec34 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48ed0b44),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64d6ec34 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48ed0b44),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22017 T64 C2 P40757 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22017 T64 C2 P40757 oass.SolrIndexSearcher.<init> Opening Searcher@2aa41cb9 realtime
[junit4:junit4] 2> 22018 T64 C2 P40757 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22018 T64 C2 P40757 /update {commit=true&softCommit=false&waitSearcher=true&openSearcher=false&commit_end_point=true&wt=javabin&version=2} {commit=} 0 25
[junit4:junit4] 2> 22037 T61 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 22039 T103 C0 P49304 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22039 T103 C0 P49304 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 22045 T103 C0 P49304 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 22046 T61 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 22052 T61 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 22054 T61 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 22054 T61 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 22055 T61 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 22057 T61 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 22057 T61 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 22057 T61 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 22058 T61 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363311084946/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363311079225/onenodecollection/
[junit4:junit4] 2> 22058 T61 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38ceb297
[junit4:junit4] 2> 22060 T61 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 22060 T61 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363311079225/onenodecollection forceNew: false
[junit4:junit4] 2> 22061 T61 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363311079225/onenodecollection/index/
[junit4:junit4] 2> 22061 T61 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363311079225/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 22061 T61 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363311079225/onenodecollection/index forceNew: false
[junit4:junit4] 2> 22063 T61 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a80a9d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@467ccea8),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22064 T61 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22064 T64 C2 P40757 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22065 T64 C2 P40757 REQ /replication {qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=17
[junit4:junit4] 2> 22066 T61 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 22067 T103 C0 P49304 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 22067 T61 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 22067 T103 C0 P49304 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 22067 T103 C0 P49304 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 22067 T61 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 22068 T61 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 22069 T61 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 22070 T61 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 22070 T61 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 22071 T61 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 22072 T62 C2 P40757 REQ /replication {qt=/replication&generation=2&wt=javabin&version=2&command=filelist} status=0 QTime=1
[junit4:junit4] 2> 22072 T61 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 22073 T103 C0 P49304 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 22074 T103 C0 P49304 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty3/index.20130315043141285 forceNew: false
[junit4:junit4] 2> 22075 T103 C0 P49304 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@9dcd7c8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@21bd5454) fullCopy=false
[junit4:junit4] 2> 22074 T61 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 22078 T61 oass.SolrIndexSearcher.<init> Opening Searcher@1953e195 main
[junit4:junit4] 2> 22078 T61 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363311079225/onenodecollection/tlog
[junit4:junit4] 2> 22079 T61 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 22079 T61 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 22082 T63 C2 P40757 REQ /replication {checksum=true&file=segments_2&qt=/replication&generation=2&wt=filestream&command=filecontent} status=0 QTime=2
[junit4:junit4] 2> 22086 T123 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@1953e195 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 22088 T103 C0 P49304 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 22094 T61 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 22100 T103 C0 P49304 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22100 T103 C0 P49304 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22103 T103 C0 P49304 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30d4b892 lockFactory=org.apache.lucene.store.NativeFSLockFactory@317e9d27),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@30d4b892 lockFactory=org.apache.lucene.store.NativeFSLockFactory@317e9d27),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22104 T103 C0 P49304 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22105 T103 C0 P49304 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 22106 T103 C0 P49304 oass.SolrIndexSearcher.<init> Opening Searcher@64dd153c main
[junit4:junit4] 2> 22108 T102 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@64dd153c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22110 T103 C0 P49304 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@9dcd7c8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@21bd5454)
[junit4:junit4] 2> 22111 T103 C0 P49304 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 22111 T103 C0 P49304 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 22112 T103 C0 P49304 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 22112 T103 C0 P49304 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22114 T103 C0 P49304 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 22369 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22371 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34201_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:34201__collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34201",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 22377 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "node_name":"127.0.0.1:40757_",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40757",
[junit4:junit4] 2> "collection":"onenodecollection"}
[junit4:junit4] 2> 22377 T49 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 22378 T49 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 22385 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49304_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:49304__collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49304",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 22392 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22392 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22393 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22393 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22394 T100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22395 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22476 T79 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:34201__collection1&state=recovering&onlyIfLeader=true&checkLive=true&core=collection1&wt=javabin&action=PREPRECOVERY&version=2&nodeName=127.0.0.1:34201_} status=0 QTime=1001
[junit4:junit4] 2> 23096 T61 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 23097 T61 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:40757 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 23098 T61 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 23107 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530006 type:delete cxid:0xa8 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 23108 T61 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 23109 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530006 type:create cxid:0xa9 zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 23111 T61 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 23111 T61 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 23112 T61 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40757/onenodecollectioncore/
[junit4:junit4] 2> 23112 T61 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 23112 T61 oasc.SyncStrategy.syncToMe http://127.0.0.1:40757/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 23113 T61 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40757/onenodecollectioncore/
[junit4:junit4] 2> 23113 T61 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 23119 T30 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6bac31530006 type:create cxid:0xb3 zxid:0xc9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 23913 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23931 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23931 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23931 T68 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23931 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23931 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23931 T100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23973 T61 oasc.ZkController.register We are http://127.0.0.1:40757/onenodecollectioncore/ and leader is http://127.0.0.1:40757/onenodecollectioncore/
[junit4:junit4] 2> 23974 T61 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:40757
[junit4:junit4] 2> 23974 T61 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 23975 T61 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 23977 T61 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23978 T61 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=1&roles=none&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363311079225/onenodecollection&name=onenodecollectioncore&wt=javabin&action=CREATE&version=2&collection=onenodecollection} status=0 QTime=2496
[junit4:junit4] 2> 23979 T25 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 23980 T25 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C1_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, node_name=127.0.0.1:34201_, core=collection1, base_url=http://127.0.0.1:34201, collection=collection1}
[junit4:junit4] 2> 24477 T120 C1 P34201 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55579/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 24478 T120 C1 P34201 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34201 START replicas=[http://127.0.0.1:55579/collection1/] nUpdates=100
[junit4:junit4] 2> 24478 T120 C1 P34201 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 24478 T120 C1 P34201 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 24479 T120 C1 P34201 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 24479 T120 C1 P34201 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 24479 T120 C1 P34201 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 24480 T120 C1 P34201 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55579/collection1/. core=collection1
[junit4:junit4] 2> 24480 T120 C1 P34201 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@39c18846 url=http://127.0.0.1:55579/collection1 node=127.0.0.1:55579_ C3_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, node_name=127.0.0.1:55579_, core=collection1, base_url=http://127.0.0.1:55579, collection=collection1, leader=true}
[junit4:junit4] 2> 24484 T80 C3 P55579 REQ /get {distrib=false&qt=/get&wt=javabin&getVersions=100&version=2} status=0 QTime=0
[junit4:junit4] 2> 24486 T77 C3 P55579 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24488 T77 C3 P55579 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@333c4fe3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@60259ea3),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 24489 T77 C3 P55579 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 24490 T77 C3 P55579 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@333c4fe3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@60259ea3),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@333c4fe3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@60259ea3),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24490 T77 C3 P55579 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24491 T77 C3 P55579 oass.SolrIndexSearcher.<init> Opening Searcher@5c038fcf realtime
[junit4:junit4] 2> 24491 T77 C3 P55579 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24491 T77 C3 P55579 /update {commit=true&softCommit=false&waitSearcher=true&openSearcher=false&commit_end_point=true&wt=javabin&version=2} {commit=} 0 5
[junit4:junit4] 2> 24492 T120 C1 P34201 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24493 T120 C1 P34201 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 24495 T80 C3 P55579 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24495 T80 C3 P55579 REQ /replication {qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4:junit4] 2> 24496 T120 C1 P34201 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 24497 T120 C1 P34201 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 24497 T120 C1 P34201 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 24500 T77 C3 P55579 REQ /replication {qt=/replication&generation=2&wt=javabin&version=2&command=filelist} status=0 QTime=0
[junit4:junit4] 2> 24501 T120 C1 P34201 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 24502 T120 C1 P34201 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363311079225/jetty4/index.20130315043143714 forceNew: false
[junit4:junit4] 2> 24503 T120 C1 P34201 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@401789d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@73183efb) fullCopy=false
[junit4:junit4] 2> 24506 T79 C3 P55579 REQ /replication {checksum=true&file=segments_2&qt=/replication&generation=2&wt=filestream&command=filecontent} status=0 QTime=0
[junit4:junit4] 2> 24508 T120 C1 P34201 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 24509 T120 C1 P34201 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 24509 T120 C1 P34201 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 24512 T120 C1 P34201 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33ec90ef lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e078e19),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33ec90ef lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e078e19),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24512 T120 C1 P34201 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24513 T120 C1 P34201 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 24513 T120 C1 P34201 oass.SolrIndexSearcher.<init> Opening Searcher@6a65d226 main
[junit4:junit4] 2> 24515 T119 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6a65d226 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 24516 T120 C1 P34201 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@401789d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@73183efb)
[junit4:junit4] 2> 24516 T120 C1 P34201 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 24517 T120 C1 P34201 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 24517 T120 C1 P34201 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 24517 T120 C1 P34201 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 24519 T120 C1 P34201 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 24982 T25 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25441 T49 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25442 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "node_name":"127.0.0.1:40757_",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:40757__onenodecollectioncore",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40757",
[junit4:junit4] 2> "collection":"onenodecollection"}
[junit4:junit4] 2> 25469 T49 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34201_",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:34201__collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34201",
[junit4:junit4] 2> "collection":"collection1"}
[junit4:junit4] 2> 25475 T117 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25475 T84 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25476 T48 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25475 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25475 T100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncCo
[...truncated too long message...]
t4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=51D6D53516D2EED3 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_YE -Dtests.timezone=Africa/Niamey -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 48.2s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([51D6D53516D2EED3:D0305B2D618D8EEF]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:92)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:54)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 48189 T2722 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 48192 T2721 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 48586 T2725 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 49392 T2814 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 49393 T2814 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 49393 T2814 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {_version_=Lucene41(blocksize=128), rnd_b=PostingsFormat(name=Asserting), multiDefault=PostingsFormat(name=SimpleText), other_tl1=Lucene41(blocksize=128), timestamp=Lucene41(blocksize=128), a_si=PostingsFormat(name=SimpleText), range_facet_sl=MockVariableIntBlock(baseBlockSize=35), intDefault=Lucene41(blocksize=128), range_facet_l=Lucene41(blocksize=128), range_facet_si=PostingsFormat(name=SimpleText), text=MockVariableIntBlock(baseBlockSize=35), id=PostingsFormat(name=Asserting), a_t=Lucene41(blocksize=128)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ar_YE, timezone=Africa/Niamey
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=5,free=38529392,total=192720896
[junit4:junit4] 2> NOTE: All tests run in this JVM: [AlternateDirectoryTest, LegacyHTMLStripCharFilterTest, TermVectorComponentTest, TestSolrQueryParser, ClusterStateUpdateTest, TestFaceting, TestPropInjectDefaults, TestRealTimeGet, TermsComponentTest, SpatialFilterTest, TestSolrCoreProperties, DocValuesTest, SuggesterFSTTest, TestFieldCollectionResource, ChaosMonkeyNothingIsSafeTest, DocumentBuilderTest, TestLRUCache, TestReplicationHandler, TestLFUCache, SimpleFacetsTest, TestConfig, ShardRoutingTest, TestCoreContainer, MoreLikeThisHandlerTest, TestPseudoReturnFields, TestPluginEnable, TestDocumentBuilder, MBeansHandlerTest, TestExtendedDismaxParser, QueryElevationComponentTest, LukeRequestHandlerTest, SchemaVersionSpecificBehaviorTest, PreAnalyzedFieldTest, TestCopyFieldCollectionResource, SolrInfoMBeanTest, SOLR749Test, RecoveryZkTest, SpellingQueryConverterTest, SynonymTokenizerTest, LeaderElectionTest, TestSolrIndexConfig, CoreAdminHandlerTest, BasicDistributedZkTest, SliceStateUpdateTest, StatelessScriptUpdateProcessorFactoryTest, TestFastWriter, ZkCLITest, PrimitiveFieldTypeTest, TestSearchPerf, DirectSolrConnectionTest, TestGroupingSearch, TestDynamicFieldResource, TestStressRecovery, TestDocSet, SolrIndexSplitterTest, UnloadDistributedZkTest, TestCharFilters, TestXIncludeConfig, IndexSchemaTest, ShowFileRequestHandlerTest, ResponseLogComponentTest, RAMDirectoryFactoryTest, AutoCommitTest, ResourceLoaderTest, ExternalFileFieldSortTest, CollectionsAPIDistributedZkTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 49.47s, 1 test, 1 failure <<< FAILURES!
[...truncated 557 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 error, 1 failure, 13 ignored (7 assumptions)
Total time: 51 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b79) - Build #
4681 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4681/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseG1GC
2 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:49362/xp_/db/onenodecollectioncore returned non ok status:404, message:Can not find: /xp_/db/onenodecollectioncore/update
Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:49362/xp_/db/onenodecollectioncore returned non ok status:404, message:Can not find: /xp_/db/onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([802158C9E3ABED06:1C7D6D194F48D3A]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Still found shard
Stack Trace:
java.lang.AssertionError: Still found shard
at __randomizedtesting.SeedInfo.seed([802158C9E3ABED06:1C7D6D194F48D3A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:487)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9346 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T2260 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /xp_/db
[junit4:junit4] 2> 3 T2260 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363305275558
[junit4:junit4] 2> 4 T2260 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 4 T2261 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 5 T2261 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 5 T2261 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 6 T2261 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 6 T2261 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 7 T2261 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 104 T2260 oasc.ZkTestServer.run start zk server on port:60354
[junit4:junit4] 2> 105 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@415c77be
[junit4:junit4] 2> 106 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 106 T2266 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 106 T2266 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 107 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51887
[junit4:junit4] 2> 107 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51887
[junit4:junit4] 2> 107 T2264 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 220 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a90000 with negotiated timeout 10000 for client /127.0.0.1:51887
[junit4:junit4] 2> 220 T2266 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a90000, negotiated timeout = 10000
[junit4:junit4] 2> 221 T2267 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@415c77be name:ZooKeeperConnection Watcher:127.0.0.1:60354 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 221 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 221 T2260 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 225 T2265 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b53a0a90000
[junit4:junit4] 2> 226 T2267 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 226 T2260 oaz.ZooKeeper.close Session: 0x13d6b53a0a90000 closed
[junit4:junit4] 2> 226 T2262 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51887 which had sessionid 0x13d6b53a0a90000
[junit4:junit4] 2> 226 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4f9b91e5
[junit4:junit4] 2> 227 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 227 T2268 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 228 T2268 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 228 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51888
[junit4:junit4] 2> 228 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51888
[junit4:junit4] 2> 229 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a90001 with negotiated timeout 10000 for client /127.0.0.1:51888
[junit4:junit4] 2> 229 T2268 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a90001, negotiated timeout = 10000
[junit4:junit4] 2> 229 T2269 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f9b91e5 name:ZooKeeperConnection Watcher:127.0.0.1:60354/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 229 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 230 T2260 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 232 T2260 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 234 T2260 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 236 T2260 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 238 T2260 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 238 T2260 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 242 T2260 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 243 T2260 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 246 T2260 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 247 T2260 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 249 T2260 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 249 T2260 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 252 T2260 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 252 T2260 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 255 T2260 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 256 T2260 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 258 T2260 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 258 T2260 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 261 T2260 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 261 T2260 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 264 T2260 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 264 T2260 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 267 T2265 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b53a0a90001
[junit4:junit4] 2> 268 T2269 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 268 T2262 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51888 which had sessionid 0x13d6b53a0a90001
[junit4:junit4] 2> 268 T2260 oaz.ZooKeeper.close Session: 0x13d6b53a0a90001 closed
[junit4:junit4] 2> 347 T2260 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 354 T2260 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33462
[junit4:junit4] 2> 355 T2260 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 355 T2260 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 355 T2260 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363305275822
[junit4:junit4] 2> 356 T2260 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363305275822/solr.xml
[junit4:junit4] 2> 356 T2260 oasc.CoreContainer.<init> New CoreContainer 892232039
[junit4:junit4] 2> 356 T2260 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363305275822/'
[junit4:junit4] 2> 357 T2260 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363305275822/'
[junit4:junit4] 2> 377 T2260 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 377 T2260 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 378 T2260 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 378 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 378 T2260 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 378 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 379 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 379 T2260 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 379 T2260 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 380 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 386 T2260 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 395 T2260 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60354/solr
[junit4:junit4] 2> 396 T2260 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 396 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4fa9f877
[junit4:junit4] 2> 397 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 397 T2279 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 398 T2279 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 398 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51889
[junit4:junit4] 2> 398 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51889
[junit4:junit4] 2> 399 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a90002 with negotiated timeout 20000 for client /127.0.0.1:51889
[junit4:junit4] 2> 399 T2279 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a90002, negotiated timeout = 20000
[junit4:junit4] 2> 399 T2280 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fa9f877 name:ZooKeeperConnection Watcher:127.0.0.1:60354 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 399 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 401 T2265 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b53a0a90002
[junit4:junit4] 2> 401 T2280 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 401 T2262 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51889 which had sessionid 0x13d6b53a0a90002
[junit4:junit4] 2> 401 T2260 oaz.ZooKeeper.close Session: 0x13d6b53a0a90002 closed
[junit4:junit4] 2> 402 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 404 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@51566e92
[junit4:junit4] 2> 405 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 405 T2281 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 405 T2281 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 406 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51890
[junit4:junit4] 2> 406 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51890
[junit4:junit4] 2> 407 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a90003 with negotiated timeout 20000 for client /127.0.0.1:51890
[junit4:junit4] 2> 407 T2281 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a90003, negotiated timeout = 20000
[junit4:junit4] 2> 407 T2282 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51566e92 name:ZooKeeperConnection Watcher:127.0.0.1:60354/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 407 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 409 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 410 T2260 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 411 T2260 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33462_xp_%2Fdb
[junit4:junit4] 2> 411 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33462_xp_%2Fdb Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33462_xp_%2Fdb
[junit4:junit4] 2> 412 T2260 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33462_xp_%2Fdb
[junit4:junit4] 2> 414 T2260 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 417 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 417 T2260 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 419 T2260 oasc.Overseer.start Overseer (id=89345574539165699-127.0.0.1:33462_xp_%2Fdb-n_0000000000) starting
[junit4:junit4] 2> 420 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 420 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 421 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 422 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 422 T2284 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 422 T2260 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 424 T2260 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 426 T2260 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 427 T2283 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 429 T2285 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363305275822/collection1
[junit4:junit4] 2> 429 T2285 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 430 T2285 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 430 T2285 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 431 T2285 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363305275822/collection1/'
[junit4:junit4] 2> 431 T2285 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363305275822/collection1/lib/README' to classloader
[junit4:junit4] 2> 431 T2285 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363305275822/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 460 T2285 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 491 T2285 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 491 T2285 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 495 T2285 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 812 T2285 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 817 T2285 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 819 T2285 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 829 T2285 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 832 T2285 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 835 T2285 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 836 T2285 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 836 T2285 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 836 T2285 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 837 T2285 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 837 T2285 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 837 T2285 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 838 T2285 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363305275822/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/control/data/
[junit4:junit4] 2> 838 T2285 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f7ed45c
[junit4:junit4] 2> 838 T2285 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 838 T2285 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/control/data forceNew: false
[junit4:junit4] 2> 839 T2285 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/control/data/index/
[junit4:junit4] 2> 839 T2285 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 839 T2285 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/control/data/index forceNew: false
[junit4:junit4] 2> 840 T2285 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@38cdeac7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5413be95),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 841 T2285 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 842 T2285 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 842 T2285 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 843 T2285 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 843 T2285 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 843 T2285 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 844 T2285 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 844 T2285 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 844 T2285 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 844 T2285 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 847 T2285 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 849 T2285 oass.SolrIndexSearcher.<init> Opening Searcher@2bda45d7 main
[junit4:junit4] 2> 849 T2285 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/control/data/tlog
[junit4:junit4] 2> 849 T2285 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 850 T2285 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 853 T2286 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2bda45d7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 854 T2285 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 854 T2285 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 855 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 1930 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1930 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33462/xp_/db",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:33462_xp_%2Fdb"}
[junit4:junit4] 2> 1931 T2283 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1931 T2283 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1931 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 1935 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2857 T2285 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2857 T2285 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33462/xp_/db collection:control_collection shard:shard1
[junit4:junit4] 2> 2858 T2285 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2863 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2864 T2285 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2864 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2865 T2285 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2865 T2285 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2866 T2285 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33462/xp_/db/collection1/
[junit4:junit4] 2> 2866 T2285 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2866 T2285 oasc.SyncStrategy.syncToMe http://127.0.0.1:33462/xp_/db/collection1/ has no replicas
[junit4:junit4] 2> 2866 T2285 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33462/xp_/db/collection1/
[junit4:junit4] 2> 2866 T2285 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2869 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3438 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3445 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3472 T2285 oasc.ZkController.register We are http://127.0.0.1:33462/xp_/db/collection1/ and leader is http://127.0.0.1:33462/xp_/db/collection1/
[junit4:junit4] 2> 3472 T2285 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33462/xp_/db
[junit4:junit4] 2> 3473 T2285 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3473 T2285 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3473 T2285 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3474 T2285 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3475 T2260 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3476 T2260 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3476 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3479 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3479 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e2bfb50
[junit4:junit4] 2> 3480 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3480 T2288 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3480 T2288 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 3480 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51893
[junit4:junit4] 2> 3481 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51893
[junit4:junit4] 2> 3481 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a90004 with negotiated timeout 10000 for client /127.0.0.1:51893
[junit4:junit4] 2> 3481 T2288 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a90004, negotiated timeout = 10000
[junit4:junit4] 2> 3482 T2289 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e2bfb50 name:ZooKeeperConnection Watcher:127.0.0.1:60354/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3482 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3484 T2260 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3485 T2260 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3541 T2260 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3543 T2260 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53340
[junit4:junit4] 2> 3544 T2260 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3544 T2260 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3544 T2260 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039
[junit4:junit4] 2> 3545 T2260 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/solr.xml
[junit4:junit4] 2> 3545 T2260 oasc.CoreContainer.<init> New CoreContainer 1970581758
[junit4:junit4] 2> 3546 T2260 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/'
[junit4:junit4] 2> 3546 T2260 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/'
[junit4:junit4] 2> 3564 T2260 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3564 T2260 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3565 T2260 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3565 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3565 T2260 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3565 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3566 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3566 T2260 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3566 T2260 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3567 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3572 T2260 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 3581 T2260 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60354/solr
[junit4:junit4] 2> 3581 T2260 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3582 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@20258063
[junit4:junit4] 2> 3582 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3583 T2299 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3583 T2299 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 3584 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51894
[junit4:junit4] 2> 3584 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51894
[junit4:junit4] 2> 3585 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a90005 with negotiated timeout 20000 for client /127.0.0.1:51894
[junit4:junit4] 2> 3585 T2299 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a90005, negotiated timeout = 20000
[junit4:junit4] 2> 3585 T2300 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20258063 name:ZooKeeperConnection Watcher:127.0.0.1:60354 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3585 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3586 T2265 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b53a0a90005
[junit4:junit4] 2> 3587 T2300 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 3587 T2262 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51894 which had sessionid 0x13d6b53a0a90005
[junit4:junit4] 2> 3587 T2260 oaz.ZooKeeper.close Session: 0x13d6b53a0a90005 closed
[junit4:junit4] 2> 3587 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3590 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2359609e
[junit4:junit4] 2> 3590 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3590 T2301 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3591 T2301 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 3591 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51896
[junit4:junit4] 2> 3591 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51896
[junit4:junit4] 2> 3592 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a90006 with negotiated timeout 20000 for client /127.0.0.1:51896
[junit4:junit4] 2> 3592 T2301 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a90006, negotiated timeout = 20000
[junit4:junit4] 2> 3592 T2302 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2359609e name:ZooKeeperConnection Watcher:127.0.0.1:60354/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3592 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3593 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3594 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3595 T2260 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4597 T2260 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53340_xp_%2Fdb
[junit4:junit4] 2> 4598 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:53340_xp_%2Fdb Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:53340_xp_%2Fdb
[junit4:junit4] 2> 4599 T2260 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53340_xp_%2Fdb
[junit4:junit4] 2> 4601 T2282 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4602 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4602 T2289 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4602 T2302 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 4607 T2303 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/collection1
[junit4:junit4] 2> 4607 T2303 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 4608 T2303 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 4608 T2303 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 4609 T2303 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/collection1/'
[junit4:junit4] 2> 4609 T2303 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/collection1/lib/README' to classloader
[junit4:junit4] 2> 4610 T2303 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 4633 T2303 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 4660 T2303 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 4661 T2303 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 4664 T2303 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 4950 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4951 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33462/xp_/db",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:33462_xp_%2Fdb"}
[junit4:junit4] 2> 4954 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4954 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4954 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 4968 T2303 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 4973 T2303 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 4975 T2303 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 4984 T2303 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 4987 T2303 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 4990 T2303 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 4990 T2303 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 4991 T2303 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 4991 T2303 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 4992 T2303 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 4992 T2303 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 4992 T2303 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 4992 T2303 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty1/
[junit4:junit4] 2> 4992 T2303 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f7ed45c
[junit4:junit4] 2> 4993 T2303 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 4993 T2303 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty1 forceNew: false
[junit4:junit4] 2> 4993 T2303 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty1/index/
[junit4:junit4] 2> 4994 T2303 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 4994 T2303 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty1/index forceNew: false
[junit4:junit4] 2> 4995 T2303 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b26000f lockFactory=org.apache.lucene.store.NativeFSLockFactory@652458ba),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 4995 T2303 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 4997 T2303 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 4997 T2303 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 4998 T2303 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 4998 T2303 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 4998 T2303 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 4999 T2303 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 4999 T2303 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 4999 T2303 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 4999 T2303 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5002 T2303 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5004 T2303 oass.SolrIndexSearcher.<init> Opening Searcher@2caeb8a1 main
[junit4:junit4] 2> 5004 T2303 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty1/tlog
[junit4:junit4] 2> 5004 T2303 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5005 T2303 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5007 T2304 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2caeb8a1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5009 T2303 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5009 T2303 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6459 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6460 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53340/xp_/db",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:53340_xp_%2Fdb"}
[junit4:junit4] 2> 6460 T2283 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6460 T2283 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 6464 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6464 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6464 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7011 T2303 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7011 T2303 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53340/xp_/db collection:collection1 shard:shard2
[junit4:junit4] 2> 7012 T2303 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 7017 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7017 T2303 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7018 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7019 T2303 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7019 T2303 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7019 T2303 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53340/xp_/db/collection1/
[junit4:junit4] 2> 7019 T2303 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7020 T2303 oasc.SyncStrategy.syncToMe http://127.0.0.1:53340/xp_/db/collection1/ has no replicas
[junit4:junit4] 2> 7020 T2303 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53340/xp_/db/collection1/
[junit4:junit4] 2> 7020 T2303 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 7023 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7968 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7976 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7976 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7976 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8027 T2303 oasc.ZkController.register We are http://127.0.0.1:53340/xp_/db/collection1/ and leader is http://127.0.0.1:53340/xp_/db/collection1/
[junit4:junit4] 2> 8027 T2303 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53340/xp_/db
[junit4:junit4] 2> 8027 T2303 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8028 T2303 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8028 T2303 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8029 T2303 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8030 T2260 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8031 T2260 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8031 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8089 T2260 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8092 T2260 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49362
[junit4:junit4] 2> 8093 T2260 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8093 T2260 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8094 T2260 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363305283588
[junit4:junit4] 2> 8094 T2260 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363305283588/solr.xml
[junit4:junit4] 2> 8094 T2260 oasc.CoreContainer.<init> New CoreContainer 310137196
[junit4:junit4] 2> 8095 T2260 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363305283588/'
[junit4:junit4] 2> 8095 T2260 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363305283588/'
[junit4:junit4] 2> 8113 T2260 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8113 T2260 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8113 T2260 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8114 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8114 T2260 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8114 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8115 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8115 T2260 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8115 T2260 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8116 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8121 T2260 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8130 T2260 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60354/solr
[junit4:junit4] 2> 8131 T2260 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8131 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4ca62e0b
[junit4:junit4] 2> 8132 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8132 T2315 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8133 T2315 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 8133 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51905
[junit4:junit4] 2> 8133 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51905
[junit4:junit4] 2> 8134 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a90007 with negotiated timeout 20000 for client /127.0.0.1:51905
[junit4:junit4] 2> 8134 T2315 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a90007, negotiated timeout = 20000
[junit4:junit4] 2> 8134 T2316 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ca62e0b name:ZooKeeperConnection Watcher:127.0.0.1:60354 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8135 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8136 T2265 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b53a0a90007
[junit4:junit4] 2> 8136 T2316 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8137 T2262 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51905 which had sessionid 0x13d6b53a0a90007
[junit4:junit4] 2> 8136 T2260 oaz.ZooKeeper.close Session: 0x13d6b53a0a90007 closed
[junit4:junit4] 2> 8137 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8140 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@752a2f92
[junit4:junit4] 2> 8140 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8141 T2317 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8141 T2317 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 8141 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51906
[junit4:junit4] 2> 8141 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51906
[junit4:junit4] 2> 8142 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a90008 with negotiated timeout 20000 for client /127.0.0.1:51906
[junit4:junit4] 2> 8142 T2317 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a90008, negotiated timeout = 20000
[junit4:junit4] 2> 8142 T2318 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@752a2f92 name:ZooKeeperConnection Watcher:127.0.0.1:60354/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8143 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8144 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8144 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8146 T2260 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9148 T2260 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49362_xp_%2Fdb
[junit4:junit4] 2> 9149 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49362_xp_%2Fdb Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49362_xp_%2Fdb
[junit4:junit4] 2> 9150 T2260 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49362_xp_%2Fdb
[junit4:junit4] 2> 9151 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9151 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9153 T2282 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9153 T2318 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9153 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9153 T2289 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9154 T2302 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9157 T2319 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363305283588/collection1
[junit4:junit4] 2> 9157 T2319 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9158 T2319 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9158 T2319 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9159 T2319 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363305283588/collection1/'
[junit4:junit4] 2> 9159 T2319 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363305283588/collection1/lib/README' to classloader
[junit4:junit4] 2> 9159 T2319 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363305283588/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9186 T2319 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 9216 T2319 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9217 T2319 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9221 T2319 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9482 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9483 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53340/xp_/db",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:53340_xp_%2Fdb"}
[junit4:junit4] 2> 9486 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9486 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9486 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9486 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9527 T2319 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 9531 T2319 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 9534 T2319 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 9544 T2319 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9547 T2319 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 9549 T2319 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9550 T2319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9550 T2319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9551 T2319 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 9551 T2319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 9552 T2319 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 9552 T2319 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9552 T2319 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363305283588/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty2/
[junit4:junit4] 2> 9552 T2319 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f7ed45c
[junit4:junit4] 2> 9553 T2319 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 9553 T2319 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty2 forceNew: false
[junit4:junit4] 2> 9553 T2319 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty2/index/
[junit4:junit4] 2> 9554 T2319 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 9554 T2319 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty2/index forceNew: false
[junit4:junit4] 2> 9555 T2319 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4aff6714 lockFactory=org.apache.lucene.store.NativeFSLockFactory@70957d3d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 9555 T2319 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 9557 T2319 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 9557 T2319 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 9558 T2319 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 9558 T2319 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 9558 T2319 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 9559 T2319 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 9559 T2319 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 9559 T2319 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 9559 T2319 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 9562 T2319 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 9564 T2319 oass.SolrIndexSearcher.<init> Opening Searcher@107837b7 main
[junit4:junit4] 2> 9564 T2319 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty2/tlog
[junit4:junit4] 2> 9564 T2319 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 9565 T2319 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 9568 T2320 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@107837b7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 9568 T2319 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 9569 T2319 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10990 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10990 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49362/xp_/db",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:49362_xp_%2Fdb"}
[junit4:junit4] 2> 10991 T2283 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 10991 T2283 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11012 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11012 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11012 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11013 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11570 T2319 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11570 T2319 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49362/xp_/db collection:collection1 shard:shard1
[junit4:junit4] 2> 11571 T2319 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 11576 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4] 2> 11576 T2319 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11576 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11577 T2319 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11578 T2319 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11578 T2319 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49362/xp_/db/collection1/
[junit4:junit4] 2> 11578 T2319 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11578 T2319 oasc.SyncStrategy.syncToMe http://127.0.0.1:49362/xp_/db/collection1/ has no replicas
[junit4:junit4] 2> 11578 T2319 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49362/xp_/db/collection1/
[junit4:junit4] 2> 11578 T2319 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 11582 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12516 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12524 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12524 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12524 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12525 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12538 T2319 oasc.ZkController.register We are http://127.0.0.1:49362/xp_/db/collection1/ and leader is http://127.0.0.1:49362/xp_/db/collection1/
[junit4:junit4] 2> 12538 T2319 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49362/xp_/db
[junit4:junit4] 2> 12538 T2319 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 12538 T2319 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 12539 T2319 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12540 T2319 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12542 T2260 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 12542 T2260 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12543 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12634 T2260 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12641 T2260 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56340
[junit4:junit4] 2> 12642 T2260 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12643 T2260 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12643 T2260 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363305288101
[junit4:junit4] 2> 12644 T2260 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363305288101/solr.xml
[junit4:junit4] 2> 12644 T2260 oasc.CoreContainer.<init> New CoreContainer 800542751
[junit4:junit4] 2> 12645 T2260 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363305288101/'
[junit4:junit4] 2> 12646 T2260 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363305288101/'
[junit4:junit4] 2> 12679 T2260 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12680 T2260 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12681 T2260 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12681 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12682 T2260 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12682 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12683 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12683 T2260 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12684 T2260 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12684 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12696 T2260 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12712 T2260 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60354/solr
[junit4:junit4] 2> 12713 T2260 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12713 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@31dedc6c
[junit4:junit4] 2> 12715 T2331 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12715 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12716 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51923
[junit4:junit4] 2> 12716 T2331 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 12717 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51923
[junit4:junit4] 2> 12718 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a90009 with negotiated timeout 20000 for client /127.0.0.1:51923
[junit4:junit4] 2> 12718 T2331 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a90009, negotiated timeout = 20000
[junit4:junit4] 2> 12719 T2332 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31dedc6c name:ZooKeeperConnection Watcher:127.0.0.1:60354 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12719 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12721 T2265 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b53a0a90009
[junit4:junit4] 2> 12721 T2262 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51923 which had sessionid 0x13d6b53a0a90009
[junit4:junit4] 2> 12721 T2260 oaz.ZooKeeper.close Session: 0x13d6b53a0a90009 closed
[junit4:junit4] 2> 12722 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12725 T2332 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12726 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@486c677a
[junit4:junit4] 2> 12727 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12727 T2333 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12728 T2333 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 12728 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51924
[junit4:junit4] 2> 12728 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51924
[junit4:junit4] 2> 12730 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a9000a with negotiated timeout 20000 for client /127.0.0.1:51924
[junit4:junit4] 2> 12730 T2333 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a9000a, negotiated timeout = 20000
[junit4:junit4] 2> 12730 T2334 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@486c677a name:ZooKeeperConnection Watcher:127.0.0.1:60354/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12730 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12731 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a9000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12732 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a9000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12734 T2260 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13736 T2260 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56340_xp_%2Fdb
[junit4:junit4] 2> 13737 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a9000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56340_xp_%2Fdb Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56340_xp_%2Fdb
[junit4:junit4] 2> 13738 T2260 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56340_xp_%2Fdb
[junit4:junit4] 2> 13740 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13740 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13740 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13741 T2302 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13742 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13742 T2334 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13744 T2289 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13745 T2282 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13745 T2318 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13751 T2335 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363305288101/collection1
[junit4:junit4] 2> 13751 T2335 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13752 T2335 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13752 T2335 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13755 T2335 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363305288101/collection1/'
[junit4:junit4] 2> 13756 T2335 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363305288101/collection1/lib/README' to classloader
[junit4:junit4] 2> 13756 T2335 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363305288101/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13793 T2335 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 13830 T2335 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13831 T2335 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13836 T2335 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 14030 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14031 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49362/xp_/db",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:49362_xp_%2Fdb"}
[junit4:junit4] 2> 14035 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14035 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14035 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14035 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14035 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14229 T2335 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14235 T2335 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14237 T2335 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14250 T2335 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14253 T2335 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14257 T2335 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14258 T2335 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14258 T2335 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14259 T2335 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14259 T2335 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14260 T2335 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14260 T2335 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14260 T2335 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363305288101/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty3/
[junit4:junit4] 2> 14260 T2335 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f7ed45c
[junit4:junit4] 2> 14261 T2335 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14261 T2335 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty3 forceNew: false
[junit4:junit4] 2> 14261 T2335 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty3/index/
[junit4:junit4] 2> 14261 T2335 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14262 T2335 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty3/index forceNew: false
[junit4:junit4] 2> 14263 T2335 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ac5ae5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ec1f793),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14263 T2335 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14265 T2335 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14265 T2335 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14266 T2335 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14266 T2335 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14267 T2335 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14267 T2335 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14267 T2335 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14267 T2335 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14268 T2335 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14270 T2335 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14272 T2335 oass.SolrIndexSearcher.<init> Opening Searcher@6c429880 main
[junit4:junit4] 2> 14273 T2335 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty3/tlog
[junit4:junit4] 2> 14273 T2335 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14273 T2335 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14279 T2335 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14279 T2335 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14279 T2336 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c429880 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15540 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15541 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56340/xp_/db",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:56340_xp_%2Fdb"}
[junit4:junit4] 2> 15541 T2283 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15542 T2283 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 15546 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15546 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15546 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15546 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15546 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16281 T2335 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16281 T2335 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56340/xp_/db collection:collection1 shard:shard2
[junit4:junit4] 2> 16284 T2335 oasc.ZkController.register We are http://127.0.0.1:56340/xp_/db/collection1/ and leader is http://127.0.0.1:53340/xp_/db/collection1/
[junit4:junit4] 2> 16284 T2335 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56340/xp_/db
[junit4:junit4] 2> 16284 T2335 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16284 T2335 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C409 name=collection1 org.apache.solr.core.SolrCore@b971b83 url=http://127.0.0.1:56340/xp_/db/collection1 node=127.0.0.1:56340_xp_%2Fdb C409_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, base_url=http://127.0.0.1:56340/xp_/db, collection=collection1, node_name=127.0.0.1:56340_xp_%2Fdb}
[junit4:junit4] 2> 16285 T2337 C409 P56340 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16285 T2335 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16285 T2337 C409 P56340 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16285 T2337 C409 P56340 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16286 T2337 C409 P56340 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16286 T2260 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 16286 T2337 C409 P56340 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16286 T2260 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16287 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16346 T2260 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16348 T2260 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34710
[junit4:junit4] 2> 16350 T2260 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16350 T2260 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16350 T2260 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363305291844
[junit4:junit4] 2> 16351 T2260 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363305291844/solr.xml
[junit4:junit4] 2> 16351 T2260 oasc.CoreContainer.<init> New CoreContainer 651899082
[junit4:junit4] 2> 16351 T2260 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363305291844/'
[junit4:junit4] 2> 16352 T2260 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363305291844/'
[junit4:junit4] 2> 16370 T2260 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 16370 T2260 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 16371 T2260 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 16371 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 16371 T2260 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 16372 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 16372 T2260 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 16372 T2260 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 16373 T2260 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 16373 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 16378 T2260 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16387 T2260 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:60354/solr
[junit4:junit4] 2> 16388 T2260 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16388 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6b110725
[junit4:junit4] 2> 16389 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16389 T2348 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16390 T2348 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 16390 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51952
[junit4:junit4] 2> 16391 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51952
[junit4:junit4] 2> 16391 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a9000b with negotiated timeout 20000 for client /127.0.0.1:51952
[junit4:junit4] 2> 16391 T2348 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a9000b, negotiated timeout = 20000
[junit4:junit4] 2> 16392 T2349 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b110725 name:ZooKeeperConnection Watcher:127.0.0.1:60354 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16392 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16393 T2265 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b53a0a9000b
[junit4:junit4] 2> 16394 T2349 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16394 T2262 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51952 which had sessionid 0x13d6b53a0a9000b
[junit4:junit4] 2> 16394 T2260 oaz.ZooKeeper.close Session: 0x13d6b53a0a9000b closed
[junit4:junit4] 2> 16394 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 16397 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7fee6283
[junit4:junit4] 2> 16398 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16398 T2350 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 16398 T2350 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 16398 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51953
[junit4:junit4] 2> 16398 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51953
[junit4:junit4] 2> 16399 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a9000c with negotiated timeout 20000 for client /127.0.0.1:51953
[junit4:junit4] 2> 16399 T2350 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a9000c, negotiated timeout = 20000
[junit4:junit4] 2> 16399 T2351 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fee6283 name:ZooKeeperConnection Watcher:127.0.0.1:60354/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16400 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16400 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a9000c type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16401 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a9000c type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16402 T2260 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17050 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17051 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56340/xp_/db",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:56340_xp_%2Fdb"}
[junit4:junit4] 2> 17054 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17054 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17054 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17054 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17054 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17054 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17291 T2298 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {action=PREPRECOVERY&state=recovering&wt=javabin&core=collection1&coreNodeName=4&nodeName=127.0.0.1:56340_xp_%252Fdb&version=2&checkLive=true&onlyIfLeader=true} status=0 QTime=1000
[junit4:junit4] 2> 17405 T2260 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34710_xp_%2Fdb
[junit4:junit4] 2> 17406 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a9000c type:delete cxid:0xd zxid:0xa9 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34710_xp_%2Fdb Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34710_xp_%2Fdb
[junit4:junit4] 2> 17406 T2260 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34710_xp_%2Fdb
[junit4:junit4] 2> 17408 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17408 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17408 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17409 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17410 T2318 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17410 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17410 T2351 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17410 T2302 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17410 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17411 T2289 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17411 T2334 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17411 T2282 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17415 T2352 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363305291844/collection1
[junit4:junit4] 2> 17416 T2352 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17416 T2352 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17416 T2352 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17417 T2352 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363305291844/collection1/'
[junit4:junit4] 2> 17418 T2352 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363305291844/collection1/lib/README' to classloader
[junit4:junit4] 2> 17418 T2352 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363305291844/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 17442 T2352 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 17469 T2352 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17470 T2352 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17473 T2352 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17784 T2352 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17789 T2352 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17791 T2352 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17800 T2352 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17803 T2352 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17806 T2352 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17806 T2352 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17807 T2352 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17807 T2352 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17807 T2352 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17808 T2352 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17808 T2352 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17808 T2352 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363305291844/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty4/
[junit4:junit4] 2> 17808 T2352 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f7ed45c
[junit4:junit4] 2> 17809 T2352 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17809 T2352 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty4 forceNew: false
[junit4:junit4] 2> 17809 T2352 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty4/index/
[junit4:junit4] 2> 17809 T2352 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17810 T2352 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty4/index forceNew: false
[junit4:junit4] 2> 17811 T2352 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7125461b lockFactory=org.apache.lucene.store.NativeFSLockFactory@94e246e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17811 T2352 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17813 T2352 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17813 T2352 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17813 T2352 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17814 T2352 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17814 T2352 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17814 T2352 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17814 T2352 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17815 T2352 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17815 T2352 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17817 T2352 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17819 T2352 oass.SolrIndexSearcher.<init> Opening Searcher@3149c536 main
[junit4:junit4] 2> 17820 T2352 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty4/tlog
[junit4:junit4] 2> 17820 T2352 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17820 T2352 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17824 T2353 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3149c536 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17826 T2352 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 17827 T2352 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18560 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18561 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34710/xp_/db",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:34710_xp_%2Fdb"}
[junit4:junit4] 2> 18561 T2283 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 18562 T2283 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 18564 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18564 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18565 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18565 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18564 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18565 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18828 T2352 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 18828 T2352 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34710/xp_/db collection:collection1 shard:shard1
[junit4:junit4] 2> 18831 T2352 oasc.ZkController.register We are http://127.0.0.1:34710/xp_/db/collection1/ and leader is http://127.0.0.1:49362/xp_/db/collection1/
[junit4:junit4] 2> 18831 T2352 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34710/xp_/db
[junit4:junit4] 2> 18831 T2352 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 18831 T2352 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C410 name=collection1 org.apache.solr.core.SolrCore@2eb3d85b url=http://127.0.0.1:34710/xp_/db/collection1 node=127.0.0.1:34710_xp_%2Fdb C410_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, base_url=http://127.0.0.1:34710/xp_/db, collection=collection1, node_name=127.0.0.1:34710_xp_%2Fdb}
[junit4:junit4] 2> 18832 T2354 C410 P34710 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 18832 T2352 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18832 T2354 C410 P34710 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 18832 T2354 C410 P34710 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 18833 T2354 C410 P34710 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18833 T2260 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 18833 T2260 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 18834 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18837 T2354 C410 P34710 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18837 T2260 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18838 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18841 T2298 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/onenodecollectioncore
[junit4:junit4] 2> 18841 T2298 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 18842 T2298 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 18842 T2298 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 18843 T2298 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 18843 T2298 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 18845 T2298 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 18846 T2298 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/onenodecollectioncore/'
[junit4:junit4] 2> 18872 T2298 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 18899 T2298 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18900 T2298 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18904 T2298 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 19192 T2298 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19197 T2298 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19199 T2298 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19209 T2298 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19212 T2298 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19214 T2298 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19215 T2298 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19216 T2298 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19216 T2298 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19217 T2298 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19217 T2298 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19217 T2298 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19218 T2298 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363305279039/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363305275558/onenodecollection/
[junit4:junit4] 2> 19218 T2298 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f7ed45c
[junit4:junit4] 2> 19218 T2298 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19219 T2298 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363305275558/onenodecollection forceNew: false
[junit4:junit4] 2> 19219 T2298 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363305275558/onenodecollection/index/
[junit4:junit4] 2> 19219 T2298 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363305275558/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19220 T2298 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363305275558/onenodecollection/index forceNew: false
[junit4:junit4] 2> 19221 T2298 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@791db191 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3884854a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19222 T2298 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19223 T2298 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19223 T2298 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19224 T2298 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19224 T2298 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19225 T2298 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19225 T2298 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19225 T2298 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19226 T2298 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19226 T2298 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19228 T2298 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19230 T2298 oass.SolrIndexSearcher.<init> Opening Searcher@3069ea8 main
[junit4:junit4] 2> 19231 T2298 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363305275558/onenodecollection/tlog
[junit4:junit4] 2> 19231 T2298 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19232 T2298 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19235 T2356 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@3069ea8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19236 T2298 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> C409_STATE=coll:collection1 core:collection1 props:{state=recovering, shard=shard2, core=collection1, base_url=http://127.0.0.1:56340/xp_/db, collection=collection1, node_name=127.0.0.1:56340_xp_%2Fdb}
[junit4:junit4] 2> 19292 T2337 C409 P56340 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53340/xp_/db/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19293 T2337 C409 P56340 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56340/xp_/db START replicas=[http://127.0.0.1:53340/xp_/db/collection1/] nUpdates=100
[junit4:junit4] 2> 19293 T2337 C409 P56340 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19293 T2337 C409 P56340 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19293 T2337 C409 P56340 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19293 T2337 C409 P56340 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19293 T2337 C409 P56340 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19294 T2337 C409 P56340 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53340/xp_/db/collection1/. core=collection1
[junit4:junit4] 2> 19294 T2337 C409 P56340 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C411 name=collection1 org.apache.solr.core.SolrCore@4c5e96f4 url=http://127.0.0.1:53340/xp_/db/collection1 node=127.0.0.1:53340_xp_%2Fdb C411_STATE=coll:collection1 core:collection1 props:{state=active, shard=shard2, core=collection1, base_url=http://127.0.0.1:53340/xp_/db, collection=collection1, node_name=127.0.0.1:53340_xp_%2Fdb, leader=true}
[junit4:junit4] 2> 19297 T2297 C411 P53340 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 19297 T2295 C411 P53340 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19298 T2295 C411 P53340 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b26000f lockFactory=org.apache.lucene.store.NativeFSLockFactory@652458ba),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19299 T2295 C411 P53340 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19299 T2295 C411 P53340 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b26000f lockFactory=org.apache.lucene.store.NativeFSLockFactory@652458ba),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b26000f lockFactory=org.apache.lucene.store.NativeFSLockFactory@652458ba),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19299 T2295 C411 P53340 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19300 T2295 C411 P53340 oass.SolrIndexSearcher.<init> Opening Searcher@6dd4be13 realtime
[junit4:junit4] 2> 19300 T2295 C411 P53340 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19300 T2295 C411 P53340 /update {openSearcher=false&waitSearcher=true&softCommit=false&wt=javabin&commit_end_point=true&version=2&commit=true} {commit=} 0 3
[junit4:junit4] 2> 19302 T2337 C409 P56340 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19302 T2337 C409 P56340 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19306 T2296 C411 P53340 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19306 T2296 C411 P53340 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=3
[junit4:junit4] 2> 19306 T2337 C409 P56340 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19306 T2337 C409 P56340 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19307 T2337 C409 P56340 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19308 T2295 C411 P53340 REQ /replication {command=filelist&wt=javabin&generation=2&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 19309 T2337 C409 P56340 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19309 T2337 C409 P56340 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty3/index.20130314165454863 forceNew: false
[junit4:junit4] 2> 19309 T2337 C409 P56340 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d3b7895 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a08b8c6) fullCopy=false
[junit4:junit4] 2> 19312 T2297 C411 P53340 REQ /replication {command=filecontent&wt=filestream&generation=2&file=segments_2&qt=/replication&checksum=true} status=0 QTime=0
[junit4:junit4] 2> 19313 T2337 C409 P56340 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19314 T2337 C409 P56340 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19314 T2337 C409 P56340 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19315 T2337 C409 P56340 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ac5ae5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ec1f793),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ac5ae5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ec1f793),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19315 T2337 C409 P56340 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19315 T2337 C409 P56340 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19316 T2337 C409 P56340 oass.SolrIndexSearcher.<init> Opening Searcher@273cb787 main
[junit4:junit4] 2> 19316 T2336 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@273cb787 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19317 T2337 C409 P56340 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d3b7895 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a08b8c6)
[junit4:junit4] 2> 19317 T2337 C409 P56340 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19317 T2337 C409 P56340 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19317 T2337 C409 P56340 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19317 T2337 C409 P56340 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19318 T2337 C409 P56340 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20068 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20069 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34710/xp_/db",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:34710_xp_%2Fdb"}
[junit4:junit4] 2> 20071 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53340/xp_/db",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:53340_xp_%2Fdb"}
[junit4:junit4] 2> 20072 T2283 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 20072 T2283 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 20074 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56340/xp_/db",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:56340_xp_%2Fdb"}
[junit4:junit4] 2> 20077 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20077 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20077 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20077 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20077 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20077 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20237 T2298 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 20238 T2298 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:53340/xp_/db collection:onenodecollection shard:shard1
[junit4:junit4] 2> 20239 T2298 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 20246 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:delete cxid:0xa8 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 20246 T2298 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 20247 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:create cxid:0xa9 zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20248 T2298 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 20249 T2298 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 20249 T2298 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53340/xp_/db/onenodecollectioncore/
[junit4:junit4] 2> 20249 T2298 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 20250 T2298 oasc.SyncStrategy.syncToMe http://127.0.0.1:53340/xp_/db/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 20250 T2298 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53340/xp_/db/onenodecollectioncore/
[junit4:junit4] 2> 20251 T2298 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 20254 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:create cxid:0xb3 zxid:0xc9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20840 T2312 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {action=PREPRECOVERY&state=recovering&wt=javabin&core=collection1&coreNodeName=5&nodeName=127.0.0.1:34710_xp_%252Fdb&version=2&checkLive=true&onlyIfLeader=true} status=0 QTime=2001
[junit4:junit4] 2> 21582 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21588 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21588 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21588 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21588 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21588 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21589 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21612 T2298 oasc.ZkController.register We are http://127.0.0.1:53340/xp_/db/onenodecollectioncore/ and leader is http://127.0.0.1:53340/xp_/db/onenodecollectioncore/
[junit4:junit4] 2> 21612 T2298 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:53340/xp_/db
[junit4:junit4] 2> 21612 T2298 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 21613 T2298 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 21614 T2298 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21615 T2298 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {action=CREATE&roles=none&wt=javabin&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363305275558/onenodecollection&collection=onenodecollection&version=2&numShards=1&name=onenodecollectioncore} status=0 QTime=2774
[junit4:junit4] 2> 21615 T2260 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21616 T2260 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22618 T2260 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C410_STATE=coll:collection1 core:collection1 props:{state=recovering, shard=shard1, core=collection1, base_url=http://127.0.0.1:34710/xp_/db, collection=collection1, node_name=127.0.0.1:34710_xp_%2Fdb}
[junit4:junit4] 2> 22841 T2354 C410 P34710 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49362/xp_/db/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 22841 T2354 C410 P34710 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34710/xp_/db START replicas=[http://127.0.0.1:49362/xp_/db/collection1/] nUpdates=100
[junit4:junit4] 2> 22842 T2354 C410 P34710 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 22842 T2354 C410 P34710 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 22842 T2354 C410 P34710 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 22842 T2354 C410 P34710 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 22842 T2354 C410 P34710 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 22843 T2354 C410 P34710 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49362/xp_/db/collection1/. core=collection1
[junit4:junit4] 2> 22843 T2354 C410 P34710 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C412 name=collection1 org.apache.solr.core.SolrCore@2977c7c7 url=http://127.0.0.1:49362/xp_/db/collection1 node=127.0.0.1:49362_xp_%2Fdb C412_STATE=coll:collection1 core:collection1 props:{state=active, shard=shard1, core=collection1, base_url=http://127.0.0.1:49362/xp_/db, collection=collection1, node_name=127.0.0.1:49362_xp_%2Fdb, leader=true}
[junit4:junit4] 2> 22847 T2312 C412 P49362 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 22847 T2313 C412 P49362 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22849 T2313 C412 P49362 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4aff6714 lockFactory=org.apache.lucene.store.NativeFSLockFactory@70957d3d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22849 T2313 C412 P49362 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22850 T2313 C412 P49362 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4aff6714 lockFactory=org.apache.lucene.store.NativeFSLockFactory@70957d3d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4aff6714 lockFactory=org.apache.lucene.store.NativeFSLockFactory@70957d3d),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22850 T2313 C412 P49362 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22851 T2313 C412 P49362 oass.SolrIndexSearcher.<init> Opening Searcher@2b2ccdea realtime
[junit4:junit4] 2> 22851 T2313 C412 P49362 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22852 T2313 C412 P49362 /update {openSearcher=false&waitSearcher=true&softCommit=false&wt=javabin&commit_end_point=true&version=2&commit=true} {commit=} 0 5
[junit4:junit4] 2> 22854 T2354 C410 P34710 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22854 T2354 C410 P34710 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 22856 T2311 C412 P49362 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22856 T2311 C412 P49362 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1
[junit4:junit4] 2> 22856 T2354 C410 P34710 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 22857 T2354 C410 P34710 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 22857 T2354 C410 P34710 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 22859 T2312 C412 P49362 REQ /replication {command=filelist&wt=javabin&generation=2&qt=/replication&version=2} status=0 QTime=0
[junit4:junit4] 2> 22859 T2354 C410 P34710 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 22860 T2354 C410 P34710 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/jetty4/index.20130314165458414 forceNew: false
[junit4:junit4] 2> 22860 T2354 C410 P34710 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@44035900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2bd2afd8) fullCopy=false
[junit4:junit4] 2> 22871 T2313 C412 P49362 REQ /replication {command=filecontent&wt=filestream&generation=2&file=segments_2&qt=/replication&checksum=true} status=0 QTime=0
[junit4:junit4] 2> 22872 T2354 C410 P34710 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 22873 T2354 C410 P34710 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22873 T2354 C410 P34710 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22874 T2354 C410 P34710 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7125461b lockFactory=org.apache.lucene.store.NativeFSLockFactory@94e246e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7125461b lockFactory=org.apache.lucene.store.NativeFSLockFactory@94e246e),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 22874 T2354 C410 P34710 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 22874 T2354 C410 P34710 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 22875 T2354 C410 P34710 oass.SolrIndexSearcher.<init> Opening Searcher@410c8832 main
[junit4:junit4] 2> 22876 T2353 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@410c8832 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 22876 T2354 C410 P34710 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@44035900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2bd2afd8)
[junit4:junit4] 2> 22876 T2354 C410 P34710 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 22876 T2354 C410 P34710 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 22877 T2354 C410 P34710 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 22877 T2354 C410 P34710 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22878 T2354 C410 P34710 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23093 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23094 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53340/xp_/db",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:53340_xp_%2Fdb"}
[junit4:junit4] 2> 23098 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34710/xp_/db",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:34710_xp_%2Fdb"}
[junit4:junit4] 2> 23101 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23101 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23102 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23101 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23101 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23101 T2289 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23619 T2260 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23620 T2260 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 23620 T2260 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23631 T2312 oejs.Response.sendError WARNING Committed before 404 Can not find: /xp_/db/onenodecollectioncore/update
[junit4:junit4] 2> 23631 T2260 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:60354 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2aa8bca8
[junit4:junit4] 2> 23632 T2312 oejs.ServletHandler.doHandle WARNING /xp_/db/onenodecollectioncore/update java.lang.IllegalStateException: Committed
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.resetBuffer(Response.java:1136)
[junit4:junit4] 2> at org.eclipse.jetty.server.Response.sendError(Response.java:314)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$Servlet404.service(JettySolrRunner.java:465)
[junit4:junit4] 2> at javax.servlet.http.HttpServlet.service(HttpServlet.java:770)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1336)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:379)
[junit4:junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:141)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1307)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:275)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1074)
[junit4:junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:382)
[junit4:junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1006)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4:junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4:junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:365)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:485)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:948)
[junit4:junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4:junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4:junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 23632 T2260 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 23632 T2361 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:60354. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 23633 T2361 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:60354, initiating session
[junit4:junit4] 2> 23633 T2262 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51968
[junit4:junit4] 2> 23633 T2262 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51968
[junit4:junit4] 2> 23634 T2264 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b53a0a9000d with negotiated timeout 10000 for client /127.0.0.1:51968
[junit4:junit4] 2> 23634 T2361 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:60354, sessionid = 0x13d6b53a0a9000d, negotiated timeout = 10000
[junit4:junit4] 2> 23634 T2362 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2aa8bca8 name:ZooKeeperConnection Watcher:127.0.0.1:60354 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 23634 T2260 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 23666 T2265 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b53a0a9000d
[junit4:junit4] 2> 23667 T2362 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 23667 T2262 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51968 which had sessionid 0x13d6b53a0a9000d
[junit4:junit4] 2> 23667 T2260 oaz.ZooKeeper.close Session: 0x13d6b53a0a9000d closed
[junit4:junit4] 2> 23668 T2265 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b53a0a90004
[junit4:junit4] 2> 23668 T2289 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 23668 T2262 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51893 which had sessionid 0x13d6b53a0a90004
[junit4:junit4] 2> 23668 T2260 oaz.ZooKeeper.close Session: 0x13d6b53a0a90004 closed
[junit4:junit4] 2> 23670 T2260 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 33462
[junit4:junit4] 2> 23671 T2260 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=892232039
[junit4:junit4] 2> 24607 T2283 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24608 T2283 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33462/xp_/db",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "node_name":"127.0.0.1:33462_xp_%2Fdb"}
[junit4:junit4] 2> 24612 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24612 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24612 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24612 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24612 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25672 T2260 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 25673 T2260 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 25675 T2260 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@3b20ddda
[junit4:junit4] 2> 25677 T2260 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 25678 T2260 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 25678 T2260 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 25678 T2260 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 25678 T2260 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 25679 T2260 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/control/data/index
[junit4:junit4] 2> 25679 T2260 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/control/data/index
[junit4:junit4] 2> 25679 T2260 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/control/data
[junit4:junit4] 2> 25680 T2260 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363305275557/control/data
[junit4:junit4] 2> 25680 T2283 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89345574539165699-127.0.0.1:33462_xp_%2Fdb-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 25681 T2265 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b53a0a90003
[junit4:junit4] 2> 25683 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25683 T2262 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51890 which had sessionid 0x13d6b53a0a90003
[junit4:junit4] 2> 25683 T2260 oaz.ZooKeeper.close Session: 0x13d6b53a0a90003 closed
[junit4:junit4] 2> 25683 T2351 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25683 T2302 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25683 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25683 T2334 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25684 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25684 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25684 T2318 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 25685 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:delete cxid:0xc3 zxid:0xe5 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 25686 T2302 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 25687 T2302 oasc.Overseer.start Overseer (id=89345574539165702-127.0.0.1:53340_xp_%2Fdb-n_0000000001) starting
[junit4:junit4] 2> 25687 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:create cxid:0xc8 zxid:0xe7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25688 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:create cxid:0xc9 zxid:0xe8 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25688 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:create cxid:0xca zxid:0xe9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25689 T2265 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b53a0a90006 type:create cxid:0xcb zxid:0xea txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 25690 T2364 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 25690 T2363 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 25691 T2363 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25692 T2363 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33462/xp_/db",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:33462_xp_%2Fdb"}
[junit4:junit4] 2> 25705 T2260 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/xp_/db,null}
[junit4:junit4] 2> 25709 T2302 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25709 T2334 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25709 T2318 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25709 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 25756 T2260 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53340
[junit4:junit4] 2> 25757 T2260 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1970581758
[junit4:junit4] 2> 26983 T2282 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 26983 T2282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26983 T2282 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 26983 T2282 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 27214 T2363 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27215 T2363 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:53340_xp_%2Fdb_one
[...truncated too long message...]
it4] 1> /solr/overseer_elect/election/89345589046607878-127.0.0.1:57944_-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89345589046607884-127.0.0.1:47541_-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89345589046607875-127.0.0.1:42373_-n_0000000000 (0)
[junit4:junit4] 1> /solr/live_nodes (5)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:53058_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:50556_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:47541_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:57944_ (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:42373_ (0)
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=802158C9E3ABED06 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ms -Dtests.timezone=Indian/Mahe -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 144s J0 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Still found shard
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([802158C9E3ABED06:1C7D6D194F48D3A]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 143892 T1955 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 143902 T1954 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 144085 T1958 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=306), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=306)), sim=DefaultSimilarity, locale=ms, timezone=Indian/Mahe
[junit4:junit4] 2> NOTE: Linux 3.2.0-38-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=232772136,total=522190848
[junit4:junit4] 2> NOTE: All tests run in this JVM: [RegexBoostProcessorTest, SpellingQueryConverterTest, PrimitiveFieldTypeTest, PreAnalyzedFieldTest, TestLRUCache, DistributedQueryElevationComponentTest, DocumentBuilderTest, TestSort, AnalysisAfterCoreReloadTest, ClusterStateUpdateTest, TestQuerySenderListener, TestPseudoReturnFields, TestSurroundQueryParser, TestTrie, TestStressRecovery, TestFieldTypeResource, OverseerTest, TestSolrIndexConfig, TestPluginEnable, QueryEqualityTest, PeerSyncTest, TestWriterPerf, TestFastLRUCache, TestStressVersions, FieldMutatingUpdateProcessorTest, LegacyHTMLStripCharFilterTest, TestRemoteStreaming, SuggesterTest, TestDocSet, ChaosMonkeyNothingIsSafeTest, SystemInfoHandlerTest, TestJoin, SliceStateTest, LeaderElectionTest, SuggesterFSTTest, ZkCLITest, PolyFieldTest, UUIDFieldTest, TestFieldTypeCollectionResource, BasicFunctionalityTest, TestPropInjectDefaults, SpatialFilterTest, ReturnFieldsTest, TestDocumentBuilder, SOLR749Test, RecoveryZkTest, TestBadConfig, UpdateRequestProcessorFactoryTest, TestValueSourceCache, SearchHandlerTest, TestFuzzyAnalyzedSuggestions, TestXIncludeConfig, DirectSolrConnectionTest, TestFunctionQuery, StatelessScriptUpdateProcessorFactoryTest, ShowFileRequestHandlerTest, AutoCommitTest, JsonLoaderTest, TestPHPSerializedResponseWriter, DistributedTermsComponentTest, TestIBSimilarityFactory, TestQueryUtils, SoftAutoCommitTest, TestSolrDeletionPolicy1, TestConfig, SimpleFacetsTest, CachingDirectoryFactoryTest, BasicDistributedZkTest, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 144.17s, 1 test, 1 failure <<< FAILURES!
[...truncated 411 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 error, 1 failure, 13 ignored (7 assumptions)
Total time: 42 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure