You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/06/07 00:40:04 UTC
[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0_05) - Build #
4093 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4093/
Java: 32bit/jdk1.8.0_05 -server -XX:+UseConcMarkSweepGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage
Error Message:
SolrCore.getOpenCount()==2
Stack Trace:
java.lang.RuntimeException: SolrCore.getOpenCount()==2
at __randomizedtesting.SeedInfo.seed([1B1BF998AD82EF41]:0)
at org.apache.solr.util.TestHarness.close(TestHarness.java:332)
at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:630)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:182)
at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage
Error Message:
4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage: 1) Thread[id=3273, name=coreZkRegister-1805-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=3271, name=Thread-1589, state=WAITING, group=TGRP-TestManagedResourceStorage] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:944) 3) Thread[id=3267, name=Thread-1588, state=TIMED_WAITING, group=Overseer state updater.] at java.lang.Object.wait(Native Method) at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:273) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:596) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=3270, name=searcherExecutor-1810-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage:
1) Thread[id=3273, name=coreZkRegister-1805-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=3271, name=Thread-1589, state=WAITING, group=TGRP-TestManagedResourceStorage]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
3) Thread[id=3267, name=Thread-1588, state=TIMED_WAITING, group=Overseer state updater.]
at java.lang.Object.wait(Native Method)
at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:273)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:596)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)
at java.lang.Thread.run(Thread.java:745)
4) Thread[id=3270, name=searcherExecutor-1810-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([1B1BF998AD82EF41]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=3273, name=coreZkRegister-1805-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=3271, name=Thread-1589, state=WAITING, group=TGRP-TestManagedResourceStorage] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:944) 3) Thread[id=3270, name=searcherExecutor-1810-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=3273, name=coreZkRegister-1805-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=3271, name=Thread-1589, state=WAITING, group=TGRP-TestManagedResourceStorage]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
3) Thread[id=3270, name=searcherExecutor-1810-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([1B1BF998AD82EF41]:0)
Build Log:
[...truncated 10869 lines...]
[junit4] Suite: org.apache.solr.rest.TestManagedResourceStorage
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\init-core-data-001
[junit4] 2> 940240 T3253 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 940240 T3253 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 940242 T3254 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 940332 T3253 oasc.ZkTestServer.run start zk server on port:60398
[junit4] 2> 940334 T3253 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 940339 T3260 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1571d86 name:ZooKeeperConnection Watcher:127.0.0.1:60398 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 940339 T3253 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 940339 T3253 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 940344 T3253 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 940351 T3262 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f1f56 name:ZooKeeperConnection Watcher:127.0.0.1:60398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 940351 T3253 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 940352 T3253 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 940355 T3253 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 940357 T3253 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 940359 T3253 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 940362 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 940364 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 940372 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4] 2> 940372 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 940377 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 940377 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 940383 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 940383 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 940388 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 940388 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 940406 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 940406 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 940412 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 940412 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 940416 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 940416 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 940420 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 940420 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 940424 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 940424 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 940428 T3253 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 940428 T3253 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 940434 T3253 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 940434 T3253 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\'
[junit4] 2> 940437 T3253 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 940437 T3253 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 940440 T3253 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 940507 T3253 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 940528 T3253 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 940530 T3253 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 940537 T3253 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 940645 T3253 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 940651 T3253 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 940651 T3253 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 940690 T3253 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 940694 T3253 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 940697 T3253 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 940697 T3253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 940697 T3253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 940697 T3253 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 940697 T3253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 940697 T3253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 940697 T3253 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 940697 T3253 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr
[junit4] 2> 940699 T3253 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\'
[junit4] 2> 940718 T3253 oasc.CoreContainer.<init> New CoreContainer 26339938
[junit4] 2> 940718 T3253 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\]
[junit4] 2> 940720 T3253 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 940720 T3253 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 940720 T3253 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 940720 T3253 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 940720 T3253 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 940720 T3253 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 940720 T3253 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 940720 T3253 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 940722 T3253 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 940730 T3253 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 940730 T3253 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 940730 T3253 oasc.CoreContainer.load Host Name:
[junit4] 2> 940730 T3253 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60398/solr
[junit4] 2> 940730 T3253 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 940734 T3253 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 940736 T3264 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1caab68 name:ZooKeeperConnection Watcher:127.0.0.1:60398 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 940737 T3253 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 940742 T3253 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 940745 T3266 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12892a7 name:ZooKeeperConnection Watcher:127.0.0.1:60398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 940746 T3253 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 940747 T3253 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 940750 T3253 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 940754 T3253 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 940761 T3253 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 940765 T3253 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 940769 T3253 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 940772 T3253 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/192.168.57.16:_
[junit4] 2> 940773 T3253 oascc.SolrZkClient.makePath makePath: /live_nodes/192.168.57.16:_
[junit4] 2> 940777 T3253 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 940780 T3253 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 940785 T3253 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 192.168.57.16:_
[junit4] 2> 940785 T3253 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 940789 T3253 oasc.Overseer.start Overseer (id=91887652112105475-192.168.57.16:_-n_0000000000) starting
[junit4] 2> 940793 T3253 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 940810 T3253 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 940819 T3268 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 940824 T3253 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 940828 T3253 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 940832 T3267 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 940837 T3269 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 940837 T3269 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 940838 T3269 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 940838 T3266 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 940840 T3267 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 940841 T3267 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://192.168.57.16:",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"192.168.57.16:_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":"192.168.57.16:__collection1"}
[junit4] 2> 940845 T3266 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 940847 T3266 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 941725 T3269 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 941726 T3269 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 941726 T3269 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 941728 T3269 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 941728 T3269 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1/'
[junit4] 2> 941728 T3269 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 941728 T3269 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 941728 T3269 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 941759 T3269 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 941792 T3269 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 941795 T3269 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 941800 T3269 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 941933 T3269 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 941939 T3269 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 941939 T3269 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 941953 T3269 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 941957 T3269 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 941959 T3269 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 941960 T3269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 941960 T3269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 941960 T3269 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 941961 T3269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 941961 T3269 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 941961 T3269 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 941962 T3269 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 941962 T3269 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1/, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\init-core-data-001\
[junit4] 2> 941962 T3269 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b4ceb6
[junit4] 2> 941963 T3269 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\init-core-data-001\
[junit4] 2> 941963 T3269 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\init-core-data-001\index/
[junit4] 2> 941963 T3269 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\init-core-data-001\index' doesn't exist. Creating new index...
[junit4] 2> 941964 T3269 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\init-core-data-001\index
[junit4] 2> 941965 T3269 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=46.1328125, floorSegmentMB=0.552734375, forceMergeDeletesPctAllowed=25.760874311718435, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 941965 T3269 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@45fca3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@a14d40)),segFN=segments_1,generation=1}
[junit4] 2> 941965 T3269 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 941965 T3269 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 941967 T3269 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 941968 T3269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 941968 T3269 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 941968 T3269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 941968 T3269 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 941969 T3269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 941969 T3269 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 941969 T3269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 941969 T3269 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 941970 T3269 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 941970 T3269 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 941970 T3269 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 941970 T3269 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 941970 T3269 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 941972 T3269 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 941972 T3269 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 941972 T3269 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 941972 T3269 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 941972 T3269 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 941973 T3269 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 941973 T3269 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 941973 T3269 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 941973 T3269 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 941974 T3269 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 941974 T3269 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 941974 T3269 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 941975 T3269 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 941975 T3269 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 941975 T3269 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 941976 T3269 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 941976 T3269 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 941976 T3269 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 941977 T3269 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 941977 T3269 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 941977 T3269 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 941983 T3269 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 941983 T3269 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 941985 T3269 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 941985 T3269 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 941987 T3269 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=32, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.35963864054566885]
[junit4] 2> 941987 T3269 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@45fca3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@a14d40)),segFN=segments_1,generation=1}
[junit4] 2> 941987 T3269 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 941987 T3269 oass.SolrIndexSearcher.<init> Opening Searcher@46fe5c[collection1] main
[junit4] 2> 941987 T3269 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 941989 T3269 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 941989 T3269 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 941989 T3269 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 941989 T3269 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 941990 T3269 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 941990 T3269 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 941990 T3269 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 942003 T3269 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 942058 T3270 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@46fe5c[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 942064 T3269 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 942067 T3273 oasc.ZkController.register Register replica - core:collection1 address:http://192.168.57.16: collection:collection1 shard:shard1
[junit4] 2> 942069 T3253 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 942070 T3273 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 942081 T3253 oas.SolrTestCaseJ4.setUp ###Starting testFileBasedJsonStorage
[junit4] 2> 942085 T3253 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\json-storage-001\'
[junit4] 2> 942102 T3273 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 942106 T3266 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 942108 T3273 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 942109 T3273 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 942109 T3273 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://192.168.57.16:/collection1/ shard1
[junit4] 2> 942110 T3273 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 942112 T3253 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\json-storage-001\managed
[junit4] 2> 942114 T3267 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 942117 T3253 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _test_foo.json using file:dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\json-storage-001\managed
[junit4] 2> 942117 T3253 oasr.ManagedResourceStorage.load Reading _test_foo.json using file:dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\json-storage-001\managed
[junit4] 2> 942118 T3253 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _test_foo.json using file:dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\json-storage-001\managed
[junit4] 2> 942119 T3253 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _test_foo.json using file:dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\json-storage-001\managed
[junit4] 2> 942119 T3253 oasr.ManagedResourceStorage.load Reading _test_foo.json using file:dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\json-storage-001\managed
[junit4] 2> 942119 T3253 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _test_foo.json using file:dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.rest.TestManagedResourceStorage-1B1BF998AD82EF41-001\json-storage-001\managed
[junit4] 2> 942121 T3253 oas.SolrTestCaseJ4.tearDown ###Ending testFileBasedJsonStorage
[junit4] 2> 942137 T3266 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 942142 T3253 oas.SolrTestCaseJ4.setUp ###Starting testZkBasedJsonStorage
[junit4] 2> 942142 T3253 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './'
[junit4] 2> 942161 T3253 oascc.SolrZkClient.makePath makePath: /test
[junit4] 2> 942163 T3266 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 942165 T3253 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /test
[junit4] 2> 942166 T3253 oascc.SolrZkClient.makePath makePath: /test/_test_foo.json
[junit4] 2> 942169 T3266 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 942170 T3266 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 942170 T3253 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 136 bytes to new znode /test/_test_foo.json
[junit4] 2> 942170 T3253 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 942171 T3253 oasr.ManagedResourceStorage.load Reading _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 942173 T3253 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 136 bytes from znode /test/_test_foo.json
[junit4] 2> 942174 T3253 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 942177 T3253 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 175 bytes to existing znode /test/_test_foo.json
[junit4] 2> 942177 T3253 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 942177 T3253 oasr.ManagedResourceStorage.load Reading _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 942178 T3253 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 175 bytes from znode /test/_test_foo.json
[junit4] 2> 942178 T3253 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _test_foo.json using ZooKeeperStorageIO:path=/test
[junit4] 2> 942180 T3253 oas.SolrTestCaseJ4.tearDown ###Ending testZkBasedJsonStorage
[junit4] 2> 942183 T3253 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60398 60398
[junit4] 2> 942209 T3273 oasc.ZkController.register We are http://192.168.57.16:/collection1/ and leader is http://192.168.57.16:/collection1/
[junit4] 2> 943509 T3266 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 942599 T3268 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 944180 T3254 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60398 60398
[junit4] 2> 944180 T3273 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://192.168.57.16:
[junit4] 2> 944185 T3273 oasc.ZkController.checkRecovery WARN Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4] 2> 944185 T3273 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 944185 T3273 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 944186 T3273 oasc.ZkController.getLeaderInitiatedRecoveryState WARN Unable to read /collections/collection1/leader_initiated_recovery/shard1/collection1 due to: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_initiated_recovery/shard1/collection1
[junit4] 2> 944186 T3253 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 944189 T3273 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 944189 T3273 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 944189 T3273 oasc.ZkContainer$2.run ERROR org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:243)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:240)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:240)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:346)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:330)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1077)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1014)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1010)
[junit4] 2> at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:207)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 944191 T3273 oasc.SolrException.log ERROR :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:243)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:240)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:240)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:346)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:330)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1077)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1014)
[junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1010)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:826)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:740)
[junit4] 2> at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:200)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 4422 T3252 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4] 2> 24474 T3252 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage:
[junit4] 2> 1) Thread[id=3273, name=coreZkRegister-1805-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2) Thread[id=3271, name=Thread-1589, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
[junit4] 2> 3) Thread[id=3267, name=Thread-1588, state=TIMED_WAITING, group=Overseer state updater.]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:273)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:596)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 4) Thread[id=3270, name=searcherExecutor-1810-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 24475 T3252 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=3273, name=coreZkRegister-1805-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> 2) Thread[id=3271, name=Thread-1589, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> 3) Thread[id=3267, name=Thread-1588, state=TIMED_WAITING, group=Overseer state updater.]
[junit4] 2> 4) Thread[id=3270, name=searcherExecutor-1810-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> 964715 T3267 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 192.168.57.16:_
[junit4] 2> 964717 T3274 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 27488 T3252 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=3273, name=coreZkRegister-1805-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2) Thread[id=3271, name=Thread-1589, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
[junit4] 2> 3) Thread[id=3270, name=searcherExecutor-1810-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=104), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=104)), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ca, timezone=SystemV/PST8PDT
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0_05 (32-bit)/cpus=2,threads=4,free=85570160,total=218365952
[junit4] 2> NOTE: All tests run in this JVM: [TestUniqueKeyFieldResource, HdfsCollectionsAPIDistributedZkTest, PrimitiveFieldTypeTest, TestQueryUtils, TestDistribDocBasedVersion, SimplePostToolTest, SolrPluginUtilsTest, SyncSliceTest, FieldAnalysisRequestHandlerTest, SolrTestCaseJ4Test, FileUtilsTest, TestSolrDeletionPolicy1, BasicZkTest, TestCustomSort, UpdateParamsTest, TestSolrQueryParser, TestBadConfig, SpatialFilterTest, TestSerializedLuceneMatchVersion, TestReloadAndDeleteDocs, XsltUpdateRequestHandlerTest, TestJoin, TestWriterPerf, OverseerCollectionProcessorTest, TestStandardQParsers, DistributedSuggestComponentTest, TestDefaultSearchFieldResource, MultiTermTest, TestModifyConfFiles, DocumentAnalysisRequestHandlerTest, TestCollationFieldDocValues, TestSolrXmlPersistor, TestSchemaVersionResource, TestMiniSolrCloudCluster, TestFastLRUCache, TestAddFieldRealTimeGet, IndexSchemaTest, DeleteShardTest, TestFiltering, TestDistributedGrouping, NoCacheHeaderTest, OutputWriterTest, DeleteInactiveReplicaTest, HardAutoCommitTest, MinimalSchemaTest, TestHashPartitioner, TestLuceneMatchVersion, DistribDocExpirationUpdateProcessorTest, DateRangeFieldTest, TestRecoveryHdfs, TestNonDefinedSimilarityFactory, TestSurroundQueryParser, TestJmxIntegration, ZkNodePropsTest, ResourceLoaderTest, BlockCacheTest, QueryEqualityTest, DistributedExpandComponentTest, TestRestManager, TestSchemaResource, SampleTest, TestSystemIdResolver, ExpressionTest, ShowFileRequestHandlerTest, ExternalFileFieldSortTest, DebugComponentTest, BasicDistributedZk2Test, TermsComponentTest, DocValuesMultiTest, TestCodecSupport, ResponseLogComponentTest, DistributedQueryElevationComponentTest, FastVectorHighlighterTest, TestDocumentBuilder, TestManagedSchema, TestXIncludeConfig, TestExtendedDismaxParser, TestGroupingSearch, TestExpandComponent, TestCollectionAPI, TestUpdate, TestHighFrequencyDictionaryFactory, TestInitQParser, BasicFunctionalityTest, FunctionTest, TestTrie, TestDistributedMissingSort, ChangedSchemaMergeTest, ReturnFieldsTest, CustomCollectionTest, RegexBoostProcessorTest, CollectionsAPIAsyncDistributedZkTest, TestSweetSpotSimilarityFactory, TestFastOutputStream, DocValuesMissingTest, TestOverriddenPrefixQueryForCustomFieldType, TestStressReorder, CoreAdminRequestStatusTest, TestJmxMonitoredMap, TestPostingsSolrHighlighter, TestManagedResourceStorage]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestManagedResourceStorage -Dtests.seed=1B1BF998AD82EF41 -Dtests.slow=true -Dtests.locale=ca -Dtests.timezone=SystemV/PST8PDT -Dtests.file.encoding=Cp1252
[junit4] ERROR 0.00s | TestManagedResourceStorage (suite) <<<
[junit4] > Throwable #1: java.lang.RuntimeException: SolrCore.getOpenCount()==2
[junit4] > at __randomizedtesting.SeedInfo.seed([1B1BF998AD82EF41]:0)
[junit4] > at org.apache.solr.util.TestHarness.close(TestHarness.java:332)
[junit4] > at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:630)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:182)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage:
[junit4] > 1) Thread[id=3273, name=coreZkRegister-1805-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=3271, name=Thread-1589, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:502)
[junit4] > at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
[junit4] > 3) Thread[id=3267, name=Thread-1588, state=TIMED_WAITING, group=Overseer state updater.]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:273)
[junit4] > at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:596)
[junit4] > at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:560)
[junit4] > at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 4) Thread[id=3270, name=searcherExecutor-1810-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([1B1BF998AD82EF41]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=3273, name=coreZkRegister-1805-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=3271, name=Thread-1589, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:502)
[junit4] > at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
[junit4] > 3) Thread[id=3270, name=searcherExecutor-1810-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([1B1BF998AD82EF41]:0)
[junit4] Completed in 27.53s, 2 tests, 3 errors <<< FAILURES!
[...truncated 914 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1296: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:920: There were test failures: 409 suites, 1691 tests, 3 suite-level errors, 1122 ignored (9 assumptions)
Total time: 49 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0_05 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_60) - Build #
4095 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4095/
Java: 64bit/jdk1.7.0_60 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([A677606D44DA43D6:A27FEF9E567FACF7]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:134)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:661)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
... 46 more
Build Log:
[...truncated 10561 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.OverseerTest-A677606D44DA43D6-001\init-core-data-001
[junit4] 2> 236404 T573 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 236404 T573 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 236405 T573 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 236411 T573 oas.SolrTestCaseJ4.setUp ###Starting testStateChange
[junit4] 2> 236415 T573 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 236415 T574 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 236541 T573 oasc.ZkTestServer.run start zk server on port:49536
[junit4] 2> 236544 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 236551 T580 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24f8d1e2 name:ZooKeeperConnection Watcher:127.0.0.1:49536/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 236552 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 236555 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 236563 T582 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27755c25 name:ZooKeeperConnection Watcher:127.0.0.1:49536 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 236563 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 236568 T575 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676de7df30001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 236571 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 236575 T584 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bfb1416 name:ZooKeeperConnection Watcher:127.0.0.1:49536 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 236575 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 236575 T573 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 236582 T575 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676de7df30002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 236583 T573 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 236589 T573 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 236599 T573 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 236603 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 236611 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 236615 T586 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11746615 name:ZooKeeperConnection Watcher:127.0.0.1:49536/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 236616 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 236619 T573 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 236622 T573 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 236632 T573 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49536_solr
[junit4] 2> 236632 T573 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 236637 T573 oasc.Overseer.start Overseer (id=91891540375568387-127.0.0.1:49536_solr-n_0000000000) starting
[junit4] 2> 236642 T573 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 236649 T573 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 236657 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 236664 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 236672 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 236680 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 236694 T588 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 236696 T587 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 236701 T573 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 236704 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 236705 T587 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 236705 T587 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 236712 T586 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 236713 T580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 236767 T573 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 236771 T586 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 236775 T587 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 236777 T587 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"active"}
[junit4] 2> 236777 T587 oasc.Overseer$ClusterStateUpdater.updateState node=core_node1 is already registered
[junit4] 2> 236777 T587 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 236787 T586 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 236919 T580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 236971 T575 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676de7df30003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 236971 T573 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49536 49536
[junit4] 2> 239218 T588 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 239811 T574 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49536 49536
[junit4] 2> 239817 T573 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
[junit4] 2> 239820 T587 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:49536_solr
[junit4] 2> 239826 T589 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 239842 T573 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4] 2> 239847 T573 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 239848 T590 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 239975 T573 oasc.ZkTestServer.run start zk server on port:49551
[junit4] 2> 239977 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 239983 T596 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@470d3ad7 name:ZooKeeperConnection Watcher:127.0.0.1:49551/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 239984 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 239987 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 239989 T598 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@790b66b5 name:ZooKeeperConnection Watcher:127.0.0.1:49551 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 239991 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 239995 T591 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676de8b640001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 239998 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 240002 T600 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4aba2f0c name:ZooKeeperConnection Watcher:127.0.0.1:49551 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 240003 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 240003 T573 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 240010 T573 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 240010 T591 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676de8b640002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 240018 T573 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 240024 T573 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 240027 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 240036 T573 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 240046 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 240050 T602 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26763a60 name:ZooKeeperConnection Watcher:127.0.0.1:49551/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 240050 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 240052 T573 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 240057 T573 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 240067 T573 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49551_solr
[junit4] 2> 240067 T573 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 240072 T573 oasc.Overseer.start Overseer (id=91891540601077763-127.0.0.1:49551_solr-n_0000000000) starting
[junit4] 2> 240077 T573 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 240086 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 240094 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 240101 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 240109 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 240122 T604 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 240133 T603 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 240134 T603 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 240136 T603 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 240138 T596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 240153 T603 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core2",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 240156 T596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 240163 T603 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 240169 T603 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 240170 T603 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core3",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 240177 T602 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 240311 T596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 240390 T591 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676de8b640003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 240392 T591 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676de8b640000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 240394 T573 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49551 49551
[junit4] 2> 242652 T604 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 243232 T590 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49551 49551
[junit4] 2> 243236 T573 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4] 2> 243240 T603 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:49551_solr
[junit4] 2> 243243 T605 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 243249 T573 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4] 2> 243254 T573 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 243255 T606 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 243382 T573 oasc.ZkTestServer.run start zk server on port:49566
[junit4] 2> 243385 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243392 T612 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51309126 name:ZooKeeperConnection Watcher:127.0.0.1:49566 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243393 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243398 T607 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676de98af0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 243400 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243404 T614 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c6a22dd name:ZooKeeperConnection Watcher:127.0.0.1:49566 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243405 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243405 T573 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 243416 T607 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676de98af0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 243419 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243424 T616 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cc6376a name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243424 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243425 T573 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 243434 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243437 T618 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4605f6fa name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243437 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243441 T573 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 243447 T573 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 243458 T573 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49566_solr
[junit4] 2> 243459 T573 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 243475 T573 oasc.Overseer.start Overseer (id=91891540824096771-127.0.0.1:49566_solr-n_0000000000) starting
[junit4] 2> 243480 T573 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 243490 T573 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 243499 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 243506 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 243515 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 243527 T573 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 243547 T620 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 243547 T573 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 243552 T619 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 243557 T573 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 243563 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243574 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243579 T622 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bc8a33 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243579 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243582 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243588 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4] 2> 243603 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243609 T624 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a3627c2 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243611 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243617 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243622 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 243635 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243641 T626 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fd52634 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243643 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243646 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243665 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 243677 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243683 T628 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2435968a name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243684 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243687 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243693 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4] 2> 243705 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243713 T630 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a8f6bf2 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243713 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243718 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243725 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4] 2> 243745 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243751 T632 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55ad7f3f name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243752 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243756 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243762 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4] 2> 243779 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243785 T634 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c8f8429 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243786 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243790 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243795 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4] 2> 243817 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243837 T636 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2425bc73 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243839 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243842 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243848 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4] 2> 243871 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243888 T638 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f4aaa58 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243891 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243894 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243901 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4] 2> 243924 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243942 T640 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12a40ad name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243944 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243947 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 243953 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4] 2> 243977 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 243994 T642 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29a76766 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 243995 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 243998 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244004 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4] 2> 244030 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244049 T644 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b7ca312 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244051 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244053 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244059 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4] 2> 244092 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244114 T646 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63c77356 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244116 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244118 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244124 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4] 2> 244154 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244157 T648 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56eabf4a name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244159 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244161 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244167 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4] 2> 244187 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244192 T650 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2dabc841 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244193 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244197 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244203 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4] 2> 244223 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244227 T652 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67fae944 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244227 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244232 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244240 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4] 2> 244261 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244264 T654 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ca0ac5a name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244266 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244268 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244275 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4] 2> 244299 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244305 T656 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c670b0 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244305 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244309 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244315 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4] 2> 244338 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244342 T658 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76a331c8 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244342 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244345 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244352 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4] 2> 244381 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244388 T660 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5243e3e0 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244390 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244396 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244404 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4] 2> 244439 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244447 T662 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52e036b name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244449 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244451 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244458 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4] 2> 244482 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244488 T664 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4198f74e name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244488 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244495 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244503 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4] 2> 244527 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244534 T666 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@299aef85 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244534 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244539 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244546 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4] 2> 244570 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244576 T668 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49cf85e name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244577 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244582 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244591 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4] 2> 244615 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244623 T670 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e41e983 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244623 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244628 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244639 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4] 2> 244673 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244678 T672 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f610891 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244680 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244687 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244696 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
[junit4] 2> 244719 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244732 T674 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6972c9cf name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244734 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244737 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244743 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
[junit4] 2> 244805 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244820 T676 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f730eb1 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244820 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244850 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244858 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
[junit4] 2> 244883 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244889 T678 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@695645b6 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244891 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244895 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244901 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
[junit4] 2> 244926 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 244937 T680 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18da869a name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 244938 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 244943 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 244956 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
[junit4] 2> 245015 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245019 T682 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b9b95f2 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245020 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245026 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245033 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node30
[junit4] 2> 245056 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245058 T684 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6eea2c1c name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245060 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245062 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245069 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node31
[junit4] 2> 245091 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245096 T686 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5439b2d name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245096 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245099 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245106 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node32
[junit4] 2> 245131 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245135 T688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e5909ed name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245135 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245139 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245146 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node33
[junit4] 2> 245166 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245173 T690 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bb15389 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245173 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245177 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245183 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node34
[junit4] 2> 245208 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245214 T692 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2121bf06 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245215 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245218 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245226 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node35
[junit4] 2> 245270 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245276 T694 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52adbffc name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245277 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245280 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245288 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node36
[junit4] 2> 245329 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245335 T696 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10109ece name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245335 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245339 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245347 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node37
[junit4] 2> 245381 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245387 T698 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@205cd1d name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245388 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245391 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245400 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node38
[junit4] 2> 245423 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245431 T700 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@537f9525 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245433 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245434 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245439 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node39
[junit4] 2> 245464 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245468 T702 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a821a88 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245468 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245470 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245477 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node40
[junit4] 2> 245515 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245519 T704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f66492a name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245520 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245525 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245533 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node41
[junit4] 2> 245565 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245570 T706 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e813354 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245572 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245576 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245584 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node42
[junit4] 2> 245614 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245627 T708 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74a67e64 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245627 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245631 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245639 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node43
[junit4] 2> 245679 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245684 T710 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b3abf70 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245685 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245689 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245698 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node44
[junit4] 2> 245731 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245737 T712 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d05ef91 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245737 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245741 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245748 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node45
[junit4] 2> 245787 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245791 T714 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e38e859 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245791 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245793 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245799 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node46
[junit4] 2> 245849 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245887 T716 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47fbeb99 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245887 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245891 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245896 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node47
[junit4] 2> 245937 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245942 T718 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7537e025 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245942 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245945 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 245950 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node48
[junit4] 2> 245987 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 245992 T720 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b65231e name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 245994 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 245998 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246007 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node49
[junit4] 2> 246050 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246056 T722 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3064b085 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246056 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246060 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246068 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node50
[junit4] 2> 246117 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246123 T724 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3794dd8a name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246125 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246127 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246134 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node51
[junit4] 2> 246202 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246207 T726 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a4e8d25 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246207 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246211 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246219 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node52
[junit4] 2> 246258 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246264 T728 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@730f1a19 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246264 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246268 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246275 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node53
[junit4] 2> 246317 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246321 T730 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1000fc9f name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246322 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246325 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246331 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node54
[junit4] 2> 246386 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246391 T732 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41619a5c name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246391 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246394 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246399 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node55
[junit4] 2> 246427 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246431 T734 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e952e6f name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246433 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246434 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246440 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node56
[junit4] 2> 246471 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246477 T736 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10afa1ee name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246477 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246481 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246486 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node57
[junit4] 2> 246525 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246533 T738 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f47a361 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246534 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246538 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246542 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node58
[junit4] 2> 246591 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246625 T740 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49025ed0 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246626 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246629 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246636 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node59
[junit4] 2> 246665 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246669 T742 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5393973d name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246671 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246672 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246679 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node60
[junit4] 2> 246709 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246714 T744 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@db9451e name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246714 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246717 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246721 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node61
[junit4] 2> 246756 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246760 T746 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ae23279 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246760 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246764 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246777 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node62
[junit4] 2> 246815 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246819 T748 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bff62b name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246819 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246822 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246827 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node63
[junit4] 2> 246861 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246865 T750 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30a8046c name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246867 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246868 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246873 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node64
[junit4] 2> 246909 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246913 T752 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4653a8b3 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246914 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246919 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246925 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node65
[junit4] 2> 246963 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 246968 T754 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b30e314 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 246968 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 246971 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 246978 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node66
[junit4] 2> 247050 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247059 T756 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2068b0d8 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247060 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247063 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247071 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node67
[junit4] 2> 247144 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247149 T758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e270c93 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247149 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247153 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247160 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node68
[junit4] 2> 247207 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247211 T760 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ea9f732 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247213 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247215 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247223 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node69
[junit4] 2> 247290 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247294 T762 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@208fe288 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247294 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247296 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247303 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node70
[junit4] 2> 247374 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247383 T764 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@501c1504 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247384 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247387 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247398 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node71
[junit4] 2> 247445 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247451 T766 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dcc2621 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247452 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247455 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247461 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node72
[junit4] 2> 247510 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247514 T768 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fad1ba name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247517 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247519 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247525 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node73
[junit4] 2> 247570 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247574 T770 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@357dbc5 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247575 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247578 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247583 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node74
[junit4] 2> 247630 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247636 T772 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3fddae2f name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247637 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247640 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247648 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node75
[junit4] 2> 247691 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247697 T774 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a9376d3 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247698 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247701 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247707 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node76
[junit4] 2> 247765 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247770 T776 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@796ef9cb name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247771 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247774 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247782 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node77
[junit4] 2> 247834 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247838 T778 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f38c3fe name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247840 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247843 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247849 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node78
[junit4] 2> 247914 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247917 T780 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38e55b5a name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247918 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247921 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 247926 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node79
[junit4] 2> 247990 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 247993 T782 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ff985a8 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 247994 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 247997 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 248003 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node80
[junit4] 2> 248049 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 248053 T784 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@543645eb name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 248055 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 248057 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 248064 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node81
[junit4] 2> 248210 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 248217 T786 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@573ab004 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 248218 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 248222 T573 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 248228 T573 oascc.SolrZkClient.makePath makePath: /live_nodes/node82
[junit4] 2> 248329 T573 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 248337 T788 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2926bfd5 name:ZooKeeperConnection Watcher:127.0.0.1:49566/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 248339 T573 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[ju
[...truncated too long message...]
DataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 299875 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 300975 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 302074 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 303173 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 304273 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 305371 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 306476 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 307577 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 308677 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 309776 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 310780 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 311769 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 312761 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 313751 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 314741 T573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 314754 T1013 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676df62b50003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 314757 T1013 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676df62b50005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 314763 T1013 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14676df62b50002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 314763 T573 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49971 49971
[junit4] 2> 315578 T1033 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 316982 T1012 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49971 49971
[junit4] 2> 316985 T573 oas.SolrTestCaseJ4.tearDown ###Ending testOverseerFailure
[junit4] 2> 316993 T1032 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:49971_solr
[junit4] 2> 316995 T1034 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=OverseerTest -Dtests.method=testOverseerFailure -Dtests.seed=A677606D44DA43D6 -Dtests.slow=true -Dtests.locale=fi_FI -Dtests.timezone=PRC -Dtests.file.encoding=UTF-8
[junit4] ERROR 22.0s | OverseerTest.testOverseerFailure <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
[junit4] > at __randomizedtesting.SeedInfo.seed([A677606D44DA43D6:A27FEF9E567FACF7]:0)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:134)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
[junit4] > at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
[junit4] > at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:661)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
[junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
[junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
[junit4] > at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
[junit4] > at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
[junit4] > ... 46 more
[junit4] 2> 317000 T573 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 317000 T573 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 319933 T573 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.OverseerTest-A677606D44DA43D6-001
[junit4] 2> NOTE: test params are: codec=Lucene49: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=fi_FI, timezone=PRC
[junit4] 2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=2,threads=1,free=43252096,total=125870080
[junit4] 2> NOTE: All tests run in this JVM: [ZkControllerTest, TestCloudManagedSchemaAddField, HdfsBasicDistributedZkTest, StandardRequestHandlerTest, FunctionTest, ReplicationFactorTest, TestQuerySenderNoQuery, OverseerTest]
[junit4] Completed in 83.57s, 9 tests, 1 error <<< FAILURES!
[...truncated 1249 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1296: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:920: There were test failures: 410 suites, 1693 tests, 1 error, 41 ignored (20 assumptions)
Total time: 108 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_60) - Build #
4094 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4094/
Java: 64bit/jdk1.7.0_60 -XX:+UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([62E5DC2C7D1DBC88:66ED53DF6FB853A9]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:134)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:661)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
... 46 more
Build Log:
[...truncated 11196 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.OverseerTest-62E5DC2C7D1DBC88-001\init-core-data-001
[junit4] 2> 2502282 T8344 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 2502282 T8344 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 2502283 T8344 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 2502286 T8344 oas.SolrTestCaseJ4.setUp ###Starting testPlaceholders
[junit4] 2> 2502287 T8344 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2502287 T8345 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2502377 T8344 oasc.ZkTestServer.run start zk server on port:60516
[junit4] 2> 2502379 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2502383 T8351 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31e63db0 name:ZooKeeperConnection Watcher:127.0.0.1:60516/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2502384 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2502385 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2502387 T8353 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e9b4bf6 name:ZooKeeperConnection Watcher:127.0.0.1:60516 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2502387 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2502390 T8346 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752b8f8a0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2502391 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2502393 T8355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58e3888a name:ZooKeeperConnection Watcher:127.0.0.1:60516 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2502393 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2502394 T8344 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2502398 T8344 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2502402 T8344 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2502406 T8344 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2502408 T8344 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2502414 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2502415 T8357 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d14cc9 name:ZooKeeperConnection Watcher:127.0.0.1:60516/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2502416 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2502417 T8344 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2502421 T8344 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2502427 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2502429 T8359 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@498f0bb2 name:ZooKeeperConnection Watcher:127.0.0.1:60516/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2502430 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2502431 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2502434 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2502441 T8344 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60516_solr
[junit4] 2> 2502441 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2502444 T8344 oasc.Overseer.start Overseer (id=91889672359903236-127.0.0.1:60516_solr-n_0000000000) starting
[junit4] 2> 2502448 T8344 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2502453 T8344 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2502461 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2502465 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2502469 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2502474 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2502484 T8360 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2502484 T8361 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2502488 T8360 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2502488 T8360 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=12 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"12",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2502488 T8360 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9, shard10, shard11, shard12]
[junit4] 2> 2502489 T8360 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 2502493 T8359 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2502494 T8357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2502494 T8351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2502931 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 2502946 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 2502953 T8359 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2502954 T8344 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2502956 T8360 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2502957 T8346 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752b8f8a0004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2502959 T8346 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752b8f8a0003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2502962 T8346 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752b8f8a0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2502962 T8344 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60516 60516
[junit4] 2> 2504270 T8361 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 2504292 T8360 oasc.Overseer$ClusterStateUpdater.run WARN Solr cannot talk to ZK, exiting Overseer main queue loop org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ClusterState.load(ClusterState.java:239)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:445)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:242)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:234)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2504970 T8345 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60516 60516
[junit4] 2> 2504971 T8360 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:60516_solr
[junit4] 2> 2504972 T8344 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4] 2> 2504973 T8362 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 2504976 T8344 oas.SolrTestCaseJ4.setUp ###Starting testStateChange
[junit4] 2> 2504977 T8344 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2504978 T8363 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2505067 T8344 oasc.ZkTestServer.run start zk server on port:60534
[junit4] 2> 2505070 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2505074 T8369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ecc7e67 name:ZooKeeperConnection Watcher:127.0.0.1:60534/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2505075 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2505076 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2505078 T8371 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e4cb500 name:ZooKeeperConnection Watcher:127.0.0.1:60534 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2505078 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2505080 T8364 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752b9a0b0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2505081 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2505084 T8373 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c051383 name:ZooKeeperConnection Watcher:127.0.0.1:60534 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2505084 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2505085 T8344 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2505088 T8344 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2505089 T8364 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752b9a0b0002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2505092 T8344 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2505094 T8344 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2505096 T8344 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2505100 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2505101 T8375 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cd1c9af name:ZooKeeperConnection Watcher:127.0.0.1:60534/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2505102 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2505102 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2505106 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2505110 T8344 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60534_solr
[junit4] 2> 2505110 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2505113 T8344 oasc.Overseer.start Overseer (id=91889672536129539-127.0.0.1:60534_solr-n_0000000000) starting
[junit4] 2> 2505116 T8344 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2505120 T8344 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2505124 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2505127 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2505132 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2505136 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2505146 T8377 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2505149 T8376 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2505150 T8344 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2505153 T8376 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2505154 T8376 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2505154 T8376 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2505160 T8375 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2505161 T8369 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2505196 T8344 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2505199 T8375 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2505201 T8376 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2505202 T8376 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"active"}
[junit4] 2> 2505202 T8376 oasc.Overseer$ClusterStateUpdater.updateState node=core_node1 is already registered
[junit4] 2> 2505202 T8376 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2505207 T8375 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2505299 T8369 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2505337 T8364 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752b9a0b0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2505340 T8344 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60534 60534
[junit4] 2> 2506933 T8377 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 2507347 T8363 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60534 60534
[junit4] 2> 2507349 T8344 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
[junit4] 2> 2507349 T8376 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:60534_solr
[junit4] 2> 2507351 T8378 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 2507353 T8344 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4] 2> 2507354 T8344 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2507355 T8379 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2507444 T8344 oasc.ZkTestServer.run start zk server on port:60549
[junit4] 2> 2507445 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2507450 T8385 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7129584 name:ZooKeeperConnection Watcher:127.0.0.1:60549/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2507451 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2507452 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2507454 T8387 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16195fc1 name:ZooKeeperConnection Watcher:127.0.0.1:60549 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2507454 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2507457 T8380 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752ba3580001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2507458 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2507459 T8389 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a6e872d name:ZooKeeperConnection Watcher:127.0.0.1:60549 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2507460 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2507460 T8344 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2507464 T8344 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2507464 T8380 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752ba3580002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2507468 T8344 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2507471 T8344 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2507472 T8344 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2507477 T8344 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2507483 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2507485 T8391 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18aeb17d name:ZooKeeperConnection Watcher:127.0.0.1:60549/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2507485 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2507485 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2507489 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2507493 T8344 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60549_solr
[junit4] 2> 2507494 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2507497 T8344 oasc.Overseer.start Overseer (id=91889672692170755-127.0.0.1:60549_solr-n_0000000000) starting
[junit4] 2> 2507499 T8344 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2507505 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2507509 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2507512 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2507518 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2507525 T8393 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2507528 T8392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2507529 T8392 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 2507530 T8392 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2507531 T8385 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2507536 T8392 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core2",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2507537 T8385 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2507539 T8392 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2507544 T8392 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2507545 T8392 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core3",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 2507548 T8391 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2507640 T8385 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 2507707 T8380 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752ba3580003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2507710 T8380 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752ba3580000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2507711 T8344 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60549 60549
[junit4] 2> 2509318 T8393 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 2509766 T8379 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60549 60549
[junit4] 2> 2509768 T8344 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4] 2> 2509768 T8392 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:60549_solr
[junit4] 2> 2509770 T8394 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 2509772 T8344 oas.SolrTestCaseJ4.setUp ###Starting testBadQueueItem
[junit4] 2> 2509774 T8344 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2509775 T8395 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2509873 T8344 oasc.ZkTestServer.run start zk server on port:60564
[junit4] 2> 2509875 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2509880 T8401 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50749785 name:ZooKeeperConnection Watcher:127.0.0.1:60564 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2509881 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2509882 T8396 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752bacca0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2509883 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2509885 T8403 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1879c4ed name:ZooKeeperConnection Watcher:127.0.0.1:60564 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2509886 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2509886 T8344 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2509891 T8396 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752bacca0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2509892 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2509894 T8405 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@341879bb name:ZooKeeperConnection Watcher:127.0.0.1:60564/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2509894 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2509894 T8344 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2509899 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2509901 T8407 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22a59c6e name:ZooKeeperConnection Watcher:127.0.0.1:60564/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2509901 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2509902 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2509905 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2509911 T8344 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60564_solr
[junit4] 2> 2509912 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2509915 T8344 oasc.Overseer.start Overseer (id=91889672850636803-127.0.0.1:60564_solr-n_0000000000) starting
[junit4] 2> 2509919 T8344 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2509925 T8344 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2509929 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2509935 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2509941 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2509946 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2509954 T8409 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2509954 T8344 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2509955 T8408 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2509957 T8344 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2509960 T8344 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2509964 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2509966 T8411 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5593a7fe name:ZooKeeperConnection Watcher:127.0.0.1:60564/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2509967 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2509968 T8344 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2509971 T8344 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1
[junit4] 2> 2509978 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2509980 T8408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2509981 T8408 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2509981 T8408 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 2509981 T8408 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 2509986 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2509987 T8405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2509987 T8411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2510468 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 2510482 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 2510490 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2510494 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2510494 T8408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2510499 T8408 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2510499 T8408 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2510499 T8408 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2510503 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2510604 T8405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2510604 T8411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2510984 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2510995 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2511001 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511002 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511002 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511005 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511005 T8408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2511011 T8408 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2511011 T8408 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2511011 T8408 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2511015 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511116 T8411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2511117 T8405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2511495 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2511508 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2511516 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511516 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511516 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511518 T8408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2511523 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511624 T8405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2511625 T8411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2511669 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511669 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511670 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511672 T8408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2511672 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511673 T8408 oasc.Overseer$ClusterStateUpdater.checkKeyExistence ERROR Skipping invalid Overseer message because it has no collection specified: {
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core0",
[junit4] 2> "core_node_name":"node0",
[junit4] 2> "collection":"",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2511679 T8408 oasc.Overseer$ClusterStateUpdater.checkKeyExistence ERROR Skipping invalid Overseer message because it has no collection specified: {
[junit4] 2> "operation":"deletecore",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core0",
[junit4] 2> "core_node_name":"node0",
[junit4] 2> "collection":""}
[junit4] 2> 2511683 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511685 T8408 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2511685 T8408 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection2 with shards [shard1, shard2, shard3]
[junit4] 2> 2511685 T8408 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 2511689 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2511790 T8405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2511791 T8411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2512166 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard3/election
[junit4] 2> 2512182 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard3
[junit4] 2> 2512191 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2512192 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2512192 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2512195 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2512196 T8408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2512203 T8408 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2512203 T8408 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2512203 T8408 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2512207 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2512310 T8405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2512310 T8411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2512685 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard1/election
[junit4] 2> 2512699 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard1
[junit4] 2> 2512709 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2512710 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2512710 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2512714 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2512715 T8408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2512737 T8408 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 2512738 T8408 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2512738 T8408 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2512742 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2512845 T8405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2512846 T8411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2513205 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard2/election
[junit4] 2> 2513221 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard2
[junit4] 2> 2513230 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2513230 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2513231 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2513235 T8408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2513242 T8407 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2513344 T8405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2513345 T8411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2513383 T8396 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752bacca0002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2513386 T8396 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752bacca0004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2513391 T8396 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752bacca0003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2513391 T8344 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60564 60564
[junit4] 2> 2513879 T8409 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 2515602 T8395 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60564 60564
[junit4] 2> 2515604 T8344 oas.SolrTestCaseJ4.tearDown ###Ending testBadQueueItem
[junit4] 2> 2515605 T8408 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:60564_solr
[junit4] 2> 2515606 T8412 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 2515612 T8344 oas.SolrTestCaseJ4.setUp ###Starting testOverseerFailure
[junit4] 2> 2515615 T8344 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2515616 T8413 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2515714 T8344 oasc.ZkTestServer.run start zk server on port:60582
[junit4] 2> 2515717 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2515724 T8419 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58372b32 name:ZooKeeperConnection Watcher:127.0.0.1:60582 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2515724 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2515728 T8414 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752bc39c0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2515730 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2515733 T8421 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c8806df name:ZooKeeperConnection Watcher:127.0.0.1:60582 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2515733 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2515733 T8344 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2515740 T8414 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752bc39c0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2515741 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2515744 T8423 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@634cd944 name:ZooKeeperConnection Watcher:127.0.0.1:60582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2515745 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2515745 T8344 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2515749 T8344 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2515751 T8344 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2515754 T8344 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2515759 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2515762 T8425 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73f414db name:ZooKeeperConnection Watcher:127.0.0.1:60582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2515763 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2515765 T8344 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2515769 T8344 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 2515778 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2515781 T8427 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34dc3f2e name:ZooKeeperConnection Watcher:127.0.0.1:60582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2515781 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2515783 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2515788 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2515796 T8344 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60582_solr
[junit4] 2> 2515796 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2515801 T8344 oasc.Overseer.start Overseer (id=91889673233498116-127.0.0.1:60582_solr-n_0000000000) starting
[junit4] 2> 2515804 T8344 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2515810 T8344 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2515817 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2515830 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2515841 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2515850 T8344 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2515868 T8429 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2515870 T8428 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2516851 T8427 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2516854 T8428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2516855 T8428 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2516855 T8428 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 2516855 T8428 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2516860 T8427 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2516861 T8423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2516862 T8425 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2517341 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2517357 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2517368 T8427 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2517369 T8344 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2517371 T8428 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2517375 T8427 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2517376 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2517379 T8428 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2517379 T8428 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2517382 T8427 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2517484 T8425 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2517485 T8423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2517537 T8414 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146752bc39c0004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2517833 T8429 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 2518520 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2518531 T8344 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2518533 T8431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43f93dd8 name:ZooKeeperConnection Watcher:127.0.0.1:60582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2518534 T8344 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2518534 T8428 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:60582_solr
[junit4] 2> 2518536 T8432 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 2518540 T8344 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60582_solr
[junit4] 2> 2518540 T8344 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2518543 T8344 oasc.Overseer.start Overseer (id=91889673233498117-127.0.0.1:60582_solr-n_0000000001) starting
[junit4] 2> 2518563 T8434 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2518563 T8433 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2518566 T8433 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2518567 T8433 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2518567 T8433 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 2518572 T8431 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2518573 T8425 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2518574 T8423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2518628 T8431 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2518628 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2518629 T8433 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2518637 T8344 oasc.LeaderElector.checkIfIamLeader WARN Failed setting watch org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election/91889673233498115-node1_core1-n_0000000002
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:127)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
[junit4] 2> at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
[junit4] 2> at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:661)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2518641 T8433 oasc.SolrException.log ERROR Problem cleaning up collection in zk:collection1:org.apache.zookeeper.KeeperException$NotEmptyException: KeeperErrorCode = Directory not empty for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:125)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:177)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:174)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:631)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:626)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:626)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:626)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.removeCore(Overseer.java:1066)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.processMessage(Overseer.java:346)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:242)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2518641 T8425 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2518644 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2518647 T8431 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2518652 T8431 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2518653 T8425 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2518654 T8433 oasc.Overseer$ClusterStateUpdater.setShardLeader ERROR Could not mark shard leader for non existing collection:collection1
[junit4] 2> 2518658 T8431 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2518662 T8431 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2518664 T8433 oasc.Overseer$ClusterStateUpdater.setShardLeader ERROR Could not mark shard leader for non existing collection:collection1
[junit4] 2> 2518667 T8431 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2518768 T8425 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2518769 T8423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2519688 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2520772 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2521856 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2522939 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2524024 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2525107 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2526192 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2527275 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2528358 T8344 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2529444 T8344 oascc.SolrZkClient.makePath makePath: /co
[...truncated too long message...]
er.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2561496 T8818 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2561492 T8766 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60933 60933
[junit4] 2> 2561500 T8344 oas.SolrTestCaseJ4.tearDown ###Ending testShardLeaderChange
[junit4] 2> 2561501 T8824 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:60933_solr
[junit4] 2> 2561502 T8344 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 2561503 T8344 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 2561503 T8826 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 2564176 T8344 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.OverseerTest-62E5DC2C7D1DBC88-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=da_DK, timezone=America/Winnipeg
[junit4] 2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=2,threads=1,free=238093272,total=416808960
[junit4] 2> NOTE: All tests run in this JVM: [LoggingHandlerTest, ReturnFieldsTest, TestShortCircuitedRequests, TestZkChroot, TestLazyCores, TestCursorMarkWithoutUniqueKey, MultiTermTest, TestMergePolicyConfig, TestFoldingMultitermQuery, TestRecovery, TestOmitPositions, TestStressRecovery, CoreAdminCreateDiscoverTest, SuggesterFSTTest, ClusterStateUpdateTest, TestManagedSynonymFilterFactory, RequiredFieldsTest, ZkSolrClientTest, TestNRTOpen, StressHdfsTest, TestManagedResource, DistributedSpellCheckComponentTest, HardAutoCommitTest, TestDistributedSearch, DistributedExpandComponentTest, FileUtilsTest, TestSolr4Spatial, TestSort, TestIBSimilarityFactory, SpellPossibilityIteratorTest, CopyFieldTest, ExpressionTest, LeaderElectionIntegrationTest, TestRandomFaceting, SolrIndexConfigTest, TestSearcherReuse, HttpPartitionTest, TestCodecSupport, DocumentBuilderTest, TestWordDelimiterFilterFactory, LukeRequestHandlerTest, OutputWriterTest, BadCopyFieldTest, AddBlockUpdateTest, DirectUpdateHandlerOptimizeTest, TestInitQParser, MigrateRouteKeyTest, NumericFieldsTest, ReplicationFactorTest, InfoHandlerTest, PingRequestHandlerTest, TestWriterPerf, OpenExchangeRatesOrgProviderTest, TestDocumentBuilder, OpenCloseCoreStressTest, TestCopyFieldCollectionResource, TestFieldSortValues, TestSolrQueryParserDefaultOperatorResource, DistributedSuggestComponentTest, CurrencyFieldXmlFileTest, IndexBasedSpellCheckerTest, HdfsDirectoryTest, TestFastLRUCache, TestLMJelinekMercerSimilarityFactory, DebugComponentTest, BasicDistributedZkTest, SliceStateTest, TestConfigSets, TestRandomDVFaceting, TestCollationField, TestMaxScoreQueryParser, TestChildDocTransformer, SpellCheckComponentTest, HdfsLockFactoryTest, SolrInfoMBeanTest, ZkNodePropsTest, TestReloadAndDeleteDocs, FunctionTest, TestCloudInspectUtil, SyncSliceTest, DistributedQueryComponentCustomSortTest, JsonLoaderTest, TestAddFieldRealTimeGet, TestStressLucene, CursorPagingTest, LeaderElectionTest, TestPerFieldSimilarity, TestSolrQueryParserResource, AlternateDirectoryTest, TestDistribDocBasedVersion, HdfsBasicDistributedZkTest, TestInfoStreamLogging, NotRequiredUniqueKeyTest, TestSolrDeletionPolicy2, TestCollapseQParserPlugin, DocExpirationUpdateProcessorFactoryTest, TestFaceting, TestPartialUpdateDeduplication, TestMiniSolrCloudCluster, TestSimpleQParserPlugin, TestRTGBase, BadIndexSchemaTest, TestManagedSchema, ResponseHeaderTest, TestReplicationHandlerBackup, SOLR749Test, MergeStrategyTest, DirectUpdateHandlerTest, TestPseudoReturnFields, TestExceedMaxTermLength, FastVectorHighlighterTest, SolrCoreTest, TestExtendedDismaxParser, BadComponentTest, TestSolrXml, SoftAutoCommitTest, AbstractAnalyticsStatsTest, TestCharFilters, ScriptEngineTest, DocValuesMissingTest, HighlighterConfigTest, RangeFacetTest, SolrIndexSplitterTest, TestRangeQuery, StandardRequestHandlerTest, IndexSchemaTest, TestDefaultSearchFieldResource, TestReRankQParserPlugin, DistributedTermsComponentTest, TestSearchPerf, SpatialFilterTest, TestSolrCoreProperties, TestSuggestSpellingConverter, TestCSVLoader, AnalysisErrorHandlingTest, IndexSchemaRuntimeFieldTest, TermVectorComponentTest, TestSweetSpotSimilarityFactory, DateRangeFieldTest, PeerSyncTest, SolrPluginUtilsTest, LegacyHTMLStripCharFilterTest, TestElisionMultitermQuery, DocValuesTest, ResponseLogComponentTest, HdfsRecoveryZkTest, HdfsWriteToMultipleCollectionsTest, TestSchemaResource, QueryElevationComponentTest, TestSolrQueryParser, PolyFieldTest, HighlighterTest, TestFieldCollectionResource, TimeZoneUtilsTest, PluginInfoTest, SolrRequestParserTest, TestDynamicFieldResource, BlockDirectoryTest, SolrCoreCheckLockOnStartupTest, DirectSolrConnectionTest, ChaosMonkeySafeLeaderTest, ShardSplitTest, TestCollectionAPI, XsltUpdateRequestHandlerTest, TestIndexSearcher, TestManagedSchemaFieldResource, DeleteReplicaTest, DirectSolrSpellCheckerTest, FullSolrCloudDistribCmdsTest, ShardRoutingCustomTest, TestDocBasedVersionConstraints, TestComplexPhraseQParserPlugin, BinaryUpdateRequestHandlerTest, TestStressReorder, HdfsUnloadDistributedZkTest, SystemInfoHandlerTest, OverseerRolesTest, TestBinaryField, PathHierarchyTokenizerFactoryTest, TestLFUCache, FieldFacetExtrasTest, ZkCLITest, SolrXmlInZkTest, CoreMergeIndexesAdminHandlerTest, PrimUtilsTest, DateMathParserTest, RemoteQueryErrorTest, AbstractAnalyticsFacetTest, AddSchemaFieldsUpdateProcessorFactoryTest, DocumentAnalysisRequestHandlerTest, CSVRequestHandlerTest, TestLRUCache, TestDistributedGrouping, TestLMDirichletSimilarityFactory, TestRemoteStreaming, TestNonNRTOpen, TestAnalyzeInfixSuggestions, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OverseerTest]
[junit4] Completed in 61.93s, 9 tests, 1 error <<< FAILURES!
[...truncated 624 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1296: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:920: There were test failures: 410 suites, 1693 tests, 1 error, 42 ignored (21 assumptions)
Total time: 111 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any