You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/07/08 04:56:58 UTC
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.8.0_20-ea-b21) -
Build # 4081 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/4081/
Java: 32bit/jdk1.8.0_20-ea-b21 -client -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.RollingRestartTest.testDistribSearch
Error Message:
No overseer designate as leader found after restart #3: 127.0.0.1:60996_
Stack Trace:
java.lang.AssertionError: No overseer designate as leader found after restart #3: 127.0.0.1:60996_
at __randomizedtesting.SeedInfo.seed([5263BF570390CF79:D385314F74CFAF45]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:100)
at org.apache.solr.cloud.RollingRestartTest.doTest(RollingRestartTest.java:61)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.GeneratedMethodAccessor78.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11917 lines...]
[junit4] Suite: org.apache.solr.cloud.RollingRestartTest
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\init-core-data-001
[junit4] 2> 3832103 T12905 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 3832103 T12905 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 3832110 T12905 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 3832111 T12905 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3832112 T12906 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 3832213 T12905 oasc.ZkTestServer.run start zk server on port:60889
[junit4] 2> 3832217 T12905 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3832229 T12912 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4068a6 name:ZooKeeperConnection Watcher:127.0.0.1:60889 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3832230 T12905 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3832231 T12905 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 3832251 T12907 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14713dcd29b0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 3832254 T12905 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3832260 T12914 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14a4c91 name:ZooKeeperConnection Watcher:127.0.0.1:60889/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3832261 T12905 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3832261 T12905 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 3832271 T12905 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 3832280 T12905 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 3832289 T12905 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 3832298 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 3832298 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 3832313 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4] 2> 3832313 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 3832324 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3832327 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3832333 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 3832333 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 3832339 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 3832339 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 3832351 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 3832351 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 3832360 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 3832360 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 3832369 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 3832369 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 3832380 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3832380 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3832390 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 3832390 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 3832399 T12905 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 3832400 T12905 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 3834549 T12905 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 3834586 T12905 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60896
[junit4] 2> 3834587 T12905 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 3834588 T12905 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3834588 T12905 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-002
[junit4] 2> 3834589 T12905 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-002\'
[junit4] 2> 3834636 T12905 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-002\solr.xml
[junit4] 2> 3834659 T12905 oasc.CoreContainer.<init> New CoreContainer 26295198
[junit4] 2> 3834659 T12905 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-002\]
[junit4] 2> 3834661 T12905 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 3834661 T12905 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 3834661 T12905 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 3834661 T12905 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 3834661 T12905 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 3834663 T12905 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 3834663 T12905 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 3834663 T12905 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 3834664 T12905 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 3834664 T12905 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3834664 T12905 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3834664 T12905 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 3834667 T12905 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60889/solr
[junit4] 2> 3834667 T12905 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 3834669 T12905 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3834672 T12925 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@169991e name:ZooKeeperConnection Watcher:127.0.0.1:60889 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3834673 T12905 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3834676 T12907 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14713dcd29b0002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 3834678 T12905 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3834681 T12927 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cfff0f name:ZooKeeperConnection Watcher:127.0.0.1:60889/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3834681 T12905 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3834684 T12905 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 3834691 T12905 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 3834699 T12905 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 3834705 T12905 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 3834711 T12905 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 3834717 T12905 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 3834720 T12905 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60896_
[junit4] 2> 3834721 T12905 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60896_
[junit4] 2> 3834726 T12905 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 3834731 T12905 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 3834738 T12905 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60896_
[junit4] 2> 3834738 T12905 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 3834744 T12905 oasc.Overseer.start Overseer (id=92064156531490819-127.0.0.1:60896_-n_0000000000) starting
[junit4] 2> 3834750 T12905 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 3834773 T12929 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 3834774 T12905 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 3834781 T12905 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 3834785 T12905 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3834791 T12928 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 3834798 T12930 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 3834798 T12930 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 3834801 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3834801 T12930 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 3834804 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3834805 T12928 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60896",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60896_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 3834805 T12928 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 3834805 T12928 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 3834811 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3834812 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3835806 T12930 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 3835806 T12930 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 3835809 T12930 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 3835809 T12930 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 3835812 T12930 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3835812 T12930 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-002\collection1\'
[junit4] 2> 3835816 T12930 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/solr.cloud.RollingRestartTest-5263BF570390CF79-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 3835818 T12930 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/solr.cloud.RollingRestartTest-5263BF570390CF79-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 3835820 T12930 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/solr.cloud.RollingRestartTest-5263BF570390CF79-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 3835880 T12930 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
[junit4] 2> 3835890 T12930 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3835895 T12930 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 3835921 T12930 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 3836106 T12930 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 3836107 T12930 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 3836109 T12930 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 3836117 T12930 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 3836119 T12930 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 3836143 T12930 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3836148 T12930 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3836153 T12930 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3836155 T12930 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 3836155 T12930 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 3836155 T12930 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3836158 T12930 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 3836158 T12930 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 3836158 T12930 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 3836158 T12930 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 3836159 T12930 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-002\collection1\, dataDir=.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001/control/data\
[junit4] 2> 3836159 T12930 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b01e6e
[junit4] 2> 3836159 T12930 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\control\data
[junit4] 2> 3836161 T12930 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001/control/data\index/
[junit4] 2> 3836161 T12930 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\control\data\index' doesn't exist. Creating new index...
[junit4] 2> 3836161 T12930 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\control\data\index
[junit4] 2> 3836162 T12930 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 3836180 T12930 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 3836181 T12930 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 3836185 T12930 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 3836185 T12930 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 3836185 T12930 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 3836185 T12930 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 3836187 T12930 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 3836187 T12930 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 3836188 T12930 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3836188 T12930 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3836188 T12930 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 3836189 T12930 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 3836190 T12930 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 3836190 T12930 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 3836190 T12930 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 3836192 T12930 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 3836192 T12930 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 3836192 T12930 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 3836198 T12930 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 3836201 T12930 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 3836201 T12930 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 3836203 T12930 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=650056751, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 3836203 T12930 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 3836203 T12930 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 3836205 T12930 oass.SolrIndexSearcher.<init> Opening Searcher@e59d3d[collection1] main
[junit4] 2> 3836206 T12930 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 3836207 T12930 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3836207 T12930 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 3836208 T12930 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3836208 T12930 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 3836208 T12930 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3836210 T12930 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 3836211 T12930 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3836211 T12930 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 3836212 T12930 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 3836217 T12931 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e59d3d[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 3836243 T12930 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 3836245 T12934 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60896 collection:control_collection shard:shard1
[junit4] 2> 3836246 T12905 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 3836246 T12905 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 3836249 T12905 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3836252 T12934 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 3836252 T12936 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38d5dd name:ZooKeeperConnection Watcher:127.0.0.1:60889/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3836253 T12905 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3836256 T12905 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3836262 T12905 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 3836279 T12934 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 3836283 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3836285 T12934 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 3836285 T12934 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3159 name=collection1 org.apache.solr.core.SolrCore@49d641 url=http://127.0.0.1:60896/collection1 node=127.0.0.1:60896_ C3159_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:60896, core=collection1, node_name=127.0.0.1:60896_}
[junit4] 2> 3836285 T12934 C3159 P60896 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60896/collection1/
[junit4] 2> 3836285 T12934 C3159 P60896 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 3836285 T12934 C3159 P60896 oasc.SyncStrategy.syncToMe http://127.0.0.1:60896/collection1/ has no replicas
[junit4] 2> 3836286 T12934 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60896/collection1/ shard1
[junit4] 2> 3836287 T12934 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 3836290 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3836298 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3836298 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3836299 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3836310 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3836318 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3836411 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3836412 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3836447 T12934 oasc.ZkController.register We are http://127.0.0.1:60896/collection1/ and leader is http://127.0.0.1:60896/collection1/
[junit4] 2> 3836447 T12934 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60896
[junit4] 2> 3836447 T12934 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 3836447 T12934 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 3836447 T12934 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 3836451 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3836451 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3836451 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3836455 T12934 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3836457 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3836458 T12928 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:60896",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60896_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 3836463 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3836562 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3836562 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 3838796 T12905 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 3838798 T12905 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 3838806 T12905 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60908
[junit4] 2> 3838807 T12905 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 3838807 T12905 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3838807 T12905 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-003
[junit4] 2> 3838807 T12905 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-003\'
[junit4] 2> 3838866 T12905 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-003\solr.xml
[junit4] 2> 3838890 T12905 oasc.CoreContainer.<init> New CoreContainer 22641427
[junit4] 2> 3838891 T12905 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-003\]
[junit4] 2> 3838892 T12905 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 3838892 T12905 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 3838892 T12905 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 3838894 T12905 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 3838894 T12905 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 3838894 T12905 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 3838897 T12905 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 3838897 T12905 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 3838898 T12905 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 3838899 T12905 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3838899 T12905 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3838899 T12905 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 3838899 T12905 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60889/solr
[junit4] 2> 3838900 T12905 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 3838903 T12905 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3838905 T12947 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@591d68 name:ZooKeeperConnection Watcher:127.0.0.1:60889 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3838906 T12905 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3838911 T12905 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3838915 T12949 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b52115 name:ZooKeeperConnection Watcher:127.0.0.1:60889/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3838915 T12905 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3838928 T12905 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3839837 T12905 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60908_
[junit4] 2> 3839839 T12905 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60908_
[junit4] 2> 3839845 T12927 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 3839846 T12936 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 3839846 T12949 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 3839863 T12950 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 3839864 T12950 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 3839866 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3839867 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3839867 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3839867 T12950 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 3839873 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3839876 T12928 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60908",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60908_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 3839877 T12928 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 3839877 T12928 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 3839889 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3839889 T12949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3839891 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3839891 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3840772 T12950 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 3840773 T12950 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 3840775 T12950 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 3840775 T12950 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 3840778 T12950 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3840778 T12950 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-003\collection1\'
[junit4] 2> 3840785 T12950 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/solr.cloud.RollingRestartTest-5263BF570390CF79-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 3840786 T12950 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/solr.cloud.RollingRestartTest-5263BF570390CF79-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 3840787 T12950 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/solr.cloud.RollingRestartTest-5263BF570390CF79-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 3840880 T12950 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
[junit4] 2> 3840898 T12950 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3840901 T12950 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 3840923 T12950 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 3841163 T12950 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 3841165 T12950 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 3841167 T12950 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 3841184 T12950 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 3841188 T12950 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 3841235 T12950 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3841243 T12950 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3841250 T12950 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3841254 T12950 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 3841255 T12950 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 3841255 T12950 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3841259 T12950 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 3841259 T12950 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 3841259 T12950 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 3841259 T12950 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 3841259 T12950 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-003\collection1\, dataDir=.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001/jetty1\
[junit4] 2> 3841259 T12950 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b01e6e
[junit4] 2> 3841259 T12950 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\jetty1
[junit4] 2> 3841262 T12950 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001/jetty1\index/
[junit4] 2> 3841263 T12950 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...
[junit4] 2> 3841265 T12950 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\jetty1\index
[junit4] 2> 3841267 T12950 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 3841279 T12950 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 3841280 T12950 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 3841287 T12950 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 3841288 T12950 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 3841289 T12950 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 3841289 T12950 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 3841289 T12950 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 3841289 T12950 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 3841291 T12950 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3841291 T12950 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3841292 T12950 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 3841293 T12950 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 3841295 T12950 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 3841295 T12950 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 3841296 T12950 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 3841297 T12950 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 3841298 T12950 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 3841299 T12950 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 3841309 T12950 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 3841313 T12950 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 3841314 T12950 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 3841318 T12950 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=650056751, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 3841320 T12950 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 3841320 T12950 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 3841321 T12950 oass.SolrIndexSearcher.<init> Opening Searcher@2d69f1[collection1] main
[junit4] 2> 3841322 T12950 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 3841325 T12950 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3841325 T12950 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 3841327 T12950 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3841327 T12950 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 3841327 T12950 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3841330 T12950 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 3841330 T12950 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3841331 T12950 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 3841332 T12950 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 3841348 T12950 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 3841350 T12951 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d69f1[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 3841355 T12954 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60908 collection:collection1 shard:shard2
[junit4] 2> 3841357 T12905 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 3841357 T12905 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 3841358 T12954 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 3841380 T12954 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 3841387 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3841390 T12954 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 3841390 T12954 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3160 name=collection1 org.apache.solr.core.SolrCore@ebbc01 url=http://127.0.0.1:60908/collection1 node=127.0.0.1:60908_ C3160_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:60908, core=collection1, node_name=127.0.0.1:60908_}
[junit4] 2> 3841390 T12954 C3160 P60908 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60908/collection1/
[junit4] 2> 3841390 T12954 C3160 P60908 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 3841390 T12954 C3160 P60908 oasc.SyncStrategy.syncToMe http://127.0.0.1:60908/collection1/ has no replicas
[junit4] 2> 3841393 T12954 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60908/collection1/ shard2
[junit4] 2> 3841394 T12954 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 3841397 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3841409 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3841414 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3841415 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3841417 T12949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3841431 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3841438 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3841534 T12949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3841536 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3841537 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3841566 T12954 oasc.ZkController.register We are http://127.0.0.1:60908/collection1/ and leader is http://127.0.0.1:60908/collection1/
[junit4] 2> 3841566 T12954 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60908
[junit4] 2> 3841566 T12954 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 3841566 T12954 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 3841566 T12954 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 3841573 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3841573 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3841574 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3841575 T12954 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3841578 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3841581 T12928 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:60908",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60908_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 3841587 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3841683 T12949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3841684 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3841684 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 3844409 T12905 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 3844410 T12905 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 3844418 T12905 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60917
[junit4] 2> 3844419 T12905 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 3844420 T12905 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3844420 T12905 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-004
[junit4] 2> 3844420 T12905 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-004\'
[junit4] 2> 3844483 T12905 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-004\solr.xml
[junit4] 2> 3844510 T12905 oasc.CoreContainer.<init> New CoreContainer 31935668
[junit4] 2> 3844511 T12905 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-004\]
[junit4] 2> 3844514 T12905 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 3844514 T12905 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 3844514 T12905 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 3844514 T12905 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 3844514 T12905 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 3844515 T12905 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 3844515 T12905 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 3844518 T12905 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 3844518 T12905 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 3844518 T12905 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 3844518 T12905 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 3844522 T12905 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 3844522 T12905 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60889/solr
[junit4] 2> 3844522 T12905 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 3844526 T12905 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3844530 T12965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1035c3f name:ZooKeeperConnection Watcher:127.0.0.1:60889 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3844530 T12905 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3844537 T12905 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 3844539 T12967 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e537b5 name:ZooKeeperConnection Watcher:127.0.0.1:60889/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 3844539 T12905 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 3844563 T12905 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 3845435 T12905 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60917_
[junit4] 2> 3845438 T12905 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60917_
[junit4] 2> 3845443 T12927 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 3845443 T12936 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 3845445 T12967 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 3845445 T12949 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 3845459 T12968 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 3845459 T12968 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 3845462 T12968 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 3845462 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3845462 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3845463 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3845466 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3845468 T12928 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60917",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60917_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 3845469 T12928 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 3845469 T12928 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 3845474 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3845476 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3845478 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3845477 T12967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3845478 T12949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3846276 T12968 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 3846276 T12968 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 3846276 T12968 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 3846276 T12968 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 3846276 T12968 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3846281 T12968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-004\collection1\'
[junit4] 2> 3846281 T12968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/solr.cloud.RollingRestartTest-5263BF570390CF79-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 3846281 T12968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/solr.cloud.RollingRestartTest-5263BF570390CF79-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 3846287 T12968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/solr.cloud.RollingRestartTest-5263BF570390CF79-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 3846415 T12968 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
[junit4] 2> 3846433 T12968 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 3846436 T12968 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 3846452 T12968 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 3846656 T12968 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 3846657 T12968 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 3846658 T12968 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 3846666 T12968 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 3846669 T12968 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 3846703 T12968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3846709 T12968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 3846715 T12968 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3846719 T12968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 3846720 T12968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 3846720 T12968 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 3846722 T12968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 3846722 T12968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 3846722 T12968 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 3846725 T12968 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 3846725 T12968 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-004\collection1\, dataDir=.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001/jetty2\
[junit4] 2> 3846725 T12968 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b01e6e
[junit4] 2> 3846726 T12968 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\jetty2
[junit4] 2> 3846729 T12968 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001/jetty2\index/
[junit4] 2> 3846731 T12968 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\jetty2\index' doesn't exist. Creating new index...
[junit4] 2> 3846731 T12968 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\jetty2\index
[junit4] 2> 3846733 T12968 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 3846748 T12968 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 3846748 T12968 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 3846754 T12968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 3846755 T12968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 3846756 T12968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 3846756 T12968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 3846756 T12968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 3846756 T12968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 3846757 T12968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3846757 T12968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 3846757 T12968 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 3846759 T12968 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 3846761 T12968 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 3846761 T12968 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 3846761 T12968 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 3846763 T12968 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 3846764 T12968 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 3846765 T12968 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 3846772 T12968 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 3846777 T12968 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 3846777 T12968 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 3846780 T12968 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=650056751, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 3846781 T12968 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 3846781 T12968 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 3846783 T12968 oass.SolrIndexSearcher.<init> Opening Searcher@17dfdc4[collection1] main
[junit4] 2> 3846783 T12968 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 3846787 T12968 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 3846787 T12968 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 3846790 T12968 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3846790 T12968 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 3846790 T12968 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3846793 T12968 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 3846793 T12968 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3846793 T12968 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 3846793 T12968 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 3846805 T12969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17dfdc4[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 3846807 T12968 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 3846810 T12972 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60917 collection:collection1 shard:shard1
[junit4] 2> 3846811 T12905 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 3846811 T12905 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 3846812 T12972 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 3846822 T12972 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 3846825 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3846828 T12972 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 3846828 T12972 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3161 name=collection1 org.apache.solr.core.SolrCore@bfaf16 url=http://127.0.0.1:60917/collection1 node=127.0.0.1:60917_ C3161_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:60917, core=collection1, node_name=127.0.0.1:60917_}
[junit4] 2> 3846828 T12972 C3161 P60917 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60917/collection1/
[junit4] 2> 3846829 T12972 C3161 P60917 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 3846829 T12972 C3161 P60917 oasc.SyncStrategy.syncToMe http://127.0.0.1:60917/collection1/ has no replicas
[junit4] 2> 3846829 T12972 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60917/collection1/ shard1
[junit4] 2> 3846830 T12972 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 3846834 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3846844 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3846846 T12967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3846846 T12949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3846848 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3846847 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3846863 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3846869 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3846956 T12967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3846957 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3846957 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3846958 T12949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3846983 T12972 oasc.ZkController.register We are http://127.0.0.1:60917/collection1/ and leader is http://127.0.0.1:60917/collection1/
[junit4] 2> 3846983 T12972 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60917
[junit4] 2> 3846983 T12972 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 3846983 T12972 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 3846983 T12972 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 3846987 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3846987 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3846987 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3846988 T12972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3846993 T12928 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 3846995 T12928 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:60917",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60917_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 3846999 T12927 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 3847085 T12949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3847086 T12967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3847087 T12927 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3847088 T12936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 3849284 T12905 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 3849285 T12905 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 3849290 T12905 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60926
[junit4] 2> 3849293 T12905 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 3849294 T12905 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 3849294 T12905 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-005
[junit4] 2> 3849294 T12905 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-005\'
[junit4] 2> 3849350 T12905 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-005\solr.xml
[junit4] 2> 3849374 T12905 oasc.CoreContainer.<init> New CoreContainer 11476712
[junit4] 2> 3849374 T12905 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001\tempDir-005\]
[junit4] 2> 3849377 T12905 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 3849377 T12905 oashc.HttpShardHandlerFact
[...truncated too long message...]
lient.java:373)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:135)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
[junit4] 2> ... 8 more
[junit4] 2>
[junit4] 2> 4032766 T12985 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.RollingRestartTest-5263BF570390CF79-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene49), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=sr_CS, timezone=America/Montserrat
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0_20-ea (32-bit)/cpus=2,threads=1,free=228629168,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [UpdateRequestProcessorFactoryTest, SampleTest, TestValueSourceCache, TestLRUCache, TestCloudManagedSchema, TestCustomSort, QueryElevationComponentTest, TimeZoneUtilsTest, StressHdfsTest, TestLazyCores, CacheHeaderTest, QueryResultKeyTest, TestArbitraryIndexDir, TestQuerySenderListener, TestQuerySenderNoQuery, TestSolrXMLSerializer, TestCoreDiscovery, TestFastLRUCache, AnalyticsQueryTest, TestDefaultSearchFieldResource, TestZkChroot, TestInitQParser, TestPerFieldSimilarity, TestClassNameShortening, LoggingHandlerTest, TestBinaryField, SolrRequestParserTest, TestWriterPerf, TestLuceneMatchVersion, DirectUpdateHandlerTest, TestStandardQParsers, StatelessScriptUpdateProcessorFactoryTest, TestOmitPositions, SolrCoreCheckLockOnStartupTest, UnloadDistributedZkTest, NumericFieldsTest, BasicDistributedZkTest, TestConfig, TestExceedMaxTermLength, TestHighFrequencyDictionaryFactory, ResponseHeaderTest, SpatialFilterTest, TestCSVResponseWriter, SearchHandlerTest, SolrInfoMBeanTest, TestReload, AsyncMigrateRouteKeyTest, SpellCheckCollatorTest, PolyFieldTest, CustomCollectionTest, TestNRTOpen, ResourceLoaderTest, TestPseudoReturnFields, TestReplicationHandlerBackup, TriLevelCompositeIdRoutingTest, TestManagedSchemaFieldResource, BlockDirectoryTest, CircularListTest, HdfsBasicDistributedZk2Test, TestAtomicUpdateErrorCases, TestManagedResource, TestInfoStreamLogging, FileUtilsTest, CollectionsAPIAsyncDistributedZkTest, TestHashPartitioner, TestReRankQParserPlugin, HttpPartitionTest, HardAutoCommitTest, UpdateParamsTest, HighlighterMaxOffsetTest, SuggestComponentTest, TestQueryTypes, HdfsRecoveryZkTest, SystemInfoHandlerTest, SOLR749Test, URLClassifyProcessorTest, MergeStrategyTest, JsonLoaderTest, DistanceFunctionTest, BadComponentTest, BlockCacheTest, HdfsDirectoryTest, DocValuesMultiTest, PrimitiveFieldTypeTest, TestOverriddenPrefixQueryForCustomFieldType, PreAnalyzedFieldTest, CoreAdminHandlerTest, TestBM25SimilarityFactory, TestImplicitCoreProperties, SpellingQueryConverterTest, TestDistributedGrouping, TestBlendedInfixSuggestions, TestNonNRTOpen, MultiTermTest, TestDynamicFieldCollectionResource, TestSolrXml, AddBlockUpdateTest, TestStressLucene, ShardRoutingCustomTest, AliasIntegrationTest, LeaderElectionIntegrationTest, TestUpdate, TestAnalyzedSuggestions, TermsComponentTest, TestCollationFieldDocValues, InfoHandlerTest, AssignTest, TestSolrQueryParser, DOMUtilTest, SignatureUpdateProcessorFactoryTest, TestStressRecovery, ConnectionManagerTest, TestManagedStopFilterFactory, IndexSchemaRuntimeFieldTest, TestMiniSolrCloudCluster, ZkSolrClientTest, TestLMDirichletSimilarityFactory, DistributedTermsComponentTest, SuggesterTest, TestPhraseSuggestions, BasicDistributedZk2Test, HdfsChaosMonkeySafeLeaderTest, UUIDFieldTest, FieldAnalysisRequestHandlerTest, CSVRequestHandlerTest, TestCopyFieldCollectionResource, TestMergePolicyConfig, MultiThreadedOCPTest, TestCharFilters, ChaosMonkeyNothingIsSafeTest, TestIndexSearcher, TestLMJelinekMercerSimilarityFactory, OverseerCollectionProcessorTest, HdfsCollectionsAPIDistributedZkTest, PrimUtilsTest, TestConfigSets, FullSolrCloudDistribCmdsTest, TestRemoteStreaming, RequestHandlersTest, BadCopyFieldTest, TestSolrJ, TestMultiCoreConfBootstrap, TestFunctionQuery, AnalysisAfterCoreReloadTest, TestBinaryResponseWriter, TestDistribDocBasedVersion, TestSuggestSpellingConverter, ZkCLITest, TestIndexingPerformance, LukeRequestHandlerTest, TestFiltering, TestPostingsSolrHighlighter, StatsComponentTest, DistribCursorPagingTest, TestManagedSynonymFilterFactory, TestCollationKeyRangeQueries, TestJmxMonitoredMap, AddSchemaFieldsUpdateProcessorFactoryTest, TestRangeQuery, NoCacheHeaderTest, SoftAutoCommitTest, RankQueryTest, TestUniqueKeyFieldResource, TermVectorComponentDistributedTest, SolrXmlInZkTest, CursorMarkTest, HighlighterConfigTest, SSLMigrationTest, BasicFunctionalityTest, AtomicUpdatesTest, EnumFieldTest, SynonymTokenizerTest, FastVectorHighlighterTest, CoreAdminRequestStatusTest, DistributedQueryElevationComponentTest, TestRealTimeGet, TestChildDocTransformer, DirectUpdateHandlerOptimizeTest, ResponseLogComponentTest, HdfsLockFactoryTest, AnalyticsMergeStrategyTest, TestFuzzyAnalyzedSuggestions, CurrencyFieldOpenExchangeTest, TestSolrXmlPersistor, TestHighlightDedupGrouping, FieldMutatingUpdateProcessorTest, TestQueryUtils, DirectSolrSpellCheckerTest, SolrTestCaseJ4Test, HighlighterTest, TestFieldResource, DocValuesMissingTest, OverseerStatusTest, SuggesterFSTTest, TestCollapseQParserPlugin, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, TestReplicationHandler, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, TestRandomDVFaceting, TestDistributedSearch, AutoCommitTest, TestFaceting, TestRecovery, DistributedSpellCheckComponentTest, ZkControllerTest, TestStressReorder, TestJoin, TestStressVersions, TestCoreContainer, SimpleFacetsTest, TestSolr4Spatial, SolrCoreTest, SpellCheckComponentTest, TestGroupingSearch, SolrCmdDistributorTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestBadConfig, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, SimplePostToolTest, TestExtendedDismaxParser, TestFoldingMultitermQuery, DocValuesTest, SuggesterTSTTest, TestTrie, SuggesterWFSTTest, TestCSVLoader, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, TestWordDelimiterFilterFactory, QueryEqualityTest, DefaultValueUpdateProcessorTest, SortByFunctionTest, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, DebugComponentTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, StandardRequestHandlerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, MoreLikeThisHandlerTest, RequiredFieldsTest, RegexBoostProcessorTest, SolrPluginUtilsTest, IndexSchemaTest, TestJmxIntegration, TestCollationField, ReturnFieldsTest, JSONWriterTest, MBeansHandlerTest, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, PingRequestHandlerTest, TestComponentsName, CoreContainerCoreInitFailuresTest, TestLFUCache, AlternateDirectoryTest, TestSolrIndexConfig, CopyFieldTest, SolrIndexConfigTest, TestSolrDeletionPolicy2, TestDocSet, TestSearchPerf, MinimalSchemaTest, TestElisionMultitermQuery, OutputWriterTest, ExternalFileFieldSortTest, TestSolrCoreProperties, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, SpellPossibilityIteratorTest, TestCodecSupport, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestNumberUtils, TestIBSimilarityFactory, TestDefaultSimilarityFactory, TestFastWriter, LegacyHTMLStripCharFilterTest, TestFastOutputStream, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, DateMathParserTest, TestSystemIdResolver, DateFieldTest, RAMDirectoryFactoryTest, ClusterStateTest, TestUtils, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, TestRTGBase, CursorPagingTest, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestTolerantSearch, DeleteInactiveReplicaTest, DeleteReplicaTest, DeleteShardTest, DistribDocExpirationUpdateProcessorTest, MigrateRouteKeyTest, OverseerRolesTest, RemoteQueryErrorTest, ReplicationFactorTest, RollingRestartTest]
[junit4] Completed in 202.05s, 1 test, 1 failure <<< FAILURES!
[...truncated 195 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1299: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:923: There were test failures: 405 suites, 1656 tests, 1 failure, 42 ignored (21 assumptions)
Total time: 111 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_20-ea-b21 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_60) - Build #
4082 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/4082/
Java: 32bit/jdk1.7.0_60 -client -XX:+UseSerialGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch
Error Message:
Mutual exclusion failed. Found more than one task running for the same collection
Stack Trace:
java.lang.AssertionError: Mutual exclusion failed. Found more than one task running for the same collection
at __randomizedtesting.SeedInfo.seed([BEA7FD33D4D11B71:3F41732BA38E7B4D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:129)
at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:70)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([BEA7FD33D4D11B71:BAAF72C0C674F450]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:143)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:660)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:130)
... 49 more
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:135)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
... 50 more
Build Log:
[...truncated 11086 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.OverseerTest-BEA7FD33D4D11B71-001\init-core-data-001
[junit4] 2> 798932 T1963 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 798932 T1963 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 798932 T1963 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 798937 T1963 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4] 2> 798938 T1963 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 798939 T1964 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 799005 T1963 oasc.ZkTestServer.run start zk server on port:59264
[junit4] 2> 799007 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799010 T1970 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18b1557 name:ZooKeeperConnection Watcher:127.0.0.1:59264/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799010 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799011 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799012 T1972 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@134826b name:ZooKeeperConnection Watcher:127.0.0.1:59264 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799012 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799016 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799017 T1974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15db5e9 name:ZooKeeperConnection Watcher:127.0.0.1:59264 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799017 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799017 T1963 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 799020 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 799023 T1963 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 799025 T1963 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 799027 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 799032 T1963 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 799037 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799038 T1976 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c2d801 name:ZooKeeperConnection Watcher:127.0.0.1:59264/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799038 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799039 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 799042 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 799046 T1963 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:59264_solr
[junit4] 2> 799046 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 799048 T1963 oasc.Overseer.start Overseer (id=92066086642778115-127.0.0.1:59264_solr-n_0000000000) starting
[junit4] 2> 799051 T1963 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 799057 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 799060 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 799064 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 799068 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 799075 T1978 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 799077 T1977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 799077 T1977 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 799078 T1977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core1",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 799079 T1970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 799083 T1977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core2",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 799084 T1970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 799087 T1977 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 799090 T1977 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 799091 T1977 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "base_url":"http://127.0.0.1/solr",
[junit4] 2> "node_name":"node1",
[junit4] 2> "shard":"s1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"core3",
[junit4] 2> "roles":"",
[junit4] 2> "state":"recovering"}
[junit4] 2> 799095 T1976 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 799164 T1970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 799212 T1963 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:59264 59264
[junit4] 2> 800479 T1978 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 800809 T1964 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:59264 59264
[junit4] 2> 800810 T1963 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4] 2> 800811 T1977 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:59264_solr
[junit4] 2> 800812 T1979 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
[junit4] 2>
[junit4] 2> 800818 T1963 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4] 2> 800820 T1963 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 800821 T1980 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 800894 T1963 oasc.ZkTestServer.run start zk server on port:59279
[junit4] 2> 800895 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800899 T1986 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@199bf18 name:ZooKeeperConnection Watcher:127.0.0.1:59279 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800899 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800903 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800905 T1988 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b84191 name:ZooKeeperConnection Watcher:127.0.0.1:59279 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800906 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800906 T1963 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 800913 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800913 T1990 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16703e8 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800914 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800914 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 800919 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800920 T1992 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9c1b0 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800920 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800922 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 800925 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 800930 T1963 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:59279_solr
[junit4] 2> 800930 T1963 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 800933 T1963 oasc.Overseer.start Overseer (id=92066086766182403-127.0.0.1:59279_solr-n_0000000000) starting
[junit4] 2> 800936 T1963 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 800940 T1963 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 800945 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 800949 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 800954 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 800960 T1963 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 800969 T1994 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 800969 T1963 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 800971 T1993 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 800972 T1963 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 800974 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 800980 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800981 T1996 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cbc1c name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800981 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800983 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 800986 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4] 2> 800991 T1996 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 800991 T1990 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 800992 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800993 T1998 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c6851b name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800993 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800995 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 800998 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 801001 T1998 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 801001 T1996 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 801001 T1990 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 801003 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801003 T2000 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a846d2 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801004 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801005 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801008 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 801011 T1996 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 801011 T1998 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 801011 T1990 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 801012 T2000 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 801012 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801014 T2002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75debf name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801015 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801016 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801019 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4] 2> 801022 T2000 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 801022 T1996 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 801022 T1990 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 801023 T1998 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 801023 T2002 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 801023 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801025 T2004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a9fe88 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801025 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801027 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801030 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4] 2> 801034 T2004 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801034 T1996 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801034 T1990 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801034 T1998 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801034 T2000 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801034 T2002 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 801036 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801038 T2006 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@702ff4 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801038 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801040 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801043 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4] 2> 801047 T1990 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801047 T1996 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801047 T2004 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801047 T2006 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801048 T2002 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801049 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801049 T2000 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801049 T1998 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 801051 T2008 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f7b085 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801051 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801052 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801055 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4] 2> 801059 T2002 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801059 T2008 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801060 T2006 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801060 T1996 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801060 T2004 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801061 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801061 T1998 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801061 T1990 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801061 T2000 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 801063 T2010 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ffa0f name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801064 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801066 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801069 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4] 2> 801075 T1998 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801075 T2006 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801075 T1996 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T2010 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T2000 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T2004 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T1990 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T2002 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801076 T2008 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 801077 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801078 T2012 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d7fb2e name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801079 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801082 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801086 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4] 2> 801091 T2000 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801091 T2008 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801092 T2002 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801092 T2010 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801092 T1996 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T2004 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T2006 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T2012 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T1990 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T1998 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 801093 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801098 T2014 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e9e79 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801098 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801100 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801102 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4] 2> 801106 T1990 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2008 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2000 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2012 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2006 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T1998 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2010 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T1996 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2004 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2002 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801107 T2014 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 801111 T2016 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b33f6c name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801109 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801112 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801115 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801119 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4] 2> 801126 T1990 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801127 T2014 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801127 T2016 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801127 T2000 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801127 T2002 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801127 T2004 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801128 T1998 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801128 T2006 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801128 T2012 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801129 T2008 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801129 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801129 T2010 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801129 T1996 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 801131 T2018 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15387cb name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801131 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801133 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801136 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4] 2> 801142 T2012 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801142 T2006 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T1998 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T2010 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801144 T2014 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801144 T2000 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801144 T2004 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801144 T1990 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801144 T2016 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801145 T2020 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1494991 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801144 T2018 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T2002 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T2008 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801143 T1996 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 801145 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801148 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801153 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4] 2> 801159 T2016 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801160 T2018 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801160 T1990 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801161 T2004 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801161 T2008 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801161 T2002 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801162 T1996 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801162 T2010 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801162 T2020 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801163 T2006 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801163 T1998 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801163 T2012 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801163 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801163 T2000 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801163 T2014 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 801165 T2022 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fe19db name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801165 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801166 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801169 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4] 2> 801173 T2000 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801175 T2004 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801176 T2018 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801177 T2020 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801177 T2012 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801178 T1998 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801178 T2010 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801178 T2022 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801178 T1996 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801178 T2002 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801179 T1990 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801179 T2006 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801179 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801179 T2014 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801179 T2016 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801179 T2008 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 801180 T2024 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2435a9 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801180 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801182 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801187 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4] 2> 801194 T2006 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801195 T1996 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801195 T2010 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801195 T2024 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801196 T2002 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801196 T2000 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801196 T2022 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801196 T2020 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T2012 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801197 T1990 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T2016 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T2008 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T2004 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T2018 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801199 T2026 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d24e1 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801197 T2014 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801197 T1998 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 801199 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801202 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801204 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4] 2> 801210 T2010 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2024 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2012 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2008 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2020 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801212 T1990 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T1998 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2022 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801211 T2002 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801210 T1996 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801212 T2006 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801213 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801213 T2014 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801214 T2000 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801214 T2026 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801214 T2016 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801214 T2018 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801214 T2004 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 801216 T2028 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@683ad name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801216 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801218 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801220 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4] 2> 801225 T2002 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T1990 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T1998 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T2006 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T2008 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T2022 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T2000 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801226 T2014 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801227 T2004 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801227 T2012 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801227 T2020 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801227 T2010 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801228 T1996 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801228 T2024 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801229 T2028 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801229 T2016 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801229 T2026 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801229 T2018 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 801231 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801233 T2030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d80815 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801233 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801236 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801238 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4] 2> 801248 T1990 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801248 T2028 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801249 T2022 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801249 T1996 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801250 T2002 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801250 T2024 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801250 T2012 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801250 T1998 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801251 T2020 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801252 T2010 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2030 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2008 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2006 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2026 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2004 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801253 T2014 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801254 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801254 T2018 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801254 T2016 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801254 T2000 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 801258 T2032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@117cdff name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801258 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801259 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801262 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4] 2> 801267 T2004 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801268 T2016 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801269 T2018 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801269 T2008 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2024 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2006 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2000 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2022 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2026 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801270 T2010 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801271 T1996 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801271 T2002 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801271 T2032 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801271 T2014 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801271 T2030 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801272 T2028 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801272 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801271 T1990 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801272 T2020 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801272 T2012 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801272 T1998 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 801274 T2034 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@168f1b9 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801274 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801276 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801280 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4] 2> 801284 T2034 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801287 T2028 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801287 T1990 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801287 T2018 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801287 T2012 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801288 T2014 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801288 T2024 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801288 T2022 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T1998 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2010 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2032 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2000 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2008 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2016 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801289 T2026 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801290 T2020 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801290 T2030 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801291 T1996 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801291 T2002 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801291 T2006 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801292 T2004 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 801292 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801294 T2036 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e382d8 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801294 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801295 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801298 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4] 2> 801304 T2010 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801304 T1990 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801305 T2008 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801305 T2028 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2012 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2002 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2022 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2006 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2030 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2036 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T2024 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801306 T1996 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T2020 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801307 T2004 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T2000 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801308 T2014 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801308 T2016 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T2018 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T1998 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801307 T2034 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801309 T2038 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b156c4 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801307 T2032 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801308 T2026 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 801309 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801311 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801314 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4] 2> 801320 T2020 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801320 T1990 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801321 T2010 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801322 T2028 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801322 T2032 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801322 T2012 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801322 T2002 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801322 T2006 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2038 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2034 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2018 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2024 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T1996 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2022 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2036 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2000 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801324 T2004 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801324 T2014 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801324 T2016 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801324 T2030 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T2026 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801323 T1998 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801324 T2008 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 801326 T2040 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72ffaa name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801323 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801326 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801328 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801331 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4] 2> 801335 T2038 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801336 T2028 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801337 T2036 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801338 T1990 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801338 T2024 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801338 T2020 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801338 T2034 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801338 T2010 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801339 T2002 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801339 T1996 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801339 T2022 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801339 T2032 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801339 T2040 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2006 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2008 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2016 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2030 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T1998 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2018 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2012 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2026 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801340 T2014 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801340 T2000 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801343 T2042 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d0f108 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801340 T2004 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 801343 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801345 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801348 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4] 2> 801353 T2038 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801354 T2006 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801354 T2008 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801355 T2034 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801356 T2022 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801356 T2032 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801356 T2018 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2016 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2004 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2028 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2020 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2024 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T1990 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2002 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2026 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801357 T2036 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T2014 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T2000 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T2030 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T2042 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801359 T1998 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801359 T2012 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801359 T2010 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801359 T1996 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T2040 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 801358 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801360 T2044 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65fae8 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801361 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801362 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801365 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4] 2> 801372 T2040 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801372 T2028 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801374 T1996 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801374 T2010 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801375 T1990 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801376 T2014 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801376 T2044 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801376 T2000 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801376 T2006 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2020 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801377 T2004 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2042 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2026 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801378 T2036 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2008 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801378 T1998 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801379 T2046 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13ae643 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801378 T2012 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801379 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801377 T2016 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2018 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2030 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2038 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2034 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2024 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2002 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2022 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801377 T2032 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 801381 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801385 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
[junit4] 2> 801390 T1998 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801391 T1996 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801391 T2010 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801391 T2012 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T1990 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2034 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2004 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2024 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2016 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2040 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801394 T2036 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801395 T2018 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801395 T2030 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801401 T2032 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801401 T2022 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801402 T2026 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801402 T2002 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801402 T2020 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801402 T2042 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2028 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2000 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2044 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2014 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2046 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801403 T2038 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2006 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801403 T2008 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 801406 T2048 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1628d15 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801406 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801407 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801409 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
[junit4] 2> 801417 T1996 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2006 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2008 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2046 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2038 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2034 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2024 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2002 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2022 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801418 T2020 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801419 T2032 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801419 T2036 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801419 T2026 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801419 T2042 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801419 T2004 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2014 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2000 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2016 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2018 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801420 T1998 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2012 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2048 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2040 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2030 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2010 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T1990 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2028 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801420 T2044 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 801423 T2050 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bba52 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801423 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801424 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801427 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
[junit4] 2> 801432 T2032 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801433 T2048 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2002 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2008 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2004 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2024 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2020 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2006 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801435 T2016 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801436 T2014 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801436 T2022 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801436 T2000 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2018 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801437 T2040 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2030 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2042 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801436 T2050 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801436 T2034 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2026 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2044 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2028 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T1990 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T1996 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2012 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T1998 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2010 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2036 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2038 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801437 T2046 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 801445 T2052 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@115ff44 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801445 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801451 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801454 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
[junit4] 2> 801462 T2044 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801462 T1990 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801462 T2028 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T2010 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T2052 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T2040 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T1998 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T2024 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801466 T2012 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801467 T2038 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801467 T2050 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801467 T2048 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801467 T2026 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801468 T2016 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801468 T2018 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801468 T2032 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801468 T2020 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2046 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2034 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2002 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T1996 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2036 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2042 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2004 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2000 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801469 T2022 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801470 T2030 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801471 T2008 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801471 T2014 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801471 T2006 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 801473 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801477 T2054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fd5ea9 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801477 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801479 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801481 T1963 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
[junit4] 2> 801489 T2036 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801490 T2044 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801490 T2014 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801490 T2028 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801490 T1990 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801490 T2040 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801491 T2000 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801491 T2042 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801491 T2026 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801491 T2004 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801491 T2030 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T2054 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T1963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 801492 T2002 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T2024 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2020 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2032 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2022 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2046 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2038 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T2016 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T2018 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T1998 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801492 T2050 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801494 T2056 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aec783 name:ZooKeeperConnection Watcher:127.0.0.1:59279/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801493 T2012 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2010 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T1996 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2052 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2048 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2006 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2008 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801493 T2034 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 801495 T1963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 801498 T1963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801502 T1963 oascc.SolrZkClient.makePath makePath: /liv
[...truncated too long message...]
_total_number=0}
[junit4] 2> 1310358 T3594 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1310358 T3594 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1310358 T3594 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1310359 T3594 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1310359 T3594 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1310359 T3594 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\index [CachedDir<<refCount=0;path=.\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\index;done=false>>]
[junit4] 2> 1310359 T3594 oasc.CachingDirectoryFactory.close Closing directory: .\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\index
[junit4] 2> 1310359 T3594 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\ [CachedDir<<refCount=0;path=.\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\;done=false>>]
[junit4] 2> 1310359 T3594 oasc.CachingDirectoryFactory.close Closing directory: .\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001\tempDir-006\collection1\data\
[junit4] 2> 1310359 T3594 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1310362 T3594 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:143)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:298)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:130)
[junit4] 2> ... 7 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:209)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:417)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:135)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
[junit4] 2> ... 8 more
[junit4] 2>
[junit4] 2> 1310362 T3594 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1310362 T3594 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solr.cloud.MultiThreadedOCPTest-BEA7FD33D4D11B71-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene49), sim=DefaultSimilarity, locale=es_HN, timezone=Asia/Kuala_Lumpur
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60 (32-bit)/cpus=2,threads=1,free=61520680,total=168554496
[junit4] 2> NOTE: All tests run in this JVM: [TestJmxIntegration, OpenCloseCoreStressTest, CursorMarkTest, HdfsBasicDistributedZk2Test, DocumentAnalysisRequestHandlerTest, DistributedDebugComponentTest, AnalyticsQueryTest, SOLR749Test, PolyFieldTest, TestQueryUtils, SpellPossibilityIteratorTest, TestManagedSchemaFieldResource, SolrCoreTest, HdfsSyncSliceTest, TermsComponentTest, TestPseudoReturnFields, CollectionsAPIDistributedZkTest, TestDistributedSearch, DistributedExpandComponentTest, SimplePostToolTest, TestRealTimeGet, ReplicationFactorTest, BasicZkTest, TestStressVersions, DistanceFunctionTest, TestLeaderElectionZkExpiry, TestStressReorder, TestSearchPerf, LeaderElectionIntegrationTest, IndexSchemaRuntimeFieldTest, TestFieldCollectionResource, TestWriterPerf, TestDistribDocBasedVersion, TestLRUCache, TestCSVLoader, TestElisionMultitermQuery, SuggesterTest, TestJoin, AtomicUpdatesTest, TestConfig, CursorPagingTest, TestRangeQuery, TestExceedMaxTermLength, TestCursorMarkWithoutUniqueKey, TestPerFieldSimilarity, TestPostingsSolrHighlighter, OverseerTest, TestSuggestSpellingConverter, DocValuesTest, IndexSchemaTest, LegacyHTMLStripCharFilterTest, DocumentBuilderTest, TestNRTOpen, SoftAutoCommitTest, NoCacheHeaderTest, TestInitQParser, TestReload, CoreMergeIndexesAdminHandlerTest, TestSolrCoreProperties, TestCollectionAPI, QueryElevationComponentTest, TestExtendedDismaxParser, RegexBoostProcessorTest, AnalyticsMergeStrategyTest, HdfsUnloadDistributedZkTest, ExternalFileFieldSortTest, RAMDirectoryFactoryTest, JsonLoaderTest, TestSchemaNameResource, DistributedSuggestComponentTest, OpenExchangeRatesOrgProviderTest, TestMergePolicyConfig, ClusterStateUpdateTest, DistributedQueryComponentCustomSortTest, TestBinaryField, OverseerRolesTest, NotRequiredUniqueKeyTest, ChaosMonkeyNothingIsSafeTest, BadCopyFieldTest, TestSolrDeletionPolicy1, CurrencyFieldXmlFileTest, HardAutoCommitTest, BasicFunctionalityTest, MultiThreadedOCPTest]
[junit4] Completed in 128.30s, 1 test, 1 failure <<< FAILURES!
[...truncated 990 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1299: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:923: There were test failures: 406 suites, 1658 tests, 1 error, 1 failure, 42 ignored (21 assumptions)
Total time: 114 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_60 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any